Why technological innovation depends on creative people, intentional search, and the ability to define a promising problem before a solution exists Draft blog article

We often talk about innovation as if it starts with an idea. In practice, it usually starts earlier. It starts with a person who wants to express something new, or with a company that deliberately chooses a territory worth exploring before any concrete idea exists. In technology businesses, I have seen two patterns repeat again and again: sometimes somebody has an idea and the company develops it into something useful; but much more often we first identify an area where innovation matters, and only then do ideas begin to arrive. The science of creativity, motivation, problem finding, and innovation increasingly supports that view.

Key thesis: the companies that innovate consistently do not wait passively for inspiration. They create the conditions in which creative people can express themselves, define strategic search spaces, and move deliberately from problem finding to idea generation, idea development, and implementation.

Creativity is not the same thing as knowledge

A useful starting point is the distinction between creativity and innovation. Creativity is usually defined as the production of ideas, products, or solutions that are both novel and useful. Innovation is the next step: the implementation, adoption, or commercialization of those ideas in an organizational setting. This distinction matters because many firms confuse technical excellence with innovation capacity. Technical excellence is essential, but it is not enough on its own.

A highly knowledgeable engineer may be outstanding at optimization, reliability, architecture, or execution without necessarily being someone who generates original directions.

That is not a criticism. It is a reminder that organizations need more than one kind of talent. They need people who perfect systems, and they also need people who reframe systems. They need people who reduce ambiguity, and people who can work inside ambiguity long enough to discover something valuable within it.

This is why innovators often resemble artists more than conventional problem solvers. Artists are comfortable working with unfinished forms, weak signals, tension, intuition, and multiple possible interpretations. Many strong innovators share that profile. They do not merely solve a presented problem; they question the frame of the problem itself. They sense an opportunity before they can yet describe it fully. They often feel an internal drive to externalize an idea, a pattern, or a contradiction that has not yet taken shape.

The research literature supports this more nuanced picture. Domain knowledge is one of the foundations of creative performance, because people need deep material to recombine, evaluate, and implement ideas. At the same time, knowledge can also produce fixation when established schemas, habits, or conventional uses become too dominant. In other words, knowledge supplies the raw material of innovation, but creativity depends on how flexibly that material is searched, recombined, challenged, and expressed.

The person before the idea

Innovation does not arise only from cognition. It also depends on motivation. Self-determination theory and related work on intrinsic motivation show that people are more persistent, exploratory, and engaged when they experience their work as meaningful and self-endorsed rather than purely externally controlled. That matters because creative work is unusually voluntary. Nobody can be forced into a truly original insight by procedure alone.

This is one reason I do not believe companies innovate simply because they employ intelligent people. They innovate when at least some people inside the company feel an urge to express themselves through innovation, and when the environment allows that urge to become visible. In practice, this means autonomy, challenge, access to problems that matter, and a culture in which unfinished thoughts are not punished too early.

Psychological safety is especially important here. Nascent ideas are fragile. At the beginning, they are often ambiguous, incomplete, and easy to dismiss. If the climate of the company punishes speculative thinking, people learn to remain silent until they can present certainty. But by then, many opportunities are already dead. Research on psychological safety shows that teams learn, speak up, and experiment more effectively when people believe they can take interpersonal risks without humiliation or penalty. For innovation, this does not mean the absence of standards; it means the presence of enough safety for exploratory thinking to surface before evaluation tightens.

Leaders therefore matter not only as resource allocators but as architects of the mental environment. Reviews of the field argue that leaders affect innovation both by motivating creative work and by shaping the conditions in which creative problem solving becomes possible at the individual, team, and organizational levels.

Two pathways to innovation

Over time, I have come to see two recurring pathways by which innovation enters a company.

The first is idea-first.

The second is area-first.

Both are real. Both can be productive. But they are not equally common, and they should not be managed in the same way.

The idea-first pathway

In the idea-first pathway, somebody experiences a relatively concrete insight early. They see a feature, a process change, a product concept, or a business-model move before the rest of the organization does. The main work then becomes elaborating, testing, championing, and implementing the idea. This pathway is closest to the romantic image of innovation: a spark appears, then execution follows.

The idea-first pathway is powerful because it can produce discontinuities. It often comes from unusual observation, a strong personal intuition, or a fresh combination of existing elements. But it also has weaknesses. Organizations tend to overvalue it because it is visible and dramatic. The danger is that they celebrate flashes of inspiration but underinvest in the upstream conditions that make those flashes more likely in the first place.

The area-first pathway

In the area-first pathway, the innovator does not yet have a solution. What exists first is a conviction that a specific terrain contains opportunity. A team might feel that checkout is changing, that compliance is becoming software-defined, that AI will rewrite a workflow, or that a hidden friction in the customer journey is strategically important. At that point, there is no final idea. There is only a search field.

In my experience, this is where most meaningful innovation actually begins. First we know the area in which innovation is likely to matter. Then we gather signals, frame the contradictions, define constraints, observe users, map the system, and challenge existing assumptions. Only after that work do ideas emerge. This is not a failure of imagination. It is a more disciplined form of imagination.

Creativity research offers a strong conceptual basis for this pathway. Problem finding and problem construction are increasingly understood as central parts of the creative process rather than optional preliminaries. They shape what is seen, what is ignored, and what kinds of solutions can even become thinkable.

A practical comparison of the two pathways

Dimension	Idea-first	Area-first	What leadership must provide
Trigger	A concrete idea appears early.	A promising search field appears first; the idea comes later.	Recognize which mode is in play instead of forcing one template.
Main strength	Speed and breakthrough potential.	Higher repeatability; better fit with strategic priorities.	Resource both inspiration and exploration.
Main risk	Hero culture and underdeveloped validation.	Analysis without decisive synthesis.	Keep search disciplined and time-bounded.
Best methods	Rapid prototyping, championing, testing.	Problem framing, observation, recombination, incubation.	Separate divergence from convergence.
Talent profile	Strong intuition and concept formation.	Curiosity, systems thinking, tolerance for ambiguity.	Protect explorers without lowering standards.
Typical failure	The idea never gains support or implementation.	The team talks about the area but never crystallizes a concept.	Create a pathway from insight to decision.

Why the area-first pathway works so often

The important conclusion is that the area-first path is not a vague pre-idea stage. It is a legitimate and often dominant route to innovation. In many firms, it is also the more manageable route because it can be designed intentionally.

First, it reflects what the literature calls problem finding and problem construction. Creative people do not only solve given problems; they are better at noticing, defining, and reframing problems. Problem finding has been linked to creative potential, and empirical work suggests that flexibility in divergent thinking is meaningfully associated with problem-finding ability. At the team level, instructing groups to engage in problem construction has been shown to increase originality, reduce conflict, and improve satisfaction relative to groups that move directly to solution talk.

Second, the area-first pathway allows innovation to become strategic rather than accidental. Once a company says, “This is a terrain where something important is changing,” it can allocate attention and resources on purpose. Search becomes intentional. The team can study customer behavior, hidden constraints, edge cases, adjacent industries, and technical bottlenecks without pretending that the first concept is already the answer.

Third, this pathway allows for productive use of both insiders and outsiders. Research on knowledge distance shows that creativity is not simply a function of being close to or far from a domain. Outsiders can outperform when they engage in focused, effortful search, while insiders can outperform when they richly recombine diverse knowledge elements from within the field. That is a valuable lesson for innovation design. Sometimes the best answer comes from deep experts. Sometimes it comes from people far enough away to ignore conventions that insiders no longer notice.

Fourth, area-first innovation makes sense of incubation. Once a promising field has been deeply explored, stepping away from it is often useful rather than wasteful. Reviews of incubation research show that setting a problem aside can facilitate later insight, especially in divergent tasks, likely because unconscious or weakly conscious recombination continues after deliberate immersion. The popular image of a sudden idea is therefore often misleading. Many “sudden” ideas are not spontaneous at all. They are the visible result of invisible processing that follows focused preparation.

Neuroscience points in a similar direction. Creative idea production is associated not with pure spontaneity or pure control, but with cooperation between networks involved in spontaneous thought, executive control, and salience detection. That suggests creativity is neither random wandering nor rigid analysis. It is controlled imagination: the capacity to explore, notice, and select within a structured but open search process.

Why expertise helps and hinders at the same time

One of the most important managerial implications is that expertise is double-edged. Companies often assume the most experienced person is automatically the most innovative person. Sometimes that is true. Often it is not. The same schemas that make an expert fast and effective can also make alternative interpretations less visible. Habit, prior use, and familiar solution paths can create fixation.

This is why many organizations make a category error. They take their best operators and expect them to become their best innovators. Yet innovation requires a different configuration: openness, tolerance for ambiguity, generative attention, intrinsic interest, social courage, and often an unusual willingness to express thoughts that are not yet fully defensible. A firm does not need everybody to be this way. But it does need to identify, protect, and connect the people who are.

A mature innovation culture therefore does two things at once. It honors expertise, because ideas without substance do not survive reality. And it deliberately introduces distance, because systems that only listen to insiders become trapped by their own success logic.

What companies should do if they want repeatable innovation

If innovation really begins before the idea, then companies should redesign the front end of innovation instead of treating it as mystical. The goal is not to bureaucratize creativity. The goal is to make creative emergence more likely.

First, define search domains, not only solution briefs. A useful search domain is a strategically relevant area where contradictions, friction, or discontinuity are likely to produce opportunities. Examples might include returns, last-meter fulfillment, self-checkout fraud, voice interfaces, software localization, or compliance automation. The domain should be clear enough to focus attention but open enough to invite novel framing.

Second, separate idea generation from idea evaluation. Many ideas die because organizations evaluate too early. Divergence and convergence require different mindsets. Early critique can improve weak concepts, but it can also silence fragile, original ones before they become articulate.

Third, institutionalize problem finding. Before asking a team for ideas, ask them for alternative problem statements, hidden assumptions, observed contradictions, boundary cases, and opportunity hypotheses. In many situations this will produce higher-quality innovation than a direct brainstorm.

Fourth, design for expression. People are more likely to offer incomplete, risky, and potentially important thoughts when they feel trusted, respected, and safe enough to be wrong in public. Psychological safety does not guarantee creativity, but without it many creative signals never appear at all.

Fifth, alternate immersion and incubation. Do not keep teams in permanent workshop mode. Give them periods of intense exposure to the problem and periods of distance from it. A good innovation rhythm combines disciplined input, reflective pause, and synthesis.

Sixth, build a path beyond ideation. An idea is not innovation until it is elaborated, championed, and implemented. Perry-Smith and Mannucci’s idea-journey model is useful here: what helps at generation is not identical to what helps at elaboration, championing, or implementation. Support systems must therefore change as an idea matures.

An operating model for intentional idea generation

Below is a practical model that we use and any other technology company can use without turning innovation into theater:

1. Choose three to five strategic search fields each quarter. These should be areas where the company expects discontinuity, hidden friction, or strategic leverage.
2. Write a short search brief for each field. The brief should define why the field matters, what tensions are visible, what assumptions should be challenged, and what would count as evidence that the field contains real opportunity.
3. Immerse a small cross-functional group. Combine deep insiders with one or two people who are cognitively distant from the domain. Ask them first for alternative ways of framing the problem, not for solutions.
4. Create an idea window after problem construction. Once the group has reframed the terrain, open a period for concepts, analogies, prototypes, and thought experiments.
5. Insert a pause. After immersion and idea generation, step away. Incubation is not laziness. It is part of the cognitive work.
6. Return for selection and championing. Evaluate not only novelty, but usefulness, strategic fit, technical feasibility, and the minimum experiment needed to learn quickly.
7. Move one or two ideas into implementation logic. Innovation cultures do not prove their seriousness by producing hundreds of ideas. They prove it by turning selected ideas into validated decisions.

This model is especially useful for companies that say they want more innovation but currently rely on accidental inspiration. It moves the process upstream, where the real leverage often sits.

Conclusion: innovation starts before inspiration

The deepest mistake organizations make is chronological. They think innovation begins with ideation. In many cases it begins earlier: with creative people who feel compelled to express something, with leaders who declare a territory worthy of search, with teams that are allowed to define the problem before they are pressured to defend a solution, and with a process that combines knowledge, freedom, effort, and timing.

Not everybody in a company must be an innovator. Nor should everybody be expected to work like an artist. But every innovative company needs at least some people who can do exactly that: people who can tolerate ambiguity, frame weak signals, question assumptions, and turn unfinished intuitions into useful directions. When those people are combined with serious expertise, strategic search fields, and an environment that supports expression, innovation becomes much less mysterious.

So the real question is not, “How do we get more ideas?” The better question is, “How do we create the people, climate, and search conditions from which worthwhile ideas can reliably emerge?” Once a company can answer that, innovation no longer starts by accident. It starts by design.

References

Selected academic sources used to inform the argument and framing of this article.

Abdulla Alabbasi, A. M. A., Reiter-Palmon, R., Sultan, Z. M., & Ayoub, A. E. A. (2021). Which divergent thinking index is more associated with problem finding ability? The role of flexibility and task nature. Frontiers in Psychology,

Acar, O. A., & van den Ende, J. (2016). Knowledge distance, cognitive-search processes, and creativity: The making of winning solutions in science contests. Psychological Science

Amabile, T. M. (1988). A model of creativity and innovation in organizations. In B. M. Staw & L. L. Cummings (Eds.), Research in Organizational Behavior (Vol. 10). JAI Press.

Amabile, T. M., & Pratt, M. G. (2016). The dynamic componential model of creativity and innovation in organizations: Making progress, making meaning. Research in Organizational Behavior

Beaty, R. E., Benedek, M., Kaufman, S. B., & Silvia, P. J. (2015). Default and executive network coupling supports creative idea production. Scientific Reports

Deci, E. L., Olafsen, A. H., & Ryan, R. M. (2017). Self-determination theory in work organizations: The state of a science. Annual Review of Organizational Psychology and Organizational Behavior

Edmondson, A. C., & Bransby, D. P. (2023). Psychological safety comes of age: Observed themes in an established literature. Annual Review of Organizational Psychology and Organizational Behavior

Fishbach, A., & Woolley, K. (2022). The structure of intrinsic motivation. Annual Review of Organizational Psychology and Organizational Behavior

Gilhooly, K. J. (2016). Incubation and intuition in creative problem solving. Frontiers in Psychology

Ibáñez de Aldecoa, P., de Wit, S., & Tebbich, S. (2021). Can habits impede creativity by inducing fixation? Frontiers in Psychology

Mumford, M. D., Medeiros, K. E., & Partlow, P. J. (2023). Leader thinking, follower thinking: Leader impacts on follower creative performance. Annual Review of Organizational Psychology and Organizational Behavior

Perry-Smith, J. E., & Mannucci, P. V. (2017). From creativity to innovation: The social network drivers of the four phases of the idea journey. Academy of Management Review

Reiter-Palmon, R., & Murugavel, V. (2018). The effect of problem construction on team process and creativity. Frontiers in Psychology

Runco, M. A., & Jaeger, G. J. (2012). The standard definition of creativity. Creativity Research Journal

Sio, U. N., & Ormerod, T. C. (2009). Does incubation enhance problem solving? A meta-analytic review. Psychological Bulletin

Zhou, J., & Hoever, I. J. (2014). Research on workplace creativity: A review and redirection. Annual Review of Organizational Psychology and Organizational Behavior

Zhou, J., & Hoever, I. J. (2023). Understanding the dynamic interplay between actor and context for creativity: Progress and desirable directions. Annual Review of Organizational Psychology and Organizational Behavior