A recent Harvard Business Review article, “Why Most Product Launches Fail,” describes a component of the difficulty in new product development. In discussing whether new products will succeed, this research finds that:

Most won’t.1 According to a leading market research firm, about 75 percent of consumer packaged goods and retail products fail to earn even $7.5 million during their first year. This is in part because of the intransigence of consumer shopping habits. The consultant Jack Trout has found that American families, on average, repeatedly buy the same 150 items, which constitute as much as 85 percent of their household needs; it’s hard to get something new on the radar. Even P&G routinely whiffs with product rollouts. Less than three percent of new consumer packaged goods exceed first-year sales of $50 million—considered the benchmark of a highly successful launch. And products that start out strong may have trouble sustaining success.

We know, then, that many new products do not succeed. Many products fail to ever make it to the market, and for those that do, success is not guaranteed. The image below depicts the chances that products will make it to market and if these products will be ultimately successful. While these numbers may vary by market and industry, the message is clear: Bringing a commercially viable product to market is tough to do.2

Obstacles Along the NPD Cycle

Often discussed but difficult to address, there are several major reasons for product launch failure:3

  • The product falls short of claims and gets bashed.
  • The new item exists in “product limbo” – it fails to distill a true and unmet customer need because its benefits are not distinct enough from those of existing items, or its features address a transient fad.
  • The product defines a new category and required substantial consumer education, but does not get it.
  • The product is revolutionary, but there is no market for it.
  • The company cannot support fast growth.

We know that challenges along the product life cycle, such as the changing marketing, changing customer preferences, new competitors, poor product design, going after the wrong target market, off-base pricing, off-target go-to-market strategy, and a lack of post-launch research can result in a shortened product life-cycle. To minimize these challenges, companies should conduct research for ideation, validation, development of a go-to-market strategy, and post-launch.

Our Insights:

We have identified key solutions to guide your use of research in the NPD process and tips for things to avoid during this key process.

1. Using Tomorrow’s Research to Justify Yesterday’s Bad Decisions

Too often companies move forward with new products based on a hunch. They have an idea, see value in it and decide to progress with the development of a product without thoroughly exploring the market for that product. However, without thoughtful research and abiding by the known principles of NPD, chances are this company and product will encounter difficulties. Then, when the inevitable problems arise, companies look to research to justify their decisions. Demonstrating this point, an article, “What Entrepreneurs Get Wrong,” surveyed entrepreneurs in Hong Kong, Kenya, Mexico, Nigeria, the United Kingdom, and the United States to uncover insights on these entrepreneurs’ first sales and what they learned through the process. In discussing their regrets, they shared that “starting late” was a mistake as they missed out on the crucial opportunity of understanding customer needs and reactions before actually developing the product.4

Once you’ve developed and rolled out the product, going back to conduct research to guide the product’s development is not cost-effective or efficient. This can create substantial delays in the ultimate progress of the product and can deplete morale and potential market share by an ineffective rollout.

Lesson: Use research to guide the NPD process, rather than trying to correct it once problems arise.

Solution: Test and experiment throughout the product development process, from inception to production. Too often companies first design a product and then figure out a way to sell it. The ultimate success or failure of a product is defined by the customers’ willingness to pay for it. Research, experimentation, and testing should therefore be incorporated throughout the product development process, rather than after the product has already been developed. A few months ago, a prospective client asked us how we would use research to ensure the successful launch of their new product:

Us: Where are you in the product development process?

Prospective client: We’re launching the product next month.”

Us: What type of research support are you looking for?

Prospective client: We have the product, we need you to tell us the size of the market and the best way to sell it before we launch.

Us: But what if we find that there is a poor market for your product?

Prospective client: Well it’s too late to change the product now.

We chose not to partner with this organization because they hoped to use research to retroactively affirm decisions to which they had already committed, severely limiting the potential impact of research on shaping and guiding the NPD process. Further discussion showed that they had designed a product that was extremely profitable for them, but of questionable value to their customers. After realizing a product is off-target, clients often lament that they should have conducted more research to support the NPD process. In addition to client testimonials, we’ve learned through experience that had companies such as the one mentioned conducted more thorough research throughout the product development process, rather than at the very end, they would have had time to adjust their product to the demands of the market. Unfortunately, they are now stuck with a lemon.

2. Separating Outcomes From the Product

When companies focus entirely on the product itself rather than also considering the sales process, they lose out on valuable knowledge. The NPD process often focuses on the product itself, but this laser focus can negatively impact the rollout of the product, as a major component of the process was excluded.

Research on mistakes made during product rollout finds that “even founders who started selling early said they were too focused on convincing prospects of the new product’s merits and not concerned enough with finding out what prospects thought of the idea.

Some realized that their passion and ego made them respond negatively to criticism and discount ideas for changes that they later saw would have increased the marketability of their offerings.5

Understanding the marketing and sales process that will accompany the actual product and its merits is a key component of the NPD process. Steps such as market assessments, product ideation, product validation, message testing, and post-launch surveys all play a role in this vital marketing and sales component, which cannot be overshadowed by a focus on the product’s merits alone. The success of a product is greatly dependent on this knowledge.

Lesson: The sales and marketing process of NPD plays a strong role in the success and viability of the product.

Solution: Define actionable goals for the product and hold yourself accountable to those goals. For example, what minimum profit margin are you willing to accept for a new product? One percent? Ten percent? One hundred percent? When do you need your new product to provide a positive return on investment? Within one month? One year? Two years? Every business has a unique set of values, competitive advantages, and tolerances of risk. As such, you should define end goals for new products that align with your central goals, mission, and appetite for risk. Defining a budget, minimum return on investment, and other baseline measurements of success for all of your new products before you invest time and resources into developing them ensures that you are not wasting efforts on products that are not profitable or are poor fits for your business model.

3. Forgetting to Test Your Own Assumptions

Strong assumptions often steer the NPD process; however, these assumptions may take you off course. A structured research process, rather than assumptions, will guide you toward a successful product launch.

The value of conducting research early in the NPD process cannot be overstated. In discussing the two distinct stages of the NPD process, Bonabeau, Bodick, and Armstrong find that “companies often treat new product development as a monolithic process, but it can be more rationally divided into two distinct stages: a truth-seeking early stage, focused on evaluating novel products’ prospects and eliminating bad bets, and a success-seeking late stage, focused on maximizing the value of products that have been cleared for development.6 The key takeaway from this finding is the importance of truth. Your assumptions and hunches must be tested and validated before progressing.

In “The Path to Developing Successful New Products,” the Wall Street Journal discussed the importance of talking to the customer throughout the development process. By surveying employees at companies throughout North America and Europe, the researchers found that “the successful innovators in our study kept in close contact with customers throughout the development process. More than 80 percent of the top performers said they periodically tested and validated customer preferences during the development process, compared with just 43 percent of bottom performers. They were also twice as likely as the laggards to research what, exactly, customers wanted. That made them better able to identify and fix design concerns early on, minimizing project delays.7 Highlighted in this article is the testing of assumptions through research; so rather than proceeding with the plan (developed based on assumptions rather than truths), top performers adjusted their assumptions to reflect research throughout the process.

Front-end product ideation research through customer feedback helps companies avoid operating solely on assumptions. A key to the market success of Dyson vacuums was the front-end ideation and development research conducted before the launch of the first model. With a focus on creating a unique product that was “highly distinctive, broadly appealing, and pragmatic,” as well as creating “a rigorous capabilities-driven system to support these product attributes,” the final product was unique, reliable, and thoroughly tested by research before its release.8

Rather than proceeding based on assumptions, external validations through research will test assumptions.

Lesson: There is great value in research-based definitions of success and unbiased, external validations of success.

Solution: Incorporate internal and external stakeholder feedback throughout the product development process.

Product development should not occur within a vacuum. A successful product requires someone to sell it, market it, and most importantly of all, buy it.

The perspectives and opinions of consumers, sales staff, and marketing staff, as well as other key internal stakeholders should be incorporated throughout the product development process to ensure that product design choices do not prevent future sales. Feedback can be incorporated through quantitative surveys or qualitative interviews, depending on the size of the population intended to reach. For example, surveys are typically the best approach for consumer products, such as outdoor grilling products, while interviews tend to be the best approach for markets with few purchasing decision makers, such as aircraft components. Inviting outside perspectives into the product development process can be an excellent method of identifying biases or groupthink within an organization before those assumptions can permanently affect the success of a new product.

Using sound research will help you to steer clear of the three identified mistakes in the NPD process.


  1. Schneider, J. & Hall, J. 2009. “Why Most Product Launches Fail. Harvard Business Review http://hbr.org/2011/04/why-most-product-launches-fail/ar/1
  2. Guide to New Product Development. Technology Multipliers http://www.slideshare.net/TechnologyMultipliers/guide-to-new-product-development-npd-9099801
  3. Schneider, J. & Hall, J. Op. cit.
  4. Onyemah, V., Pesquera, M., & Ali, A. “What Entrepreneurs Get Wrong. Harvard Business Review, May 2013. http://hbr.org/2013/05/what-entrepreneurs-get-wrong/ar/1
  5. Ibid.
  6. Bonabeau, E., Bodick, N., & Armstrong, R. “A More Rational Approach to New- Product Development. Harvard Business Review, March 2008. http://hbr.org/2008/03/a-more-rational-approach-to-new-product-development/ar/1
  7. Gordon, M., Musso, C., Rebentisch, E. & Gupta, N. “The Path To Developing Successful New Products. Wall Street Journal, November 30, 2009. http://online.wsj.com/news/articles/SB10001424052970203440104574400593760720388
  8. Kandybin, A. & Michaels, A. “Successful Product Development: Unique, Coherent… And Rare. Forbes, July 29, 2013. http://www.forbes.com/sites/boozandcompany/2013/07/29/successful-product-development-unique-coherent-and-rare/

Get the PDF of this article.