So you have a number of exciting concept ideas but you’re not sure which to take into further development? This is where conducting online concept testing comes in.

Online concept testing is the process of evaluating product ideas with consumers prior to their introduction to the market. It can include both quantitative and qualitative research, via surveys and online communities, for instance.

It’s a great way to bring consumer insights to the heart of the new product development process. These insights can help you understand which products or services will be a hit with your target audience. In this way, a concept test can dramatically reduce the risk of a product failing when it hits the market, helping to ensure a successful product launch.

Online concept testing can also point to areas of your concept that need tweaking, or new features which could be added. It can also help you answer questions such as whether the price is right and how where your idea fits in relation to competitor offerings and the perception of your brand as a whole.

But there is no one-size-fits-all approach, rather a range of methods that can be combined and tailored to meet the demands of each project. 

What online approaches can you use for concept testing?

You can take either a quantitative or qualitative approach to concept testing – or combine both. 

The main quantitative technique is an online concept test survey. Through online surveys, you can reach thousands of targeted and engaged respondents, providing rich and robust data that can be analysed. In the survey, the concept test would involve consumers reviewing a text description or a visual representation of the concept. Then, the audience would be prompted to answer questions or to discuss their impressions of your idea. 

Single-concepts can be tested through monadic survey design, whilst multiple concepts can be evaluated using sequential design (read more about this in our post on what concept testing is and why it’s important). Once we have ascertained the level of interest or purchase intent data for each concept, these can be plotted on a chart to show which spurred the most promising response. We can also unpick the relative effect of different attributes such as price or features, with the help of a well-designed survey template, advanced statistical techniques. 

When it comes to qualitative techniques, you can either run an online community – a carefully curated space to engage respondents in a group setting, as well as one to one tasks – or run a series of in depth interviews over video chat, in which you have the ability to share concepts on the screen.

What’s the advantage of online?

Online surveys enable you to reach a representative sample to gather robust data quickly and efficiently. 

Online qualitative approaches, like online communities can deliver more detailed feedback than you might get in person. The sheer quantity of comments in an online community is vast – providing a real depth of insight. 

An added benefit of qualitative online testing methods is that they can enable you to test ideas in multiple markets at the same time, so you can identify and explore common themes, rather than having to run focus groups over a number of weeks to get feedback in each market.

Online concept testing best practice

Objectives first, methodology second

Try to avoid embarking on the research with a set methodology in mind. Instead take a step back and think about your objectives and where you are in the product development process. This will help you choose the right approach. 

Ask yourself whether you require high-level responses to multiple concepts, or detailed feedback on one, in particular? Do you need qualitative inspiration or quantitative rankings?

Also think about how far along the development process you are. If you have a prototype of your concept that respondents can interact with it may be that an offline approach like a focus group could be more appropriate, whereas if your concepts are at an earlier stage, an online approach could be more valuable.

We tend to use a combination of testing methods to build up a picture of how products or services could fit into the lives of those you hope will use them – and we’ll tailor the methods based on the project. Often, we’ll work with clients to quantitatively test initial concepts to understand those with most appeal to the target market. This is often followed by an online community in which consumers help you hone your ideas further.

That said, it’s always critical to build a tailored approach depending on what you’re trying to achieve and who you’re trying to reach. For instance, if you’re looking to get feedback on new concepts from hard-to-reach, or B2B audiences, a digital in-depth interview could be appropriate.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

Choose the right tools

Many online community platforms are specifically built with concept testing in mind and have tools that allow respondents to mark up elements of a concept that they like or dislike, along with a justification. 

But always ensure the agency you work with has the right security protocols in place to protect early stage ideas. The platforms we use include a number of built-in security features. Images can be watermarked with a unique respondent identifier and, if you’re testing ads, we can set videos to self-destruct after they’ve been watched once. On top of this, we use all the confidentiality procedures we would for concept testing in-person. With such stringent processes in place, we’ve never experienced a leak. With us, your ideas are in safe hands.

Moderation, moderation, moderation

When you’re testing concepts in an online community, it’s important that conversation is carefully guided just as it would be in an offline focus group. Skilled market researchers know how to curate the conversation in an online setting, finding links between people and encouraging them to open up and feedback comprehensively on ideas.

Through a combination of effective moderation, probing and carefully structured analysis, we can identify the overall themes and elicit the information you need to move forwards in the product development process.

Bring ideas to life for consumers

To get the most out of respondents, it’s also important that you bring concepts to life by creating stimuli that enable the target market to picture your proposed products or services. Often, the early-stage concepts we receive from clients are only roughly sketched out. 

It might be a selection of words on a Post-It note, or a collage of images found online. We work with our in-house designers and copywriters to build on this, fleshing out concepts and designing mock-ups and prototypes to make sure that your initial ideas can be easily understood by consumers. After all, it’s much easier to feed back on an idea you can properly visualise.

We use prototypes to bring ideas to life for consumers in face-to-face focus groups but one of the benefits of qualitative online concept testing methods, like online communities, is that these mockups can be amended based on consumer feedback and then fed back into an online community for further comment. This allows us to iteratively improve the concepts over time to build on and strengthen initial ideas.  

At Kadence, we’re taking this principle a step further by exploring how we can use augmented reality (AR) to further bring concepts to life, thereby eliciting higher quality insights. Through AR we can create 3D digital prototypes that consumers can place in real environments using their phone – in their home, in a supermarket, wherever they happen to be. Not only do immersive methods like this deliver richer, higher quality insights, but they allow you to test concepts in context, thereby overcoming some of the challenges of face-to-face approaches.

Finally, it might sound obvious but it’s also important to ensure that your concepts are ready to be tested. It’s better to delay an online focus group if your concept is not yet fully developed, nor its purpose clear. If your ideas are easily understandable, can be brought to life and readily understood, your participants will be able to provide more comprehensive feedback.

Rigorous research shows you whether you’re really on to something. It puts everyone’s ideas on a level playing field and can help companies navigate internal politics to find a path ahead. After all, it’s your customers who will decide which idea is a success.

In this way, market research can dramatically increase the chances of developing a product concept successfully. Ultimately, testing is the process that enables you to proceed with confidence, and what can be better than that? We’d love to support your organisation with concept testing research. To discuss the best way to test your new ideas – be that online or offline –  please request a proposal. 

Every marketer knows the stat: 80% of new products fail. Or 90%. Or 95%. The precise number differs, but the story is always the same. 

By anyone’s standards, those are daunting odds for businesses that want to innovate and stay ahead of the curve. How can companies buck the trend and increase their success rate? How can you make sure your product is part of the 20% (or 10% or 5%?)

Clearly, it’s vital that any new product or service has to be just right. The question is, what does just right look like? And unfortunately, the answer to that question is not up to you. 

It’s up to your customers.

That means it’s important to find out at an early stage whether or not your concept is going to attract customers to buy or not, and if so, how you can make the most of it.

This is where concept testing comes in.

What is concept testing?

Concept testing is how businesses evaluate and optimise ideas before taking them to market.

The concept in question can be a lot of different things. It might be a totally new breed of product that no one has ever seen before. Or it might be a redesign or rebrand. 

Business questions that concept testing can address include:

  • Does the concept meet customers’ needs? Do they ‘get’ it? Do they find it appealing? Does it give them something they want?
  • Is the price right? What are consumers willing to pay? Is the product commercially viable?
  • How should it be positioned? Where does your idea fit in relation to competitors? Does it suit your brand? What’s your natural place in the market?
  • What details need to be tweaked? How can your concept get better? Is everything working right? Are any features missing?

Concept testing is not a single one-size-fits-all technique, but a whole range of methods that can be combined and tailored to fit the demands of each individual project. 

Why concept testing matters

There’s no avoiding it: conducting proper concept testing requires an investment of time and money. But that’s nothing compared to the potential cost of not testing concepts early on in the development process.

Failed products or services cost businesses not just in terms of wasted investment, but in the opportunity cost of what could have been achieved instead. The same goes for a bad ad or a bad logo design.

In fact, in the worst cases, businesses can suffer reputational damage or harm to the value of their brands by launching a product concept that wasn’t right for the market. Marketing history is littered with examples of products and ads that were wide of the mark. 

In 1985 Coca-Cola famously introduced New Coke – its answer to blind taste tests where rival Pepsi came out top. But the success of brands and products is about more than blind tests, and New Coke flopped. Decades later, it’s still remembered as a major marketing misstep.

Remember Juicero? No? Not many people do. Investors pumped $120 million into the $400 Wi-Fi-connected juice maker in 2016 – even though users could get the same effect by just squeezing the juice pouches by hand. Consumers saw through it, and within two years Juicero had been scrapped.

In 2005 ESPN launched an innovative mobile phone service that incorporated its exclusive sports content. But the price was all wrong, and the lack of handset choices also put people off.

Concept testing reduces the risk of costly failures like these, and increases the chances of hitting on a runaway success.

Ultimately, it’s about proceeding with confidence.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

9 Use cases for concept testing

1. Check whether your ideas will really fly 

Just because an idea feels right to you (or your boss, or your friends, or your mum) doesn’t mean it’s commercially viable. Rigorous concept testing research shows you whether you’re really on to something or not, so you can put a rocket under the ideas that have potential, and not waste time on the ones that don’t.

2. Settle arguments and objectively evaluate ideas

Everyone’s got an opinion, right? Great concept testing can cut through corporate politics, putting everyone’s ideas on a level playing field. It busts groupthink and unites teams behind ideas that have a real chance.

3. Compare rival concepts

Pit your ideas against each other and find out what consumers prefer. Once you’ve narrowed down your choice, you can focus on the ones that performed well.

4. Define your list of features and benefits

Particular capabilities and attributes can have a make-or-break effect on the success of a product. Find out which things consumers really care about (and which ones they can do without)

5. Figure out how to make it profitable

Knowing how to manage your costs and prioritise the investments consumers care about is crucial to success.

6. Improve concepts iteratively

Hone and tweak your concept in response to consumer feedback, then test again. Research might even throw up brand new ideas which you can develop and test.

7. Determine who to target

Concept testing can give you clear pointers as to which demographic groups, geographies or market segments will get as excited about your idea as you are.

8. Decide your communication approach

Setting the right tone and getting the key points across is not something that should be based on guesswork. Try your ideas out in the wild and get valuable feedback.

9. Refine after launch

To hone your offering, and keep it ahead of the competition, testing can continue post-launch. 

Does concept testing really work?

Some in the business world feel that intuition and inspiration ought to be enough to develop great products. True innovation, they claim, comes from maverick geniuses like Henry Ford, who supposedly said that if he’d asked customers what they wanted, they would have said “faster horses”.

The thing is, Ford was right. And that’s why at Kadence International, concept testing is about much, much more than just asking people what they want. 

Good concept testing doesn’t have to mean missing out on ground-breaking innovation or settling for mediocre ideas. It means getting under the skin of your customer and letting their feelings and needs inspire solutions with the most potential.

Sure, asking people what they want or what concept they prefer is part of the story – but only part of it. You also need to tap into the psychology and emotions that drive real world consumer behaviour, and put it all in the context of the trade-offs that consumers make regarding prices, benefits, and competitive offerings.

Concept testing the Kadence way

Concept testing is one of Kadence International’s many market research specialisms. We’ve got many years’ experience of testing concepts in numerous categories, and driving the creation of successful products and services.

Toiletries

What fragrances of shower gel would appeal to young teenagers, and what kind of imagery and language could bring them to life in a way that feels fresh and different?

We conducted research in two iterative stages. First, we ran an online survey among the target demographic to screen a set of early-stage concepts and identify the ones with the greatest appeal. The winning concepts were then explored and further refined in face-to-face focus groups, with an element of co-creation, providing the client with a robust set of high-quality concepts to develop.

Takeaway coffee

A major food and drink brand wanted to know what kinds of iced drinks could prove a hit with customers over the summer.

We ran a creative workshop with the client’s product development and research teams, to develop a series of new concepts and then visualise these with the help of our design team.  We then screened these in an online quantitative test. This allowed us to isolate the most popular concepts and acceptable price ranges. We followed up with focus groups to refine and enhance the most appealing concepts, giving the client a set of strong, worked up concepts to take into development.

Travel advertising

What kinds of imagery, messaging and language would be most effective in ads aimed at grabbing the attention of high-value travellers and attracting them to a holiday destination?

We ran an online quantitative test to evaluate a series of creative routes, looking at a number of different metrics. We began by measuring a baseline level of interest in visiting the destination, so we could identify the option that gave the greatest uplift in interest. The client was then able to create an ad campaign with the confidence that it would have the impact they wanted.

Food

A major food manufacturer wanted to gauge interest among its B2B customers in purchasing via a direct-to-customer (D2C) model, instead of through wholesalers.

We conducted a series of qualitative depth interviews looking at a set of concepts for potential D2C models. This helped the client establish which options resonated, and how they could be further enhanced.

Research methods for concept testing

At Kadence we employ a wide range of concept testing methods, including qualitative, quantitative, and combinations of both. Every project is different, and we always work with the client to come up with the right blend of techniques. 

We always begin by carefully considering what the client really needs. What do they already know, and what stage are their concepts at right now? Do they require high-level responses to a selection of concepts, or detailed feedback on one in particular? Do we need qualitative inspiration or quantitative rankings? It’s questions like these that guide our choice of methods.

Surveys

Online concept test surveys are a powerful tool. They can reach thousands of carefully targeted and engaged consumers, providing rich data that can be statistically analysed, ranked and compared. Online surveys can present choices in a way that mimics real purchase decisions, and use statistical techniques to unpick the relative effect of different attributes such as features and price. Our market research experts design the structure, hone the questions, identify the right respondents and analyse the results to pull out the key insights.

Focus groups

Focus groups – are a tried and tested way of getting rich qualitative input. We bring a small group of consumers together – face-to-face or online – and conduct a carefully guided discussion, often with prototypes or other stimuli to spark conversation. Our skilled researchers know the questions to ask that get to the nub of the issue, how to read between the lines of people’s responses, and how to understand the group dynamic.

Depth interviews

For more detailed investigation, we conduct depth interviews with individual respondents, to explore themes and topics in a way that isn’t possible through other methods. It’s a great way to dig into what really drives people’s decisions and behaviour.

Ethnography

Ethnographic research is the market research equivalent of going on safari. It’s about observing consumers in their natural habitat. We ask consumers to share pictures, make videos and keep diaries, or we simply spend some time with them one-to-one to get a window on their real lives.

Online communities

Online communities are a great way to get wide-ranging feedback from consumers. We run dedicated short-term communities specifically for your research project, where participants can explore concepts, discuss them, and contribute in text, image or video form, just like in any online community environment. We can put them in groups, set them tasks, and ask them questions. The responses we get are rich and immediate. And because communities run over a period of days or weeks rather than hours or minutes, they allow concepts to be iterated as the research progresses.

The role of design 

At Kadence we always approach concept testing with creativity, drawing on our in-house design skills..

Often the early-stage concepts we are asked to test are only roughly sketched out – it might be a selection of words on a Post-It note, or a collage of images found online. No problem. Our in-house designers and creatives flesh out the concept into something that consumers can get to grips with.

It might be a mock-up of an ad, a visual piece of stimulus to represent a new service, a model or prototype of a product, or a piece of test copy for an ad or website. We’re even piloting an augmented reality (AR) tool that will allow us to create digital 3D prototypes, so research participants can use their smartphones to see how a product would look in real life, in their own home, or wherever they happen to be. Compared to a static image, this immersive new method will take things to the next level, and we expect it to be a highly cost-effective way to deliver richer, higher quality insights.

As well as bringing design skills to our concept testing research, our approach is guided by the principles of design thinking.

The five stages of design thinking are:

  • Empathise: Start by seeing the world through your consumers’ eyes.
  • Define: Set out in clear, simple terms the challenge that you’re trying to address.
  • Ideate: Generate ideas based on what you’ve learned. (This is often the point our clients have reached when they get in touch with us – but that doesn’t mean we won’t return again to the first three stages later, to generate new ideas based on the results of testing.)
  • Prototype: This is where it gets real. Create a version of your product, service, ad or design that consumers can see, feel and provide feedback on. 
  • Test: Here’s where concept testing gets going in earnest. When it’s done, you can revisit the earlier steps and come back with something even better.

We believe this approach is a key part of what makes Kadence different.

10 Top tips for successful concept testing

1. Set clear objectives

It’s important to be as specific as possible about what your aims are. What exactly do you need to find out and what is it going to help you do or decide?

2. Don’t fall too in love with your ideas

The whole point of concept testing is to see which ideas are going to work and which aren’t. If you’re too wedded to a particular idea – or too set against another– then you risk heading down the wrong path. Let the consumer voice guide you, and have the courage to let a great idea go. It’s not the last great idea you’re going to have. 

3. Find the right people

It’s important to test concepts on a relevant group of people – those who represent the potential target audience. Kadence International has been running this kind of research for many years, and we’re experts at finding and recruiting participants – even the most  hard-to-reach audiences. Whether you’re looking for a cross-section of your potential audience, a specific subgroup or a handful of super-engaged brand advocates, we can help.

4. Bring it to life

Create stimuli that bring the concept to life in a way that feels tangible and engaging for your consumers.

5. Iterate, iterate, iterate

It can take a few tries to get a concept right, but it’s worth it (remember those stats on how many new products fail?) At Kadence, we have an in-house design team at hand who can bring ideas to life, and then iterate new designs and prototypes at speed, so we can rapidly respond to feedback, make adjustments and test again.

6. Be agile

Concept testing is different for every project, and doesn’t have to follow a rigid path. Expect to revisit and repeat the various steps until you’ve got your concept right. You never know what new ideas, issues and inspiration will come up when you put your ideas in front of consumers. Go with it.

7. Read between the lines

What consumers say out loud is the tip of the iceberg. We also need to think about how they say it, why they say it and what they don’t say. Professional market researchers are trained to see through to what consumers really think and feel – and what that means for what they will buy.

8. See the big picture

Concept testing isn’t just about scores and rankings for metrics like appeal or consideration. Look at concepts in context – think about the emotional response they elicit, what they mean for the direction you’re taking your brand, or how they might overlap with other offerings you already have on the market.

9. Work with a partner with the right processes in place to protect your early stage ideas

One of the most nerve-wracking things about concept testing is putting raw, untested early-stage designs and ideas in front of consumers. What if details end up in the wrong hands? Be sure to work only with trusted partners that have secure procedures and technologies for both online and in-person research. We’ve been doing concept testing research for years at Kadence, so we have stringent processes in place, and our research platforms include built-in security features that allow images to be watermarked, and videos to self-destruct after viewing. In over a decade, we’ve never seen a leak.

10. It’s never over

Once your product is launched and out there for real, you’re bound to learn new things, or want to make changes to adapt to fast-moving markets. Be ready to test out new ideas and keep iterating, so your product can keep getting better and better. 

What is concept testing? Essentially, it’s the process of getting your audience to evaluate or give feedback on an idea before releasing it to the public.

It can be used for adverts, physical products, websites, landing pages, and more. Here are some of the main reasons to use concept testing:

  • It’s a great way to evaluate ideas early on and make tweaks before sending something out to the wider public
  • It helps your team get company buy-in on ideas, justifying decisions by proving they work with empirical data

For these reasons and more, companies draw on the power of concept testing to make sure the ideas they come up with are actually viable in the real world before putting them out.

In this article, we’ll take a deeper dive into concept testing and what it’s all about. We’ll cover how to do it and the steps you’ll need to take.

How Does Concept Testing Work

Concept testing takes different forms depending on what you want to test, but generally, the process involves asking current or target customers e to engage with your concept and then evaluate it – either in person (for instance in a focus group) or online (either in an online community or by completing a survey or questionnaire to evaluate it.)

One of the most popular and effective ways of testing concepts is through an online survey so in this article, we’re going to focus on our top tips for getting this right.

When testing concepts through an online survey we ask questions to determine the appeal of the product, how innovative consumers thought it was, and so on. The goal is to gather feedback and to find out how the typical customer will respond to the concept, along with identifying any areas that need improvement.

So how do you get started?

How To Approach Concept Testing Through An Online Survey

Set a Clear Goal at the Outset

Before beginning, it’s extremely important to set a clear goal for your test. This is crucial because it’s what gives the survey its overall structure and direction.

Ask yourself and your team questions like:

  • Why are you doing this?
  • What kind of action will you take with the results?
  • How does this test fit into your overall strategy?

The answers to these questions will help you select your testing population better, choose the right metrics to track, and conduct a more effective and coherent survey.

Pick the Right Metrics to Track

The metrics you choose to track in your concept test are extremely important. They can make the difference between a useful survey that drives genuine positive change, and one that has very little effect other than to waste resources. Some examples of metrics to track include:

  • Purchase intent (how likely would you be to hit the buy button?)
  • Innovativeness (how innovative is the concept?)

These metrics will form the basis of your questions and shape your survey. Questions should focus on areas such as likes and dislikes, overall appeal, uniqueness, and innovativeness.

Give Your Survey A Clear Structure

Your survey should have a clear and coherent structure. Each section should follow intuitively from the next, with similar questions grouped together. You don’t want participants feeling  confused or frustrated at any point — it should all make sense.

A good way to help this along is by including an introduction section that clearly outlines what the respondent should expect from the survey, , along with instructions on how to complete it.

It’s also important to consider which method you want to use. Here are the main options:

Concept Testing Survey Methods

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

The two main types are monadic design, which uses a single concept, and sequential design, which asks the participants to compare multiple concepts.

Let’s break that down a little further:

  • Single-concept (monadic) design. Here participants analyse one concept, learn the features, and then give their feedback and opinions in a survey. It’s a great way to get in-depth responses around one single concept, but it can be time-consuming and expensive.
  • Multi-concept (sequential) design. In this kind of test, participants do all the above, but then move onto another concept and repeat, and so on. It saves time and money by combining multiple concepts into one session, but there is a risk of participants getting bored and giving lower-quality responses as time goes on. What’s more, responses can be influenced by the order in which concepts are presented, so we make sure to always randomise the order to avoid any bias.

How Long Should a Concept Testing Survey Be?

There are many different opinions on how long your survey should be but our view is that it shouldn’t be any longer than 20 -25 minutes, At this point, respondents can suffer from what’s known as “survey fatigue” and the quality of responses can deteriorate as attention drops For example, SurveyMonkey recommend keeping it under 30 questions. Fewer focused questions can be better than dozens of less relevant ones.

Ultimately, it will depend on your concept, your audience, and the resources you have available.

Ask Screener Questions and Demographic Questions

Screener questions are a way to see if your respondents are relevant to your customer base. They’re usually placed at the beginning of the survey, and the goal is to filter out unqualified participants.

You shouldn’t be too specific here — you don’t want to filter everyone out. For example, let’s say you’re testing an online payment service. The screener question might be, “How often do you shop online?” 

Demographic questions usually come at the end of the survey. They’re a way to find out a little more about the people you’re speaking to and . usually focus on things like age or profession. Collecting information on demographics allows you to ensure that your survey is representative, as well as to analyse responses based on age, gender or socio-economic grade to identify any significant differences. Demographic questions can be considered sensitive, so by putting these at the end of a survey, you avoid people being put off from taking part in the survey from the outset.

Send the Survey Out

Once the survey is ready, it’s time to select a sample of people to test it on. This should be  representative of your overall population you are interested in targeting.

Analysis and Action

The final (and most important) part of the process is to analyze the results of your concept test and take action.

The way you analyze the results depends on how the survey was structured. For example, if your survey used Likert scores (asking participants to answer on a scale of ‘very unlikely’ to ‘very likely’, you can use something called top 2 box scores in your analysis. This allows you to use one metric to compare across concepts or attributes. Remember –  never pick a ‘winner’ unless there’s a statistically significant difference.

When you have your results, it’s time to put them to use. You can use your results to justify a product launch, get buy-in for a concept, or fuel further R&D.

When sharing your results, for example with company management, it’s important to be as clear and detailed as possible. Do all the work for them, and leave them in no doubt about your findings.

Concept testing can be an extremely effective way to get hard data in support of a concept. It helps you and your team make clear-headed, evidence-based decisions and create products that delight your customers and drive the company forward.

To find out how Kadence can help you harness the power of concept testing — and take a more data-driven approach to your organisation in general — reach out to request a proposal.