Kadence Indonesian office has launched an innovative online survey platform called K-OINS (Kadence Online Insight System). With an increasing number of people moving online, there has been a need for a high-quality online survey, and K-OINS is the solution.

The K-OINS Platform can be used free by registering through its website or by downloading the app on Google Play Store. Currently, K-OINS is still under development for iOS users.

K-OINS rewards users for participating in market research surveys on their platform using “Koins,” which can be transferred to the user’s bank account or any preferred e-wallet with a minimum balance of IDR 50,000 free of any administration fee. The incentive doesn’t end here. Every registered K-OINS user also gets a referral code to be shared with new users for more “Koins.”

“With the current digital technology, innovations are carried out by almost all lines of business, and market research is no exception,” Febri Nugraha, Managing Director of Kadence International, said. “While there are many online survey platforms in the market, we continue to focus on providing the best service to our clients through our in-house online survey platform.”

According to Nugraha, K-OINS will allow the Kadence Indonesia market research team to monitor the survey results, support them in providing recommendations to clients, and help them adjust survey results in real-time.

“Additionally, we also complement the K-OINS platform with efficient UI and UX, eye-catching visuals, so that all our users can enjoy K-OINS,” he added.

According to Sebastian Mulia, Quantitative Director of Kadence Indonesia, the company released the K-OINS platform to positively impact the community and help people earn additional income.

“Launched in 2022, we have gone through various processes and research since we first started developing the K-OINS platform in 2019. We have collaborated with third parties, like agencies, to help media placement and boost awareness,” he said.

As the newest entrant in the online survey platform market, K-OINS has already conducted many studies with companies in Indonesia from various industries such as FMCGs, education, finance, automotive, and healthcare.

In the future, K-OINS will continue to innovate in the digital surveys space and will not be limited to online surveys. “Currently, we are doing some development to cover the needs from two perspectives —both from our clients as the party receiving input and the community as the party providing input,” Benediktus Timothy, Senior Manager of Operations, said.

For more information about K-OINS, please check K-OINS Instagram @koins_id or visit the website at https://k-oins.com

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

When launching a new product to market, it’s imperative to be prepared with relevant information. You need a deep understanding of your market, how your products will benefit that market, the potential challenges you might run into, and much more.

This is why it’s so important to write an in-depth, professional, and relevant market research report. Not only to gather and display all the right information but also so that you can share that information clearly and easily with people within and outside your organization. This is important for a wide range of different reasons.

In this article, we’ll look at why market research reports for product launches are so important and show you how to do it as effectively as possible.

Why market research reports are important

Conducting a detailed and relevant market research report before you launch your new product is a good idea for all kinds of reasons. Here are some of the main ones:

  • Get buy-in from senior decision-makers. When launching any product, you’ll always want the full support of the top decision-makers at your organization. This can be a tricky thing to acquire, especially if your team is relatively unproven. A detailed and informative market research report can be the deciding factor in winning their support, convincing them that your product is well-placed to succeed, and making it much easier to achieve your goals.
  • Learn more about your customers and target audience. One of the main reasons to conduct market research is to understand your prospective customers in more detail. The work you do to compile a report will give you a clear and detailed understanding of what your customers want, what they already like, where they conduct their own research, and much more. This will arm you with the insights and knowledge you need to launch your product confidently and successfully.

Discover ideas for new products and how to improve existing ones. When you research your target market, you’ll likely stumble upon inspiration for new products in addition to the one you’re planning to launch. The feedback you get from your research will also be laced with ideas for improving and tweaking existing products

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

How to write a market research report effectively

In the rest of this guide, we’ll show you what you need to do to ensure your market research report is as detailed, relevant, and valuable as it possibly can be. Let’s start with the type of information you need to include.

What you need to include:

Buyer personas

This is a crucial part of getting to know your customers and the different groups they fall into. You should start by researching your target market members as much as possible through a range of channels — interviews, social media research, email surveys, and more. Then, divide them into demographics and create a detailed persona to represent each one.

This is an incredibly valuable step because it allows you to break down your market and make broad predictions about each group’s preferences, pain points, habits, and desires. If done right, this helps you target your future marketing much more accurately and effectively.

Understand your competitors

Getting to know your competitors is a key element of market research. It allows you to understand what you will be up against when launching your product and what segments of your market might be easier or more difficult to sway from their loyalty to your competitors.

Your research report should contain detailed information about each of your competitors and what they offer. What do their products lack that yours can provide? Why do your customers go to them? How dominant are they in your market? What kind of loyalty do they command? What are some of the keys to their success? All this will help you understand what you’re up against and strengthen your chances of success.

Who did you talk to?

Much of your market research will involve talking to various people and groups of people in situations like focus groups, interviews, and surveys. It’s important to document this side of your research carefully and include it in your market research report. Be sure to break down the people you spoke to into demographics and be as specific as possible — try to align this with your buyer personas.

This will help you understand what different demographics want, identify any areas you may have missed, and see any opportunities for segmentation or expansion, as well as providing clear visibility into your research process and allowing you to justify your findings and decisions to other company members carefully.

Clearly show what will happen next — how will you use your findings? 

When you present your market research report to decision-makers in your organization, their primary concern will be what you want to do with it. Research is only valuable if it has a practical application, which should be a key element of your report.

It’s best to be specific — create plans and roadmaps for campaigns, build strategies, and include timelines and carefully researched cost estimates. If you can present a clear and viable plan for your product launch, it will be much easier to gain the support and buy-in of the higher-ups in your company. Be ready to defend and justify these plans.

Primary vs Secondary Market Research

There are two main types of research you’ll need to do when preparing your market research report: primary and secondary. Here is the difference:

  • Primary research. This refers to the first-hand information you have gathered during your research — straight from the primary source. Examples include interviews with individuals, focus groups, surveys, and information from sales teams. It helps add a human touch to your research, incorporating real people’s distinct voices and opinions.
  • Secondary research. This is data that your company didn’t personally collect but is available in the form of things like public records, trend reports, and market statistics. While it lacks the specific human element of primary research, it’s a great way to gain valuable overall insights about your target market without having to conduct huge research projects yourself.

Convincing company decision-makers with your market research report

One of the most essential functions of a market research report is to convince your company’s key stakeholders that you are prepared for a product launch and have everything in place to begin the process successfully.

When creating your report, you should always have this goal in mind. Here are some ways to do that:

  • Always clearly tie your research for business outcomes. For every conclusion your report reaches, explain what this means for the business and what concrete actions you will take as a result.
  • Use as many stats and as much hard data as possible. Clearly express this data in the form of graphs and other visual aids. Show where your data came from, how you collected it, and how your findings will impact your product launch.
  • Consider using Porter’s 5 Forces Model. This business model is aimed at understanding and explaining the fundamental market forces at work in any given industry. It can be illuminating to tie your research into this model.

A well-researched and detailed market research report is an essential part of a successful product launch strategy. It allows you to clearly understand your market, formulate concrete plans and strategies, and gain the support of your organization’s decision-makers.

Without one, you’ll be plunged into the dark, facing the monumentally challenging task of launching a product without the support of extensive research and data.
To find out more about how Kadence can help you prepare a market research report and launch your product with confidence, contact us.

Have you heard the story about Steve Jobs dismissing consumer market research as a tool to shape new products? The driving force behind the Mac, the iPod and the iPhone famously said in a 1985 Playboy interview, “We were the group of people who were going to judge whether it was great or not. We weren’t going to go out and do market research.”

It is, of course, one of the most widely debunked stories in business. Apple does conduct consumer market research – and is, arguably, in its pre-eminent position precisely because it innovates using insights generated by analysing in incredible detail its consumers’ behaviours and the market appetite for its products. (There’s video of a young Jobs extolling the virtues of market research for these purposes – it’s 90 seconds well spent.)

The fact is, most new products are very similar to things people have seen before. For every genre-busting innovation there are tens of thousands of new iterations of existing ideas, tweaks to brands and updates to proven sellers. In most cases, some kind of market research will have shaped the new iteration and how it was conceptualised; helped stand up the business case for it; framed the marketing; and guided its introduction to consumers. So how does market research help businesses design and launch successful new products?

Using market research for product development at each stage of the innovation funnel

There are lots of different ways to describe the innovation process, broadly broken down into three phases: ideas, concepts and creation. It’s not a science with a standard formula, however, but there are some common steps.  For example, some experts recommend breaking the process into 5Cs:

  • Capture intelligence about market gaps and organisational potential.
  • Connect opportunities to capabilities.
  • Convert ideas and available resources into concepts for products.
  • Confirm these products are viable in the market.
  • Conclude by executing a market entry plan for them.

Another way of thinking about it is a series of questions that need to be asked at each stage of the product development process. Market research can help answer them all.

1: What’s the opportunity?

Desk research, analysis of existing customer data and some qualitative investigation can help frame likely areas for innovation. In many cases, an organisation will face an internal problem – overcapacity, falling margins, consumer appetites shifting away from existing products – that also frame the need for new products. The output here is an extrapolation of big trends to identify emerging needs, changing behaviours and whitespace for innovation.

2: What ideas might thrive there?

In some organisations, internal R&D will have a ready supply of potential innovations that might be applied to the opportunity. More likely, R&D and marketing teams will benefit from a brief developed from the ‘opportunity’ phase to direct R&D in more concrete areas. This process might include brainstorming inside the organisation or more formal ideation sessions with an external research agency. At this point surveys can be harnessed to give more shape to the ideation process. In the search for an iterative new product (rather than a genuine technological innovation) there might be 30 broad ideas that can be tested in quantitative surveys to thin down the field.

3: What concepts deliver on those ideas?

In the next stage, focus groups and market analysis can clarify which concepts ought to progress further by exploring the strengths and weaknesses of each idea. This is also where the innovation and R&D efforts of the business are properly moulded around consumer and market insights – and some iteration takes place to align the two. Note that research here isn’t just among consumers in the core market. Channel partners, consumers and suppliers in adjacent industries are all valuable sources of insight and inspiration. For example, when Kadence worked with an airline to develop new first and business class seats, we looked to bedding experts, audiophiles and high-end restaurant maîtres d’hôtel to shape the concepts.

4: How might those concepts perform in the market?

By this point, an organisation should have narrowed its ideas down to a small number of solid concepts. At this stage, a large-scale quantitative survey can be used to identify the concept with most potential to take forward, as well as the size of the potential customer base.

5: What’s the investment case for launch?

The insights gained from market and concept testing will allow numbers to be attached to the product at this point. What might revenues be? What’s the cost to produce the product or service? With research around pricing, what’s the margin likely to be? Does this justify retooling a factory or investment in marketing? This is the “go/no go” point for a new product.

6: What should the final product look like?

Using the research on market potential and consumer attitudes to the new idea, a business can shape decisions on final feature set, ancillary products or services (again, both quant and qual market research will illustrate the need or potential for these), packaging, marketing and pricing.

7: How do we get it out to market?

Research can also highlight optimum product launch strategies, including distribution, adverting and partnerships to make the most of both existing markets and potential follow-ons – whether that’s mass-market adoption for a product designed initially for a niche or early adopters; new demographic segments; or launch into different international markets.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

The known unknowns for new products

There are broadly two types of business keen to answer these questions. First there’s the radical innovators, the people who come up with brand new ideas and product concepts and want to understand whether they stand a chance in the market. This group are interested in ‘unknown unknowns’, the broader trends in consumer behaviour that might hint at acceptance of a brand new idea. We’ll come on to these Steve Jobs types later.

The second, much larger, group understands the innovation funnel in more detail and seeks data to optimise a pipeline of new products. They are interested in ‘known unknowns’ and using the answers to justify, shape and execute a launch.

For this group, the challenge is modelling the potential performance of a new product against a number of variables already visible in the market. These organisations often have a sophisticated process in place to test new ideas and are keen to benchmark any new product in order to validate investment. They will have an algorithm for product development. The more variables they can pin down using market research, the higher the confidence in making those investments.

‘Benchmarking’ in this case might be looking at the performance of products within the target market; or evaluating consumer attitudes to particular features or benefits. This makes it a largely quantitative methodology.

This kind of quantitative approach is often applied with good reason. Standardised questionnaires and clear, consistent methodologies can help ensure that the market research process is more reliable and easier to interpret. And for many larger organisations with a wide portfolio of potential innovations, a fixed investment budget and the need for reliable returns, this rigour can be highly valuable.

But beyond simply looking at the “go / no go” result, it’s important to dig into the reasons why products didn’t pass this hurdle. This can provide valuable insights to inform future development.

Competitor analysis can also reveal opportunities for developing successful product iterations. Research might include:

  • Rivals’ marketing strategies – what’s their targeting and messaging; what are they missing?
  • Customer satisfaction with competitor products– where are there discontents that might be satisfied by your product?
  • Other gaps in the market – such as different price points or localised versions for international consumers.
  • Other competitor strengths and weaknesses – consider brand halo effects or financial status.
  • Early-adopter behaviours – in similar markets or using new technologies that might be adapted to your own target markets.

A word of warning – New Coke and the importance of taking the right approach to market research for new product development

But it’s not always done right. There’s no shortage of case studies of new product launches that didn’t go well. And often that’s not because an organisation didn’t do any market research. It’s because they didn’t use it deftly enough.

New Coke is a great example. Coca Cola is an innovative business and wields one of the greatest brands in history. In the 1980s, management decided to rebuild its dominant position with a new formula. Clearly this was a huge decision, and as a market research powerhouse, it took no risks. It spent $4m on development and conducted over 200,000 taste tests across the US to research how consumers would score the new flavour against rival Pepsi. And based on those tests, New Coke was going to be a hit.

But management made a series of errors. In a classic case of confirmation bias, they tended to put more weight behind positive views expressed in focus groups, ignoring those who warned a change would turn them off the brand. They discounted emotional feedback on their brand. And they over-focused on differentiation with Pepsi, which had long marketed itself as the sweeter product.

One big mistake was conducting sip tests instead of researching how consumers would feel drinking a whole can of the sweeter formulation. But narrowing down their research focus – ignoring the context for consumption – they ended up launching a product that turned consumers off the brand altogether.

The error, then, was not failure to conduct market research. It was failure to treat research objectively and apply appropriate methodologies. Management sought justification for their decision – not confidence that it was the right one.

The impact of market research on new product development – giving you the confidence to guide a product launch

The key word here is ‘confidence’. Even iterating an existing product entails risks. Using market research for product development helps reveal and manage that risk – and allows decision-makers to test rigorously against hypotheses for new products, rather than head off down potentially blind alleys.

Note that qualitative research plays a crucial role in helping product developers fine-tune their approach and create innovations more suited to particular audiences. And as the New Coke example shows, qual research can capture the emotional components of product change much better than quantitative analysis might. Every new product launch is a balance between gains and losses for the consumer and understanding that balance is vital.

When it comes to qualitative research, organisations shouldn’t just ask themselves whether to conduct it, but how to conduct it. Whilst central location testing for instance, allows you to ensure the product is experienced in a consistent way during the testing process  pandemic lockdowns have obviously accelerated this shift towards at-home testing. New technologies are helping. Augmented reality (AR), for example, is an ideal way to help consumers visualise new products even at the concept stage. Using their mobile phones, they can ‘see’ products in their own home or a work setting, providing valuable depth to qualitative studies at even earlier stages. This is something we’ve piloted with Asahi to test their London Pride packaging and are seeing a number of benefits, such as respondents using AR organically noticing and commenting on small visual details that aren’t picked up by other respondents assessing a 2D concept.

Using market research to guide blue-sky thinking

So we can test against quantitative benchmarks to validate new product development. And we have qualitative studies to test emotional reaction to new products and shape their evolution in ways that will make them more successful. There’s also a third way of using market research for product development: coming up with new ideas in the first place.

This is often called ‘ideation’ and it’s an area where market research has played a key role since the birth of the industry – regardless of what Steve Jobs said. He was right that consumers are typically quite poor at predicting what might define or satisfy meet their own future needs. But understanding how R&D and human appetites come together is core to the market research offering.

Take a dairy business, as an example, that’s facing a slow decline in consumption. One solution would be to increase the appeal of organic products. How might they craft a brief to their own product development team?

Working with Kadence, the company use a structured approach to frame where this innovation might gain some traction in the market. Using proven research techniques, they also explored possible options for further innovation. These can be tweaked and repositioned using further research.

This approach can be further optimised if like us, the research agency has an in-house creative team that can quickly visualise concepts based on consumer feedback. We worked with a global beverage brands wanting to relaunch its range to make this happen. Based on focus groups, we were able to redesign the packaging in a matter of hours in a way that capitalised on insights from the research.  

One other process to consider: the ideation sprint. Rather than gradually piecing together some R&D, market analysis and internal feedback before gradually building out a new product for consumer testing, this involves getting all the stakeholders into a project group together to develop new ideas within a short timeframe.

Kadence has conducted these sprints with food manufacturers – where that combination of chefs, technicians, marketing experts, salespeople and researchers working in concentrated bursts over a couple of days can see a menu of ideas created,  tested with consumers and refined incredibly quickly. And because these sprints are cross-departmental, buy-in for the new product internally is much greater.

Concluding thoughts

Product development is risky even when you’re not launching a category-busting innovation or changing the world. New flavours, revived branding, tweaked feature-sets or version updates can upset existing product performance or result in costly investment in ideas that might not fly.

Far from stifling product development, market research can deliver reassurance and confidence at every stage, helping inform the choice of new products to pursue, their key attributes, how they might be marketed and what contribution they make to a business operationally and financially.

This is an area where Kadence has extensive expertise. Find out more about our product development research services or get in touch with us to discuss a brief.

As internet penetration has increased across the world, online market research has seen rapid growth. The COVID-19 pandemic acted as a catalyst for further adoption as restrictions on face-to-face contact meant that businesses had to embrace new research approaches. The result? Many companies experiencing the advantages of online research for the first time. What’s more, the widespread adoption of tech during the pandemic – particularly amongst audiences that were traditionally easier to reach offline – means that online market research is a now a viable way of engaging more people than ever before.

In this guide we’ll:

  • Explore the key advantages and disadvantages of online market research
  • Explain the different methodologies available to you and when to use them
  • Share our top tips for setting your project up for success, moderation and analysis

What is online market research?

As the name suggests, online market research is a type of market research where data collection takes place on the internet. In this way it differs from more traditional forms of market research where data collection takes places offline (either in person or over the phone) such as focus groups or telephone interviews.

What are the main advantages and disadvantages of online market research?

Advantages of online market research include being faster and in some cases, cheaper to conduct than face-to-face market research, meaning that you can obtain results more quickly. One of the major disadvantages of online market research is that it relies on the people you’re trying to reach having access to the internet and as such it may not be suitable for all audiences. Some online qualitative methodologies also require a degree of tech savviness, and a longer time commitment than offline approaches.

Beyond this:

  • Online market research is particularly useful for global projects. If you’re looking to enter a new market and don’t have boots on the ground, online market research can help you build your understanding without having to fork out for flights and focus groups. It’s also well suited to multi-market research as you can conduct research in a number of countries in parallel to identify common trends.
  • Online research can help you get closer to customers and bring them to life for stakeholders. In a focus group or a face to face interview, you only have a short amount of time to get to know respondents. In contrast, some forms of online qualitative research take place over a series of days, weeks or even months. This allows us to dig deeper and build a richer understanding of customers and their needs than we might offline. Some methodologies even allow you to set photo and videos tasks. These result in rich multimedia outputs can be used to bring customers to life for stakeholders.
  • Online techniques allow for a more iterative approach to research. The longitudinal nature of some online qualitative methodologies means that it’s possible to adapt your discussion guide as the research progresses to capitalise on emerging insights. This is particularly effective for product development research. For example, in an online community, you can share initial concepts with consumers, iteratively improve them based on feedback and then put them back into the community for further testing. This approach allows you to build and refine the concepts as the research progresses.
  • Online market research can be good for sensitive topics. Many online methodologies offer a greater degree of anonymity than face to face research. As such, they can be better suited to discussing difficult subjects such as illness or sex.

What type of business questions can online market research help me answer?

Online market research is extremely versatile and can be harnessed to explore a broad range of challenges, including:

What are the main methodologies used in online market research and when should I use them?

There are a number of different research tools you can use to collect data online. They include:

Online surveys

An online survey is the primary method for collecting quantitative data online. Online surveys can be completed by your customers or respondents can be sourced from an online panel (a group of people that have agreed to take part in online research). If you opt for this route you can build a representative sample and extrapolate your findings to the wider population.

When to use an online survey

  • To understand trends and patterns of behaviour e.g. buying habits
  • To understand attitudes towards your brand versus the competition 
  • To compare different groups (e.g. by age, gender or market) to understand similarities or differences
  • To track metrics over time e.g. brand awareness, customer satisfaction

When to avoid an online survey

  • Projects where you need to qualitatively explore an issue with consumers to understand motivations and the “why” behind behaviours
  • Projects where you need to co-create with consumers to iteratively improve an idea

Top tips

  • It can be tempting to pack your survey full of questions but you need to be mindful of time. An online survey should take a maximum of 15 – 20 minutes to complete. Any longer than this and you risk seeing respondent fatigue or a significant proportion of people dropping off before the end. This will mean that fieldwork will take longer to complete.
  • Mix up the type of questions you use to keep the survey engaging for respondents

Online communities

Online communities are a qualitative technique for exploring a topic over a number of days, weeks or even months. Pre-screened respondents are invited to a secure online platform where they take part in a number of activities each day. This can involve discussing topics in groups, one on one or taking part in video, photo or audio tasks.

When to use an online community

  • To deepen understanding of a target audience
  • To explore content preferences and consumption
  • To test audience attitude and brand perceptions
  • To test new ideas with consumers – this can be anything from products and services to packaging or new marketing concepts. Online communities are particularly well suited to this. Many platforms enable consumers to mark-up concepts so you can gather in-depth feedback whilst also protecting the confidential nature of the stimulus, through functionality such watermarking or setting videos to self-destruct once they’ve been watched.  

When to avoid an online community

  • When you need to explore a topic with consumers on an individual level

Top tips

  • Do your research on the types of platforms available. Each offer different functionality so go back to your objectives to ensure you’re selecting most suitable for your project and what you want to achieve.

Digital depths

A digital depth is essentially an audio or video interview which takes places online. These tend to last about 30 – 90 minutes. A typical programme might involve 15 – 20 interviews per market, although this can vary based on your business objectives.

When to use a digital depth

  • To explore in-home brand or product usage or explore attitudes towards particular brands or products
  • To gain B2B market insights

When to avoid a digital depth

  • Projects where you require respondents to share and bounce ideas off each other
  • Projects that require large sample sizes as running 100s or 1000s of depths online or offline is just not feasible

Tops tips

  • One of the challenges levelled against online research is that it can be harder to build rapport online. To overcome this, consider pre-tasks that allow you to get to know the respondent beforehand and help them feel comfortable. This can be anything from asking them to complete a short diary task to some quickfire WhatsApp questions before you get started.
  • Be aware of market differences. In markets that have traditionally favoured face to face methods, using video as part of a digital depth is a must for engendering trust.  

Digital ethnographies

The objective of a digital ethnography is to view a consumer’s life as it happens. Ethnography emerged as an offline discipline, but developments in technology mean that it is now possible to conduct ethnography online. From 360 cameras to smart home technology right through to the humble old smartphone, there are a number of tools you can use. And in some cases, these new approaches can uncover insights that you just would not gather when there’s a researcher in the room.

When to use digital ethnographies

  • To explore in-home brand or product usage or to explore attitudes towards particular brands or products
  • To identify unmet needs
  • To understand cultural differences between markets

When not to use digital ethnographies

  • Projects where you need respondents to bounce ideas off one another

Top tips

  • Not everyone will be suited to take part in digital ethnography. You need respondents who are open and willing to let you into their lives. One way of doing this is to include a casting phase as part of the project to identify the right people to participate.

Online focus groups

An online focus group is where a group of pre-screened respondents are invited to join a private online platform for a few hours. Like an in-person focus group, a moderator will guide the discussion, which can be either text or video based.

When to use an online focus group

  • To test attitudes and responses to concepts and ideas at a high level
  • To sense check ideas quickly with consumers

When not to use an online focus group

  • To obtain detailed inputs from respondents at a one-to-one level

Top tips

  • If you are used to running focus groups in person, don’t automatically assume that online focus groups are the next best thing. Depending on what you’re trying to achieve, another methodology may better meet your objectives.
  • If you’re running a video based online focus group make sure that you’re able to see all of the participants at once. This will help in interpreting non-verbal cues and bringing people into the conversation.

Questions to ask yourself when designing your online research approach

As you can see, there are a number of different online methodologies available to use, each with their own distinct use cases, benefits and drawbacks. To help you design the best research approach, we’d recommend asking yourself 5 key questions:

  1. What am I trying to achieve? Some clients come to us dead set on using a particular methodology. We’d advise against this. By starting with your business objectives and then considering which methodology best allows you to meet these, you’ll be in a much stronger position to design an effective research approach.
  2. Do I need to collect quantitative or qualitative data? If you’re looking to conduct research at scale, you’ll need to opt for an online survey whereas if you want to explore a topic qualitatively, there are a number of different options available.
  3. What depth of insight do I require? Are you sense checking an idea or do you need to explore needs in real detail? This will have implications for the methodology you choose.
  4. Do I need to speak to consumers one-on-one or in a group? Different methodologies and platforms facilitate a different type of engagement with respondents. Think carefully about which you require up front.
  5. Which markets am I exploring? Not every methodology will work in every market. There are cultural factors and connectivity issues you’ll need to consider. For instance, if you’re conducting research in India outside metros or tier 1 cities, you’ll need to make sure your approach is mobile optimised but doesn’t require too much bandwidth. Or if looking to test concepts in China, you’ll need to do so in a one-on-one setting due to the Chinese habit to moderate answers and avoid causing offence in group environments. Our guide to conducting online research in Asia, can help you consider the best approach to take in each market. Remember, if you’re running a multi-market project, you don’t need to use the same methodology in every country. Harnessing an approach that will ensure you can answer your business objectives is more important than consistency of approach.
Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

Setting your online research study up for success

So you’ve decided on the best methodology for your study. The next step is to get into the nitty gritty of setting up the project. Here there are a number of key things to consider.

  • Simplicity. When you’re writing your questionnaire or discussion guide, focus on making it as easy as possible to understand. Cut out the jargon to ensure a consistent understanding amongst respondents.
  • Flexibility. For online qualitative projects, it’s worth building in an element of flexibility into your discussion guide. This will allow you to delve into emerging insights during the course of the research.  
  • Cultural nuances. We talked about the importance of culture when selecting your methodology. It’s crucial to bear this in mind throughout the entire research project. When you’re writing a questionnaire, preparing a discussion guide or designing specific tasks, consider how cultural differences might affect participants’ responses. For instance, in Japan people tend to avoid giving negative feedback so you use a traditional 5 point Likert scale here you’ll find that most people will answer somewhere in the middle, making it hard to ascertain the trend. To get a clearer go / no-go result, you’ll want to consider a 4 point scale in this market.
  • Testing and training. Some online qualitative research approaches rely on external technology platforms. Make sure you build in a comprehensive testing phase to ensure these work across different browsers and in different markets, particularly if you’re using a tool for the first time. You should also consider preparing training materials for respondents. What might seem intuitive to us as researchers, may be not be as straight forward for the person taking part in the research.

How to moderate online research

Moderation is arguably even more important online than it is offline. So what should you bear in mind?

  1. Don’t forget the basics. Just because the research is taking place online doesn’t mean that you can forget everything you’ve learnt about great moderation. Dress appropriately and try and mimic face-to-face interactions – even something as simple as waving hello at the start of an interview can help to build rapport and set someone at ease.
  2. Read the (virtual) room. Sometimes what people choose not to say can be as revealing as what they do.
  3. Do your homework. Earlier in this guide, we mentioned the value that pre-tasks can bring. Even a short WhatsApp exchange can be useful in helping you to understand more about a respondent and how they feel about certain topics so you can get the most out of them in the session.
  4. Curate the conversation. Unlike a focus group or an interview which might only last 90 minutes, online communities take place over a longer period and therefore require ongoing moderation. Moderators should think about how they curate the conversation by connecting individual respondents up to foster group discussion.
  5. Conduct research in the local language. If you’re running a project in another country, use local language moderators who’ll be able to understand and draw out local nuances.

Analysing online research projects

Online market research is often considered to deliver more bang for your buck than a face-to-face approach because of the sheer amount of data you can collect. This is particularly true of online communities due to their longitudinal nature. As such, you need to carefully structure your analysis, ensuring you’re focusing on the ‘so what’ for your stakeholders.

There are also cultural considerations to take into account when it comes to analysis. You’ll need to bear in mind that consumers in different markets can answer questions differently when you’re interpreting the data. For instance, when asking about interest levels or purchase intent, the figures you see in ASEAN developing countries tend to be higher than in other markets. Even within markets, there can be regional differences to take account of. In Vietnam, for instance, there are cultural differences between consumers in the two major cities – Hanoi in the North and Ho Chi Minh in the South. Those in the North tend to favour products from well-known brands, while those in the South are more open to trying new things, and this is reflected in the data you see from these areas.

Considering harnessing online research in your own organisation?

This is where we’re in our element. Find out about some of our online methodologies like online surveys or online communities or get in touch to discuss a project.

The polls have failed again. The result of the 2020 US Presidential election has not even been confirmed, and there are various news sources claiming that the polling companies have got it all wrong, again. Polls predicted that Biden would win various states comfortably. They either picked the wrong winner, or the race was far, far closer than the polls suggested. It was not supposed to be like this. After the 2016 disasters of Brexit and Trump winning defied the predictions from polling companies – there was supposed to be change – more accuracy in how data is collected and norms calculated.

Political polling is perhaps one of the more visible uses of market research for the average consumer. Polling is a subset of market research and there is a danger that market research as an industry receives negative association from yet another public failing. The Atlantic has published an interesting piece on the ‘disaster’ of the polls and highlights 2 potential arguments to the polls results – that is also the argument for market research as a whole:

“First, many pollsters insist that their polls are snapshots, not predictors. If their snapshots are so far off, though, where were they aiming the lens? Why bother?”

“Second, the analysts will protest that they’re only as good as the polls, but who cares? Whatever the instructions on the bottle, the public uses opinion polls to try to understand what happens. If the polls and their analysts don’t offer the service that customers are seeking, they’re doomed.”

This is similar to the argument that I have heard a few times from senior stakeholders in large companies. “Steve Jobs didn’t use research, why do we need a research company”?

Market research is critical in the uncertain world we live in now. And the mistake that people are making when commenting on the accuracy of the polls, is the same mistake that people make in business. The expectation that there is one data point or one piece of research that will predict the future.

Looking back at the polls, whether a particular result has 51% Biden, or 49%, is not as important as understanding that there is a clear divide. Digging down to uncover the reason for the divide and looking for ideas as to how to change perceptions is what should be most meaningful for anyone looking to illicit change.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

Whilst commenting on the Brexit result (and the failure of the polls) in 2016, I commented that research should be used for Inspiration, Measurement or Predictions – but not by asking for a single score! Instead, market research should be looked at the same way that you have a golf coach, or a piano tutor. You are looking to improve your skills over a period of time, by having someone provide you with the ideas and confidence to get better. Market research, at its best, draws upon multiple sources. Some primary, some secondary, some direct, some passive. What you need is the understanding of what is going on – not just a snapshot.

In the corporate world, marketing has traditionally been the function that ‘owns’ the researchers. How well CMOs can ensure their products and services are relevant to their customer justifies the work they are doing.  The future of market research needs to look more holistically. Marketeers should look to understand trends that are happening. This could mean getting insights from other industries or other markets. Market research is an ever changing, but every relevant industry. Right now, marketeers and decision makers can look at mobile applications, AI analyzed digital diaries, big data and text analytics to get an insight into consumer needs and habits. Understanding consumers has never had as many possibilities as it does today. The skill of the researcher, and the goal of any research agency is to bring together the best people, with the best tools, to advance an idea or to provide confidence.

Understanding the underlying situation is critical for decision makers to be able to create a program of change. Whoever wins the US election, the hope is that they understand the patterns and the needs of the nation to create change. For the market research industry – the focus must be on showcasing the story of change – and encouraging all to follow.

So you have a number of exciting concept ideas but you’re not sure which to take into further development? This is where conducting online concept testing comes in.

Online concept testing is the process of evaluating product ideas with consumers prior to their introduction to the market. It can include both quantitative and qualitative research, via surveys and online communities, for instance.

It’s a great way to bring consumer insights to the heart of the new product development process. These insights can help you understand which products or services will be a hit with your target audience. In this way, a concept test can dramatically reduce the risk of a product failing when it hits the market, helping to ensure a successful product launch.

Online concept testing can also point to areas of your concept that need tweaking, or new features which could be added. It can also help you answer questions such as whether the price is right and how where your idea fits in relation to competitor offerings and the perception of your brand as a whole.

But there is no one-size-fits-all approach, rather a range of methods that can be combined and tailored to meet the demands of each project. 

What online approaches can you use for concept testing?

You can take either a quantitative or qualitative approach to concept testing – or combine both. 

The main quantitative technique is an online concept test survey. Through online surveys, you can reach thousands of targeted and engaged respondents, providing rich and robust data that can be analysed. In the survey, the concept test would involve consumers reviewing a text description or a visual representation of the concept. Then, the audience would be prompted to answer questions or to discuss their impressions of your idea. 

Single-concepts can be tested through monadic survey design, whilst multiple concepts can be evaluated using sequential design (read more about this in our post on what concept testing is and why it’s important). Once we have ascertained the level of interest or purchase intent data for each concept, these can be plotted on a chart to show which spurred the most promising response. We can also unpick the relative effect of different attributes such as price or features, with the help of a well-designed survey template, advanced statistical techniques. 

When it comes to qualitative techniques, you can either run an online community – a carefully curated space to engage respondents in a group setting, as well as one to one tasks – or run a series of in depth interviews over video chat, in which you have the ability to share concepts on the screen.

What’s the advantage of online?

Online surveys enable you to reach a representative sample to gather robust data quickly and efficiently. 

Online qualitative approaches, like online communities can deliver more detailed feedback than you might get in person. The sheer quantity of comments in an online community is vast – providing a real depth of insight. 

An added benefit of qualitative online testing methods is that they can enable you to test ideas in multiple markets at the same time, so you can identify and explore common themes, rather than having to run focus groups over a number of weeks to get feedback in each market.

Online concept testing best practice

Objectives first, methodology second

Try to avoid embarking on the research with a set methodology in mind. Instead take a step back and think about your objectives and where you are in the product development process. This will help you choose the right approach. 

Ask yourself whether you require high-level responses to multiple concepts, or detailed feedback on one, in particular? Do you need qualitative inspiration or quantitative rankings?

Also think about how far along the development process you are. If you have a prototype of your concept that respondents can interact with it may be that an offline approach like a focus group could be more appropriate, whereas if your concepts are at an earlier stage, an online approach could be more valuable.

We tend to use a combination of testing methods to build up a picture of how products or services could fit into the lives of those you hope will use them – and we’ll tailor the methods based on the project. Often, we’ll work with clients to quantitatively test initial concepts to understand those with most appeal to the target market. This is often followed by an online community in which consumers help you hone your ideas further.

That said, it’s always critical to build a tailored approach depending on what you’re trying to achieve and who you’re trying to reach. For instance, if you’re looking to get feedback on new concepts from hard-to-reach, or B2B audiences, a digital in-depth interview could be appropriate.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

Choose the right tools

Many online community platforms are specifically built with concept testing in mind and have tools that allow respondents to mark up elements of a concept that they like or dislike, along with a justification. 

But always ensure the agency you work with has the right security protocols in place to protect early stage ideas. The platforms we use include a number of built-in security features. Images can be watermarked with a unique respondent identifier and, if you’re testing ads, we can set videos to self-destruct after they’ve been watched once. On top of this, we use all the confidentiality procedures we would for concept testing in-person. With such stringent processes in place, we’ve never experienced a leak. With us, your ideas are in safe hands.

Moderation, moderation, moderation

When you’re testing concepts in an online community, it’s important that conversation is carefully guided just as it would be in an offline focus group. Skilled market researchers know how to curate the conversation in an online setting, finding links between people and encouraging them to open up and feedback comprehensively on ideas.

Through a combination of effective moderation, probing and carefully structured analysis, we can identify the overall themes and elicit the information you need to move forwards in the product development process.

Bring ideas to life for consumers

To get the most out of respondents, it’s also important that you bring concepts to life by creating stimuli that enable the target market to picture your proposed products or services. Often, the early-stage concepts we receive from clients are only roughly sketched out. 

It might be a selection of words on a Post-It note, or a collage of images found online. We work with our in-house designers and copywriters to build on this, fleshing out concepts and designing mock-ups and prototypes to make sure that your initial ideas can be easily understood by consumers. After all, it’s much easier to feed back on an idea you can properly visualise.

We use prototypes to bring ideas to life for consumers in face-to-face focus groups but one of the benefits of qualitative online concept testing methods, like online communities, is that these mockups can be amended based on consumer feedback and then fed back into an online community for further comment. This allows us to iteratively improve the concepts over time to build on and strengthen initial ideas.  

At Kadence, we’re taking this principle a step further by exploring how we can use augmented reality (AR) to further bring concepts to life, thereby eliciting higher quality insights. Through AR we can create 3D digital prototypes that consumers can place in real environments using their phone – in their home, in a supermarket, wherever they happen to be. Not only do immersive methods like this deliver richer, higher quality insights, but they allow you to test concepts in context, thereby overcoming some of the challenges of face-to-face approaches.

Finally, it might sound obvious but it’s also important to ensure that your concepts are ready to be tested. It’s better to delay an online focus group if your concept is not yet fully developed, nor its purpose clear. If your ideas are easily understandable, can be brought to life and readily understood, your participants will be able to provide more comprehensive feedback.

Rigorous research shows you whether you’re really on to something. It puts everyone’s ideas on a level playing field and can help companies navigate internal politics to find a path ahead. After all, it’s your customers who will decide which idea is a success.

In this way, market research can dramatically increase the chances of developing a product concept successfully. Ultimately, testing is the process that enables you to proceed with confidence, and what can be better than that? We’d love to support your organisation with concept testing research. To discuss the best way to test your new ideas – be that online or offline –  please request a proposal. 

Every marketer knows the stat: 80% of new products fail. Or 90%. Or 95%. The precise number differs, but the story is always the same. 

By anyone’s standards, those are daunting odds for businesses that want to innovate and stay ahead of the curve. How can companies buck the trend and increase their success rate? How can you make sure your product is part of the 20% (or 10% or 5%?)

Clearly, it’s vital that any new product or service has to be just right. The question is, what does just right look like? And unfortunately, the answer to that question is not up to you. 

It’s up to your customers.

That means it’s important to find out at an early stage whether or not your concept is going to attract customers to buy or not, and if so, how you can make the most of it.

This is where concept testing comes in.

What is concept testing?

Concept testing is how businesses evaluate and optimise ideas before taking them to market.

The concept in question can be a lot of different things. It might be a totally new breed of product that no one has ever seen before. Or it might be a redesign or rebrand. 

Business questions that concept testing can address include:

  • Does the concept meet customers’ needs? Do they ‘get’ it? Do they find it appealing? Does it give them something they want?
  • Is the price right? What are consumers willing to pay? Is the product commercially viable?
  • How should it be positioned? Where does your idea fit in relation to competitors? Does it suit your brand? What’s your natural place in the market?
  • What details need to be tweaked? How can your concept get better? Is everything working right? Are any features missing?

Concept testing is not a single one-size-fits-all technique, but a whole range of methods that can be combined and tailored to fit the demands of each individual project. 

Why concept testing matters

There’s no avoiding it: conducting proper concept testing requires an investment of time and money. But that’s nothing compared to the potential cost of not testing concepts early on in the development process.

Failed products or services cost businesses not just in terms of wasted investment, but in the opportunity cost of what could have been achieved instead. The same goes for a bad ad or a bad logo design.

In fact, in the worst cases, businesses can suffer reputational damage or harm to the value of their brands by launching a product concept that wasn’t right for the market. Marketing history is littered with examples of products and ads that were wide of the mark. 

In 1985 Coca-Cola famously introduced New Coke – its answer to blind taste tests where rival Pepsi came out top. But the success of brands and products is about more than blind tests, and New Coke flopped. Decades later, it’s still remembered as a major marketing misstep.

Remember Juicero? No? Not many people do. Investors pumped $120 million into the $400 Wi-Fi-connected juice maker in 2016 – even though users could get the same effect by just squeezing the juice pouches by hand. Consumers saw through it, and within two years Juicero had been scrapped.

In 2005 ESPN launched an innovative mobile phone service that incorporated its exclusive sports content. But the price was all wrong, and the lack of handset choices also put people off.

Concept testing reduces the risk of costly failures like these, and increases the chances of hitting on a runaway success.

Ultimately, it’s about proceeding with confidence.

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

9 Use cases for concept testing

1. Check whether your ideas will really fly 

Just because an idea feels right to you (or your boss, or your friends, or your mum) doesn’t mean it’s commercially viable. Rigorous concept testing research shows you whether you’re really on to something or not, so you can put a rocket under the ideas that have potential, and not waste time on the ones that don’t.

2. Settle arguments and objectively evaluate ideas

Everyone’s got an opinion, right? Great concept testing can cut through corporate politics, putting everyone’s ideas on a level playing field. It busts groupthink and unites teams behind ideas that have a real chance.

3. Compare rival concepts

Pit your ideas against each other and find out what consumers prefer. Once you’ve narrowed down your choice, you can focus on the ones that performed well.

4. Define your list of features and benefits

Particular capabilities and attributes can have a make-or-break effect on the success of a product. Find out which things consumers really care about (and which ones they can do without)

5. Figure out how to make it profitable

Knowing how to manage your costs and prioritise the investments consumers care about is crucial to success.

6. Improve concepts iteratively

Hone and tweak your concept in response to consumer feedback, then test again. Research might even throw up brand new ideas which you can develop and test.

7. Determine who to target

Concept testing can give you clear pointers as to which demographic groups, geographies or market segments will get as excited about your idea as you are.

8. Decide your communication approach

Setting the right tone and getting the key points across is not something that should be based on guesswork. Try your ideas out in the wild and get valuable feedback.

9. Refine after launch

To hone your offering, and keep it ahead of the competition, testing can continue post-launch. 

Does concept testing really work?

Some in the business world feel that intuition and inspiration ought to be enough to develop great products. True innovation, they claim, comes from maverick geniuses like Henry Ford, who supposedly said that if he’d asked customers what they wanted, they would have said “faster horses”.

The thing is, Ford was right. And that’s why at Kadence International, concept testing is about much, much more than just asking people what they want. 

Good concept testing doesn’t have to mean missing out on ground-breaking innovation or settling for mediocre ideas. It means getting under the skin of your customer and letting their feelings and needs inspire solutions with the most potential.

Sure, asking people what they want or what concept they prefer is part of the story – but only part of it. You also need to tap into the psychology and emotions that drive real world consumer behaviour, and put it all in the context of the trade-offs that consumers make regarding prices, benefits, and competitive offerings.

Concept testing the Kadence way

Concept testing is one of Kadence International’s many market research specialisms. We’ve got many years’ experience of testing concepts in numerous categories, and driving the creation of successful products and services.

Toiletries

What fragrances of shower gel would appeal to young teenagers, and what kind of imagery and language could bring them to life in a way that feels fresh and different?

We conducted research in two iterative stages. First, we ran an online survey among the target demographic to screen a set of early-stage concepts and identify the ones with the greatest appeal. The winning concepts were then explored and further refined in face-to-face focus groups, with an element of co-creation, providing the client with a robust set of high-quality concepts to develop.

Takeaway coffee

A major food and drink brand wanted to know what kinds of iced drinks could prove a hit with customers over the summer.

We ran a creative workshop with the client’s product development and research teams, to develop a series of new concepts and then visualise these with the help of our design team.  We then screened these in an online quantitative test. This allowed us to isolate the most popular concepts and acceptable price ranges. We followed up with focus groups to refine and enhance the most appealing concepts, giving the client a set of strong, worked up concepts to take into development.

Travel advertising

What kinds of imagery, messaging and language would be most effective in ads aimed at grabbing the attention of high-value travellers and attracting them to a holiday destination?

We ran an online quantitative test to evaluate a series of creative routes, looking at a number of different metrics. We began by measuring a baseline level of interest in visiting the destination, so we could identify the option that gave the greatest uplift in interest. The client was then able to create an ad campaign with the confidence that it would have the impact they wanted.

Food

A major food manufacturer wanted to gauge interest among its B2B customers in purchasing via a direct-to-customer (D2C) model, instead of through wholesalers.

We conducted a series of qualitative depth interviews looking at a set of concepts for potential D2C models. This helped the client establish which options resonated, and how they could be further enhanced.

Research methods for concept testing

At Kadence we employ a wide range of concept testing methods, including qualitative, quantitative, and combinations of both. Every project is different, and we always work with the client to come up with the right blend of techniques. 

We always begin by carefully considering what the client really needs. What do they already know, and what stage are their concepts at right now? Do they require high-level responses to a selection of concepts, or detailed feedback on one in particular? Do we need qualitative inspiration or quantitative rankings? It’s questions like these that guide our choice of methods.

Surveys

Online concept test surveys are a powerful tool. They can reach thousands of carefully targeted and engaged consumers, providing rich data that can be statistically analysed, ranked and compared. Online surveys can present choices in a way that mimics real purchase decisions, and use statistical techniques to unpick the relative effect of different attributes such as features and price. Our market research experts design the structure, hone the questions, identify the right respondents and analyse the results to pull out the key insights.

Focus groups

Focus groups – are a tried and tested way of getting rich qualitative input. We bring a small group of consumers together – face-to-face or online – and conduct a carefully guided discussion, often with prototypes or other stimuli to spark conversation. Our skilled researchers know the questions to ask that get to the nub of the issue, how to read between the lines of people’s responses, and how to understand the group dynamic.

Depth interviews

For more detailed investigation, we conduct depth interviews with individual respondents, to explore themes and topics in a way that isn’t possible through other methods. It’s a great way to dig into what really drives people’s decisions and behaviour.

Ethnography

Ethnographic research is the market research equivalent of going on safari. It’s about observing consumers in their natural habitat. We ask consumers to share pictures, make videos and keep diaries, or we simply spend some time with them one-to-one to get a window on their real lives.

Online communities

Online communities are a great way to get wide-ranging feedback from consumers. We run dedicated short-term communities specifically for your research project, where participants can explore concepts, discuss them, and contribute in text, image or video form, just like in any online community environment. We can put them in groups, set them tasks, and ask them questions. The responses we get are rich and immediate. And because communities run over a period of days or weeks rather than hours or minutes, they allow concepts to be iterated as the research progresses.

The role of design 

At Kadence we always approach concept testing with creativity, drawing on our in-house design skills..

Often the early-stage concepts we are asked to test are only roughly sketched out – it might be a selection of words on a Post-It note, or a collage of images found online. No problem. Our in-house designers and creatives flesh out the concept into something that consumers can get to grips with.

It might be a mock-up of an ad, a visual piece of stimulus to represent a new service, a model or prototype of a product, or a piece of test copy for an ad or website. We’re even piloting an augmented reality (AR) tool that will allow us to create digital 3D prototypes, so research participants can use their smartphones to see how a product would look in real life, in their own home, or wherever they happen to be. Compared to a static image, this immersive new method will take things to the next level, and we expect it to be a highly cost-effective way to deliver richer, higher quality insights.

As well as bringing design skills to our concept testing research, our approach is guided by the principles of design thinking.

The five stages of design thinking are:

  • Empathise: Start by seeing the world through your consumers’ eyes.
  • Define: Set out in clear, simple terms the challenge that you’re trying to address.
  • Ideate: Generate ideas based on what you’ve learned. (This is often the point our clients have reached when they get in touch with us – but that doesn’t mean we won’t return again to the first three stages later, to generate new ideas based on the results of testing.)
  • Prototype: This is where it gets real. Create a version of your product, service, ad or design that consumers can see, feel and provide feedback on. 
  • Test: Here’s where concept testing gets going in earnest. When it’s done, you can revisit the earlier steps and come back with something even better.

We believe this approach is a key part of what makes Kadence different.

10 Top tips for successful concept testing

1. Set clear objectives

It’s important to be as specific as possible about what your aims are. What exactly do you need to find out and what is it going to help you do or decide?

2. Don’t fall too in love with your ideas

The whole point of concept testing is to see which ideas are going to work and which aren’t. If you’re too wedded to a particular idea – or too set against another– then you risk heading down the wrong path. Let the consumer voice guide you, and have the courage to let a great idea go. It’s not the last great idea you’re going to have. 

3. Find the right people

It’s important to test concepts on a relevant group of people – those who represent the potential target audience. Kadence International has been running this kind of research for many years, and we’re experts at finding and recruiting participants – even the most  hard-to-reach audiences. Whether you’re looking for a cross-section of your potential audience, a specific subgroup or a handful of super-engaged brand advocates, we can help.

4. Bring it to life

Create stimuli that bring the concept to life in a way that feels tangible and engaging for your consumers.

5. Iterate, iterate, iterate

It can take a few tries to get a concept right, but it’s worth it (remember those stats on how many new products fail?) At Kadence, we have an in-house design team at hand who can bring ideas to life, and then iterate new designs and prototypes at speed, so we can rapidly respond to feedback, make adjustments and test again.

6. Be agile

Concept testing is different for every project, and doesn’t have to follow a rigid path. Expect to revisit and repeat the various steps until you’ve got your concept right. You never know what new ideas, issues and inspiration will come up when you put your ideas in front of consumers. Go with it.

7. Read between the lines

What consumers say out loud is the tip of the iceberg. We also need to think about how they say it, why they say it and what they don’t say. Professional market researchers are trained to see through to what consumers really think and feel – and what that means for what they will buy.

8. See the big picture

Concept testing isn’t just about scores and rankings for metrics like appeal or consideration. Look at concepts in context – think about the emotional response they elicit, what they mean for the direction you’re taking your brand, or how they might overlap with other offerings you already have on the market.

9. Work with a partner with the right processes in place to protect your early stage ideas

One of the most nerve-wracking things about concept testing is putting raw, untested early-stage designs and ideas in front of consumers. What if details end up in the wrong hands? Be sure to work only with trusted partners that have secure procedures and technologies for both online and in-person research. We’ve been doing concept testing research for years at Kadence, so we have stringent processes in place, and our research platforms include built-in security features that allow images to be watermarked, and videos to self-destruct after viewing. In over a decade, we’ve never seen a leak.

10. It’s never over

Once your product is launched and out there for real, you’re bound to learn new things, or want to make changes to adapt to fast-moving markets. Be ready to test out new ideas and keep iterating, so your product can keep getting better and better. 

What is concept testing? Essentially, it’s the process of getting your audience to evaluate or give feedback on an idea before releasing it to the public.

It can be used for adverts, physical products, websites, landing pages, and more. Here are some of the main reasons to use concept testing:

  • It’s a great way to evaluate ideas early on and make tweaks before sending something out to the wider public
  • It helps your team get company buy-in on ideas, justifying decisions by proving they work with empirical data

For these reasons and more, companies draw on the power of concept testing to make sure the ideas they come up with are actually viable in the real world before putting them out.

In this article, we’ll take a deeper dive into concept testing and what it’s all about. We’ll cover how to do it and the steps you’ll need to take.

How Does Concept Testing Work

Concept testing takes different forms depending on what you want to test, but generally, the process involves asking current or target customers e to engage with your concept and then evaluate it – either in person (for instance in a focus group) or online (either in an online community or by completing a survey or questionnaire to evaluate it.)

One of the most popular and effective ways of testing concepts is through an online survey so in this article, we’re going to focus on our top tips for getting this right.

When testing concepts through an online survey we ask questions to determine the appeal of the product, how innovative consumers thought it was, and so on. The goal is to gather feedback and to find out how the typical customer will respond to the concept, along with identifying any areas that need improvement.

So how do you get started?

How To Approach Concept Testing Through An Online Survey

Set a Clear Goal at the Outset

Before beginning, it’s extremely important to set a clear goal for your test. This is crucial because it’s what gives the survey its overall structure and direction.

Ask yourself and your team questions like:

  • Why are you doing this?
  • What kind of action will you take with the results?
  • How does this test fit into your overall strategy?

The answers to these questions will help you select your testing population better, choose the right metrics to track, and conduct a more effective and coherent survey.

Pick the Right Metrics to Track

The metrics you choose to track in your concept test are extremely important. They can make the difference between a useful survey that drives genuine positive change, and one that has very little effect other than to waste resources. Some examples of metrics to track include:

  • Purchase intent (how likely would you be to hit the buy button?)
  • Innovativeness (how innovative is the concept?)

These metrics will form the basis of your questions and shape your survey. Questions should focus on areas such as likes and dislikes, overall appeal, uniqueness, and innovativeness.

Give Your Survey A Clear Structure

Your survey should have a clear and coherent structure. Each section should follow intuitively from the next, with similar questions grouped together. You don’t want participants feeling  confused or frustrated at any point — it should all make sense.

A good way to help this along is by including an introduction section that clearly outlines what the respondent should expect from the survey, , along with instructions on how to complete it.

It’s also important to consider which method you want to use. Here are the main options:

Concept Testing Survey Methods

Stay ahead

Get regular insights

Keep up to date with the latest insights from our research as well as all our company news in our free monthly newsletter.

The two main types are monadic design, which uses a single concept, and sequential design, which asks the participants to compare multiple concepts.

Let’s break that down a little further:

  • Single-concept (monadic) design. Here participants analyse one concept, learn the features, and then give their feedback and opinions in a survey. It’s a great way to get in-depth responses around one single concept, but it can be time-consuming and expensive.
  • Multi-concept (sequential) design. In this kind of test, participants do all the above, but then move onto another concept and repeat, and so on. It saves time and money by combining multiple concepts into one session, but there is a risk of participants getting bored and giving lower-quality responses as time goes on. What’s more, responses can be influenced by the order in which concepts are presented, so we make sure to always randomise the order to avoid any bias.

How Long Should a Concept Testing Survey Be?

There are many different opinions on how long your survey should be but our view is that it shouldn’t be any longer than 20 -25 minutes, At this point, respondents can suffer from what’s known as “survey fatigue” and the quality of responses can deteriorate as attention drops For example, SurveyMonkey recommend keeping it under 30 questions. Fewer focused questions can be better than dozens of less relevant ones.

Ultimately, it will depend on your concept, your audience, and the resources you have available.

Ask Screener Questions and Demographic Questions

Screener questions are a way to see if your respondents are relevant to your customer base. They’re usually placed at the beginning of the survey, and the goal is to filter out unqualified participants.

You shouldn’t be too specific here — you don’t want to filter everyone out. For example, let’s say you’re testing an online payment service. The screener question might be, “How often do you shop online?” 

Demographic questions usually come at the end of the survey. They’re a way to find out a little more about the people you’re speaking to and . usually focus on things like age or profession. Collecting information on demographics allows you to ensure that your survey is representative, as well as to analyse responses based on age, gender or socio-economic grade to identify any significant differences. Demographic questions can be considered sensitive, so by putting these at the end of a survey, you avoid people being put off from taking part in the survey from the outset.

Send the Survey Out

Once the survey is ready, it’s time to select a sample of people to test it on. This should be  representative of your overall population you are interested in targeting.

Analysis and Action

The final (and most important) part of the process is to analyze the results of your concept test and take action.

The way you analyze the results depends on how the survey was structured. For example, if your survey used Likert scores (asking participants to answer on a scale of ‘very unlikely’ to ‘very likely’, you can use something called top 2 box scores in your analysis. This allows you to use one metric to compare across concepts or attributes. Remember –  never pick a ‘winner’ unless there’s a statistically significant difference.

When you have your results, it’s time to put them to use. You can use your results to justify a product launch, get buy-in for a concept, or fuel further R&D.

When sharing your results, for example with company management, it’s important to be as clear and detailed as possible. Do all the work for them, and leave them in no doubt about your findings.

Concept testing can be an extremely effective way to get hard data in support of a concept. It helps you and your team make clear-headed, evidence-based decisions and create products that delight your customers and drive the company forward.

To find out how Kadence can help you harness the power of concept testing — and take a more data-driven approach to your organisation in general — reach out to request a proposal.

Trusted by

Trusted by