Facebook Twitter YouTube Instagram LinkedIn Wikidata
Category:

Don't Be Fooled by Bad Data

We constantly rely on data to point our clients in the right direction when shaping their brands.

The quality of the solutions we deliver can only be as good as the data our research provides. Recently, we learned an important lesson in how sample size can affect both research results and the conclusions we draw from it.

While engaging a new client, we conducted a very fast moving survey to examine their brand concept, appeal, opportunity, etc. Since we were under a tight schedule, we reported some preliminary results while waiting to obtain the full sample. We explained this limitation to the client, ensuring they understood our “quick hitter” initial objective. We weren’t reporting on all the measures, just taking a quick first glance based on a relative few.

The preliminary sample consisted of 120 respondents with a margin of error of +/-9 points. The final sample was 453 respondents with a margin of error of +/-4.6 points. Clearly, the final sample had a much smaller margin of error (almost half) and thus was much more likely to give trustworthy results.

Looking at more thorough measures than in the initial report, we asked our respondents to tell us how loyal they were to their current brand. What we found in our first, smaller sample was that 49% of respondents were advocates for their current brand. That decreased to 35% with the full sample, a difference of -14%. This was a crucial market share opportunity we would’ve overlooked based on the initial read from a small sample size. Consumers weren’t quite as loyal to their brand as we might’ve thought.

When we took a closer look at concept appeal we found another distinct difference. The smaller group of respondents showed that 29% would be interested in the concept. But with the full data of a larger sample size, this interest increased to 43% of all respondents, up 14%. Without taking the time to survey a larger group, we would have substantially underestimated our client’s opportunity in the marketplace. These percentages translated to over 6 MILLION additional consumer households.

What should we take away from this? Not all data reflects customer opinion accurately. We must be careful not to draw large conclusions from small samples. An adequate sample size is essential to conducting accurate and usable research. It ensures a trustworthy representation of the population under consideration and provides a confident direction for a brand. Sample size impacts the quality of the solutions we deliver to all of our clients, from insights and strategic recommendations to creative and interactive deliverables. If you have questions about consumer-based research alternatives, contact Trone Brand Energy for more information on finding and utilizing the best types of data to suit your needs.  

Related Articles

developing a creative brief
Advertising | Branding | branding | Creative Brief | Insights | Strategic Thinking

New Thoughts for an Evolving Creative Brief

We believe that the creative brief, like most things in marketing, is a living, responsive document that changes with time. This means that in order to develop a creative brief, we must continually challenge our own thinking to deliver more relevant strategies to account for the increased complexity of the marketing mix.

Since our earlier blog post about the telecom industry, Trone Brand Energy has taken another look at our Spring 2017 national survey of 980 home internet subscribers to uncover additional insights and ways for smaller, regional internet providers to more efficiently differentiate their telecom marketing strategy efforts from those of larger, nat

Digital content marketing infographic
Content Marketing | Digital | Digital Marketing | Insights |

Five Steps to Successful Digital Content Marketing [Infographic]

Content marketing could seem overwhelming as a concept. However, if broken down properly, it’s much more palatable and can be the largest weapon in your marketing arsenal. Whether you are looking to increase awareness, drive lead generation or create conversions, content marketing can provide the results you’re seeking.

Home Internet National Survey
Insights | Internet | Retail | Telecom

Segmenting Home Internet Subscribers

Through a national internet survey, we asked home internet subscribers how frequently they used their subscription for common daily activities such as emailing, surfing, shopping and even working from home. Four activities stood out—streaming videos, streaming music, listening to podcasts and online gaming.

Looking for a little firefly magic for your brand?

High Point

1823 Eastchester Drive
High Point, NC 27265

336.886.1622
Durham

201 West Main Street
Durham, NC 27701

919.307.5270