If you’re looking for powerful insights, you want to ensure that your survey is getting the right responses. Of course, the first step to fielding an effective study is building a well-designed survey – but it doesn’t end there. What’s next? Data cleaning!
To get the most actionable and reliable responses from a survey, data cleaning is just as important as survey design. Data cleaning can help you determine the relevance, reliability, and accuracy of survey responses. It’s an imperative step to take before making insights-based decisions – which is why we recommend that all sample buyers conduct data cleaning as they receive survey responses.
What exactly is data cleaning?
Data cleaning is the process of reviewing the data you’ve collected, to ensure respondent attentiveness and response validity. In general, we give survey respondents the benefit of the doubt – since they’ve opted in to provide answers and receive an incentive for completing your survey. Data cleaning simply ensures the data collected is high quality and reliable so that it can be used to make important business decisions.
As we mentioned, our expects our customers to perform data checks and data cleaning on the survey responses they collect. Following data cleaning, buyers can reconcile any unusable completes, and they are not held financially accountable.
Benefits of data cleaning
If data cleaning is an extra step in the survey process, why go through with it? A consistent data cleaning process can offer many advantages to your research.
Enhance data quality
When you apply survey data cleaning best practices, you can significantly optimize data quality. Data issues like incomplete questions or contradictory responses can skew your results – and when you rely on this data for modeling and algorithms, getting the best data is crucial.
You can encourage high-quality data by creating strong questions, choosing the right participants, and using reliable survey platforms, but all of these steps happen before distributing your surveys. Data cleaning is a way to maintain quality after your surveys are launched , offering an additional quality control step before the results are implemented into insights.
Improve decision-making
High-quality data will lead to more effective decision-making. When your company relies on inaccurate data to determine its next steps, projects may not offer the return on investment (ROI) you’re looking for. Ensuring your data is meaningful can lead to well-informed decisions that help you grow your business.
For example, a survey about a new product may not be meaningful if it goes to the wrong demographic. If your product recognizes a need in the over-65 population, you won’t receive helpful responses from someone in their 20s.
Save money
You might use your survey data to mail out marketing materials or develop large-scale projects like new products. If you haven’t appropriately cleaned the data, you may end up printing marketing materials for people who aren’t interested. Or, you could develop a product people won’t buy. Cleaning your data can save you from significant investments that fall flat. In the end, you’ll save money.
Cleaner data can even lead to more revenue. When you use reliable data to make your decisions about marketing, products, or services, your audience is more likely to engage and buy from your company.
Increase productivity
When a portion of your data collection is unreliable, you end up spending time on data analysis for information that won’t help your company anyway. Data cleaning ensures you’re only dedicating time to valuable analysis, which leads to a more productive workflow.
Starting the data cleaning process during the surveying process can also help you streamline every downstream process. Every team handles the same group of accurate data and gathers valuable insight from the dataset.
When should you conduct data cleaning?
There are a few different phases of a study when you should conduct data cleaning. Our team has first-hand experience with data cleaning on projects that we program and host. We’ll share our process for cleaning data and making recommendations for removals, as we recommend the same steps for buyers programming their own surveys.
Step 1: Pre-launch data checks
In addition to quality assurance in survey programming, we run simulated data through the survey platform to perform data checks on all survey elements before launching the project. We check the data to ensure the following elements are working as intended:
As a standard, we recommend that customers soft launch for about 10% of the total required sample or 100 completes, whichever is less. We use the data collected during the soft launch to perform the aforementioned data checks on live respondent data before proceeding to collect the entire sample.
Step 3: Full launch data cleaning
After the soft launch, we perform data cleaning twice over the course of survey fielding:
60% Data Collection
90% Data Collection
What to look for when data cleaning
Raw data can present many red flags. When starting the data cleaning process, it’s important to know these red flags and keep an eye out for them as survey results come in. Look out for the following factors.
Incomplete or unanswered questions
When respondents leave questions incomplete or unanswered, this can skew your overall results. There are several reasons why a respondent didn’t complete a survey. There may have been a flaw in the survey logic , or they may not have been engaged with the survey’s content.
If you see a high number of dropped surveys, it might be the survey design. Irrelevant questions or confusing wording can lead people to stop before they finish.
Unqualified survey respondents
Unqualified respondents are people that don’t fit the survey criteria. While it’s best practice to use screener questions to ensure that your survey is sent to the right people, unqualified respondents can still slip into your survey pool.
The best way to clean out unqualified respondents is to be mindful about the screening questions they answer prior to the survey. Screening questions are used to determine if someone is a match for a survey. For example, if you are conducting a survey to learn about people’s favorite brand of dog food, you would first ensure that your survey respondents are dog owners.
Response outliers
Some respondents may submit answers that fall far beyond the average participant’s response. For example, a survey question may ask about the number of hours spent watching television each week. A respondent might write 70 hours — whether or not it’s true, this number is well outside the average answer. Outliers like these can skew your results.
How do you conduct data cleaning?
Typically, we clean the data looking at the following survey elements and question types, though each may not be applicable to every survey:
Assess length of interview (LOI)
Looking at the survey based on the amount of time a respondent spent on a particular question, or the survey as a whole, is important. It can indicate areas where the respondent may have selected responses without thoroughly reading the question or carefully thinking about their response.
As a standard, we look at the median LOI as the expected time it takes to complete the survey. The industry definition of a “speeder” is any respondent who has completed a survey in less than ⅓ of the median LOI.
By default, we remove speeders from the survey results – and we add survey validation to automatically terminate respondents who complete within the designated speeder threshold time or less. We use the quality term redirect to communicate to our Marketplace partners why the respondent was terminated.
Please note that survey validation must be implemented after a soft launch (not before), as the only way to accurately gauge LOI is with surveys that are in-field. Setting a speeder term prior to launch might – and often does – term valid respondents.
Straightlining / Patterned Responses
Another area of data cleaning is to look at the responses on grid questions in the survey. If a respondent is answering the same answer option (“C”) over and over, their engagement in the survey may be suspect. As a default, we flag respondents who select the same response for at least five rows in a grid.
Respondents also create patterns on grid questions, though these are less obvious in the data, and thus harder to identify.
We think about data cleaning during the programming process, and we often program in validation to flag respondents who straightline specific questions in a survey.
Respondents who create patterns or pictures with their responses must be manually identified, though visualizing the data can help to identify these respondents.
Text Open End Questions
We recommends asking only one open ended question for every five minutes of respondent time to yield the best results. So, for a 15 minute survey, only three open ended questions are recommended.
Too many open ended questions can lead to respondent fatigue. Additionally, too many open ended questions can be a good indicator of the need to do qualitative research before creating a quantitative online survey. See our blog on quantitative and qualitative research to help determine if your study should be approached differently.
To clean open end responses, it is helpful to sort in alphabetical order to quickly and easily spot nonsensical text or characters such as “good” or “dfksjfdkj.”
Inconsistent or Unrealistic Responses
Inconsistent or unrealistic responses can take place on a number of different question types, including Numeric Open End and Single Select.
We advise researchers to think about unrealistic responses to questions when designing and programming the survey, as validation can be used to curb impractical responses. Here are some examples of spotting impractical responses.
How many times have you gone for a run in the past 12 months?
If a respondent answers 600 that answer is likely unrealistic because there are only 365 days in a year.
How many hours a week do you watch TV?
If a respondent answers 75 hours a week, that answer is likely unrealistic because there are 168 hours in a week and typically 40 are spent working, 56 spent sleeping, etc.
What is your birth year and age?
If a respondent is asked for their birth year as a single select question and the respondent selects “1988” and then at the end of the survey, we ask them their age, and they select “35-44” their data is inconsistent.
What is your relationship status? Number of children in your home? Total number of people in your household?
If a respondent indicates that they are married and have three children, but then say they have three people in their household, their data is inconsistent.
When should you reconcile survey responses?
Overall, it is up to the researcher or subject matter expert to determine which responses are unrealistic and which respondents to remove from the dataset. We recommend reconciling any respondent who fails these checks. Although, if your study has a very low incidence rate, it may be worthwhile to toss out respondents who fail two or more checks, but stringently review their data if they fail only one.
We allow respondents to be reconciled from the date of the complete to the last day of the following month. However, if you do plan to reconcile, we suggest doing so as quickly as possible, as reconciling poor quality completes is advantageous to both you and our supply ecosystem.
Now that you have a more thorough understanding of data cleaning, we hope you’ll implement everything you’ve learned! If you have questions about how to clean your data, please talk to your Cint representative or contact us for more information.
Learn more from Cint
At Cint, our research technology allows you to build effective surveys with reliable data. With features like our Quality Program, we can gauge factors like demographics and consistency. Learn more about our capabilities by contacting our team today.
Cint’s Jimmy Snyder, Vice President of Trust and Safety, and Shelby Downes, Senior Program Manager, discuss a range of approaches for taking action against the bots.
A panel of experts voice their opinion on what difficulties insights professionals need to be aware of in the year ahead — and how best to approach them.
A panel of experts voice their opinion on how market research and insights professionals will continue to foreground automation in their methodological approach.
Introduction Across the market research industry, more and more organizations and companies are using AI to speed up audience insights analysis. The reason is simple: AI can streamline previously lengthy processes. Formerly time-consuming work can now be done in seconds, with human beings on hand to ensure accuracy. AI tools save time and money but…
Knowing how to prioritize your limited budget while increasing the impact of your digital advertising will make the difference between success and just getting by this year.
At TMRE 2024 in Orlando, KFC’s Renee Reeves joined Cint’s Ryan Fletcher for a fireside chat on how building the right tech partnerships is the (not-so-secret) recipe for fostering a culture of innovation and setting your insights team up for success.
We speak with Andy Perricone, Senior Talent Acquisition Manager at Cint to find out how Cint avoids gendered language in job ads, why it matters, and how we foster inclusivity that attracts the top talent from all genders and backgrounds.
In 2025, global advertising spend is predicted to surpass $1 trillion—a milestone so monumental it could stretch dollar bills to the sun and back. However, beneath this record-breaking number lies a complex reality: while data is abundant, marketers and agencies still face significant challenges in unlocking its full potential. A recent research collaboration between Lotame…
As the festive season approaches, travelers worldwide are packing their bags for one of the busiest travel periods of the year – but not without a little help from technology. If the idea of using AI as your personal travel assistant sounds appealing, you’re not alone. This year, holiday travel trends reveal not only a…
Cint and Advertising Week partnered on research looking into the relationship between media influence and voter behavior leading up to this year’s US and UK elections.
From ordering food online to the rise in quick commerce, our comprehensive Diwali survey reveals how technology is reshaping the way people prepare for and celebrate Diwali.
From carnival chasing to pilates, and kitesurfing to kickboxing, our international employees at Cint talk about how their hobbies keep stress under control.
A conversation with France Lasnier, SVP, for UK, France, Central Europe and Louis Nix, Senior Analyst, Product Operations, on the importance of a data-driven approach for companies.
A conversation with Cint experts Dhruv Mathur, Vice President, Information Security and Caroline Tahon, Data Protection Officer, on keeping data as safe and secure as possible.
Push Digital, a campaign agency active in America’s highest stakes races and debates by leveraging their digital expertise to start conversations, persuade audiences, and turn out voters, partnered with Cint on a study to uncover gaps in voter support.
Using CintSnap, we surveyed 300 UK respondents on how they plan to engage with the iconic celebration and what aspects of the event excite them the most.
Using CintSnap we surveyed 300 people in the UK on how they plan to engage with the Games, most watched sports, and how brand sponsorship is perceived.
Using CintSnap, we conducted a poll with approximately 300 people from the UK to explore what they read, how they read, and what persuades them to take a punt on a new title.
HR, payroll and recruitment solution specialists Employment Hero conducted a survey with Cint to delve deep into how AI assistance could be a boon for payroll professionals across Australasia.
Maintaining data ethics is critical in market research, especially with the rise of AI technologies. Transparency, compliance with regulations, and educating employees ensure consumer information is protected.
Political scientists Andrew O’Donohue and Daniel Markovits conducted a survey with Cint to understand how prosecution of Donald Trump affected public opinion among independent voters.
From London to Malaga and Cairns, Ariel Madway takes us on a journey through Cint’s busy events season, her planning inspiration and what she’s most excited about.
Both CTV and linear TV advertising present big opportunities for advertisers. In particular, the booming demand for CTV ads. We look at what the TV upfront and NewFronts are all about and the state of streaming in 2024.
In the world of market research, finding and engaging with niche audiences can feel like navigating uncharted territories. Gaining insights demands innovative strategies and streamlined processes.
When it comes to social customs and norms, few practices are as divisive as tipping expectations. We use CintSnap to survey consumer behaviour around tipping in the US and UK.
With the prestigious Academy Awards marking its 96th year, we set out to discover if the glitz and glam of ceremony still holds weight in determining viewing habits of filmgoers, as well as why people tune in, how predictions played out and who they thought should have won the coveted golden globes.
International Women’s Day is an opportunity to celebrate wins, raise awareness and get conversations going. We’ve dived into the narrative at Cint by uncovering the insights around International Women’s Day.
We’re proud to share that Cint, a global leader in market research, emerged as the leader in sample quality for online polls in a third-party study. Sapio Research, a UK market research agency, conducted the study to understand if online surveys are accurate. Sapio surveyed 2,036 UK consumers – representative by age and gender of…
For Valentine’s Day 2024, the National Retail Federation predicts that consumers will spend $25.8 billion. We used CintSnap to find out how people in the US and the UK approach this romantic season, by surveying 300 respondents.
As football fever grips the nation, the anticipation for this year’s game is reaching unprecedented heights. We surveyed the nation to understand more about how people are planning to watch, and so much more.
On the 28th of January every year, the importance of personal data, and of Personal Identifiable Information (PII) is celebrated across the world on Data Protection Day.
The Australian Open is the first of the four Grand Slam tennis tournaments to occur. We uncovered spectator experience through preferences and behaviors of our 280 respondents across Australia.
Nick Richards, Director of Product, shares an update on the work his team have been doing to comprehensively integrate every corner of product offerings on the new platform.
With the festive season well behind us, and gloomy skies looming above, January for a myriad of reasons, isn’t the most exhilarating of months. This sentiment is so nationally widespread that in 2005, a UK-based travel agency coined the term ‘Blue Monday’ to mark the most depressing day of the year.
January is a popular time for reflection and what better month to get our plans organised for the year ahead of us? A new year represents new uncharted destinations we’ve yet to discover, and for some, the usual trusted spots bring familiar comfort to recharge weary batteries.
Vishal Bhat – Program Manager, Susi Lindner – Vice President, and Sonali Kaushal – Senior Manager at Cint discuss the importance of being inclusive in language around gender.
If Taylor Swift took up the greatest amount of air space and attention in pop culture this year; the rise of artificial intelligence (AI) – and its impact on jobs – took up the greatest amount of air space and attention in professional settings.
Since there’s nothing we love more than a data driven trip down memory lane, we’ve rounded up the top 10 #CintSnaps which got the highest engagement from you this year.
When I took the reins from Tom Buehlmann on the 3rd of April of this year, the integration of Cint, Lucid, Gapfish and P2Sample was well under way – but there was still work to do. A lot of work.
Our first video in our new interview series is with Jonathan Jaynes, Senior Director of Product Design, Cint, who shares an insider’s perspective on the groundbreaking developments underway.
Our most recent CintSnap takes a festive peek into the sentiments the UK public to unveil their thoughts on this year’s Christmas ads. Join us in unwrapping the findings and discovering what makes these ads a seasonal staple for UK consumers.
When we talk about migrating customers and supply partners to our new platform, we understand that concerns may arise. In this blog post, we want to address some of the worries you may have, and give a little reassurance about the process. You’re in good hands, we promise!
The build up to the holiday season is almost palpable, Christmas lights illuminate city centers and cheese fondue and mulled wine start popping up on the menu. We pull out our coziest socks from the attic storage and gear up for hours of Home Alone movie marathons and engage in another big part of the yearly tradition -…
As Black Friday and Cyber Monday (BFCM) sales continue to skyrocket and dominate global retailer revenues, Cint takes a deeper look into consumer behaviors in the US, UK, Canadian and Australian markets, and the shopping habits that drive this highly anticipated shopping season.
Using Cint’s owned data – that we call CintSnap – we gathered some insights around sentiments surrounding consumer behavior of the implementation of AI in the music industry, specifically on the posthumous Beatles collaboration.
Innovation is in our DNA, and our mission has always been to bridge the gap between real people and organizations striving to understand and serve them. With this in mind, we’ve embarked on an exciting journey of transformation – building a new platform that will redefine the way our customers can access and leverage consumer…
Stephanie Gall, Director of Measurement Products at Cint, examines the use of Lucid Impact Measurement to optimize advertising campaigns across linear and connected TV, digital and social channels
Read on for a brief outline of the latest developments in our new platform as we continue on an exciting journey with our partners, led by our core purpose – to feed the world’s curiosity
In today’s blog we spend a bit of time getting to know one of our superstar team members – one who you may have met on the MR events circuit this fall.
Our recent webinar hosted by Oscar Carlsson, Chief Innovation Officer, provided an overview of industry data quality trends and outlined what Cint is doing to help.
Jimmy oversees an operational team focused on creating and implementing quality-related programs and policies. He shares how the team helps to ensure a healthy and efficient market research ecosystem.
Monetizing your community involves strategically leveraging its value to generate revenue. Let’s say you have an online forum, social media group or a thriving platform with active members. You can transform your online community into a profitable asset. You can monetize your community in various ways. This post explores the ins and outs of community…
John Brackett is Director of Product, working across supply, respondent experience, and trust and safety. Here he outlines some of the actions being taken to optimize one of the world’s largest digital marketplace for research sample.
Lucid, a Cint Group company, has been chosen by NBCUniversal as a brand measurement certified partner. The selection was made based on solution readiness, deliverables, and market presence.
With the final Grand Slam tournament of the year fast approaching, Cint uncovers the most successful strategies for brand engagement by asking consumers their thoughts on the sporting extravaganza
When conducting market research, finding participants for a survey is crucial to gather valuable insights. Survey respondents provide the data necessary to understand target audiences and build action plans for reaching them. Their input enables data-driven decision-making, improves product or service offerings, and helps tailor marketing strategies to meet customer needs effectively.
The food and beverage industry is highly dynamic and constantly evolving, with new trends and consumer preferences always emerging. In such a fast-paced and competitive landscape, staying ahead of the game is critical for success. That’s where media measurement comes in.
CTV’s customized strategies provide marketers with massive amounts of analytics. With all the viewership data CTV provides, it often seems complicated to measure specific goals for your campaign. Using CTV measurement is critical for understanding your ad performance and information about your viewers.
The Back- to- School and Holiday Shopping seasons are changing rapidly, short in nature and extremely lucrative. This blog explains the power of leveraging real-time measurement to optimize your campaign; not after completion, but while consumers are still buying.
Learn how to enhance the quality of your survey results by optimizing qualification data and screening questions. Discover strategies to avoid respondent fatigue, keep data up to date, maintain specificity without bias, innovate targeting approaches, and minimize fraud. Act now and unlock the power of connected data for business success.
Surveys are powerful information sources across industries and organizations. With the data pulled from customer surveys, departments can drive actions and initiatives that better reflect audiences and market conditions. The food and beverage industry can benefit from using surveys in several applications to gain more information and knowledge about their organization, products, customers and market.
U.S. government market research aims to allocate resources to prioritize social services and responsibilities. Using market research to create a more effective fiscal policy or make purchasing decisions is valuable.
In this blog, we’ll explore the importance of market research in the healthcare industry and some of the key methods and techniques that can help gather and analyze data. We’ll also discuss specific ways healthcare providers can use market research to improve operations, expand their reach and enhance the overall patient experience. Whether you’re a…
Surveys are an effective way to gather valuable data and insights from a group of people. However, some survey questions may touch on sensitive topics, and require additional care.
By comparing your campaign’s performance against industry standards on key performance indicators (KPIs), you gain valuable insights and context that can drive better outcomes. In this blog post, we’ll explore why benchmarking your advertising campaign is essential and how Lucid Impact Measurement, a product by Cint, can help you achieve this.
With the help of customer experience research via surveys, you can locate and address pain points, in turn creating a better experience. This article will provide you with valuable insights into how to gather feedback from your customers and improve your operations as a result.
Unlock the power of connected data to drive superior research & marketing. Learn how to access rich datasets, navigate legal considerations, and gain comprehensive insights. Discover four essential steps to connect data effectively.
Survey data can provide meaningful insights to public sector agencies. It’s one of the most powerful tools to serve your community. Public sector agencies have multiple objectives. Gathering actionable feedback is essential to help you reach your goals.
The financial services industry has been experiencing significant changes in recent years due to the increasing demand for digital solutions and the emergence of a cashless society. As technology continues to advance, it has become essential for financial service providers to adapt and stay ahead of the game.
