Dissecting a Survey

Dissecting a Survey

The aftermarket loves conducting surveys and analyzing the results. But, more often than not, the data is biased and inaccurate. It’s time we begin focusing on the facts.

One thing we never seem to get our fill of in the aftermarket is survey information. We survey everything from buying trends to brand preference to inventory investment. Over and over, we ask and ask and ask. I commend our industry for wanting to know, but I wonder what we really get.

When I was in marketing for a large parts manufacturer, we used to say “output is only as good as the input provided.” Here at Counterman, we have our own in-house research department and I am very glad we do. When we conduct a research project, like our annual PARTS Supplement, I work closely with our editor Brian Cruickshank and our research expert Bob Roberts to construct the questionnaire and choose the parts categories to be surveyed each year. Consistency is critical, otherwise the data that’s been collected over the years becomes compromised and unreliable. An even more critical component is the way a question is stated or presented and the order in which questions are answered. Thus, the way you go about gathering the “input” for any research project or survey is the most critical step. 

Other key factors with regard to good survey work include (but aren’t limited to) response rates and data analysis. Without a high response rate (usually considered to be a 10 percent sampling or above), the input you’ve gathered is somewhat flawed because it is not representative of enough constituents or market participants. Accurate analysis of the data becomes a rather simple task, if the proper thought was applied to the construction of the survey up front. However, when the data reveals some things you would rather not know or aren’t happy with, then data analysis can become skewed and biased and real results can be excused away as “bad data.” In essence, sometimes the truth hurts!

So, why am I rambling on about data and research and survey results? Well, because quite frankly I’ve seen a lot of bad data dumped out in to the marketplace recently and it is quite alarming to me. In some conversations I’ve had about my concerns with this information, I’ve been told that it’s not the data that matters, but rather it’s how you package and present it. Kind of like putting lipstick on a pig!

I’ve also seen many examples of data that is being collected in a silo, with no consideration to all of the market factors that may impact or influence the results. Consensus building is difficult in such a competitive market, but an outright disregard for things that are generally accepted as normal operating conditions, general principals and widely known and accepted market behaviors is “silo” research and “silo” analysis at its best.

Here’s my advice to anyone in our market using data for strategic planning: Question everything about it, thoroughly and completely. The more informed you are about the methodology of the research and how the data was collected, the better. Otherwise, you might find yourself and your business plans waking up out in the barn next to some very pretty farm animals.

You May Also Like

What Will the ‘COVID-Era Consumer’ Do in 2022?

The beauty of the automotive aftermarket is that the economic conditions always seem to work in the industry’s favor.

Online Shopping

Remember the tariffs? Nathan Shipley does. Back in 2019, “that’s all we were talking about as an industry,” Shipley recalled, during his “Aftermarket Outlook 2022” presentation this past November at AAPEX.

Looking back at the “Distribution Preview” in the January 2019 issue of AMN/Counterman, aftermarket leaders consistently expressed concerns that former President Trump’s tariffs – and China’s retaliatory tariffs – could disrupt aftermarket supply chains, leading to higher prices and even production interruptions. Tariffs remained on their radar in January 2020, although it looked like the aftermarket was weathering the storm.

Right To Repair, Trade Associations And You

In the fight for Right to Repair legislation, aftermarket trade groups can’t do it alone.

Veterans Can Be Heroes Off the Battlefield Too

Veterans bring an incredible amount of value to the civilian workplace, in terms of nontechnical and technical skills.

Veterans and Vehicles
What’s Really Driving The Automotive Aftermarket’s Growth?

NPD’s Nathan Shipley looks at the many moving pieces contributing to the industry’s recent spike in demand.

aftermarket growth
Strength In Numbers

The automotive aftermarket is filled with great people. In fact, many say it’s our strong suit.

Teamwork automotive aftermarket

Other Posts

Never Stop Learning

With so much internet-based training content available, it’s never been easier to expand your knowledge base.

Continuing Education
Welcome To 2035 – What Things Might Look Like

The future is what we make it. We need to start addressing technology now so 2035 becomes a bright future.

Future of Transportation
Seems Like Everybody’s Talkin’ About Electric Vehicles

Not only are people talking about EVs, but according to the latest U.S. sales figures, they’re also buying them.

Tesla Electric Vehicle
Still Time To Nominate Someone For Counter Pro Of The Year

We’ll be accepting nominations through Aug. 1.