Time to stop nonsensical table top surveys

Customer feedback in the form of surveys delivered by staff at the time of purchase or service are riddled with misleading data and should be ditched by businesses says Roger Perowne.

Waiter restaurant_crop

I’m pretty sure you’ll have been handed one in the past year – I know I have. Along with your bill, and a smile, the waiter delivers a little card asking for feedback on your meal. Normally it’s a link to a survey, often with an incentive – perhaps a free side or entry to a prize draw. Seems innocent enough.

But a recent conversation with a leading casual dining brand confirmed my thinking – that this type of survey recruitment is actually doing more harm than good. At a time when this restaurant chain was closing down sites across the country, it was simultaneously gaining a +50 Net Promoter Score from its customers, using this type of recruitment.

In fact, the results suggested customers still loved its dining experience and wouldn’t change a thing, when business performance was showing the exact opposite.

When you dig a little deeper, this recruitment method is hugely biased. So survey results create a false sense of security for hundreds of retail brands (it’s one of the sector’s most common ways to gather customer feedback).

Just a few reasons I’d never recommend this approach:

  • The questionnaires only tend to be taken by your happiest customers, creating a ‘glass seatbelt’ effect – a false sense of security.
  • Any incentives tend to be free products for the brand you have recently visited – why would anyone who’d just had a bad experience participate?
  • Staff are often incentivised based on good feedback, so it’s more likely they’ll only highlight the surveys to customers who had a good experience. Another leading dining brand even told me they’d discovered staff tearing off the perforated slips with the survey on before handing the receipt over, if they felt they wouldn’t get good feedback.
  • There have also been instances of waiters filling them out themselves – up to 30% of one retail chain’s surveys, according to one brand.
  • They also rely on heavy participation to get a decent sample size.

If research isn’t representative, it’s pointless. There’s a far superior way for the sector to garner useful feedback.

We’ve found that by automatically collecting user details at the point of purchase or use, and contacting them shortly after online, the sample is far more representative and responsive. Their data could be from a card swipe (for a gym card, for example), an intuitive data capture method or an online purchase, to name a few. The data source needs to be tailored on a brand-by-brand basis.

This way all customers are targeted across the board and staff don’t see responses, so can’t influence them. The senior brand team can see real-time results via clear online dashboards.

Using this methodology one brand we work with has seen more than a million recipients and 100,000 respondents during the course of a year. More importantly, brands are seeing a clear correlation between customer satisfaction and financial performance. For one of our clients, every five point movement in their Net Promoter Score equates to 1% movement in like-for-like sales. So it’s vital research.

So let’s put an end to chasing respondents or force-feeding brands only their happiest (or grumpiest) customers. Instead, let’s focus on targeting all types of customer and getting quick, actionable data. Time to rip out the glass seat-belt once and for all.

Roger Perowne is managing director at Morar

We hope you enjoyed this article.
Research Live is published by MRS.

The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.

Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.

For example, there's an archive of winning case studies from over a decade of MRS Awards.

Find out more about the benefits of joining MRS here.

1 Comment

Neil Callaghan

I agree with some of what you say but your preferred method only works where it is possible to collect customer details and they give consent. We use many pull style surveys you are criticizing to great effect and the key is the right worded invitation with the right worded survey itself. I have myself come across the type of cheating you're describing very recently and it was clear to me how we could prevent it in what we do in the same business vertical using the same methodology. Glad you've opened up the debate to highlight how great agencies like ours can work these things through using process, fraud cleanse techniques and insight professionals.

Like Report

Display name

Email

Join the discussion


Display name

Email

Join the discussion

Newsletter
Stay connected with the latest insights and trends...
Sign Up
Latest From MRS

Our latest training courses

Our new 2025 training programme is now launched as part of the development offered within the MRS Global Insight Academy

See all training

Specialist conferences

Our one-day conferences cover topics including CX and UX, Semiotics, B2B, Finance, AI and Leaders' Forums.

See all conferences

MRS reports on AI

MRS has published a three-part series on how generative AI is impacting the research sector, including synthetic respondents and challenges to adoption.

See the reports

Progress faster...
with MRS 
membership

Mentoring

CPD/recognition

Webinars

Codeline

Discounts