Time to stop nonsensical table top surveys
I’m pretty sure you’ll have been handed one in the past year – I know I have. Along with your bill, and a smile, the waiter delivers a little card asking for feedback on your meal. Normally it’s a link to a survey, often with an incentive – perhaps a free side or entry to a prize draw. Seems innocent enough.
But a recent conversation with a leading casual dining brand confirmed my thinking – that this type of survey recruitment is actually doing more harm than good. At a time when this restaurant chain was closing down sites across the country, it was simultaneously gaining a +50 Net Promoter Score from its customers, using this type of recruitment.
In fact, the results suggested customers still loved its dining experience and wouldn’t change a thing, when business performance was showing the exact opposite.
When you dig a little deeper, this recruitment method is hugely biased. So survey results create a false sense of security for hundreds of retail brands (it’s one of the sector’s most common ways to gather customer feedback).
Just a few reasons I’d never recommend this approach:
- The questionnaires only tend to be taken by your happiest customers, creating a ‘glass seatbelt’ effect – a false sense of security.
- Any incentives tend to be free products for the brand you have recently visited – why would anyone who’d just had a bad experience participate?
- Staff are often incentivised based on good feedback, so it’s more likely they’ll only highlight the surveys to customers who had a good experience. Another leading dining brand even told me they’d discovered staff tearing off the perforated slips with the survey on before handing the receipt over, if they felt they wouldn’t get good feedback.
- There have also been instances of waiters filling them out themselves – up to 30% of one retail chain’s surveys, according to one brand.
- They also rely on heavy participation to get a decent sample size.
If research isn’t representative, it’s pointless. There’s a far superior way for the sector to garner useful feedback.
We’ve found that by automatically collecting user details at the point of purchase or use, and contacting them shortly after online, the sample is far more representative and responsive. Their data could be from a card swipe (for a gym card, for example), an intuitive data capture method or an online purchase, to name a few. The data source needs to be tailored on a brand-by-brand basis.
This way all customers are targeted across the board and staff don’t see responses, so can’t influence them. The senior brand team can see real-time results via clear online dashboards.
Using this methodology one brand we work with has seen more than a million recipients and 100,000 respondents during the course of a year. More importantly, brands are seeing a clear correlation between customer satisfaction and financial performance. For one of our clients, every five point movement in their Net Promoter Score equates to 1% movement in like-for-like sales. So it’s vital research.
So let’s put an end to chasing respondents or force-feeding brands only their happiest (or grumpiest) customers. Instead, let’s focus on targeting all types of customer and getting quick, actionable data. Time to rip out the glass seat-belt once and for all.
Roger Perowne is managing director at Morar

We hope you enjoyed this article.
Research Live is published by MRS.
The Market Research Society (MRS) exists to promote and protect the research sector, showcasing how research delivers impact for businesses and government.
Members of MRS enjoy many benefits including tailoured policy guidance, discounts on training and conferences, and access to member-only content.
For example, there's an archive of winning case studies from over a decade of MRS Awards.
Find out more about the benefits of joining MRS here.
1 Comment
Neil Callaghan
9 years ago
I agree with some of what you say but your preferred method only works where it is possible to collect customer details and they give consent. We use many pull style surveys you are criticizing to great effect and the key is the right worded invitation with the right worded survey itself. I have myself come across the type of cheating you're describing very recently and it was clear to me how we could prevent it in what we do in the same business vertical using the same methodology. Glad you've opened up the debate to highlight how great agencies like ours can work these things through using process, fraud cleanse techniques and insight professionals.
Like Reply Report