Exploring ChatGPT - NPS

I asked ChatGPT to write a blog post that focuses on the limitations of using the Net Promoter Score (NPS) metric. I’m frequently asked about the use of NPS as a tool for measuring loyalty, and personally have mixed opinions.

When I’m asked this question, I usually focus on the lack of direct actionability and the lack of benchmarks. However, there are ways to mitigate - or lessen - these limitations. Custom research should be that - designed specifically to address the needs of the study. A flat out rule - Our company uses NPS - without any reasons why, takes up real estate within a survey that could likely be used for better purposes.

The full ChatGPT response is below.

Title: Unveiling the Limitations of Net Promoter Score (NPS) as a Metric

Introduction

In the realm of customer experience and satisfaction measurement, the Net Promoter Score (NPS) has gained immense popularity. Developed by Fred Reichheld in 2003, the NPS metric is widely used across various industries to assess customer loyalty and gauge business success. However, despite its widespread adoption, it is crucial to recognize and understand the limitations associated with NPS. In this blog post, we delve into the constraints of relying solely on NPS and explore its drawbacks as a comprehensive metric for evaluating customer satisfaction.

Oversimplification of Customer Sentiment

One of the fundamental limitations of NPS lies in its oversimplified approach to capturing customer sentiment. NPS categorizes customers into three distinct groups: Promoters (score 9-10), Passives (score 7-8), and Detractors (score 0-6). By reducing complex customer emotions to a single number, NPS fails to capture the nuances and underlying reasons behind their feedback. Customers' experiences are often multifaceted, and NPS lacks the granularity to effectively reflect this complexity.

Lack of Context and Actionability

While NPS provides a numerical value, it often fails to provide actionable insights or context. Without additional information, it becomes challenging for businesses to understand the underlying factors contributing to a particular score. For instance, a high NPS score may not necessarily indicate overall satisfaction if the respondents only had a limited interaction with the company or if they were influenced by external factors. Without context, businesses may struggle to identify specific areas for improvement or make informed decisions.

Limited Scope of Feedback

NPS primarily relies on a single question: "How likely are you to recommend our product/service to a friend or colleague?" While this question can be valuable in assessing advocacy, it fails to capture the broader range of customer experiences. Customers may have different reasons for their likelihood to recommend or not, such as pricing, product features, customer support, or brand perception. By limiting feedback to a single question, NPS overlooks valuable insights that could be obtained through more comprehensive surveys or interviews.

Cultural and Industry Bias

NPS assumes that the metric's effectiveness is consistent across all industries and cultures. However, cultural differences and industry-specific factors can significantly impact customer behavior and perception. What may be considered a positive score in one culture could be perceived as average or even negative in another. Furthermore, the nature of certain industries, such as healthcare or financial services, may result in inherently lower NPS scores due to the sensitive nature of the interactions. Failing to account for these biases can lead to misinterpretation and misjudgment of customer sentiment.

Lack of Benchmarking and External Validation

While NPS provides an internal benchmark for businesses to measure their progress over time, it lacks external validation or industry-wide benchmarks. Without comparative data, it becomes difficult to assess how a company's NPS score aligns with its competitors or the industry standard. External validation plays a vital role in understanding where a company stands and identifying areas for improvement.

Conclusion

Although the Net Promoter Score (NPS) has become a widely adopted metric for evaluating customer loyalty and satisfaction, it is essential to acknowledge its limitations. NPS oversimplifies customer sentiment, lacks context and actionability, provides a limited scope of feedback, may be subject to cultural and industry bias, and lacks external validation. To gain a more comprehensive understanding of customer satisfaction, businesses should consider complementing NPS with additional metrics and research methodologies that capture a broader range of customer experiences. By doing so, companies can make more informed decisions, foster meaningful improvements, and truly prioritize their customers' needs.

What I've been reading this week, January 26, 2022

Here’s a little summary of search term trends since the Covid-19 pandemic hit. What’s the new normal? Take a look at spirits (tequila in particular), massage, and decor. Or better yet, these data show how we were all gardening last summer, baking bread, and sewing.

A few ideas on improving your life without even trying.

Hey kid. As a native Bostonian (inside 128), I often run into people who use the wrong words for things, especially when I’m traveling. When I order a tonic, please don’t bring me tonic water. When I ask for my coffee regular, that’s cream and sugar, not black. I honestly love all the peculiarities of my native tongue, and find it funny when I’m called out on it.

What I've been reading this week - June 30, 2021

I love this little video about the day the dinosaurs died. It was a normal day…and then it wasn’t.

Coming out of Covid-19, I’ve been thinking about how challenging it was to maintain relationships. Over at kottke.org, he shared an interesting piece on Dunbar’s number: that, on average, people can maintain about 150 friendships with others.

As my clients know, I’m not a huge fan of NPS. A question I get all the time is ‘Is this a good score?’ Well, here’s an article that shows you the scores of some of the biggest brands around. Take it for what it’s worth. I think more than anything this shows you how challenging NPS can be.

What I've been reading this week - May 10, 2021

As the US slowly moves toward higher rates of vaccination, brands need to understand how consumers buying habits have and will continue to change. This HBS article considers how the customer journey might evolve as our new normal is established.

Isn’t Kathryn Hahn the best? From her run as Agatha in this year’s WandaVision, to her role in Transparent, and everywhere in between, she’s a gem to watch. New York Magazine recently did a piece on things she can’t live without. Being of the same age(ish), I appreciated the many items appropriate for us Gen Xers.

I know literally one knot - the one I use to tie my shoes - and I’m always so impressed when someone pulls out a more appropriate knot for different situations. Take a look at this animated resource for knot tying and maybe add one or two more to your knot typing repertoire (the Rapala knot is a personal favorite)

What I've been reading this week - March 13, 2021

Here we are. A year into the lockdown…

While we’re still not traveling here at Ignite Research, we’re optimistic that we’ll be back on the road soon. In the meantime, we’ve enjoyed playing City Guesser that shows you brief clips from a city, and you have to guess where that clip was taken. I honestly spent a lot of time here - very enjoyable!

Many of us were so impressed with Amanda Gorman’s inauguration poem. Here’s her poem called Earthrise, a poem about climate change. Such an amazing young talent.

This article from Cognoscenti really encapsulated my feelings about the pandemic. I miss my friends and look forward to many, many reunions later this year.

What I've been reading this week - December 15, 2020

While I’m sure we are all ready to usher in 2021 - it has to be better, right? - I thought I’d share a few ‘best of’ lists that I’ve found over the past few days:

Best of television: The Times, The Atlantic, The AV Club, and many others have published their best of 2020 television lists. For me, I really enjoyed Mrs. America, The Great, Vikings, and The Watchmen (although this technically didn’t come out in 2020…). I’m currently watching The Flight Attendant and really loving it.

Best of books: Reading was more challenging this year - it was just harder to concentrate. Some of my favorites include American Dirt, A Women is No Man, Rodham, and The Ballad of Songbirds and Snakes. Here are lists from Time, NPR, and Kirkus.

Happy Holidays!

What I've been reading this week - November 9, 2020

Harvard Business Review has a great piece on how to brief a senior executive. It’s hard to succinctly present work to senior leaders, especially in research when you know there is so much ‘goodness’ that often can’t be presented due to time. For me, staying focused on the task is crucial to success, and understanding how to bring a team around that may have gone off course is a skill that I’ve worked on over the years. The other is staying silent. I think this is my superpower. Over the years I’ve become very comfortable taking a long pause. It makes people think, consider, and just slow down.

Some good thoughts on how to manage your career over time. Reading these 12 career lessons made me stop and think about my past, present, and future.

Ready for the holidays? The New York Times has published their 2020 Holiday Gift Guide. Always a helpful resource this time of year. I especially like the category called ‘Hard to Please’!

What I've been reading this week - October 26, 2020

Scientific American has a piece on the myths associated with Covid-19 and why people believe them. It’s worth reading.

This story on Stevie Nicks was fun. I recently saw her 24 Karat Gold movie at the cinema. I was one of 6 people there. The film was amazing. The experience of being in a - basically - empty cinema was oddly satisfying.

Most of us who work in marketing research and/or analytics have a strong understanding of Excel. i think that’s why I enjoyed this story on the Excel warriors who help companies fix their Excel mistakes. As mentioned in the article:

Research suggests more than 90 per cent of spreadsheets have errors, and half of spreadsheet models used in large businesses have “material defects”. Given some 750 million people use Excel globally, there are plenty of errors needing attention. One prominent researcher calls spreadsheets the dark matter of corporate IT.

What I've been reading this week - September 14, 2020

Today is the first day of school for our town, which is employing a hybrid model that entails splitting students into two groups who take turns being live at the school and being remote online. In our house, we’re starting with the remote option, which has actually eased us back into the school day.

The Covid-19 pandemic certainly has caused us stress. Here’s a short piece listing a few relaxation techniques to try to help reduce anxiety.

Alternatively (or in addition to) you might spend some time outdoors. Personally, I’m not one for roughing it, so this article on 5 fun spots to go glamping was a winner with me!

What I've been reading this week - May 22, 2020

I continue to find interesting pieces on how to conduct naming research. Here’s a nice list of considerations to keep in mind.

I love xkcd.com. This panel on Coronavirus polling hit close to home. This one is also fun.

I spent the weekend reading Rodham, an historical fiction asking what would have happened if Hillary didn’t marry Bill. I actually thought it was so clever, both on the Hillary storyline as well as the Bill storyline.

Ignite Research turned 6 this month. Yeah, us!

What I've been reading this week - April 18, 2020

I’m working on a naming project and, in my searching for some past research, came upon this interesting piece from 2015 that’s still relevant today. Naming is hard, and interesting, and weird.

Companies are releasing ‘secret’ recipes during the pandemic. It’s certainly an interesting way to stay relevant (or at least top of mind) and you can bet I’m making these DoubleTree Hotel cookies this weekend.

Seems like a good time for a refresher on Bayes Rule, right?

Math is weird.

Social isolation is difficult for some, and I really don’t envy the teachers who are not teaching via online methods. I think this little ditty likely sums up what a lot of our teachers are feeling these days.

What I've been reading this week - April 10, 2020

The COVID-19 pandemic is still hitting us hard here in Boston, but most people are doing their part to flatten the curve. Here’s a few things I’ve been reading this week to lighten the mood:

  • Vulture asked various television writers to imagine how their characters would deal with COVID-19. My favorite was 30 Rock’s episode (written by Tina Fey and Sam Means) where Liz refuses a trip to GE’s secret island. Also loved how Leslie Knope would already have a binder for that.

  • Are you making bread yet? We are. Here’s a nice recipe for sandwich bread, and my standby for weeknight dinners (I proof in my InstantPot, saving hours!)

  • Rev.com has a public transcript archive where they’ve been collecting COVID-19 briefings from around the world.

  • I really enjoyed this article highlighting how COVID-19 is making changes to the world around us. Have you noticed? Fewer rumblings from trains and cars, less air pollution, quieter city streets.

Stay safe.

What I've been reading this week - April 3, 2020

While the COVID-19 pandemic continues, here are a few lighter things I’ve been reading this week:

Finally, a little self promotion. Last year I conducted some research for Alyce. They’ve turned that work into a really compelling presentation called The State of Swag. Enjoy!

What I've been reading this week - March 20, 2020

The COVID-19 pandemic changed the landscape of work for many people this week. At Ignite Research, we’ve been working from a home office for the past 6 years and have a few tips for people for whom this might be a new experience:

  • Get ready for work in the morning - Each day, get up and get ready as if you’re headed out to work. For different people that means different things, but for us, it’s going to the gym, having breakfast, taking a shower, and getting dressed. This helps us to shift our mindset to work.

  • Take frequent breaks - When we started working from home, we noticed that the lack of in person colleagues meant that we didn’t get up nearly as much to ask a question, say hello, or even go to the printer down the hall. It’s vitally important to make frequent breaks during the day. For us, we make sure every hour to go up and down the stairs in the house. It sounds simple, but the movement is refreshing. We also always eat lunch in the kitchen, not at our desk.

  • Have set hours - At first, it was difficult not to work all the time. We didn’t set office hours because, well, our office was always available and honestly there was always work to do. But setting an end to the day was particularly helpful, and making sure to leave the office - that means no laptop - and go be with family and friends, make dinner, play a game, go for a walk was crucial in developing our happiness in a work from home office.

  • Find a distraction - When we worked in a traditional office, there are always distractions if you need them. I think of these distractions as palette cleansers - brief ‘things to do’ to help shift from one activity to another or to just have a way to stop thinking. For me, watching portions of 30-minute sitcom television is a great way to take a break - The Office, Parks and Rec, 30 Rock are all quick, easy, and funny distractions.

I found an interesting visualization of the history of pandemics that helps put into context our current situation. It also highlights the level of infectiousness of different diseases. My biggest takeaway was how dramatically infectious measles are compared with other diseases. I had no idea.

Stay safe and be well.

What I've been reading this week - Jan 31

Over the past 12 years, I’ve taken to publishing (for friends and family) the books I read that year. Here’s this years list - I hope you find something that interests you!

My favorites

Mission Hill (Abby Endicott Novels #1) by Pamela Wechsler

This Is How It Always Is by Laurie Frankel

Mrs. Everything by Jennifer Weiner

The Hundred-Year-Old Man Who Climbed Out of the Window and Disappeared (The Hundred-Year-Old Man, #1) by Jonas Jonasson

The Radium Girls: The Dark Story of America's Shining Women by Kate Moore

Nothing to See Here by Kevin Wilson

Very good books

The Institute by Stephen King

The Calculating Stars (Lady Astronaut, #1) by Mary Robinette Kowal

The Testaments by Margaret Atwood

The Last Widow (Will Trent, #9) by Karin Slaughter

City of Girls by Elizabeth Gilbert

The Rise and Fall of D.O.D.O. by Neal Stephenson

Lost Roses by Martha Hall Kelly

My Lovely Wife by Samantha Downing

Daisy Jones & The Six by Taylor Jenkins Reid

City of Flickering Light by Juliette Fay

My Sister, the Serial Killer by Oyinkan Braithwaite

Charming Billy by Alice McDermott

Good books

The Silent Patient by Alex Michaelides

The Price of Time by Tim Tigner

Carnegie's Maid by Marie Benedict

The Cactus by Sarah Haywood

The Tuscan Child by Rhys Bowen

Only Child by Rhiannon Navin

Norse Mythology by Neil Gaiman

I Can't Complain: (All Too) Personal Essays by Elinor Lipman

The Muralist by B.A. Shapiro

I wouldn’t recommend these - not because they’re necessarily ‘bad’ but just not to my taste

There There by Tommy Orange

Small Fry: A Memoir by Lisa Brennan-Jobs

What I've been reading this week - January 20, 2020

Happy New Year!

As a frequent traveler - and a formerly frequent red-eye traveler - I enjoyed this piece on how to sleep in coach. I tend to be the View Finder, but have also been the Bobblehead. Ah, the joys of business travel.

Over at Greenbook.org, a few insights and analytics folks shared their 2020 predictions. I personally think the biggest change coming at us centers around data governance and privacy, and I hope the industry continues to push on improved quality standards.

A former colleague and friend Diana Takach recently started Me Do, a clothing brand for children with consideration for kids who might have sensory processing challenges. I love her mission! Read more here.