Mystery shoppers take the mystery out of the patient experience

When Angela Simpkin arrived at the urgent care, she couldn't tell where she was supposed to check in. Paper signs were taped all over the glass reception window. The scowling receptionist seemed unaware of her arrival. When Simpkin (not her real name) asked for assistance, the scowler pointed to a stack of forms and a sign that demanded, "Please complete form before registering."

"I was so irritated I was ready to turn and walk out," she says. "But then I remembered that as the mystery patient, this is exactly what I was here for—to observe and stay tuned into my reactions to the encounter. In less than two minutes, I had a pretty good idea about the real patients' experience."

Simpkin is a trained mystery shopper who specializes in healthcare. Sitting down in the waiting room, Simpkin covertly retrieved a notepad from her purse and, under the guise of doing a crossword puzzle, began to jot notes for her report—including a reference to the rude receptionist. She overheard conversations between other patients; two were complaining about the wait time, and a third said she had to go to the bathroom but was afraid to leave for fear of missing her turn.

Kevin Stranberg, another mystery patient, feels that his power of observation helps shed light on problem areas. "I'm not a clinical person, but when I do mystery shopping, I focus mainly on how the experience made me feel," he says.

Stranberg describes a negative experience: "The receptionist shoved papers at me and asked for my insurance card. When I said I had no insurance, she sighed and sounded irritated when she asked, 'Did they tell you about our payment policy? You'll have to pay something today.' Then the intake information asked for the same information on three different forms. So when the doctor walked into the exam room without making eye contact and mumbling some indecipherable greeting, I was mentally filling out my forms indicating that I would be highly unlikely to recommend this practice."

A face on the data
Mystery shopping, a reliable assessment tactic used for years by banks, restaurants, and hotels, has exploded on the healthcare scene in recent years.

Although many healthcare organizations are measuring patient satisfaction, their data don't always pinpoint the experiences behind the scores. Mystery shoppers fill in the fine details and help organizations understand how patients feel about their experiences, apart from how they feel about their medical treatment.

Mystery shoppers are keen observers. The average patient in the physician's waiting room probably isn't timing how long it actually takes before he's escorted to an exam room. But mystery shoppers will know exactly how many minutes they waited—and will tell you if they felt it was too long. They'll also observe whether patients are informed of wait times, what can be overheard from the reception desk, and how close the nearest restroom and drinking fountain are.

"We don't just uncover the problem areas," Stranberg says. "We also identify things that contribute to a great experience. In one emergency department, we observed a nurse who came out to the waiting room and made rounds with patients about every 20 minutes or so. In that situation, I documented that it made me feel reassured and confident in the experience."

Mystery shoppers follow a feedback form with criteria developed in part by the organization being "shopped." In situations in which the organization has specific standards, the mystery shopping experience will ferret out how well the staff lived up to those standards.

When organizations make culture changes, real-life experiences and stories have the greatest impact.

It's one thing to have data about how likely people are to recommend your services, says Stranberg. But if you can stand in front of a group and say, "When the nurse got down to eye level with the elderly woman in the waiting room, and put his hand on hers, I felt that he, and probably every person in this ER, really cares about us," it has much more meaning.

Feedback from mystery shoppers validates data from patient satisfaction surveys. Interpreting data is a cerebral activity. The concrete, detailed descriptions and stories shared by mystery shoppers helps move that information from the head to the heart.

Steve Sparks, director of PR and marketing for St. Mary's Hospital in Madison, WI, recently engaged mystery shoppers. "We were completing a major expansion of our emergency department," Sparks says. "We wanted to know how easy it was to get in, if the signage was clear, how well our staff put you at ease, if staff made eye contact and treated you like a person and not just another clinical case."

The mystery shopping data were similar to the data from the quantitative surveys the organization had already completed. "For example, our survey asks if you were treated with respect, and the patient will grade you on a Likert scale. But the mystery shopper could speak more to the experience," Sparks says, adding that mystery shoppers also pointed out staff members who stood out as stars. "That was just as important in this process as finding the weak areas in need of improvement."

Sparks tells of a mystery patient who felt "discounted" when one provider poked his head into the exam room to speak with the other physician during an appointment—information that may never have been revealed by a survey. It's not intended to take the place of surveys, he says, "it's simply another form of research to drill deeper into the patient experience . . . Mystery shoppers put a face on the data."

A closer look at first contact
Barry Ensminger, vice president of external affairs for Maimonides Medical Center in Brooklyn, NY, recently engaged mystery shoppers to assess the customer experience with direct phone contacts to his organization. "We wanted to learn more about how all those phones were being answered," says Ensminger. "Does the caller get what he wanted? If a staff member in one of those departments doesn't have the information requested, how will he handle the call?"

During the assessment, a reputable outside firm made hundreds of telephone contacts. As a result, "virtually no one here has questioned the accuracy," says Ensminger. "That has been very important in building the buy-in needed to make the necessary changes. Equally important is that the mystery shopper report helped us to identify internal best practices. That way, when we go to make the recommended changes, we can utilize those strengths and replicate their practices throughout. Those two things alone offered lots of value."

Ensminger's mystery shoppers found that callers were disconnected during a number of transfers. In many departments, the employee answering the phone didn't have even some of the most basic information about hospital services. And in several encounters, the staff members seemed rushed and eager to get the caller off the phone.

"By using mystery shopping," he says, "I was able to point out our shortcomings in a way that eliminated the denial and built engagement. The approach gave hard evidence that no one can question. Not one person said, 'It's not a problem' . . . The data speaks."

A path to improvement
As a mystery shopper myself, I have been able to help physicians understand how their comments, gestures, body language, and facial expressions made me feel during an encounter. In many cases, the physicians were surprised to learn the kind of impression they made on me. And many of these providers, if receptive to coaching, were eager to learn some specific actions they could take to improve the patient experience.

In one case, I presented as a self-pay patient for a physical. During the exam, the physician mentioned that at my age, I should have a colonoscopy—and quickly added, "but that can be expensive." With a stroke of her pen, she marked it off her list. Three times during the encounter, the physician mentioned the cost of tests. At first I thought she was being helpful by keeping me informed about the cost for services. But by the time I left, I felt that she had determined what I could and could not afford and did not give me the option of making these decisions for myself.

During the follow-up coaching session, I had the opportunity to tell this physician how her comments made me feel and to talk with her about how she can engage the patient in making decisions about whether to pursue elective tests.

Done right, mystery shopping can help you evaluate how well your staff is living the organization's mission, vision, and brand promise in daily operations. Mystery patients will use real-life situations tailored to each particular area of your organization, from a physician's office to the emergency department to inpatient and outpatient settings. They may even have another mystery shopper accompany them as a family member in order to supply additional details from another important point of view.

And though telephone mystery shoppers will have different criteria than the in-person shoppers, they can glean several important details about your organization's services in this area.

Mystery shoppers can shed a revealing light, taking the mystery out of the customer experience.