{"id":1917,"date":"2019-11-26T17:00:03","date_gmt":"2019-11-26T17:00:03","guid":{"rendered":"http:\/\/blogs.lshtm.ac.uk\/hppdebated\/?p=1917"},"modified":"2019-11-26T17:12:38","modified_gmt":"2019-11-26T17:12:38","slug":"mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care","status":"publish","type":"post","link":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/","title":{"rendered":"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care?"},"content":{"rendered":"

By Jessica King (London School of Hygiene & Tropical Medicine)<\/p>\n

The million-dollar question<\/strong><\/p>\n

How can we best measure quality of care? It\u2019s the million-dollar question which those of us working in health systems and quality improvement would love to answer. So much of our time and effort is expended in trying to make the care that patients receive better, but it\u2019s hard to say exactly what better care means, and then to measure the results.<\/p>\n

That\u2019s the void into which the standardised patient was introduced: a mystery shopper, but for health facilities. People pretending to be patients isn\u2019t new; they\u2019ve been used as a training tool for decades, and medical students will be familiar with standardised patients in their practical exams. What\u2019s new is the idea that we can send standardised patients to doctors in real settings, and send them undercover- to measure how health workers behave when they don\u2019t know they are being observed.<\/p>\n

This raises a number of ethical, as well as practical, questions. Is there a danger to our fieldworkers when we send them to seek care in often basic settings? Does the deception of doctors by standardised patients violate norms of informed consent in medical research? Are we wasting the limited time and resources of health facilities by sending healthy people for consultations and to buy drugs?<\/p>\n

Potential risks and challenges<\/strong><\/p>\n

Those of us who use standardised patients in our work would argue that the risks are outweighed by the huge benefit of good data on quality of care which no other measurement tool can provide. As well as avoiding the Hawthorne effect (when people change their behaviour because they\u2019re being observed), they allow the researcher to control the patient and disease mix, avoiding confounding and meaning that the treatment of rarer conditions be investigated without the need of long observation periods waiting for the right patient to turn up in a health facility . And importantly, in our new Editor\u2019s choice paper<\/a> we explain how many of the risks can be mitigated and minimised.<\/p>\n

We also discuss the practical challenges faced in organising a standardised patient survey. How can healthy people pretend to be ill? You have to carefully select conditions so that obvious visual symptoms aren\u2019t required. We suggest scenarios which work: a person who reports a history of coughing, night sweats and weight loss should be treated as a potential TB patient and referred for testing, regardless of whether they look unwell or the doctor can hear \u2018crackles\u2019 on the chest.<\/p>\n

A creative approach is sometimes required; for example, if you\u2019re interested in the quality of malaria case management, you can\u2019t send real malaria patients into health facilities. What we do instead is train our standardised patients to say they have a fever and think they have malaria- and the thing we test is whether or not they\u2019re offered a test, and whether the test gives the correct (negative!) result.<\/p>\n

Still, it\u2019s important to ask how good standardised patients are at convincing doctors \u2013 is it ever obvious from their behaviour and appearance that they aren\u2019t real? One way to answer this question is to conduct a detection survey. After the standardised patient visits are all finished, researchers contact the health facilities and ask if they suspected any recent patients were actually standardised patients. If the answer is yes, we take more details so we can confirm whether their suspicions were correct. In a recent study I carried out in Tanzania, 5% of our standardised patients were detected by health workers, but this varied by setting; in busy urban facilities detection rates were lower, but in rural settings where the presence of an outsider was more obvious, they were more likely to be detected.<\/p>\n

Conclusion<\/strong><\/p>\n

Yes, standardised patients aren\u2019t a perfect tool- they can\u2019t be used to measure all quality of care (it\u2019s hard to imagine how they could check on the quality of antenatal and delivery care, for example!) and they\u2019re more challenging to implement than patient exit interviews. But the depth and richness of the data they give us make them well worth the extra effort.<\/p>\n

\n

Access the paper in Health Policy and Planning<\/a>.<\/em><\/p>\n

Image credit: Jessica King<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

By Jessica King (London School of Hygiene & Tropical Medicine) The million-dollar question How can…<\/p>\n","protected":false},"author":576,"featured_media":1921,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16247,24205,24213],"tags":[26950,77790,77791,77789],"class_list":["post-1917","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-health-policy","category-health-systems","category-low-income-countries","tag-lmic","tag-mystery-shoppers","tag-quality-of-care","tag-standardised-patients","odd"],"yoast_head":"\nMystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated\" \/>\n<meta property=\"og:description\" content=\"By Jessica King (London School of Hygiene & Tropical Medicine) The million-dollar question How can...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\" \/>\n<meta property=\"og:site_name\" content=\"Health Policy and Planning Debated\" \/>\n<meta property=\"article:published_time\" content=\"2019-11-26T17:00:03+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2019-11-26T17:12:38+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"613\" \/>\n\t<meta property=\"og:image:height\" content=\"556\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"phpunsal\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"phpunsal\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"4 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\"},\"author\":{\"name\":\"phpunsal\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97\"},\"headline\":\"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care?\",\"datePublished\":\"2019-11-26T17:00:03+00:00\",\"dateModified\":\"2019-11-26T17:12:38+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\"},\"wordCount\":726,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png\",\"keywords\":[\"LMIC\",\"mystery shoppers\",\"quality of care\",\"standardised patients\"],\"articleSection\":[\"health policy\",\"health systems\",\"low-income countries\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\",\"name\":\"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png\",\"datePublished\":\"2019-11-26T17:00:03+00:00\",\"dateModified\":\"2019-11-26T17:12:38+00:00\",\"author\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png\",\"contentUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png\",\"width\":613,\"height\":556},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/\",\"name\":\"Health Policy and Planning Debated\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97\",\"name\":\"phpunsal\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0eb8024050dfb79188ec632b3c126b21503861881ec0932af76989917471a5d0?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0eb8024050dfb79188ec632b3c126b21503861881ec0932af76989917471a5d0?s=96&d=mm&r=g\",\"caption\":\"phpunsal\"},\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/author\/phpunsal\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/","og_locale":"en_GB","og_type":"article","og_title":"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated","og_description":"By Jessica King (London School of Hygiene & Tropical Medicine) The million-dollar question How can...","og_url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/","og_site_name":"Health Policy and Planning Debated","article_published_time":"2019-11-26T17:00:03+00:00","article_modified_time":"2019-11-26T17:12:38+00:00","og_image":[{"width":613,"height":556,"url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png","type":"image\/png"}],"author":"phpunsal","twitter_misc":{"Written by":"phpunsal","Estimated reading time":"4 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#article","isPartOf":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/"},"author":{"name":"phpunsal","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97"},"headline":"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care?","datePublished":"2019-11-26T17:00:03+00:00","dateModified":"2019-11-26T17:12:38+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/"},"wordCount":726,"commentCount":0,"image":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png","keywords":["LMIC","mystery shoppers","quality of care","standardised patients"],"articleSection":["health policy","health systems","low-income countries"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/","name":"Mystery shoppers for healthcare providers: risky or rewarding in measuring quality of care? - Health Policy and Planning Debated","isPartOf":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage"},"image":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png","datePublished":"2019-11-26T17:00:03+00:00","dateModified":"2019-11-26T17:12:38+00:00","author":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2019\/11\/26\/mystery-shoppers-for-healthcare-providers-risky-or-rewarding-in-measuring-quality-of-care\/#primaryimage","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png","contentUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2019\/11\/Capture-2.png","width":613,"height":556},{"@type":"WebSite","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/","name":"Health Policy and Planning Debated","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/28a4efb1d1010ffde9ce165ad9dd7e97","name":"phpunsal","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0eb8024050dfb79188ec632b3c126b21503861881ec0932af76989917471a5d0?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0eb8024050dfb79188ec632b3c126b21503861881ec0932af76989917471a5d0?s=96&d=mm&r=g","caption":"phpunsal"},"url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/author\/phpunsal\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/1917","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/users\/576"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/comments?post=1917"}],"version-history":[{"count":2,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/1917\/revisions"}],"predecessor-version":[{"id":1922,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/1917\/revisions\/1922"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/media\/1921"}],"wp:attachment":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/media?parent=1917"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/categories?post=1917"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/tags?post=1917"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}