{"id":284,"date":"2013-09-16T12:41:39","date_gmt":"2013-09-16T11:41:39","guid":{"rendered":"http:\/\/blogs.lshtm.ac.uk\/hppdebated\/?p=284"},"modified":"2014-12-02T17:55:56","modified_gmt":"2014-12-02T16:55:56","slug":"systematic-reviews-who-is-asking-the-question","status":"publish","type":"post","link":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/","title":{"rendered":"Systematic reviews: who is asking the question?"},"content":{"rendered":"

By Gill Walt<\/em><\/p>\n

A recently published paper by de Jongh et al<\/a>. reports on a study commissioned by the Global Fund to Fight AIDS, Tuberculosis and Malaria<\/a>. It offers a robust defence of the substantial financial investment donors have made with regard to these three diseases, demonstrating that their funds have had a measurable impact on health.<\/p>\n

The authors used a systematic review<\/a> approach to collecting and analysing the data, and ended up with thirteen individual papers (reporting on 11 studies) which were sufficiently detailed and rigorous to allow them to make a confident link between external funding and health impact.\u00a0 The great majority of studies that were perused (over 1600) did not fit the criteria selected, so the findings cannot be generalized beyond these 11 studies.<\/p>\n

Three points came to mind in reading the paper:<\/p>\n

First, one of the basic tenets when doing a systematic review is to identify a question which is relevant and interesting. \u00a0The question often depends on who is funding the systematic review. In this case, the paper <\/a>was commissioned by an important donor<\/a>, and the information produced was useful (and reassuring) for a group of donor policymakers, because it justified expenditure on HIV, TB and malaria. \u00a0It also provided some valid recommendations for the design of donor-funded studies. However, I did not find it a very exciting question. For example, I would like to know how<\/i> the external funds were invested? Was it through vertical or integrated programmes? Did one type of programme have more impact than another, or did it not matter how interventions were delivered? How far was the health system strengthened through the extra funds? A systematic review of one of those questions would potentially offer more useful information for understanding what works and what doesn\u2019t.<\/p>\n

Second, the authors show clearly how complex it is to undertake a study of this sort. They succeed magnificently \u2013 this is a really useful paper for those interested in doing systematic reviews \u2013 because it demonstrates the process and the difficulties along the way. But it would be interesting to know how long it took, what resources it entailed, and the inputs of each of the seven authors.\u00a0 Sometimes there is too much obeisance to the method. That is why it is important to identify the question being asked, because the amount of time and energy that goes into the search strategy, selection of eligible studies, data extraction and quality appraisal \u2013 let alone constructing a \u2018causal chain\u2019 –\u00a0 is mammoth, and might be better spent asking different questions using different methods..<\/p>\n

Third, and the paper\u2019s central point. It is surprising how few studies are well designed to a rigorous scientific standard.\u00a0 When donors put money into programmes, they should be subject to methodological scrutiny at the outset. Funding should be set aside for designing monitoring and evaluation processes which will identify up-front, possible \u00a0causal pathways, and what data is necessary to collect, and most likely to capture or explain, links between cause and effect or impact.<\/p>\n

Gill Walt is Emeritus Professor of International Health Policy at the London School of Hygiene and Tropical Medicine<\/a> and co-founder of Health Policy and Planning<\/a><\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

By Gill Walt A recently published paper by de Jongh et al. reports on a…<\/p>\n","protected":false},"author":151,"featured_media":288,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[24213],"tags":[24288,24215,24236,9238,21468],"class_list":["post-284","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-low-income-countries","tag-donors","tag-financing","tag-impact","tag-outcomes","tag-systematic-review","odd"],"yoast_head":"\nSystematic reviews: who is asking the question? - Health Policy and Planning Debated<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Systematic reviews: who is asking the question? - Health Policy and Planning Debated\" \/>\n<meta property=\"og:description\" content=\"By Gill Walt A recently published paper by de Jongh et al. reports on a...\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\" \/>\n<meta property=\"og:site_name\" content=\"Health Policy and Planning Debated\" \/>\n<meta property=\"article:published_time\" content=\"2013-09-16T11:41:39+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2014-12-02T16:55:56+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1024\" \/>\n\t<meta property=\"og:image:height\" content=\"683\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\"},\"author\":{\"name\":\"\",\"@id\":\"\"},\"headline\":\"Systematic reviews: who is asking the question?\",\"datePublished\":\"2013-09-16T11:41:39+00:00\",\"dateModified\":\"2014-12-02T16:55:56+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\"},\"wordCount\":531,\"commentCount\":0,\"image\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg\",\"keywords\":[\"Donors\",\"Financing\",\"Impact\",\"Outcomes\",\"Systematic review\"],\"articleSection\":[\"low-income countries\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\",\"name\":\"Systematic reviews: who is asking the question? - Health Policy and Planning Debated\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg\",\"datePublished\":\"2013-09-16T11:41:39+00:00\",\"dateModified\":\"2014-12-02T16:55:56+00:00\",\"author\":{\"@id\":\"\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg\",\"contentUrl\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg\",\"width\":1024,\"height\":683},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/\",\"name\":\"Health Policy and Planning Debated\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"\",\"url\":\"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/author\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Systematic reviews: who is asking the question? - Health Policy and Planning Debated","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/","og_locale":"en_GB","og_type":"article","og_title":"Systematic reviews: who is asking the question? - Health Policy and Planning Debated","og_description":"By Gill Walt A recently published paper by de Jongh et al. reports on a...","og_url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/","og_site_name":"Health Policy and Planning Debated","article_published_time":"2013-09-16T11:41:39+00:00","article_modified_time":"2014-12-02T16:55:56+00:00","og_image":[{"width":1024,"height":683,"url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg","type":"image\/jpeg"}],"twitter_misc":{"Written by":"","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#article","isPartOf":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/"},"author":{"name":"","@id":""},"headline":"Systematic reviews: who is asking the question?","datePublished":"2013-09-16T11:41:39+00:00","dateModified":"2014-12-02T16:55:56+00:00","mainEntityOfPage":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/"},"wordCount":531,"commentCount":0,"image":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg","keywords":["Donors","Financing","Impact","Outcomes","Systematic review"],"articleSection":["low-income countries"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/","name":"Systematic reviews: who is asking the question? - Health Policy and Planning Debated","isPartOf":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website"},"primaryImageOfPage":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage"},"image":{"@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage"},"thumbnailUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg","datePublished":"2013-09-16T11:41:39+00:00","dateModified":"2014-12-02T16:55:56+00:00","author":{"@id":""},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/"]}]},{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/2013\/09\/16\/systematic-reviews-who-is-asking-the-question\/#primaryimage","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg","contentUrl":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/files\/2013\/09\/walt3.jpg","width":1024,"height":683},{"@type":"WebSite","@id":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/#website","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/","name":"Health Policy and Planning Debated","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"","url":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/author\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/284","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/users\/151"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/comments?post=284"}],"version-history":[{"count":10,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/284\/revisions"}],"predecessor-version":[{"id":517,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/posts\/284\/revisions\/517"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/media\/288"}],"wp:attachment":[{"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/media?parent=284"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/categories?post=284"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.lshtm.ac.uk\/hppdebated\/wp-json\/wp\/v2\/tags?post=284"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}