{"id":200,"date":"2020-04-13T05:10:05","date_gmt":"2020-04-13T05:10:05","guid":{"rendered":"https:\/\/blogs.isb.edu\/healthcare\/?p=200"},"modified":"2025-12-31T09:24:41","modified_gmt":"2025-12-31T09:24:41","slug":"building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty","status":"publish","type":"post","link":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/","title":{"rendered":"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty"},"content":{"rendered":"<p style=\"text-align: center\"><em>By Alekhya Chaparala,\u00a0Research Assistant,\u00a0MIHM<\/em><\/p>\n<div>On a cool day last December, I visited the Kopaganj Community Center in Uttar Pradesh\u2019s Mau district. Implementation of an MIHM costing study on family planning was about to begin, and I was in the field to finalize operations and brief local officials before data collection commenced the following week. My work largely involved traveling between our study districts and tracking down various district health officials. At any given moment these officials could be in their offices, on a site visit, or performing a surgery \u2013 which is how I ended up at the CHC in Kopaganj, looking for the Chief Medical Officer (CMO) of Mau. Kopaganj was not one of our originally selected study facilities. The facilities for the costing study had been selected based on service delivery data recorded online in the Uttar Pradesh Health Management Information System (UPHMIS) portal, and delivery of female sterilization had been a priority inclusion criterium.<\/div>\n<div><\/div>\n<div>We had originally selected the nearby Ratanpura CHC for our study, which had performed the most female sterilizations in the past year based on UPHMIS data. However, upon reaching Kopaganj, I quickly learned that this was not the case. I found the CMO sitting in a packed administrative office with a steady stream of staff flowing in and out. He beckoned me to sit next to him, and I quickly explained the purpose of my visit before we could get interrupted by one of the many people vying for his attention. When I mentioned that we planned to collect data from Ratanpura CHC, he frowned.\u00a0 \u201cWhy are you studying Ratanpura? Study this facility,\u201d the CMO said, gesturing emphatically. I tried to explain that we had already selected Ratanpura, but he continued insisting. \u201cNo, no, this is a better facility. You will get better data here.\u201d Perhaps the Ratanpura facility was poorly maintained, I thought, and he worried it would reflect badly on his team.<\/div>\n<div><\/div>\n<div>\u201cWe are looking for the facilities that perform the most female sterilization,\u201d I explained. \u201cHaan, then study here!\u201d the CMO responded, tapping the desk in front of him. \u201cFemale sterilization is performed only here.\u201d What? How could that be? \u201cWhat do you mean?\u201d I asked. \u201cThis is the only CHC which performs female sterilization,\u201d he repeated. \u201cIn the whole district?\u201d \u201cYes. I know because I am the only one who performs sterilization!\u201d he laughed at my confusion, finally delivering the punchline. \u201cBut, that\u2019s not what the UPHMIS data said,\u201d I attempted weakly, realizing even before I finished that the data we had originally consulted was likely very flawed.<\/div>\n<div><\/div>\n<div>UPHMIS data is facility-reported, after all, leaving plenty of opportunity for embellishment. I looked across the room at a large PC where the facility\u2019s designated data operator sat, and wondered if were we about to embark on a data-collecting mission in all the wrong facilities. After ten minutes of back-and-forth questions with the CMO, I accepted that we would have to swap out Ratanpura for Kopaganj in our study. As an early career researcher, this was my first experience with what seasoned researchers know well \u2013 that data is messy, flawed, and often misrepresentative of reality. Despite having carefully pored over UPHMIS data for dozens of facilities and health indicators before selecting the study facilities, I suddenly felt as if we had been flying blind the whole time.<\/div>\n<div><\/div>\n<div>Although our study was a relatively small-scale one, breakdown in data quality is not an uncommon occurrence. Primary data forms the bedrock of social services \u2013 implementing, assessing and recalibrating public programs requires an understanding of what is happening on the ground. And when the story we see is incomplete or inaccurate, the decisions we make about how to fund, expand or implement social programs can lead to resources being allocated in ways that ultimately prove\u00a0 ineffective, or even harmful. The National Family Health Survey (NFHS) is a larger example of this. As the largest source of primary health data in India, NFHS provides data upon which thousands of health-related research studies, public programs and policy decisions are based. Yet NFHS\u2019s well-documented weaknesses &#8212; including a lengthy questionnaire and poorly trained and compensated field researchers &#8212; pose a significant vulnerability to India\u2019s public health sector, which has built its programs largely based on NFHS findings for the last twenty-plus years.<\/div>\n<div><\/div>\n<div>So what do we do when the data we\u2019re working with is flawed? How do we implement solutions when we don\u2019t fully know the scope and details of the problem? There is no perfect solution &#8212; how large the gap between data and reality is for any given dataset is, by nature, impossible to fully ascertain. Instead, we must commit to thorough investigations of data quality at every point of the research process, and recognize current limitations as a jumping-off point for future study.<\/div>\n<div><\/div>\n<div>Firstly, investigators should be mindful of the challenges of data collection, and be amenable to accommodations in study protocol which allow the most accurate data possible to be captured. Likewise, field researchers should have not just proper training but also an investment in the study, in order to understand when and how to make these accommodations in real-time. And lastly, policy-makers, social program implementors and other stakeholders who use base their decision-making on ground-level evidence should allow a buffer for the dynamic, imperfect nature of primary research, and likewise work to improve conditions for program data collection wherever possible. Data tells a story, translating the world around us into building blocks for growth and innovation. Much can get lost in translation, however, and it up to us as researchers and program architects to constantly question and clarify the message we receive, in order to gather the clearest, most holistic picture of the truth as possible.<\/div>\n","protected":false},"excerpt":{"rendered":"<p>By Alekhya Chaparala,\u00a0Research Assistant,\u00a0MIHM On a cool day last December, I visited the Kopaganj Community Center in Uttar Pradesh\u2019s Mau district. Implementation of an MIHM costing study on family planning was about to begin, and I was in the field to finalize operations and brief local officials before data collection commenced the following week. My [&hellip;]<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"_uf_show_specific_survey":0,"_uf_disable_surveys":false},"categories":[9],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.5 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management\" \/>\n<meta property=\"og:description\" content=\"By Alekhya Chaparala,\u00a0Research Assistant,\u00a0MIHM On a cool day last December, I visited the Kopaganj Community Center in Uttar Pradesh\u2019s Mau district. Implementation of an MIHM costing study on family planning was about to begin, and I was in the field to finalize operations and brief local officials before data collection commenced the following week. My [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/\" \/>\n<meta property=\"og:site_name\" content=\"Max Institute of Healthcare Management\" \/>\n<meta property=\"article:published_time\" content=\"2020-04-13T05:10:05+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-12-31T09:24:41+00:00\" \/>\n<meta name=\"author\" content=\"Healthcare at ISB\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Healthcare at ISB\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/\",\"url\":\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/\",\"name\":\"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management\",\"isPartOf\":{\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/#website\"},\"datePublished\":\"2020-04-13T05:10:05+00:00\",\"dateModified\":\"2025-12-31T09:24:41+00:00\",\"author\":{\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/d99e27b4524ef627ccbb90b2705a91b0\"},\"breadcrumb\":{\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/blogs.isb.edu\/healthcare\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/#website\",\"url\":\"https:\/\/blogs.isb.edu\/healthcare\/\",\"name\":\"Max Institute of Healthcare Management\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blogs.isb.edu\/healthcare\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/d99e27b4524ef627ccbb90b2705a91b0\",\"name\":\"Healthcare at ISB\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/e6bc21277345112f1a00361a9ed2a708?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/e6bc21277345112f1a00361a9ed2a708?s=96&d=mm&r=g\",\"caption\":\"Healthcare at ISB\"},\"sameAs\":[\"https:\/\/blogs.isb.edu\/healthcare\/\"],\"url\":\"https:\/\/blogs.isb.edu\/healthcare\/author\/isbhealthcare\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/","og_locale":"en_US","og_type":"article","og_title":"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management","og_description":"By Alekhya Chaparala,\u00a0Research Assistant,\u00a0MIHM On a cool day last December, I visited the Kopaganj Community Center in Uttar Pradesh\u2019s Mau district. Implementation of an MIHM costing study on family planning was about to begin, and I was in the field to finalize operations and brief local officials before data collection commenced the following week. My [&hellip;]","og_url":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/","og_site_name":"Max Institute of Healthcare Management","article_published_time":"2020-04-13T05:10:05+00:00","article_modified_time":"2025-12-31T09:24:41+00:00","author":"Healthcare at ISB","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Healthcare at ISB","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/","url":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/","name":"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty - Max Institute of Healthcare Management","isPartOf":{"@id":"https:\/\/blogs.isb.edu\/healthcare\/#website"},"datePublished":"2020-04-13T05:10:05+00:00","dateModified":"2025-12-31T09:24:41+00:00","author":{"@id":"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/d99e27b4524ef627ccbb90b2705a91b0"},"breadcrumb":{"@id":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blogs.isb.edu\/healthcare\/2020\/04\/13\/building-with-imperfect-tools-notes-from-the-field-on-data-quality-and-uncertainty\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/blogs.isb.edu\/healthcare\/"},{"@type":"ListItem","position":2,"name":"Building With Imperfect Tools: Notes from the Field on Data Quality and Uncertainty"}]},{"@type":"WebSite","@id":"https:\/\/blogs.isb.edu\/healthcare\/#website","url":"https:\/\/blogs.isb.edu\/healthcare\/","name":"Max Institute of Healthcare Management","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blogs.isb.edu\/healthcare\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/d99e27b4524ef627ccbb90b2705a91b0","name":"Healthcare at ISB","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/blogs.isb.edu\/healthcare\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/e6bc21277345112f1a00361a9ed2a708?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/e6bc21277345112f1a00361a9ed2a708?s=96&d=mm&r=g","caption":"Healthcare at ISB"},"sameAs":["https:\/\/blogs.isb.edu\/healthcare\/"],"url":"https:\/\/blogs.isb.edu\/healthcare\/author\/isbhealthcare\/"}]}},"_links":{"self":[{"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/posts\/200"}],"collection":[{"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/comments?post=200"}],"version-history":[{"count":1,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/posts\/200\/revisions"}],"predecessor-version":[{"id":689,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/posts\/200\/revisions\/689"}],"wp:attachment":[{"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/media?parent=200"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/categories?post=200"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.isb.edu\/healthcare\/wp-json\/wp\/v2\/tags?post=200"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}