Introduction
Recent innovation around measuring household-level water insecurity has filled an important gap.1 Previously, water insecurity was primarily measured at national or regional scales and tended to focus on water volumes or other physical, hydrological conditions.2 3 The innovation around household-level scales, particularly those that capture people’s water-related experiences, reflects a needed shift toward a human-centred approach that is better aligned with human capabilities and activities.4
Most currently used household water insecurity metrics are scales constructed from a series of short survey questions that assess perceived components of water insecurity such as access, affordability, quality or quantity.2 Early versions of experience-focused scales tended to be tailored to particular settings, and could thus capture the effects of water insecurity in ways that take into account local language and cultural contexts.5–8
The Household Water Insecurity Experiences (HWISE) scale was created as the first cross-culturally validated household-level scale through a concerted effort to develop an experiential scale that could be used across water-insecure contexts.9 Candidate survey items were collected at 27 different locations, and scale development led to a final set of 12 items that comprise the original HWISE scale. These items were derived from 11 sites and capture household-level disruptions related to water availability, consumption, personal hygiene and psychosocial distress using a 4-week recall period. The HWISE scale was intended as a rapid screener of household- and community-level water insecurity and as a potential monitoring and evaluation tool, and it was eventually adapted into a 4-item short form version.10 In multisite studies, variations of the 12-item HWISE scale have been associated, as hypothesised, with measures of food insecurity,11 mental health,12 water expenditures,13 interpersonal conflict14 and water borrowing.15
The HWISE scale was subsequently adapted into an individual water insecurity experiences (IWISE) scale16 and 4-item short form17 to facilitate rapid water insecurity screening in other health and development surveys. The IWISE scale recognises that individuals are best able to characterise their own experiences, and that household-level metrics can obscure intrahousehold variation in water insecurity related to age, gender, household responsibilities and other sociodemographics.4 16 The IWISE scale thus lends itself to measuring intrahousehold water dynamics by surveying multiple household members to understand within-household differences in the impacts of water insecurity, a potentially important innovation for both research and intervention. But this is not how it has been implemented to date. Rather, it has been deployed in more global settings than any other water metric due to its inclusion in the 2020 Gallup World Poll in 31 countries, a national-level sample of individuals who were not nested in households.16 This deployment—intended to generate national estimates of water insecurity—made two important compromises.
First, this cross-national implementation of the IWISE scale used a recall period of 12 months with items scored from 0 to 3 as never (0); 1–2 months (1); some, not all, months (2); or almost every month (3). This diverges from the 4-week recall period of the original HWISE scale. This change mirrored the standard recall period of other measures in the Gallup World Poll,16 and was suggested by the scale developers to better capture the impacts of seasonal variation in precipitation and temperature on water access.17
But the temporal aggregation of experiences over 12 months ignores evidence about how water insecurity experiences can fluctuate as frequently as daily due to seasonality, water system intermittency and social factors.18–21 This effectively decreases the resolution of water insecurity measurement and introduces significant interpretative limitations. HWISE/IWISE scale data collected using a 4-week recall period could potentially be compared within or across seasons. But the 12-month recall period and scoring system can yield similar scores for a set of seasonally acute water problems and a single chronic year-round water problem—situations which beckon very different interventions. Even more problematically, the 12-month recall period ignores a large and well-documented literature showing that recall-based data at long time scales are highly inaccurate, especially for chronic conditions.22 While some loss of precision and accuracy may be acceptable for the purposes of informal stakeholder monitoring, it poses significant challenges to valid research.
Second, recent IWISE implementations have classified individuals as water insecure if their IWISE score was 12 or higher on the scale ranging from 0 to 36.23 24 This cut-off score of 12 was generated using data-driven approaches during the original HWISE scale validation9 and effectively reduces the complex experience of water insecurity to a binary attribute. The IWISE methodology thus classifies an individual who experiences 11 of the 12 IWISE items during 1–2 months a year—or any other configuration that produces an IWISE score of 11— as water secure.
This is inconsistent with one of the most commonly cited notions of water insecurity, that is, that approximately two-thirds of the global population experience severe water scarcity at least 1 month of the year.25 Such a reductive view of water insecurity is also inconsistent with a broad literature that theorises household-level and individual-level water insecurity as comprising many interconnected experiences that are best conceptualised as a matter of degree.1 26 But we suggest that this use of a binary cut-off point, especially at a national level, may also be harmful in more serious and systemic ways. It can easily render less visible—or even invisible—the experiences of non-majority groups who are already more likely to be water insecure, and in ways that can perpetuate or even create new water, sanitation and/or hygiene (WASH) stigmas.27 The use of a cut-off point to interpret the HWISE or IWISE scale is thus problematic because it very easily fundamentally distorts the interpretation of water insecurity. That is, a respondent’s best estimation of whether a single IWISE item was experienced during 2 versus 3 months over the prior year—which manifests as a 1-point difference in scoring—can ultimately determine whether an individual (or the demographic segment that they represent) is classified as water insecure or secure.
The reconceptualisation of the IWISE scale as a set of annual experiences—combined with little evidence of test–retest reliability, which is essential for a monitoring and evaluation tool28—raises other questions about whether these new scale variants inadvertently risk generating what Satterthwaite called ‘nonsense statistics’ (in that case, in the context of the Millennium Development Goals)29 that are difficult to meaningfully interpret or use in scientific terms. As scientists, it is critical that we acknowledge the limitations and even dangers of these increasingly popular tools. We need to envision and develop a next generation of water insecurity metrics that reflects the complexity and variance of water insecurity experiences (including embedded inequalities) and provides refined tools to further examine the causes and consequences of such experiences scientifically.
So, how can we extend these water insecurity tools to provide richer information about the types of water system improvements that would make the biggest impact at household and individual scales? To this end, next we identify three core aspects of water insecurity—severity, adaptation and resilience—that should be prioritised for future assessment as new monitoring, evaluation, and scientific tools across diverse contexts.