*Director, Applied Disaster Metrics- Office of Critical Event Preparedness and Response (CEPAR) *Assistant Professor, School of Medicine- Department of Emergency Medicine Bloomberg School of Public Health- Department of International Health
Attending, Emergency Medicine, Cook County Hospital Assistant Medical Director, Adult Emergency Services Assistant Professor, Rush Medical College
Associate Professor Department of Emergency Medicine Department of International Health The Johns Hopkins University School of Medicine and Bloomberg School of Public Health
Background: Complex Humanitarian Emergencies (CHE) result in rapid degradation of population health and quickly overwhelm indigenous health resources. Numerous governmental, non-governmental, national and international organizations and agencies are involved in the assessment of post-CHE affected populations. To date, there is no entirely quantitative assessment tool conceptualized to measure the public health impact of CHE. Methods: Essential public health parameters in CHE were identified based on the Sphere Project "Minimum Standards", and scoring rubrics were proposed based on the prevailing evidence when applicable. Results: 12 quantitative parameters were identified, representing the four categories of “Minimum Standards for Disaster Response” according to the Sphere Project; health, shelter, food and nutrition, in addition to water and sanitation. The cumulative tool constitutes a quantitative scale, referred to as the Public Health Impact Severity Scale (PHISS), and the score on this scale ranges from a minimum of 0 to a maximum of 100. Conclusion: Quantitative measurement of the public health impact of CHE is germane to accurate assessment, in order to identify the scale and scope of the critical response required for the relief efforts of the affected populations. PHISS is a new conceptual metric tool, proposed to add an objective quantitative dimension to the post-CHE assessment arsenal. PHISS has not yet been validated, and studies are needed with prospective data collection to test its validity, feasibility and reliability. Citation: Bayram JD, Kysia R, Kirsch TD. Disaster Metrics: A Proposed Quantitative Assessment Tool in Complex Humanitarian Emergencies – The Public Health Impact Severity Scale (PHISS). PLOS Currents Disasters. 2012 Aug 21. doi: 10.1371/4f7b4bab0d1a3.
Complex Humanitarian Emergencies (CHE) constitute a multifaceted global public health threat. Contextually, there are multiple interpretations of the term CHE. The United Nations (UN) Inter-Agency Steering Committee defines CHE as: “A humanitarian crisis in a country, region or society where there is a total or significant breakdown of authority resulting from internal or external conflict and which requires an international response that goes beyond the mandate or capacity of any single agency and/or the ongoing UN country program. Common characteristics include: civilian casualties, and populations besieged or displaced; serious political or conflict-related impediments to delivery of assistance; inability of people to pursue normal social, political or economic activities; high security risks for relief workers; and international and cross-border operations affected by political differences.”
The Sphere Project, launched in 1997 by a group of humanitarian non-governmental organizations and the Red Cross and Red Crescent movement, proposed a set of public health “Minimum Standards for Disaster Response” that need to be monitored and addressed in various phases of disaster response. The four categories of minimum standards are health, food and nutrition, shelter, water and sanitation. The Sphere Project is now in its third edition (2011), and is considered the foundation of public health response in CHE.
To evaluate the public health impact of CHE, in order to provide guidance for disaster relief efforts, organizations and agencies have adopted a myriad of assessment tools. Currently, individual agencies conduct separate assessments utilizing a multiplicity of methods for data-gathering and reporting.
The objective of this study is to propose a conceptual quantitative assessment tool to measure the severity of the public health impact resulting from Complex Humanitarian Emergencies (CHE), based on The Sphere Project "Minimum Standards". Testing the feasibility and validity of the proposed tool is not the objective of this manuscript. Acknowledging the importance of qualitative analysis in conjunction with quantitative data, the proposed tool, henceforth referred to as the Public Health Impact Severity Scale (PHISS), complements and builds upon existing tools and qualitative analyses by providing an objective, quantitative and cumulative measures.
Based on the four “Minimum Standards” listed in The Sphere Project 2011 (i.e. health, food and nutrition, shelter, water and sanitation), the authors identified relevant essential public health indicators in CHE. By consensus, the final group of indicators (parameters) was selected, and the scoring rubric for each parameter was stochastically assigned. Whenever applicable, already existing standardized parameters and scores were adopted. The baseline and ceiling scoring values for each parameter, based on criteria available in the literature. Various examples from actual retrospective CHE were provided illustrating how to utilize the scoring rubric for each parameter. Inclusion criteria for each parameter were quantifiability, and being a public health indicator based on The Sphere Project.
Twelve parameters were identified, representing the four categories of “Minimum Standards” according to The Sphere Project 2011; namely health, shelter, food and nutrition, in addition to water and sanitation. These parameters were: number of excess deaths, number of under-5 excess deaths, number of cases with acute communicable diseases, number of cases with injuries due to the CHE, levels of healthcare services, number of young children with acute malnutrition, level of healthcare services, number of displaced persons, number of persons with inadequate living space, water quantity, water quality, level of sanitation facilities, and gender-based violence. The cumulative scale (PHISS) is quantitative, with a score ranging from a minimum of 0 to a maximum of 100. Below is a detailed description of each parameter selected, the basis for parameter selection, and their suggested scoring rubric, with representative examples.
The floor of the scoring rubric for this parameter was chosen to be 10 deaths. This number stems from the criteria adopted by the Centre for Research on the Epidemiology of Disasters (CRED); a collaborative initiative established in 1988 by the WHO and the Belgian government that has been maintaining a database on international disasters named EM-DAT.
<10
0
None recorded by EM-DAT
N/A
10-99
1
Greece, 2007, forest fire
67
100-999
2
United States, 1947, explosion
561
1,000-4,999
3
Papua New Guinea, 1951, volcanic eruption
3,000
5,000-9,999
4
Germany 2003, heatwave
9,355
10,000-19,999
5
Soviet Union, 1949, landslide
12,000
20,000-49,999
6
India, 1942, tropical storm
40,000
50,000-99,999
7
Pakistan, 2005, earthquake
73,338
100,000-199,999
8
Japan, 1945, atomic bomb
105,000
200,000-299,999
9
Haiti, 2010, earthquake
222,570
Greater than or equal to 300,000
10
Bangladesh, 1970, tropical cyclone
300,000
Number of under-5 excess deaths
Severity score
<10
0
10-99
1
100-999
2
1,000-4,999
3
5,000-9,999
4
10,000-19,999
5
20,000-29,999
6
30,000-39,999
7
40,000-49,999
8
50,000-59,999
9
Greater than or equal to 60,000
10
The floor of the scoring rubric for this parameter was chosen to be 10 deaths, based on CRED criteria. The remainder of this scoring rubric, beyond the baseline, is stochastic. For illustration purposes, it was estimated that 46,900 excess deaths among young Iraqi children (under-5 years old) occurred from January 1991 through August 1991, due to the Gulf War and subsequent sanctions.
The estimated absolute number of cases with acute communicable disease cases is used in this parameter. In addition to this parameter, four out of the 12 parameters also utilize absolute numbers for affected persons (other than dead). These other parameters are: number of cases with traumatic/chemical/radiological injuries; number of children with acute malnutrition; number of displaced persons; and number of persons with inadequate living space. The baseline for these parameters is set at 20 so the cumulative total would add to a minimum of 100. This was purposefully designed since CRED lists “more than 100 affected persons” as one of its criteria to enter a disaster in its registry. For example, a CHE that causes 19 cases in each of these 5 parameters (a total of 95 affected persons) would get a score of 0 on each parameter, and would not qualify to enter the CRED registry.
Number of cases with acute communicable diseases
Severity score
<20
0
20-99
1
100-999
2
1,000-4,999
3
5,000-9,999
4
10,000-19,999
5
20,000-29,999
6
30,000-39,999
7
40,000-49,999
8
50,000-59,999
9
Greater than or equal to 60,000
10
Number of cases with traumatic/chemical/radiological injuries
Severity score
Country, year, type
Number of cases
<20
0
None recorded by EM-DAT
N/A
20-99
1
Indonesia, 1928, earthquake
40
100-999
2
Sakhalin Island, 1927, earthquake
750
1,000-4,999
3
Vietnam, 2006, typhoon
2,000
5,000-9,999
4
Nepal, 1920, earthquake
6,553
10,000-19,999
5
Chile, 2010, 12,000
12,000
20,000-49,999
6
Iran, 1926, earthquake
30,000
50,000-99,999
7
Pakistan, 2008, earthquake
69,000
100,000-199,999
8
Japan, 1945, atomic bomb
110,000
200,000-299,999
9
India, 1984, chemical
200,000
Greater than or equal to 300,000
10
Haiti, 2010, earthquake
300,000
Levels of health care services
Severity score
All levels of heath care system are intact
0
Disrupted fourth level of health care; intact third, second and first levels
1
Disrupted fourth and third levels of health care; intact second and first levels
2
Disrupted second, third and fourth levels of healthcare; intact first level
3
All levels of health care disrupted
4
The 2010 Haiti earthquake, all levels of healthcare were disrupted in the acute phase, and hence this CHE would get a score of 4 at that time. Note that a retrospective evaluation of the pre-earthquake health system in Haiti using the above parameters indicates disrupted third and fourth levels of healthcare services.
Number of young children (age 6-59 months) with acute malnutrition
Severity score
<20
0
20-99
1
100-999
2
1,000-4,999
3
5,000-9,999
4
10,000-19,999
5
20,000-29,999
6
30,000-39,999
7
40,000-49,999
8
50,000-59,999
9
Greater than or equal to 60,000
10
Number of displaced persons
Severity score
<20
0
20-99
1
100-999
2
1,000-9,999
3
10,000-49,000
4
50,000-99,999
5
100,000-199,999
6
200,000-499,999
7
500,000-999,999
8
Greater than or equal to 1,000,000
9
Number of persons with surface area of less than 45 m2 or covered area of less than 3.5 m2
Severity score
<20
0
20-99
1
100-999
2
1,000-4,999
3
5,000-9,999
4
10,000-19,999
5
20,000-49,999
6
50,000-99,999
7
100,000-199,999
8
Greater than or equal to 200,000
9
Water quantity (liters/person/day)
Severity score
>15
0
12.5-15
1
10-12.4
2
7.5-9.9
3
6.5-7.4
4
5.5-6.4
5
4.5-5.4
6
3.5-4.4
7
2.5-3.4
8
<2.5
9
Percentage of water samples with more than 10 fecal coliforms/100 ml
Severity score
0%
0
>0-9.9%
1
10-19.9%
2
20-29.9%
3
30-39.9%
4
40-49.9%
5
50-59.9%
6
60-69.9%
7
70-79.9%
8
80-89.9%
9
>90%
10
Levels of sanitation facilities
Severity score
Intact well developed sanitary system for disposal of excreta
0
Minor disruption of a well developed sanitary system for disposal of excreta
1
Two or more toilets (or latrines) per 20 people, or two or more family latrines per 4 families, or two or more trench latrines per 100 people
2
One toilet (or latrine) per 20 people, or one family latrine per 4 families, or one trench latrine per 100 people
3
Less than one toilet (or latrine) per 20 people, or one family latrine per 4 families, or one trench latrine per 100 people
4
Complete absence of any system for disposal of excreta
5
Gender-based violence
Severity score
None
0
Isolated single events (not daily)
1
Average occurrences approximately one daily
2
Average occurrences approximately multiple daily
3
Systematic gender-based violence
4
Assessment of public health impact in complex humanitarian emergencies is a daunting task of unparalleled importance.
The proposed PHISS, illustrated above, constitute quantitative measures for the assessment of the public health impact of Complex Humanitarian Emergencies. Conceptually, it may be used as a “big picture” multi-sectoral quantitative assessment tool, by providing objective scores on specific parameters. It can potentially be used in entirety or partially, both cross-sectionally or longitudinally across time. The cumulative PHISS score ranges from a minimum of 0 to a maximum of 100. It uses absolute numbers instead of percentages (e.g. excess mortality instead of mortality rates), in order to depict the actual scale of the impact that would be applicable to affected populations of various sizes. Whenever possible, existing scoring rubric criteria were utilized for the parameters. This scale does not undermine the value of descriptive methods, nor is it meant to replace existing guidelines and tools, but rather to build upon and augment them. Adopting and applying such a quantitative scale in CHE maybe useful for guiding response efforts, longitudinal assessment within each CHE, and comparative studies between various CHE. Such methodology would compliment current descriptive assessment tools. This approach may streamline the post-CHE assessment phase by providing an overall quantitative objective measure, and provide the opportunity of pooling comparable data from various sources and organizations. The opportunity to aggregate data from various agencies and organizations increases the precision of assessment data, and optimizes the speed and accuracy of resource allocation in CHE. In longitudinal assessments, comparable periods of time need to be taken into consideration. A uniform quantitative assessment method would help facilitate inter-agency communication and reduce subjective variations and errors in assessment. The scale may allow the standardization of the various approaches currently in use across health organizations, which would reduce redundancy of assessment efforts. Moreover, applying an overall quantitative score to different events allows for historical comparisons between disparate CHE. Of note, the reason PHISS has not been applied to one single historical CHE, is that data on the 12 proposed parameters are not readily available and do not reside in one or multitude of data sources.
It is of prime importance to note that sound and standardized sampling methodology, in addition to uniformity of measurement techniques, are key to the accuracy of the PHISS results. Technical issues regarding cluster sampling and data aggregation for various parameters require thorough evaluation and further recommendation.
There are several limitations and challenges to our proposed scale; most are related to the availability of baseline population figures, and to the accuracy and standardized methodology of measuring the 12 proposed parameters. First, some of those parameters (e.g. excess mortality) require baseline population figures which may be lacking in CHE. This potential problem is not unique to this proposed tool, and may be remedied by estimation methods. Second, there would still be some variation in the data collected by various assessors. A training program for potential assessment teams can minimize this variation. Third, PHISS is not meant to be an exhaustive tool, and some parameters might be suggested to be added to the scale (e.g. food availability by calories). Other CHEs might have special characteristics that are not included. Yet, the parameters included in PHISS constitute the major public health categories in the acute phase of CHE, as identified by many benchmark guidelines including The Sphere Project. Fourth, there is an inherent element of stochasticity -though chosen by consensus- when assigning scoring rubrics for some of the parameters. In addition, the maximum score for few parameters varies, giving more weight to some more than others. These restrictions were due to the absence of standardized reference ranges in the literature. However, every attempt was made to use available data and references when applicable. Fifth, the sum of all the parameters' scores might not always reflect the complexity of the CHE. Sixth, we comparing different CHE, the period of time need to be standardized for parameters one and tow (excess deaths and under-5 excess deaths). Finally, one parameter, namely water quality, requires some basic technological capacity. Simple commercial kits are readily available on the market, can be used to collect the water quality data. Of note, pooling data from existing tools may readily provide quantitative scores on certain PHISS parameters (e.g. estimated number of excess deaths). Since testing the validity and feasibility of PHISS was not the objective of this proposed study, the authors hope that the introduction of this quantitative scale would invigorate scientific discussion and prompt organizations and agencies with sufficient resources to apply PHISS prospectively in future CHE.
Measuring the public health impact of complex humanitarian emergencies is germane to objectively and accurately identify the scope and scale of the critical needs and relief priorities for affected populations. A new quantitative assessment tool (PHISS) has been proposed, based on The Sphere Project “minimum standards”, in order to streamline and standardize the post-CHE assessment phase. PHISS is a conceptual disaster metric that has not yet been validated, and studies are needed with prospective data collection to test its validity, feasibility and reliability.
The authors would like to acknowledge Dr. Nawar Abdul Latif, Mr. Ahmad Bayram, and Mrs. Jomana Musmar-Bayram for their valuable assistance in this study.