Development of a heat-illness screening instrument using the Delphi panel technique
Related Experiment Video
Updated: May 27, 2026
Determining heat and mechanical pain threshold in inflamed skin of human subjects
Published on: January 14, 2009
Lindsey E Eberman1, Michelle A Cleary
1Florida International University, Miami, USA.leberman@indstate.edu
Context:
Exertional heat illness (EHI) is the third leading cause of death among athletes, but with preparticipation screening, risk factors can be identified, and some EHIs can be prevented.
Objective:
To establish content validity of the Heat Illness Index Score (HIIS), a 10-item screening instrument designed to identify athletes at risk for EHI during a preparticipation examination.
Design:
Delphi study.
Setting:
The Delphi technique included semistructured face-to-face or telephone interviews and included electronic questionnaires administered via e-mail.
Patients Or Other Participants:
Six individuals with extensive research experience and/or clinical expertise in EHI participated as expert panelists.
Main Outcome Measure(S):
We used a Delphi panel technique (3 rounds) to evaluate the HIIS with the consensus of expert opinions. For round 1, we conducted face-to-face interviews with the panelists. For round 2, we solicited panelists' feedback of the transcribed data to ensure trustworthiness, then provided the participants with the revised HIIS and a questionnaire eliciting their levels of agreement for each revision from the previous round on a visual analog scale (11.4 cm) with extreme indicators of strongly disagree and strongly agree. We calculated the mean and SD for each revision and accepted when the mean was greater than 7.6 cm (agree) and the SD still permitted a positive response (> 5.7 cm), suggesting consensus. For round 3, we instructed participants to indicate their levels of agreement with each final, revised item and their levels of agreement with the entire instrument on a 4-point Likert scale (1 = strongly disagree, 4 = strongly agree).
Results:
In round 1, panelists supported all 10 items but requested various revisions. In round 2, 16.3% (7 of 43) revisions were rejected, and 2 revisions were modified. In round 3, 100% of panelists reported agreeing (n = 3 of 6) or strongly agreeing (n = 3 of 6) with the final instrument.
Conclusions:
Panelists were able to achieve consensus and validated the content of the HIIS, as well as the instrument itself. Implementation and further analysis are necessary to effectively identify the diagnostic accuracy of the HIIS.
Related Concept Videos
01:14Assessing Body Temperature - Oral
Step 1:
Start by practicing proper hand hygiene to prevent the spread of microorganisms.
Step 2:
Take the thermometer out of the charging unit, switch it on, and wait for the ready sign.
Step 3:
Gently slide the probe cover until a click is heard. This simple action prevents cross-contamination and ensures the correct placement of the probe cover.
Step 4:
Instruct the patient to open their mouth and place...
01:27Assessing Body Temperature - Rectal
Follow these steps for rectal temperature assessment:
Step 1: Perform hand hygiene and don clean gloves to prevent cross-infection.
Step 2: Position the patient in a side-lying position to better visualize the rectal...
01:14Assessing Body Temperature - Axilla
Step 1: Perform hand hygiene and put on clean gloves to maintain infection control and prevent cross-contamination.
Step 2: Prepare the patient by explaining the procedure to ensure understanding and cooperation. Ensure privacy, expose the axilla, and inform the patient that minimal movement is crucial for an accurate reading.
Step 3: Adjust the patient’s clothing to expose only the axilla. It minimizes...
01:19Assessing Body Temperature - Temporal Artery
Step 1: Perform hand hygiene and don a fresh pair of gloves to prevent cross-infection and ensure patient safety.
Step 2: Explain the procedure to the patient to establish trust. Clear communication establishes trust with the patient, ensures they understand what to expect, promotes cooperation, and enhances comfort during the procedure.
Step 3: Assess the patient's forehead...