Related Experiment Video
Updated: Jul 19, 2026

Electromagnetic Source Imaging in Presurgical Evaluation of Children with Drug-Resistant Epilepsy
Published on: September 20, 2024
Use of ED diagnosis to determine medical necessity of EMS transports
P Daniel Patterson1, Charity G Moore, Jane H Brice
1Cecil G. Sheps Center for Health Services Research, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA. dpatterson@schsr.unc.edu
Insights
Physician agreement on medical necessity for emergency transports was fair, with significant variation by specialty and diagnosis. Further criteria development is needed for consistent evaluation of emergency medical services.
Area of Science:
- Medical research
- Health services research
Background:
- Emergency medical services (EMS) transports are sometimes questioned for medical necessity.
- Emergency department (ED) diagnoses are proposed as a sole criterion for determining necessity.
Purpose of the Study:
- To assess interrater agreement among physicians when classifying EMS transports as medically unnecessary based solely on ED diagnoses.
- To identify factors influencing agreement in medical necessity determinations.
Main Methods:
- Nine hundred thirteen International Classification of Diseases, Ninth Revision (ICD-9) codes were reviewed by emergency and family medicine physicians.
- Agreement was measured using kappa statistics, analyzing overall, interrater, and category-specific concordance.
- Experience level and specialty were examined for their impact on agreement.
Main Results:
- Physicians deemed 25%-65% of diagnoses as medically unnecessary.
- Overall agreement was fair (kappa = 0.31), with higher agreement among family medicine physicians (kappa = 0.52) than emergency physicians (kappa = 0.22).
- Agreement varied by disease category, highest for symptoms (kappa = 0.40) and lowest for blood disorders (kappa = -0.17); experienced physicians showed better agreement.
Conclusions:
- The utility of ED diagnoses alone for determining medical necessity is questionable.
- Further refinement and validation of criteria, such as Neely Conference criteria, are required.
- Investigating inter-specialty judgment differences is crucial for medical director professions.
Objective:
To examine interrater agreement for classifying emergency medical services transports as medically unnecessary using emergency department diagnosis as the sole determining factor.
Methods:
Three emergency physicians and two family medicine physicians classified 913 International Classification of Diseases, Ninth Revision (ICD-9) codes as medically necessary, unnecessary, or uncertain. Overall agreement, interrater agreement, and agreement within 17 major disease categories were measured using kappa statistics in SAS.
Results:
Physicians rated between 25% and 65% of diagnoses codes as medically unnecessary. Overall agreement was fair (kappa = 0.31). Agreement within specialties was higher among family medicine-trained physicians than among emergency physicians (kappa = 0.52 and kappa = 0.22, respectively). Agreement across all raters was highest for diseases classified as symptoms, signs, and ill-defined conditions (kappa = 0.40) and lowest for diseases of the blood and blood-forming organs (kappa = -0.17). Agreement was observably better between physicians with more experience.
Conclusions:
Considerable doubts about the utility of emergency department diagnosis as a criterion are raised from study findings. Further development of Neely Conference criteria is needed. Priority should be given to testing and validation of criteria as well as exploration of differences in judgment between specialists representative of the medical director profession.
Related Concept Videos
Methods of Documentation VII: EMR
Electronic Distance Measuring Instruments
Cardiopulmonary Resuscitation III: AED Use
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Documentation of Nursing Diagnosis
In some settings, data-driven computerized decision support systems are in place, allowing for more accurate nursing diagnoses. The database within one of these systems includes diagnostic labels defining characteristics, activities, and indicators for nursing. A nurse enters assessment...
Pulmonary Embolism II: Diagnostic Studies and Interprofessional Care