Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Comparing medical audits: correlation, scaling, and sensitivity.

J Studnicki, R Saywell

    Journal of Medical Education
    |June 1, 1978
    PubMed
    Summary

    This study compares two medical audit methods across different diagnostic categories to assess their consistency and effectiveness. The researchers found that the audits often produce conflicting results when applied to the same research question. The study shows that the modified Payne process and the JCAH audit differ in how they measure clinical performance. The findings suggest that factors like item specificity, total number of items, and item weights influence audit outcomes. The authors propose that audit design should be adapted to the diagnostic context to improve reliability. The study supports the need for a standardized framework for comparing audit methods. These insights help healthcare professionals choose more appropriate audit tools for their specific needs. The results highlight the importance of considering audit design when evaluating clinical performance.

    Related Concept Videos

    You might also read

    Related Articles

    Articles linked to this work by shared authors, journal, and citation graph.

    Sort by
    Same author

    A Post Hoc Exploratory Analysis: Induced Abortion Complications Mistaken for Miscarriage in the Emergency Room are a Risk Factor for Hospitalization.

    Health services research and managerial epidemiology·2022
    Same author

    Diabetes complications and adverse health outcomes after coronary revascularization.

    Diabetes research and clinical practice·2014
    Same author

    Heroic measures when treating patients with hematologic malignancies - the economic cost of survival.

    International journal of oncology·2011
    Same author

    Physician practice volume and alternative surgical treatment for breast cancer in Florida.

    Health services research·2005
    Same author

    Rating the health status of U.S. communities.

    Managed care interface·2001
    Same author

    Comparing alternative methods for composing community peer groups: a data warehouse application.

    Journal of public health management and practice : JPHMP·2001

    Area of Science:

    • Healthcare quality assessment
    • Medical audit methodology
    • Clinical outcomes research

    Background:

    Medical audit tools are used to evaluate clinical performance, but their effectiveness can vary depending on the diagnostic context. Prior research has shown that audit methods can produce inconsistent results when applied across different conditions or settings. This gap motivated the need to assess how audit tools compare in terms of their measurement properties. No prior work had resolved whether the variability in audit outcomes stems from the tools themselves or the diagnostic categories assessed. Understanding this variability is crucial for selecting appropriate audit methods in clinical research. The knowledge gap centers on the lack of a standardized framework for comparing audit tools. This paper's contribution is to provide a method for evaluating audit scaling and sensitivity. The study addresses the need for more transparent and consistent audit practices in healthcare.

    Purpose Of The Study:

    This study aimed to compare two medical audit methods across multiple diagnostic categories. The goal was to evaluate how the audits differ in their scaling and sensitivity. The motivation came from the observed inconsistencies in audit results when applied to specific research questions. The researchers wanted to determine whether these inconsistencies were due to the audit methods or the diagnostic context. The focus was on the modified Payne process and the JCAH intermediate outcome audit. The study sought to illustrate a method for comparing audit tools in terms of their measurement characteristics. The purpose was to provide a framework for evaluating audit performance in different clinical settings. This approach supports more reliable audit outcomes in healthcare quality assessment.

    Keywords:
    Medical audit methodologyHealthcare quality assessmentAudit scalingClinical outcomes research

    Frequently Asked Questions

    The main outcome is that audit correlations vary significantly by diagnostic category, leading to inconsistent results when applied to specific research questions.

    The study shows that item specificity influences audit scaling and sensitivity, affecting how harsh or discriminative the audit is.

    The total number of items affects the audit's sensitivity and scaling, as more items can increase the audit's ability to detect variation in performance.

    Outcome indicators and process indicators have different impacts on audit results, influencing the overall effectiveness of the audit method.

    Related Experiment Videos

    Main Methods:

    The researchers applied two audit methods to a large dataset of 6,980 cases across eight diagnostic categories. The audits were conducted in 22 hospitals with 1,321 attending physicians. The modified Payne process and the JCAH audit were used to assess clinical performance. The study focused on comparing the scaling and sensitivity of these methods. The researchers examined how item specificity and total number of items affect audit outcomes. They also analyzed the impact of outcome versus process indicators on audit results. The weighting of items was considered as a factor in audit measurement. The methods provided a framework for evaluating audit performance across different diagnostic contexts.

    Main Results:

    The overall correlations between the two audit methods varied significantly across diagnostic categories. In some cases, the audits produced conflicting results when applied to the same research question. The modified Payne process and the JCAH audit showed different levels of harshness and sensitivity. The study found that audit scaling and sensitivity are influenced by item specificity and total number of items. Outcome indicators had a different impact on audit results compared to process indicators. The weighting of items also affected the measurement characteristics of the audits. These findings suggest that audit methods should be evaluated in the context of specific diagnostic categories. The results highlight the importance of considering audit design when interpreting clinical performance data.

    Conclusions:

    The study concludes that audit methods can produce inconsistent results depending on the diagnostic context. The authors suggest that audit scaling and sensitivity should be considered when selecting an audit tool. The findings indicate that item specificity and total number of items affect audit outcomes. The researchers propose that outcome and process indicators have different impacts on audit results. The weighting of items is another factor that influences audit performance. The study supports the need for a standardized framework for comparing audit methods. The authors emphasize that audit design should be tailored to the diagnostic category being assessed. These conclusions align with the observed variability in audit outcomes across different clinical settings.

    The weighting of items influences the audit's scaling and sensitivity, altering how performance is measured and compared.

    The authors suggest that audit design should be tailored to the diagnostic category being assessed to improve consistency and reliability.