Related Experiment Video
Updated: Jun 24, 2025
In Vitro Application of a Wireless Sensor in Flexion-Extension Gap Balance of Unicompartmental Knee Arthroplasty
Published on: May 5, 2023
A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI
Felix C Oettl1,2, Ayoosh Pareek3, Philipp W Winkler4,5,6
1Hospital for Special Surgery New York New York USA.
Abstract:
Artificial intelligence's (AI) accelerating progress demands rigorous evaluation standards to ensure safe, effective integration into healthcare's high-stakes decisions. As AI increasingly enables prediction, analysis and judgement capabilities relevant to medicine, proper evaluation and interpretation are indispensable. Erroneous AI could endanger patients; thus, developing, validating and deploying medical AI demands adhering to strict, transparent standards centred on safety, ethics and responsible oversight. Core considerations include assessing performance on diverse real-world data, collaborating with domain experts, confirming model reliability and limitations, and advancing interpretability. Thoughtful selection of evaluation metrics suited to the clinical context along with testing on diverse data sets representing different populations improves generalisability. Partnering software engineers, data scientists and medical practitioners ground assessment in real needs. Journals must uphold reporting standards matching AI's societal impacts. With rigorous, holistic evaluation frameworks, AI can progress towards expanding healthcare access and quality.
Level Of Evidence:
Level V.
