Related Experiment Video
Updated: Feb 3, 2026

µTongue: A Microfluidics-Based Functional Imaging Platform for the Tongue In Vivo
Published on: April 22, 2021
Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for
Zhen Qi1, Li-Ping Tu1, Zhi-Yu Luo1
1Basic Medical College, Shanghai University of Traditional Chinese Medicine, 1200 Cailun Road, Shanghai 201203, China.
This study introduces a method to evaluate expert agreement in tongue image analysis, improving TCM diagnostic database reliability by selecting consistent raters. The approach enhances interrater agreement, ensuring higher quality expert opinions.
Area of Science:
- Traditional Chinese Medicine (TCM)
- Medical Imaging Analysis
- Biostatistics
Background:
- Reliable diagnostic databases are crucial for Traditional Chinese Medicine (TCM).
- Expert opinion in TCM tongue image analysis requires robust agreement evaluation.
- Identifying and excluding discordant raters is essential for data integrity.
Purpose of the Study:
- To introduce a novel method for individual agreement evaluation to identify discordant raters.
- To optimize expert selection methods for constructing a reliable tongue image database.
- To enhance the overall reliability of TCM diagnostic data based on expert consensus.
Main Methods:
- Fifty TCM experts rated 300 tongue images.
- Gwet's AC1 (first-order agreement coefficient) was used for interrater and intrarater agreement calculation.
- A disagreement score was developed to assess individual expert external consistency.
Main Results:
- The proposed method successfully optimized interrater agreement.
- Method C (intrarater agreement > 0.6 and disagreement score = 0) yielded the highest interrater agreement (0.76 [0.67-0.83]).
- Expert selection significantly improved agreement from 0.53 [0.32-0.75] to 0.76 [0.67-0.83].
Conclusions:
- A comprehensive evaluation considering both internal and external consistency of experts is superior for tongue image database construction.
- The developed method effectively identifies and excludes unreliable raters.
- This approach enhances the quality and reliability of TCM diagnostic databases derived from expert opinions.
More Related Videos
06:15Protocol and Guidelines for Point-of-Care Lung Ultrasound in Diagnosing Neonatal Pulmonary Diseases Based on International Expert Consensus
Published on: March 6, 2019
05:50International Expert Consensus and Recommendations for Neonatal Pneumothorax Ultrasound Diagnosis and Ultrasound-guided Thoracentesis Procedure
Published on: March 12, 2020
Related Concept Videos
Tongue
Anatomical Position in the Oral Cavity
The tongue is located within the oral cavity, also known as the mouth. It is attached to the floor of the mouth by a fold of mucous membrane called the...
Tip-of-the-Tongue Phenomenon
The Tongue and Taste Buds
Impact of Individuals on Individuals
What is Natural Selection?
Impact of Groups on Individuals