Related Experiment Video
Updated: Feb 3, 2026

µTongue: A Microfluidics-Based Functional Imaging Platform for the Tongue In Vivo
Published on: April 22, 2021
Tongue Image Database Construction Based on the Expert Opinions: Assessment for Individual Agreement and Methods for
Zhen Qi1, Li-Ping Tu1, Zhi-Yu Luo1
1Basic Medical College, Shanghai University of Traditional Chinese Medicine, 1200 Cailun Road, Shanghai 201203, China.
Abstract:
This study aims at introducing a method for individual agreement evaluation to identify the discordant raters from the experts' group. We exclude those experts and decide the best experts selection method, so as to improve the reliability of the constructed tongue image database based on experts' opinions. Fifty experienced experts from the TCM diagnostic field all over China were invited to give ratings for 300 randomly selected tongue images. Gwet's AC1 (first-order agreement coefficient) was used to calculate the interrater and intrarater agreement. The optimization of the interrater agreement and the disagreement score were put forward to evaluate the external consistency for individual expert. The proposed method could successfully optimize the interrater agreement. By comparing three experts' selection methods, the interrater agreement was, respectively, increased from 0.53 [0.32-0.75] for original one to 0.64 [0.39-0.80] using method A (inclusion of experts whose intrarater agreement>0.6), 0.69 [0.63-0.81] using method B (inclusion of experts whose disagreement score="0"), and 0.76 [0.67-0.83] using method C (inclusion of experts whose intrarater agreement>0.6& disagreement score="0"). In this study, we provide an estimate of external consistency for individual expert, and the comprehensive consideration of both the internal consistency and the external consistency for each expert would be superior to either one in the tongue image construction based on expert opinions.
More Related Videos
06:15Protocol and Guidelines for Point-of-Care Lung Ultrasound in Diagnosing Neonatal Pulmonary Diseases Based on International Expert Consensus
Published on: March 6, 2019
05:50International Expert Consensus and Recommendations for Neonatal Pneumothorax Ultrasound Diagnosis and Ultrasound-guided Thoracentesis Procedure
Published on: March 12, 2020
Related Concept Videos
Tongue
Anatomical Position in the Oral Cavity
The tongue is located within the oral cavity, also known as the mouth. It is attached to the floor of the mouth by a fold of mucous membrane called the...
Tip-of-the-Tongue Phenomenon
The Tongue and Taste Buds
Impact of Individuals on Individuals
What is Natural Selection?
Impact of Groups on Individuals