Related Experiment Video
Updated: Apr 23, 2026

A Protocol of Manual Tests to Measure Sensation and Pain in Humans
Published on: December 19, 2016
A protocol for testing expert-system reliability
P François1, C Robert2, G Weil2
1Département de pédiatrie, CHU de Grenoble, 38700 La Tronche, France.
Abstract:
We set out a protocol for giving a computerised medical decision system the label of expert-system meaning that its responses are of the same standard as those of an expert. We apply it to the validation of an expert-system, MENINGE, which is applied to diagnosis of meningitis in children. The proposed protocol can be widely used since it doesn't refer to the existence of correct responses for therapy or diagnosis, and since it involves simple statistical computations. First this validation rests on a comparison of agreement among experts and among physicians new to medical practice. Secondly, the agreement of the system with the experts is compared to the agreement of the system with physicians new to medical practice. In order to perform this comparison we recommend a standard agreement measure, the choice of which is an important issue in this paper.
More Related Videos
10:39Qualitative and Quantitative Validation of Tools with Rating Scales Aimed at Assessing the Quality of University Service-Learning
Published on: August 29, 2025
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Related Concept Videos
Reliability and Validity
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...
Random and Systematic Errors
Random and Systematic Errors
Detection of Gross Error: The Q Test
Testing a Claim about Standard Deviation
The hypothesis testing for the claim of population standard deviation (or variance) requires the data and samples to be random and unbiased. The population distribution also must be normal. There is no specific requirement on the sample size as the estimation is based on the chi-square distribution.
As a first step, the hypothesis (null and alternative) concerning the claim about...