Related Experiment Video
Updated: Jul 18, 2026
09:18
Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
Published on: December 15, 2023
A weighted reliability measure for phonetic transcription
D Kimbrough Oller1, Heather L Ramsdell
1School of Audiology and Speech-Language Pathology, The University of Memphis, 807 Jefferson Avenue, Memphis, TN 38105, USA. koller@memphis.edu
Journal of Speech, Language, and Hearing Research : JSLHR
|January 2, 2007
Summary
A new weighted transcription agreement measure offers higher resolution than traditional methods. This tool accounts for phonological theory, improving reliability assessments in phonetic transcription research.
Area of Science:
- Linguistics
- Phonetics
- Speech Science
Background:
- Traditional transcription agreement measures lack resolution.
- Unweighted approaches treat all phonetic differences equally.
- A need exists for a more nuanced assessment of transcription reliability.
Purpose of the Study:
- To introduce and demonstrate the utility of a novel weighted transcription agreement measure.
- To address the limitations of traditional unweighted agreement assessments.
- To provide a phonologically informed tool for evaluating transcription consistency.
Main Methods:
- Developed a weighted transcription agreement measure based on phonological theory.
- Eight coders transcribed speech and infant vocalizations.
- Compared weighted and unweighted measures using computer-based analysis.
Main Results:
- The weighted measure exhibits superior scaling properties compared to the unweighted measure.
- The weighted measure avoids floor effects observed in traditional methods, especially with difficult transcriptions.
- Orderly agreement relations were found across diverse speech samples, including babbling and adult languages.
Conclusions:
- The weighted measure offers improved foundations for phonetic transcription research.
- This tool enhances the reliability monitoring of transcriptions.
- It provides a more robust framework for analyzing speech data.
Related Concept Videos
01:20Kendall's Coefficient of Concordance
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
00:57Weighted Mean
While taking the arithmetic, geometric, or harmonic mean of a sample data set, equal importance is assigned to all the data points. However, all the values may not always be equally important in some data sets. An intrinsic bias might make it more important to give more weightage to specific values over others.
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
For example, consider the number of goals scored in the matches of a tournament. While computing the average number of goals scored in the tournament, it may be more important to...
01:19Expected Frequencies in Goodness-of-Fit Tests
A goodness-of-fit test is conducted to determine whether the observed frequency values are statistically similar to the frequencies expected for the dataset. Suppose the expected frequencies for a dataset are equal such as when predicting the frequency of any number appearing when casting a die. In that case, the expected frequency is the ratio of the total number of observations (n) to the number of categories (k).
03:37Uncertainty in Measurement: Accuracy and Precision
Scientists typically make repeated measurements of a quantity to ensure the quality of their findings and to evaluate both the precision and the accuracy of their results. Measurements are said to be precise if they yield very similar results when repeated in the same manner. A measurement is considered accurate if it yields a result that is very close to the true or the accepted value. Precise values agree with each other; accurate values agree with a true value.
01:29Reliability and Validity
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
01:13Accuracy and Errors in Hypothesis Testing
Hypothesis testing is a fundamental statistical tool that begins with the assumption that the null hypothesis H0 is true. During this process, two types of errors can occur: Type I and Type II. A Type I error refers to the incorrect rejection of a true null hypothesis, while a Type II error involves the failure to reject a false null hypothesis.
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5% chance...