Information theory measures of grammatical goodness-of-fit
1Shimer College, Mount Carroll, Illinois.
Abstract:
Reasons for the declining use of information-theory-based statistics were reviewed, and were found to reflect overly grandiose or overly constrained interpretations of distributional uncertainty measures. The range of definitions of H as a characterization of dispersion was extended to cases in which the scope, mode or specification, and unit of count were not limited to single terminal units. Information statistics may be generally described as reflecting the "fit" between a given grammar and a given language sample.
Related Concept Videos
Goodness-of-Fit Test
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
Expected Frequencies in Goodness-of-Fit Tests
Test for Homogeneity
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this;...
Accuracy and Errors in Hypothesis Testing
In hypothesis testing, the probability of making a Type I error, denoted as α, is commonly set at 0.05. This significance level indicates a 5%...


