Performance Measures for Geometric Fitting in the NIST Algorithm Testing and Evaluation Program for Coordinate
Theodore H Hopp1, Mark S Levenson1
1National Institute of Standards and Technology, Gaithersburg, MD 20899-0001.
Summary
The NIST Calibration Program
Area of Science:
- Metrology and Measurement Science
- Computational Geometry and Algorithm Analysis
Background:
- Coordinate Measurement Systems (CMS) are crucial for industrial inspection.
- Performance evaluation of geometric fitting software in CMS is essential for accuracy.
- NIST offers the Algorithm Testing and Evaluation Program for Coordinate Measurement Systems (ATEP-CMS) as a Special Test Service.
Purpose of the Study:
- To document and explain the rationale behind performance measures in ATEP-CMS.
- To analyze the uncertainties associated with these performance measures.
- To provide a foundation for the experimental NIST service.
Main Methods:
- Development of performance metrics for geometric fitting software.
- Analysis of uncertainty propagation for the chosen performance measures.
- Documentation of the ATEP-CMS methodology.
Main Results:
- Established a clear rationale for ATEP-CMS performance measures.
- Quantified the uncertainties inherent in the ATEP-CMS evaluation.
- Provided a framework for assessing geometric fitting software performance.
Conclusions:
- ATEP-CMS offers a novel, albeit experimental, NIST service for CMS software.
- Understanding the rationale and uncertainties of performance measures is key to interpreting ATEP-CMS results.
- This work supports the advancement of accurate and reliable coordinate measurement.


