Data Mining and Official Statistics: The Past, the Present and the Future.

Area of Science:

• Statistics
• Data Science
• Information Science

Background:

• Growing availability of large datasets managed by National Statistical Institutes.
• Data mining in official statistics is a rapidly developing and important research area.
• Previous research has explored various data mining applications within official statistics.

Purpose of the Study:

• To provide a comprehensive review of published literature on data mining applications in official statistics.
• To identify and categorize the data mining techniques that have been explored in this domain.
• To highlight the significance of data mining for the field of official statistics.

Main Methods:

• Systematic literature review of published works.
• Analysis and categorization of applied data mining techniques.
• Identification of challenges and opportunities in the field.

Main Results:

• A thorough review of existing research on data mining in official statistics.
• Identification of key data mining techniques utilized, such as classification, clustering, and regression.
• Acknowledgement of the increasing importance and potential of data mining for official statistics.

Conclusions:

• Data mining offers significant potential for enhancing official statistics through advanced analytical methods.
• Despite its importance, the development of data mining in official statistics has faced several challenges over the past two decades.
• Further research and development are needed to overcome these challenges and fully realize the benefits of data mining.