The Internet's impact on policy evaluation: information compression and credibility

Area of Science:

• Evaluation Science
• Policy Analysis
• Information Science

Background:

• The Internet is increasingly the primary information medium for evaluators.
• Its influence on information structuring and decision-making behaviors is profound.
• Understanding the Internet's impact on evaluation is crucial for research integrity.

Purpose of the Study:

• To establish a theoretical framework for the Internet's influence on evaluation and policy analysis.
• To examine the effects on evaluators' roles, norms, and work habits.
• To assess the impact on the definition of professional evaluation and evaluator identity.
• To analyze the influence on the technical quality and credibility of evaluations.

Main Methods:

• Theoretical analysis of the Internet's role in information dissemination and evaluation.
• Exploration of key questions regarding professional practice and evaluation quality.
• Examination of the concept of information compression and its implications.

Main Results:

• The Internet compresses information, making it difficult to discern information sources and their authority.
• This compression presents a dual effect: potential democratization of evaluation.
• Conversely, it risks undermining evaluation legitimacy due to challenges in quality distinction.

Conclusions:

• The Internet significantly alters the landscape of evaluation and policy analysis.
• While offering opportunities for broader participation, it introduces challenges to ensuring the quality and credibility of evaluation research.
• Further theoretical development is needed to navigate these impacts.