Measuring the impact of a Web-based data query system: the logic model as a tool in the evaluation process

Area of Science:

• Information Science
• Program Evaluation
• Web-based Systems

Background:

• Web-based data query systems (WDQSs) require robust evaluation methods.
• Traditional evaluation approaches may not fully capture the complexities of WDQS development and implementation.

Purpose of the Study:

• To present program evaluation perspectives, focusing on logic models.
• To demonstrate the applicability of logic models to the evaluation of WDQSs.

Main Methods:

• Review of program evaluation literature.
• Application of logic model framework to WDQS components (inputs, constraints, activities, outputs, outcomes).
• Identification of potential evaluation items and outcome examples for WDQSs.

Main Results:

• A logic model framework is proposed for WDQS evaluation.
• Detailed components of a WDQS logic model are outlined.
• Examples of initial, intermediate, and ultimate outcomes for WDQSs are provided.

Conclusions:

• Logic models are crucial for early WDQS development and ongoing maintenance.
• Logic models provide a roadmap to identify and rectify issues in WDQS development, implementation, and maintenance.
• Utilizing logic models enhances the probability of achieving desirable WDQS outcomes.