Related Experiment Videos
Development of an Evaluation Index System for Chinese Medicine Specialist Nurse Training Effectiveness: A Delphi-AHP
Yanhuan Qi1, Haimin Li2,3, Jiahui Mao2,3
1Department of Endocrinology, Shenzhen Hospital (Futian) of Guangzhou University of Chinese Medicine, Shenzhen, People's Republic of China.
Objective:
To develop an evaluation index system for Chinese medicine specialist nurse training effectiveness based on the Context, Input, Process, and Product (CIPP)-Kirkpatrick model, and to preliminarily assess its feasibility in practical application.
Methods:
From January to September 2024, a research team developed an initial indicator pool through literature reviews and semi-structured interviews using the CIPP and Kirkpatrick models as theoretical frameworks. The Delphi method was employed for two rounds of consultation. 16 experts from 6 provinces were invited, and 15 completed both rounds, to refine the indicators. Indicator weights were determined using the Analytic Hierarchy Process (AHP). The resulting index system was then preliminarily applied at one provincial Chinese medicine training base in Guangdong Province to assess the feasibility of its practical use.
Results:
The two rounds of expert consultation yielded effective response rates of 93.75% and 100%, with an expert authority coefficient of 0.965. Kendall's coefficients of concordance were 0.275 and 0.292, respectively (P < 0.001). The final system comprises 4 primary, 13 secondary, and 71 tertiary indicators. Among the primary dimensions, outcome evaluation received the highest weight, followed by process, context, and input evaluation. In the empirical application, the training base achieved an overall score of 82.55. The process evaluation dimension scored highest (90.99), while the outcome evaluation dimension scored lowest (75.93), with research-related indicators scoring below 35 points.
Conclusion:
The developed index system demonstrated good content relevance and expert consensus, while reflecting the core features of Chinese medicine syndrome differentiation-based nursing. Preliminary field application suggests that the system is feasible for identifying potential weaknesses in training programs and may serve as a practical reference for the evaluation and improvement of Chinese medicine specialist nurse training. It may also provide a contextual reference for evaluating specialist nurse training programs in other culturally specific or discipline-based practice settings.
