Designing and psychometrics of the academic advisor's performance evaluation questionnaire

Students are facing issues that can affect their academic performance. Therefore, they need to receive counseling services through guidance professors. This research was conducted with the aim of designing and psychometrics assessing the performance evaluation questionnaire of the academic advisor from the perspective of the academic advisor and student.

The current research was done in two stages including instrument design and psychometric evaluation at Kashan University of Medical Sciences in 2022. In the first stage, using the last edition of the consultant's regulations, two primary questionnaires were designed: "Evaluation of the academic advisor performance from the perspective of the academic advisor" and "evaluation of the consultant's performance from the student viewpoint." In the second stage, the reduction of overlapping items and questionnaire validation were performed using validity of face and content and reliability calculation (Cronbach's alpha and intra-cluster correlation coefficient index [ICC]). Exploratory factor analysis was performed to assess construct validity. Data analysis was done with Statistical Package for the Social Sciences (SPSS) software version 22.

The initial version of both tools had 45 items. The tool for evaluating the performance of the academic advisor from the student's point of view has five dimensions (educational and disciplinary, student and job opportunities, teacher's behavioral domain, lesson planning, and student guidance in special cases) and 36 items, and Cronbach's alpha and intraclass correlation coefficient index were, respectively, 0.908 and 0.912. After performing factor analysis, five factors with 36 items explained 79.52% of the total variance of the instrument. Cronbach's alpha and intraclass correlation coefficient were 0.936 and 0.949, respectively. The total content validity of the questionnaire (S-CVI) was 0.92.

The academic advisor performance evaluation questionnaire that was designed and psychometrically evaluated in this study is a valid and reliable questionnaire for evaluating the performance of academic advisors and has an easy-to-use scale.