Evaluation of Validity and Reliability of the Questionnaire of Student Evaluation of Teaching

Document Type : Original Article

Abstract

Background and Objective:  In any research work, the tools used to approach the designed project goals should be evaluated. The purpose of the present study was to obtain validity and reliability of the questionnaire of student ratings of teaching in Ahvaz JundiShapur University of Medical Sciences.
Subjects and Methods:  The questionnaire of student ratings of teaching was evaluated in a descriptive study. In this study the views of 70 expert faculty members and 5420 completed questionnaire by students were used.  To investigate the reliability, two methods of split-half and internal consistency (Cronbach's Alpha) were applied, and the validity was determined by three aspects of construct validity (factor analysis), concurrent validity and content validity. The Data were analyzed by SPSS-15 software.
Results: The factor analysis revealed 2 factors as tutor capability and expert teaching, which could explain 67.69 % of the total variance. The concurrent validity coefficiency was determined as 0.538 for the first 14 questions in comparison to question number 15. Within content validity the coefficient of all items was determined as 0.920. The internal consistency of questions showed a high correlation of all 15 questionnaire items. The Cronbach’s alpha was 0.947 % and split-half reliability was 0.884%.
Conclusion: It is concluded that student ratings questionnaire with a reasonable degree of validity and reliabilitycould be accounted as a suitable tool to evaluate the University teaching conditions.
Sci Med J 2012; 10(6):583-593

Keywords

References

1-Tanya N, Beran TN, Rokosh JL. Instructors' perspectives on the utility of student ratings of instruction. Instr Sci. 2009; 37: 171-84.
2-Seif A. Measuring methods and instructional evaluation. Tehran: Nashre Duran; 1995.
3-Seldin P. The use and abuse of student ratings of professors. The Chronicle of Higher Education. 1993; 39: 40-4.
4-Mason PM, Steagall JW, Fabritius MA. Student evaluations of faculty: A new procedure for using aggregate measures of performance. Economics of Education Review. 1995; 14(4): 403-16.
5-Karamdoust NA. An investigation on the relation between students' ratings of the faculty, and GPA of course taught by the faculty members in the Faculty of psychology and education from 1999-2002. Journal of Psychology & Education. 2004; 34(1): 57-76.
6-Delavar A, Zahracar K. Sanjesh va andazehgiri da ravanshenasi. Tehran: Nashre Arsabaran; 1387: 156-202. ch. 1.
7-Costin F, Greenough WT, Menges RJ.Student ratings of college teaching: Reliability, validity, and usefulness. Review of Educational Research. 1971; (41)5: 511-35.
8-Abbott RD, Perkins D. Reliability and validity evidence for scales measuring dimensions of student ratings of instruction. Educational and Psychological Measurement. 1982; 42(2): 563-9.
9-John S, Baird JR. Validity and reliability of student ratings of faculty. Teaching of Psychology. 1983; 10(1): 46-53.
10-Kulik JA. Student ratings: Validity, utility, and controversy. New Directions for Institutional Research.  2001; 109: 9-24.
11-Beckman TJ, Cook DA, Mandrekar JN. What is the validity evidence for assessments of clinical teaching?. J Gen Intern Med. 2005; 20: 1159-64.
12-Adhami A, Nakhaee N, Fasihi Harandi T, Fattahi Z. Preliminary assessment of the validity and reliability of the evaluation questionnaires by the students regarding methods of the faculty members of Kerman university of medical sciences in 2002-2003. Journal of Medical Education Center. 2005; 1(2): 121-9. 
13-Wachtel HK. Student evaluation of college effectiveness: A brief review. Assessment and Evaluation in Higher Education. 1998; 23(2): 191-211.
14-Santos RA. Cronbach's alpha: A tool for assessing the reliability of scales. Journal of Extension. 1999; 37(2): 35-9.
15-Lynn MR. Determination and quantification of content validity. Nurs Res. 1986; 35(6): 382-5.
16-Polit DF, Beck CT. The content validity index: Are you sure you know what's being reported?. Research  in Nursing & Health. 2006; 29: 489-97.
17-Tagharrobi Z,  Tagharrobi L,  Sharifi K,  Sooki Z. Psychometric evaluation of the life satisfaction index-Z (LSI-Z) in an iranian elderly sample. Payesh. 2011; 10: 5-13.
18-Scanlan CL. Reliability and validity of a student scale for assessing the quality of internet-based distance learning.Online Journal of Distance Learning Administration. 2003; 6(3). Available from: http://www.westga.edu/~distance/ojdla/fall63/scanlan63.html
19-Lin WY, Atkins DW, Meng QM. A cross-cultural investigation into students’ evaluation of university teaching. CUHK Education Journal. 2005; 22(2): 291-304.
20-Safaee A, Dehkordi Moghimi B, Tabatabaei SHR. Reliability and validity of the QLQ-C30 questionnaire in cancer patients. Armaghane Danesh. 2007; 12(2): 79-87.
21-Moshki M, Ghofranipour F, Azadfallah P, Hajizadeh E. Validity and reliability of the multidimensional health locus of control (Form B) scale in iranian medical students. The Journal of Ofogh-E-Danesh. 2006; 12(1): 33-42.
22-Onwuegbuzie AJ, Daniel LG, Collins KMT. A meta-validation model for assessing the score-validity of student teaching evaluations. Qual Quant. 2009; 43: 197-209.
23-Test MA, Greenberg JS, Long JD, Brekke JS, Burke SS. Construct validity of a measure of subjective satisfaction with life of adults with serious mental illness.  Psychiatr Serv. 2005; 56: 292-300.  
24-Ebrahimi A, Neshatdoost HT, Kalantari M, Molavi H, Asadollahi GHA. Factor structure, reliability and validity of religious attitude scale. Journal of Fundamentals of Mental Health Summer. 2008; 10(38): 107-16.
25-Ghaffari M,  Niknami  SH,  Kazemnejad  A,  Mirzae  E,  Ghofranipour  F. Designing and validating 10 conceptual scales to prevent HIV among adolescents. Behbood. 2007; 11(1): 38-50.
 
 
 
 
Jundishapur Scientific Medical Journal
Volume 10, Issue 6 - Serial Number 75
January and February 2012
Pages 583-593

Files

History

  • Receive Date: 18 October 2010
  • Revise Date: 17 September 2011
  • Accept Date: 11 October 2011

Share

How to cite

Statistics