{"id":17298,"date":"2015-11-09T15:24:21","date_gmt":"2015-11-09T15:24:21","guid":{"rendered":"http:\/\/www.valpo.edu\/cital-blog\/?p=222"},"modified":"2015-11-09T15:24:21","modified_gmt":"2015-11-09T15:24:21","slug":"do-good-course-evaluations-mean-you-are-a-good-teacher","status":"publish","type":"post","link":"https:\/\/intra.valpo.edu\/cital\/do-good-course-evaluations-mean-you-are-a-good-teacher\/","title":{"rendered":"Do Good Course Evaluations Mean You Are a Good Teacher?"},"content":{"rendered":"<h5><span style=\"font-family: calibri\"><b>BY: Allison M. Hunt, Assistant Director of Instructional Technology<br \/>\n<\/b><\/span><\/h5>\n<p>Why is teacher effectiveness so important? I think the obvious answer is that the measure, in part, determines one\u2019s future in academe (i.e. promotion and tenure). Accreditors are also scrutinizing the ability of institutions to provide evidence to show whether students are actually learning what instructors purport the students are learning. Accreditors are here to keep universities accountable which means the pressure is put on administrators and faculty to pony up the evidence. So\u2026. what evidence do you have to show that YOU are an <i>effective <\/i>instructor? What tools do YOU use to measure your effectiveness? -Are your methods and beliefs supported by research?<\/p>\n<p>One important thing to remember about course evaluations completed by students at the end of the semester is that they represent a single datapoint, &nbsp;which is not sufficient to make a holistic determination about one\u2019s effectiveness as an instructor. Hativa (2014) notes that \u201cstudents are not knowledgeable enough to evaluate all aspects of teaching quality\u201d and additional sources of information should be used.<\/p>\n<p>This article is a snapshot of evidence-based tools that measure teacher effectiveness. The research all agrees there is not one <i>magic tool<\/i> to use. Instead, institutions would be wise to include multiple methods of assessment.<\/p>\n<p>The chart below summarizes the findings from various authors and experts in the field. Each author discusses the validity and reliability of each tool and the purpose of each. The VU faculty handbook is included to reflect current practice.<br \/>\n<a href=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.15.36-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-220 size-full\" src=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.15.36-AM.png\" alt=\"Screen Shot 2015-11-09 at 9.15.36 AM\" width=\"627\" height=\"709\" srcset=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.15.36-AM.png 627w, https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.15.36-AM-265x300.png 265w\" sizes=\"auto, (max-width: 627px) 100vw, 627px\" \/><\/a><\/p>\n<p>In sum, it looks like there is a discrepancy between what the research is recommending and what the institution is doing. <b>In particular, <\/b><b>teaching portfolios<\/b><b> and <\/b><b>learning outcome measures<\/b><b> could be included to measure teacher effectiveness. <\/b>These discrepancies are common across institutions and were highlighted in Henderson\u2019s (2014) article. His findings are shown below.<\/p>\n<p><a href=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-02-at-4.22.54-PM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-216 size-full\" src=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-02-at-4.22.54-PM.png\" alt=\"Screen Shot 2015-11-02 at 4.22.54 PM\" width=\"860\" height=\"409\"><\/a><\/p>\n<p>It\u2019s important to remember that each tool measures different aspects of teacher effectiveness. Nilson (2003) would break down two of the resources as follows:<\/p>\n<p><a href=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.03.16-AM.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-217 size-full\" src=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.03.16-AM.png\" alt=\"Screen Shot 2015-11-09 at 9.03.16 AM\" width=\"630\" height=\"102\" srcset=\"https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.03.16-AM.png 630w, https:\/\/intra.valpo.edu\/cital\/wp-content\/uploads\/sites\/13\/2015\/08\/Screen-Shot-2015-11-09-at-9.03.16-AM-300x49.png 300w\" sizes=\"auto, (max-width: 630px) 100vw, 630px\" \/><\/a><\/p>\n<p>As mentioned earlier, a multitude of resources is preferred as the strengths of one tool can cover the weaknesses and shortcomings of any single source (Nilson, 2003; Berk, 2005; Hativa, 2014). Wouldn\u2019t it be nice if the research could simply identify the <i>qualities<\/i> or <i>skills<\/i> of a teacher? This way instructors can focus their energies appropriately. Well, this would be nice, but the research has a hard time coming up with anything solid.<\/p>\n<p>Berk writes that the act of teaching is too complex to measure. However, there are some researchers who have identified <i>dimensions<\/i> and actual <i>qualities<\/i> of teacher effectiveness. -These are items that could be included on student evaluations.<\/p>\n<p>Hativa (2014) identified general teaching behaviors which cannot be directly observed or measured. These are simply correlated with a global item, \u201coverall teacher effectiveness\u201d through student evaluations.<\/p>\n<p><b>General Teaching Behaviors:<\/b><\/p>\n<ul>\n<li>Clarity<\/li>\n<li>Organization<\/li>\n<li>Engagement\/Interesting<\/li>\n<li>Interaction (questioning, discussion)<\/li>\n<li>Rapport (interest in and concern about students and their learning, motivating students)<\/li>\n<\/ul>\n<p>These general teaching behaviors are further categorized into general instructional skills under two dimensions:<\/p>\n<p><b>Cognitive Dimension<\/b>=Communication of material<\/p>\n<ul>\n<li>Lesson clarity<\/li>\n<li>Course &amp; lesson organization<\/li>\n<li>Engaging\/interesting presentation<\/li>\n<\/ul>\n<p><b>Affective Dimension<\/b>=Interpersonal Rapport<\/p>\n<ul>\n<li>Interactions, questioning &amp; answering<\/li>\n<li>Rapport with students<\/li>\n<\/ul>\n<p>Calaguas, G. M. (2012) identified 67 behaviors through PCA (Principal Components Analysis) loaded on four identified dimensions:<\/p>\n<ul>\n<li>Teaching-related behavior<\/li>\n<li>Subject matter expertise<\/li>\n<li>Relational expertise<\/li>\n<li>Personality<\/li>\n<\/ul>\n<h4>*Whatever data sources chosen, the reliability, validity, and methodology are paramount to produce data that is worthwhile to interpret.<\/h4>\n<p>The Course Evaluation Task Force is currently evaluating the processes of student\/course evaluations, including, but not limited to, the purpose of evaluations, the current methods and processes, the questions asked on the surveys, and the interpretation of the results. The task force has the tremendous goal to provide such recommendations rooted in research. However, we cannot forget that student evaluations are just ONE source to measure teacher effectiveness. -What do you rely on?<\/p>\n<hr>\n<p>Resources<\/p>\n<p>Berk, R.A. (2005). Survey of 12 Strategies to Measure Teaching Effectiveness. Vol. 17, No. 1, 48-62. <i>International Journal of Teaching and Learning in Higher Education<\/i>.<\/p>\n<p>Calaguas, G.M. (2012) &nbsp;Teacher effectiveness scale in higher education: Development and psychometric properties.<\/p>\n<p>Retrieved from: https:\/\/www.consortiacademia.org\/files\/journals\/1\/articles\/108\/public\/108-424-1-PB.pdf<\/p>\n<p>Henderson, C. et al (2014). Assessment of Teaching Effectiveness : Lack of alignment between instructors, institutions, and research recommendations. <i>Physical Review Special Topics: Physics Education Research. <\/i>Retrieved from: https:\/\/journals.aps.org\/prstper\/pdf\/10.1103\/PhysRevSTPER.10.010106<\/p>\n<p>Hativa, N. (2014). Student Ratings of Instruction: Recognizing Effective Teaching. <i>Oren Publications.<\/i><\/p>\n<p>Nilson, L. B. (2003). Teaching At Its Best, 2nd edition. <i>Anker Publishing, now Jossey-Bass.<\/i><\/p>\n<p>Valparaiso University Faculty Handbook: https:\/\/www.valpo.edu\/generalcounsel\/assets\/docs\/Faculty%20Handbook.pdf<\/p>\n<p>2.3.4.1 Teaching (Qualities)<\/p>\n<p>2.3.5.1 &#8211; 2.3.5.3 (Annual Evaluation Principles, Components, &amp; Expectations)<\/p>\n","protected":false},"excerpt":{"rendered":"<p>BY: Allison M. Hunt, Assistant Director of Instructional Technology Why is teacher effectiveness so important? I think the obvious answer is that the measure, in part, determines one\u2019s future in academe (i.e. promotion and tenure). Accreditors are also scrutinizing the ability of institutions to provide evidence to show whether students are actually learning what instructors&hellip;<\/p>\n","protected":false},"author":7,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uag_custom_page_level_css":"","advgb_blocks_editor_width":"","advgb_blocks_columns_visual_guide":"","footnotes":""},"categories":[32],"tags":[74,141],"post_folder":[],"class_list":["post-17298","post","type-post","status-publish","format-standard","hentry","category-32","tag-course-evaluations","tag-teacher-effectiveness"],"author_meta":{"display_name":"kim.pomeroy@valpo.edu","author_link":"https:\/\/intra.valpo.edu\/cital\/author\/kim-pomeroyvalpo-edu\/"},"featured_img":null,"uagb_featured_image_src":{"full":false,"thumbnail":false,"medium":false,"medium_large":false,"large":false,"1536x1536":false,"2048x2048":false,"Profile":false},"uagb_author_info":{"display_name":"kim.pomeroy@valpo.edu","author_link":"https:\/\/intra.valpo.edu\/cital\/author\/kim-pomeroyvalpo-edu\/"},"uagb_comment_info":0,"uagb_excerpt":"BY: Allison M. Hunt, Assistant Director of Instructional Technology Why is teacher effectiveness so important? I think the obvious answer is that the measure, in part, determines one\u2019s future in academe (i.e. promotion and tenure). Accreditors are also scrutinizing the ability of institutions to provide evidence to show whether students are actually learning what instructors&hellip;","coauthors":[],"tax_additional":{"categories":{"linked":["<a href=\"https:\/\/intra.valpo.edu\/cital\/category\/2015\/\" class=\"advgb-post-tax-term\">2015<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">2015<\/span>"]},"tags":{"linked":["<a href=\"https:\/\/intra.valpo.edu\/cital\/category\/2015\/\" class=\"advgb-post-tax-term\">course evaluations<\/a>","<a href=\"https:\/\/intra.valpo.edu\/cital\/category\/2015\/\" class=\"advgb-post-tax-term\">teacher effectiveness<\/a>"],"unlinked":["<span class=\"advgb-post-tax-term\">course evaluations<\/span>","<span class=\"advgb-post-tax-term\">teacher effectiveness<\/span>"]}},"comment_count":"0","relative_dates":{"created":"Posted 10 years ago","modified":"Updated 10 years ago"},"absolute_dates":{"created":"Posted on November 9, 2015","modified":"Updated on November 9, 2015"},"absolute_dates_time":{"created":"Posted on November 9, 2015 3:24 pm","modified":"Updated on November 9, 2015 3:24 pm"},"featured_img_caption":"","series_order":"","_links":{"self":[{"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/posts\/17298","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/users\/7"}],"replies":[{"embeddable":true,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/comments?post=17298"}],"version-history":[{"count":0,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/posts\/17298\/revisions"}],"wp:attachment":[{"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/media?parent=17298"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/categories?post=17298"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/tags?post=17298"},{"taxonomy":"post_folder","embeddable":true,"href":"https:\/\/intra.valpo.edu\/cital\/wp-json\/wp\/v2\/post_folder?post=17298"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}