Student evaluations are controversial, particularly when they are used to make personnel decisions.<\/a> My interest, however, is not in evaluating instructors, but in seeing if there is evidence for students’ complaints about uneven expectations. Naturally, there are questions about the reliability of the data. As any parent with a teenager knows, self-reported estimates of time spent on task are suspect.\u00a0 Will there be any signal in the noise?<\/p>\n In the plot below I show the results for a single semester of data for two classes, Intellectual Heritage I and II.\u00a0 Both classes are required of all Temples students so there are dozens of sections offered every semester. I’ve converted the Likert scale into hours worked by using the mean value for each choice (e.g. 8 hours for choice 3). Each mark represents a different section of the class. The corresponding workload is an average across all of the students who completed the evaluation for that section (sadly, not all students complete the evaluation).<\/p>\n We see a fair spread in the reported effort, ranging from less than four hours per week to as many as 15.\u00a0 If you look across all GenEd courses the range is even greater, but here we have a factor of three to four difference between sections of the same class.<\/p>\n The red marks show four sections taught by Instructor A.<\/p><\/div>\n Many of the instructors teach four sections of IH I and\/or IH II each semester. Let’s assume that each instructor uses the same syllabus for all of their sections of the same class, though it may differ from another instructor’s.\u00a0 Do students enrolled in different sections of the same class, taught by the same instructor (red markers), report a similar workload?<\/p>\n There is considerable spread, but the variation in the workload reported between sections taught by the same instructor is certainly less than between instructors overall. In the two examples shown, it seems clear that the students taking the class from Instructor A at least think<\/em> they are spending more time on coursework than students taking the class from Instructor B.\u00a0 If they compare notes, they may grumble.<\/p>\n The red marks show four sections taught by instructor B.<\/p><\/div>\n What I am really curious to know is whether the students’ self-assessment bears any relationship to the instructor’s belief of how much effort they are asking of their students. To answer this, I hope to encourage IH instructors to try this online workload estimator<\/a> (screenshot below).\u00a0 If there is a reasonable correspondence between instructor and student perceptions, then it may be possible for instructors to use the workload estimator as a tool to balance the load across sections, addressing students’ concerns without requiring a common syllabus or restricting instructors’ freedom to choose their assignments.<\/p>\n This online workload calculator allows instructors to estimate the time students will spend on their class based on the frequency and type of reading, writing, and other assignments.<\/p>\n","protected":false},"excerpt":{"rendered":" It is a common student lament: “A friend of mine is taking the same class from a different teacher and she has far fewer readings and papers.”\u00a0 We’ve all heard it. Maybe we made similar complaints when we were college … Continue reading ![\"Workload](\"https:\/\/sites.temple.edu\/geophysics\/files\/2022\/01\/IH_Histogram.png\")
<\/a>![\"Second](\"https:\/\/sites.temple.edu\/geophysics\/files\/2022\/01\/IH_Histogram2.png\")
<\/a>![\"\"](\"https:\/\/sites.temple.edu\/geophysics\/files\/2022\/01\/workload_est-1.png\")
<\/a><\/p>\n