

{"id":119,"date":"2022-10-10T09:45:44","date_gmt":"2022-10-10T13:45:44","guid":{"rendered":"https:\/\/sites.temple.edu\/edvice\/?p=119"},"modified":"2023-08-30T13:39:14","modified_gmt":"2023-08-30T17:39:14","slug":"beyond-sffs-a-series-on-evaluating-teaching-part-i-developing-a-holistic-approach-to-teaching-evaluation","status":"publish","type":"post","link":"https:\/\/sites.temple.edu\/edvice\/2022\/10\/10\/beyond-sffs-a-series-on-evaluating-teaching-part-i-developing-a-holistic-approach-to-teaching-evaluation\/","title":{"rendered":"Beyond SFFs: A Series on Evaluating Teaching &#8211; Part I: Developing a Holistic Approach to Teaching Evaluation"},"content":{"rendered":"\n<p>Stephanie Laggini Fiore, Ph.D.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full is-resized\"><img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/sites.temple.edu\/edvice\/files\/2023\/08\/beyond-sffs.png\" alt=\"\" class=\"wp-image-503\" style=\"width:688px;height:387px\" width=\"688\" height=\"387\" srcset=\"https:\/\/sites.temple.edu\/edvice\/files\/2023\/08\/beyond-sffs.png 512w, https:\/\/sites.temple.edu\/edvice\/files\/2023\/08\/beyond-sffs-300x169.png 300w\" sizes=\"(max-width: 688px) 100vw, 688px\" \/><\/figure>\n\n\n\n<p><\/p>\n\n\n\n<p><em>Evaluation without development is punitive, and development without evaluation is guesswork.<\/em> (Theall, 2017)<\/p>\n\n\n\n<p>Lee Shulman, past president of the&nbsp;<a href=\"https:\/\/www.carnegiefoundation.org\/\">Carnegie Foundation for the Advancement of Teaching<\/a>&nbsp;and professor emeritus at Stanford University, recounts his surprise that his vision of faculty life as a combination of quiet, solitary scholarly activity and vibrant, collegial interactions with a community of teachers was backward. Says&nbsp;<a href=\"https:\/\/tchsotl.sitehost.iu.edu\/part4\/shulman%20community%20property.pdf\">Shulman<\/a>&nbsp;(1993),&nbsp;\u201cWe close the classroom door and experience pedagogical solitude, whereas in our life as scholars, we are members of active communities: communities of conversation, communities of evaluation, communities in which we gather with others in our invisible colleges to exchange our findings, our methods, and our excuses.\u201d In fact, when I speak with faculty about the possibility of implementing new methods of teaching evaluation (such as peer review) that will break down that isolation and begin to develop synergies among faculty for development in teaching and learning, they may fall prey to imposter syndrome, claiming not to be expert enough to provide feedback to colleagues. At the same time, they reveal a sense of vulnerability at the idea of having others observe their teaching.&nbsp;&nbsp;<\/p>\n\n\n\n<p>But a remarkable thing happened during the shift to remote learning during COVID-19. Faculty began to emerge from their isolation, connect with each other to talk about teaching and brainstorm together solutions to teaching challenges. New Facebook pages dedicated to pedagogy sprang up (the Pandemic Pedagogy group has 31K followers), national disciplinary organizations put information on their websites and circulated it through listservs, department meetings were dedicated to teaching and learning, faculty spoke with students about what worked. In short, because we were pushed into the deep end without a lifejacket, we focused our attention on teaching. And we grew by learning from each other and from our students!<\/p>\n\n\n\n<p>Evaluation of teaching has long been practiced as a mechanism for summative decisions regarding promotion or contract renewal, and faculty will complain (often rightfully so) that it can be either a checkbox exercise devoid of real meaning or based heavily on student feedback. Evaluation of teaching should be so much more! It should create the kind of community that the pandemic briefly afforded us, one in which we as professionals reflect on our own teaching, discuss our practices with colleagues, learn from each other, from our students, and from how well students meet our learning goals, and move towards continual, formative improvement. Stephen Brookfield (2005)&nbsp;<a href=\"https:\/\/onlinelibrary.wiley.com\/doi\/abs\/10.1002\/chp.1340180402?casa_token=Zh0I2DEo0h8AAAAA:oAQSns7IIPmro7D3YOWFSIgkVGjMQ-M7zU9Di-7z79aJPhT6NwmEyHPFKuKtJG2WDqLLbEAaqaXwo6U\">suggests<\/a>&nbsp;that we look at our teaching through four lenses: an autobiographical lens, our students\u2019 lens, our colleagues\u2019 lens, and the lens of theoretical literature. We might also think about how we assess whether our students are reaching the learning goals we\u2019ve set out for them, and what changes we might make to try to improve their ability to succeed in our courses. As&nbsp;<a href=\"https:\/\/go-gale-com.libproxy.temple.edu\/ps\/i.do?id=GALE%7CA626042500&amp;sid=googleScholar&amp;v=2.1&amp;it=r&amp;linkaccess=abs&amp;issn=07367627&amp;p=AONE&amp;sw=w&amp;enforceAuth=true&amp;linkSource=delayedAuthFullText&amp;userGroupName=temple_main&amp;u=temple_main\">Berk<\/a>&nbsp;(2018) points out, multiple sources can be both more accurate and more comprehensive in evaluating a professional activity as complex as teaching. These multiple sources can be deployed for summative purposes, of course, but more importantly, they can be useful as a holistic tool to help us continue our growth as educators, and our effectiveness in supporting student learning.<\/p>\n\n\n\n<p>We already have a long history of employing the student lens through student feedback forms (SFFs) so this series will not separately discuss this method of evaluation. However, I will mention here how important it is to be mindful of best practices in using SFF data in order for it to provide helpful information towards improvement of teaching.&nbsp;The Temple University Assessment of Instruction Committee has just put out a very helpful guide to using SFF data,&nbsp;<a href=\"https:\/\/teaching.temple.edu\/sites\/teaching\/files\/resource\/pdf\/Recommendations%20for%20the%20Use%20of%20Student%20Feedback%20Form%20Data%20at%20Temple%20-%209.29.2022.pdf\"><em>Recommendations for the Use of Student Feedback Form (SFF) Data at Temple University<\/em><\/a>. This comprehensive guidance includes a good overview on the purpose of SFFs, what they are and are not, advice for instructors on how to use SFF data, and advice for evaluators on how to use SFFs responsibly and effectively for evaluation purposes.&nbsp;See also&nbsp;<em>How to Read Those SFFs<\/em>&nbsp;and&nbsp;<em>Flip the Switch: Making the Most of Student Feedback Forms&nbsp;<\/em>for guidance on&nbsp;the best ways for faculty to use student feedback to improve teaching<em>.&nbsp;<\/em>And, of course, you can make an&nbsp;<a href=\"http:\/\/catbooking.temple.edu\/\">appointment<\/a>&nbsp;with a faculty developer at the CAT to discuss your SFFs.<\/p>\n\n\n\n<p>Remember also that SFFs are not the only way to receive student feedback. I strongly recommend gathering&nbsp;<a href=\"https:\/\/teaching.berkeley.edu\/news\/spotlight-teaching-and-learning-mid-semester-check\">mid-semester feedback<\/a>&nbsp;as a check-in with your students while there is still time to make changes in the semester. It has the added bonus of having students reflect on their learning and consider changes&nbsp;<em>they<\/em>&nbsp;may want to make in order to achieve better results. You can also ask the CAT to perform a mid-semester&nbsp;<a href=\"https:\/\/teaching.temple.edu\/consultations-and-observations\">small (or large) group instructional diagnosis<\/a>.&nbsp;<\/p>\n\n\n\n<p>This blog series will continue throughout the fall semester with an exploration into the other teaching evaluation methods that can be used to both assess teaching practices and grow teaching excellence. Stay tuned for the following upcoming topics:<\/p>\n\n\n\n<p><strong>Part II: Reflective Practice<\/strong><\/p>\n\n\n\n<p><strong>Part III: Peer Review of Teaching<\/strong><\/p>\n\n\n\n<p><strong>Part IV: Assessment of Learning Outcomes<\/strong><\/p>\n\n\n\n<p><strong>Part V:&nbsp; Literature on Teaching and Learning<\/strong><\/p>\n\n\n\n<p>At the end of this series, my sincerest wish for you is that you find new ways to think about your teaching practices, that you engage with your colleagues (and with the CAT!) in productive and enlightening conversations about teaching, that you find a favorite resource on teaching, and that you connect with your students in ways that help them to learn deeply.<\/p>\n\n\n\n<p><em>Stephanie Fiore serves as Assistant Vice Provost of Temple&#8217;s Center for the Advancement of Teaching.<\/em>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Stephanie Laggini Fiore, Ph.D. Evaluation without development is punitive, and development without evaluation is guesswork. (Theall, 2017) Lee Shulman, past president of the&nbsp;Carnegie Foundation for the Advancement of Teaching&nbsp;and professor emeritus at Stanford University, recounts his surprise that his vision of faculty life as a combination of quiet, solitary scholarly activity and vibrant, collegial interactions &hellip; <a href=\"https:\/\/sites.temple.edu\/edvice\/2022\/10\/10\/beyond-sffs-a-series-on-evaluating-teaching-part-i-developing-a-holistic-approach-to-teaching-evaluation\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Beyond SFFs: A Series on Evaluating Teaching &#8211; Part I: Developing a Holistic Approach to Teaching Evaluation<\/span><\/a><\/p>\n","protected":false},"author":29430,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6,4],"tags":[],"class_list":["post-119","post","type-post","status-publish","format-standard","hentry","category-beyond-sffs","category-special-topics"],"_links":{"self":[{"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/posts\/119","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/users\/29430"}],"replies":[{"embeddable":true,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/comments?post=119"}],"version-history":[{"count":2,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/posts\/119\/revisions"}],"predecessor-version":[{"id":508,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/posts\/119\/revisions\/508"}],"wp:attachment":[{"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/media?parent=119"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/categories?post=119"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/sites.temple.edu\/edvice\/wp-json\/wp\/v2\/tags?post=119"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}