Associate Director’s log, stardate 4616.2. Temple University. While minding our own business over here, someone invented generative AI and made it readily accessible to the people of Earth, which includes our students. We find ourselves in a strange and unfamiliar landscape; computer probability projections are useless due to insufficient data¹. Some faculty members have boldly entered this new terrain.
_______
We decided to call this blog series Faculty Adventures in the AI Learning Frontier not only because Google’s new AI tool Gemini suggested the title but because of its resonance with Star Trek. The original television series and its many reboots and spin-offs depict intrepid adventurers exploring the deep reaches of space, the “final frontier,” as we were reminded at the beginning of each episode. With the rapid evolution of generative AI, we find ourselves standing on the threshold of a strange new world. Teaching in the age of AI is, indeed, a new frontier; instructors are boldly going where no instructor has gone before. With great ingenuity, and at times trepidation, faculty members throughout Temple have begun to explore what it means to integrate AI into their class planning and delivery.
Over the course of this series, we will showcase examples of activities and assessments that Temple faculty members used in their classes in Fall 2023. In our March 11th post, we will feature assignments used in First Year Writing courses. March 25th will focus on implementation of generative AI assignments and activities in the health sciences and our final post on April 15th will include examples of how instructors across different disciplines have addressed ethics in the use of generative AI. Some of the featured activities and assessments have been designed to help students practice implementing generative AI in their fields while others encourage students to critically interrogate the impact of AI.
Whether we like it or not, generative AI is now part of our–and our students’–world. It is our responsibility not just to familiarize ourselves with these tools but to help our students make decisions about their use and, should they choose to use them, to do so effectively and ethically. We hope this series will give you some concrete and applicable examples of how to address generative AI in your courses.
_______
¹ The Gamesters Of Triskelion, Original Airdate: 5 Jan, 1968.
It’s common for faculty members to use midterm exams or projects to assess student progress, however, for students who are struggling, a midterm check-in may come too late to effectively address challenges. In this post, we’ll talk about ways to check in with students earlier in the semester and what to do if students are missing classes and assignments or their work demonstrates a need for additional support.
Enter your Midterm Progress Ratings for Academic Progress
In spring 2024, Midterm Progress Ratings (MPRs) for undergraduate classes will be open from January 31, 2024 to March 11, 2024. This is three weeks earlier than in previous years so that instructors can provide targeted outreach to students who may need additional guidance or resources to support their learning and retention. It’s a good idea to check your rosters for students who have missed classes or assignments, or whose submitted work is not meeting a passing standard and enter progress ratings as early as possible. It won’t come as a surprise to faculty that missed classes and assignments in the first weeks of classes are a strong predictor of poor course outcomes, so the sooner these patterns are identified, the better.
Some advising units use MPRs to identify students who require additional outreach and support. Students are also notified if a professor has submitted an MPR. While this can be a helpful indicator to some students that they are at risk of not succeeding in the course, for others, a rating of “Unsatisfactory” can be discouraging, so we recommend reaching out to students who are identified as “Unsatisfactory” (more on that below). There is a helpful guide to completing MPRs available in TU Portal.
Reach Out to Students Whose Attendance, Course Engagement and/or Work on Assignments is Cause for Concern
If in the process of reviewing student performance and completing MPRs, you notice a student has not been regularly engaging with your course or is struggling with assignments, check in with the student. You might send an email using TUmail or the Canvas email function or have a brief chat with the student after class. You can also check the “People” function in Canvas to see how much time students have spent in the course and email them directly from there. Some faculty members schedule meetings with students around the quarter-semester mark, though the size or number of your classes may prohibit this option. If you have too many students to make bespoke outreach possible, Canvas’s “message students who” function can help.
Be sure to communicate to the student that you want them to succeed and that you’re there to help. Share information on resources such as the Student Success Center, Disability Resources Services,Cherry Pantry, and the Wellness Resource Center. If you want to learn more about available resources, the Dean of Students office has a “Red Folder” with advice on making appropriate referrals.Temple has also made new apps available to students who may need mental health counseling, such as TogetherAll and Welltrack Boost. Checking in with your students demonstrates your care and concern, which can also make a difference to a student who may be feeling overwhelmed or struggling.
Give a Word of Encouragement
This is the time in the semester when the full weight of their obligations begins to hit students. Assignment due dates start to amass. Midterm exams loom. A majority of Temple students hold at least one part-time job and many participate in extracurricular activities, some of which are required by their colleges. It’s a good time to remind our students that we see and appreciate their work and that we believe they can succeed. Some students may need more guidance about resources available to them for building their study skills, including note taking, time management, and mapping out their schedules with their various responsibilities outside of school; some may be managing challenges related to housing, food security, or other personal matters that may make it harder for them to manage coursework. We can be proactive and normalize help seeking by regularly reminding students about resources on campus during these stressful stages of the semester and ensuring we list available resources in our Canvas sites.
Use Informal Surveying or a Mid-Semester Instructional Diagnosis to Check In
While we collect student feedback at the end of the semester, at that point, it’s too late to change anything. Consider using an informal, anonymous survey that asks students what is most helping their learning and what is getting in the way of their learning. This can be done using a tool such as Google or Microsoft forms or simply by using index cards. Stephen Brookfield’s Critical Incident Questionnaire can also be a helpful tool for regular check-ins.
The CAT can also help! We invite you to schedule a Mid-Semester Instructional Diagnosis: a CAT staff person will visit your class for 35-40 minutes and (once you have left the room) gather consensus feedback from students on four questions relating to what you, and what they can do to improve their learning.
Encourage Students to Engage in Metacognitive Reflection
Invite students to reflect on their learning strategies and on what is working and what needs adjustment. Share strategies for studying or reading that encourage students to check in with themselves on their own understanding. While the semester is still relatively young, we have a window of opportunity to provide formative feedback that will motivate students and encourage them to take ownership of their learning.
As always, if you’d like assistance with supporting your students early in the semester, our faculty developers and educational technology specialists are ready to help. Make an appointment here or email a CAT staff member directly.
More than 225 faculty from universities across the region came together with the CAT on January 10 and 11 for the 2024 Annual Faculty Conference on Teaching Excellence. The event was co-sponsored by Temple Libraries, the Office of Digital Education, Information Technology Services, and the General Education Program.
This year’s theme was Teaching and Learning in the Age of Generative Artificial Intelligence. Participants grappled with the broad impacts of generative artificial intelligence (GAI) in higher education and the specific implications for teaching and learning–all evolving in real time! The availability of these tools to our students raises important and difficult questions about the nature of thinking and learning, academic integrity, and the purpose and effectiveness of our assessments and learning activities.
Keynote and Plenary Address
Dr. Sarah Elaine Eaton and Dr. Sharla Barry
The CAT was honored to have Dr. Sarah Elaine Eaton, Associate Professor at the Werklund School of Education at the University of Calgary, Canada, who also holds a concurrent appointment as an Honorary Associate Professor at Deakin University in Australia. Her day one keynote was titled, Academic Integrity in a Postplagiarism World: The Impact of Generative Artificial Intelligence on Teaching, Learning, and Assessment.
Dr. Eaton began by defining a post-plagiarism world as an era in human society in which advanced technologies are a normal part of life, including how we teach, learn, and interact daily. After introducing us to the breadth of areas beyond student academic integrity that concern generative AI integrity in higher education, (e.g., publication ethics, research and integrity ethics, instruction ethics, and institutional ethics), she urged us not to approach student academic integrity from a “crime and punishment/I will catch you if you try to cheat” mindset. Rather, she suggested faculty and administrators adopt a more humanist mindset, as cheating is often a symptom of other problems, be it a lack of understanding or trying to handle multiple life responsibilities.
Dr. Eaton then presented some likely realities of a post-plagiarism world, suggesting that some hybrid of human-AI technologies will be the norm, including wearable and implantable AI. Dr. Eaton reminded us that wearable AI is already here as is implantable AI (a cochlear implant), and thus we need to be preemptive rather than speculative in our thinking so that we are not caught off guard as we were with AI/ChatGPT. She stressed that we have an imperative as faculty to ensure the ethical use of future AI to leave the education system better than when we found it, and lastly, that we must also remember that students cannot relinquish their responsibility for what they generate and submit!
We were also delighted to have Dr. Sharla Berry, Associate Director of the Center for Evaluation and Educational Effectiveness at California State University, Long Beach. Her day two plenary session was titled, Teaching with Technology: Holistic Pedagogies in a Time of Change.
Dr. Berry helped us explore the sociocultural implications of our evolving digital learning landscape by posing some thought-provoking questions we need to reflect on regarding the development of AI and its use in education:
While AI increases our ability to gather information, how are we ensuring that students have the ability to synthesize and use that information to benefit their learning? Is getting the right answer considered learning?
Are we acknowledging and looking out for historical information from limited perspectives that result in biased output?
Are we helping students to give better prompts that enable more balanced perspectives?
What are the environmental impacts of AI? Dr. Berry shared a finding of U. of Massachusetts researchers cited in an MIT report titled Reducing the carbon footprint of artificial intelligence: “The amount of power required for training and searching a certain neural network architecture involves the emissions of roughly 626,000 pounds of carbon dioxide. That’s equivalent to nearly five times the lifetime emissions of the average U.S. car, including its manufacturing.”
What are the social impacts of AI? Dr. Berry asked us to consider a variety of impacts, such as the substandard hourly wages paid to AI content moderators, the potential for AI to increase loneliness and social isolation, and its potential to enhance social interactions and connections with others.
In sum, Dr. Berry’s primary message was that while there are benefits of AI to humanity and society, there are also costs which need to be considered and addressed as we take a more holistic approach to assessing AI and its impacts
Building on the Keynote and Plenary Address
In addition to keynote and plenary speakers, the conference featured interactive workshops, breakout sessions, lightning talks, and poster sessions–all designed to generate discussion and share ideas for best teaching practices (with and without generative AI).
New this year was our AI Playground where participants tried out these generative AI programs:
Claude AI (Can be used like ChatGPT; We used it to summarize PDF’s)
LitMaps (Research based, can explore connections between articles)
Our 2024 Annual Faculty Conference generated many thought-provoking questions and teaching strategies, so let’s continue talking! Here are some ways you can keep the conversation going:
Share what you’ve learned with your program/department faculty.
Avail yourself of the robust AI resources on our website.
Schedule a consultation with the CAT to work on incorporating what you have learned into your courses.
Attend CAT workshops and consider joining one of our Faculty Learning Communities.
In this last post of our series on active learning, we identify the challenges faculty sometimes face when planning and implementing active learning. We also give you some strategies for meeting those challenges.
How can I make time in class or online for active learning when I have so much content to cover?
While there are active learning strategies that don’t take a lot of class time and are easy to implement, integrating active learning into your class sessions will require rethinking the content you cover in class to ensure there is adequate time to complete activities. There’s a saying that’s useful to remember as you wrestle with what content may have to be moved out of class time: “If you say it, that doesn’t mean they’ve learned it.” So, ask yourself what foundational knowledge (e.g., definitions, factoids, easy-to-understand/background information on a topic) can be moved out of class time and assigned prior to class. To ensure accountability, you can give students a short assessment before or at the start of class. Another way to help you decide is by categorizing your content as “crucial to know,” “good to know,” and “tangential or unrelated to the Topic.” Often we include content that really doesn’t enhance students’ learning and does not move students toward meeting course goals, so consider simply removing it. Finally, remember that active learning strategies are used to address course content; they simply involve students in the process. While you may not be delivering the content in the form of a lecture, a well-designed active learning strategy will require students to grapple with key concepts, apply knowledge or skills and test their understanding.
I’ll lose control of the class if I don’t lecture.
Active learning doesn’t mean you give up control; it means that you provide opportunities for other ways of learning where you don’t take center stage while continuing to monitor and assist as students actively engage with course content. This short video demonstrates how instructors continue to guide students during an in-class activity. Viewing our role more as a facilitator of learning rather than as the dispenser of all wisdom can be a useful mindset to help you let go of this concern, especially if you are teaching large lecture courses. And remember, your TA or Diamond Peer Teacher can play a significant role in helping set up and monitor students when they work in pairs or small groups.
My students are used to lecturing; they’re not going to be happy campers.
For a variety of reasons, you may get pushback from students who have never been in an active learning classroom or who have had negative experiences. It’s not unusual for faculty to hear some version of these student comments: “I pay your salary, and I expect you to be the one to teach me!”; “My peers don’t know enough, or I’ll get misinformation”; “I hate group work!”; or “I take five classes, work, and take care of my younger siblings. How can you expect me to be prepared for every class period?”
These statements (and your concerns about them) are understandable, but here’s the thing: active learning can improve your SFFs! A 2019 study reported that “when the percentage of class devoted to lecturing fell between 20% and 60%, the most likely outcome was an increase of scores on student evaluations.” Not only that, but the messaging we give around active learning will greatly increase the chances that students will value the experience (translating to stronger SFFs).
There are three points that can be helpful in your messaging to students about your decision to use active learning strategies: 1. The skills they’ll develop as a result of actively engaging in the course will be of value to them (now and in their future professional lives); 2. There is a large body of research demonstrating that students in classes where active learning strategies are used learn more and retain what they have learned for longer; and 3. Acknowledging that “stuff happens,” and thus what you are hoping (or expecting) to see is that more often than not, they will come to class prepared to engage with the material and with each other.
Messaging about your use of active learning strategies can start before the semester begins. You might create a “welcome to the course” email or video in which you share a little bit about how your course will run and why that’s of value to students. In addition to the benefits of deeper understanding and better course outcomes, you can share these other valuable benefits: You’ll practice working collaboratively (skills crucial in most workplaces and in life!); you’ll hear different perspectives and thus will become a better listener and a better citizen; you’ll help create trust and a sense of community–a crucial element to feeling a sense of belonging, especially for students from underrepresented or marginalized groups or who are first generation college students. Raising the value of active learning is key! Keep in mind that the messaging may need to be repeated during the semester as student motivation and effort ebb and flow.
Then, devote a paragraph or two in your syllabus to your expectations for students, your role in an active learning classroom or online course, and the value of active learning. Here’s one way you can structure the messaging in your syllabus:
Here’s my role (e.g., facilitator/coach) and why.
Here’s your role (e.g., active participant) and why it’s so important for you now and in the future.
As we’ve presented in this blog series, there are a wide variety of active learning activities from simply pausing your lecture in order to ask a question all the way up to devoting an entire class period to learning activities (a.k.a. flipping the classroom). If you are new to active learning, we encourage you to dip your toes in the water and pick a few easy-to-implement activities to try out in the next semester. If they don’t go as anticipated, be sure to take some time to reflect on why. Getting your students’ perspective on how they went can never hurt. With each subsequent semester, tweak the ones you’ve tried as needed and consider adding some that are more involved. Always remember that your course goals should guide your choice of active learning activities. For example, if a course goal is to have students deliver effective oral presentations, think about the types of active learning experiences that would give students practice and feedback to prepare them to give a strong oral presentation.
The CAT is here to assist. Make an appointment for a consultation to help create or refine your active learning activities or to have us come observe and give you feedback on what you’ve tried.
Cliff Rouder is Pedagogy and Design Specialist at Temple’s Center for the Advancement of Teaching (CAT). Linda Hasunuma is Assistant Director at the CAT.
In our ongoing series, “Another Look at Active Learning,” we’ve explored various active learning techniques. While active learning is an effective approach in all types of courses, its application can differ in online environments. This is especially true for asynchronous courses where students lack real-time contact with the instructor and their peers. So it becomes crucial to establish opportunities for active engagement with the instructor and fellow students in asynchronous settings. In this blog post, we delve into activities that can effectively engage students in both synchronous and asynchronous online learning settings.
Synchronous active learning strategies
Synchronous activities take place in real-time, often using platforms like Zoom. They often mirror the types of activities that we use in in-person settings, with some adjustments to help them work in this modality.
Examples
Strategy #1: Jigsaw Online
How it works:
Step 1: Identify a reading or learning unit that can be divided into parts.
Step 2: Form small groups and have each group focus on one of the parts. This can be completed prior to class, or by reading independently during class time.
Step 3: In class, form breakout rooms for each group to allow them to discuss their part with the goal of being able to explain it to other classmates. They should be working together to identify key concepts and clarify any gaps in understanding. Then, have them return to the main room.
Step 4: Form new groups in the breakout room so that each new group has one member for each of the different parts. I recommend asking students to add their Step 3 breakout room number next to their names to make it easier for instructors to reform the groups. Each group member now explains their part to the other members in the new group.
Step 5: Optional: Provide the new groups with a problem to solve that requires the integration of the different parts.
Strategy #2: Rotating Stations
How it works:
Step 1: Define the learning unit and craft a set of open-ended discussion questions before class.
Step 2: Create shareable collaborative documents (e.g. Google Docs) for each question, and change the sharing setting to enable “edit access for anyone with a link”. Provide all the links on a single Google Doc, using it as the central hub.
Step 3: In class, establish breakout rooms for group discussions. Have students record their answers in the documents and rotate every 10 minutes through the questions.
Step 4: After they’ve cycled through all stations (i.e. google docs), bring them back to the main room for discussion through chat, raised hands, or taking turns to speak.
Note: Monitor document activity to support groups if needed during the activity.
Strategy #3: Digital Sticky Notes
Sticky notes are great for getting lots of student ideas quickly. You can use them for brainstorming together in real time, making mind maps, and helping students sort out concepts to boost their critical thinking.
Digital sticky notes work just like the real ones, they can be added by everyone, and you can keep coming back to them. Padlet is an easy digital sticky note tool to use, great for sharing and collaborative editing.
Strategy #4: Live Polling
Uses for live polling:
Assess Learning: Use multiple-choice or open-ended polls to assess comprehension.
Build Community: Foster a sense of belonging using image or word cloud polls.
Gather Feedback: Collect course and teaching feedback.
Facilitate Peer Learning: Encourage discussions and decision-making through polls.
Use Poll Everywhere for both in-person and online teaching; it integrates into presentations with various question types. Kahoot, another polling tool, enables creating multiple-choice questions for instant feedback and leaderboards. Employ Kahoot games for knowledge reinforcement, review, or as individual challenges for asynchronous learning with set deadlines.
Asynchronous active learning strategies
Asynchronous activities occur at students’ own pace and on their schedule. Designed well, they can be successful at actively engaging students with the content and with others in the class.
Examples
Strategy #1: Collaborative Writing
Consider using collaborative writing tools like Google Docs, or Microsoft Word, when assigning group writing projects where students can work together asynchronously. These tools are very useful because they allow everyone to contribute and edit the same documents. In addition, they have features like tracking changes and adding comments, which make it easy for everyone to give feedback and improve the work together.
Strategy #2: Peer Review
Leverage peer review for student connections and enhanced learning using Canvas Peer Review in asynchronous classes, and keep the following considerations in mind:
Define expectations: Provide precise instructions for the criteria students should consider in their reviews.
Offer guidance: Provide students with guiding questions, rubrics, or worksheets to assist them in their peer reviews. This can aid in structured and focused evaluations.
Encourage author questions: Encourage students to include initial questions for their peer reviewers to guide them on what aspects the author would like them to focus on.
Strategy #3: Gamification, like Escape Games
Using gamification, like online escape games, is an exciting and effective approach to foster active learning, critical thinking, and problem-solving skills among students. To create and manage such games, select a suitable tool (e.g., Genially), and design the game with a storyline, puzzles, and challenges aligned with the learning objectives. Provide clear instructions, establish support and feedback channels, and encourage engagement through debriefing discussions to review solutions and outcomes. It’s worth noting that escape games can be utilized synchronously where you give students a link to the game and then return to debrief.
Strategy # 4: Online Discussions
Using tools like VoiceThread for online discussions is excellent for engaging students, especially in asynchronous courses. VoiceThread is an interactive collaboration tool where you can share materials and multimedia, and students can add text, audio, or video comments directly. It facilitates rich discussions and allows students to interact directly with shared material and also build digital presentations with comments for discussion.
Strategy #5: Generative AI
Generative AI, like ChatGPT, offers exciting opportunities for engaging students in active learning. Refer to the CAT AI guide on how to incorporate these activities in our EDvice Exchange blog post A Survival Guide to AI and Teaching pt.4: Make AI Your Friend.
If you’re interested in trying these techniques, we encourage you to reach out to the CAT. In the next post of this blog series, we will focus on overcoming challenges in active learning.
In part 2 of our series on active learning, we identified high-impact, easy-to-implement active learning techniques, and in part 3, we explored peer and collaborative learning. In this part, we’re going to examine high-impact active learning techniques that extend beyond a single class period, possibly spanning an entire semester or even the entire year. These techniques require a bigger planning component and involve a significant shift in roles for the instructor and for students as students assume more responsibility for their own learning. However, they also yield big rewards, including deriving solutions to real-world problems, increased engagement and greater ability to communicate/work effectively in groups. So without further ado, let’s take a look at a variety of long-term active learning techniques.
Experiential Learning
Experiential learning encompasses activities that invite students to learn by doing. Students apply the skills and knowledge they’re learning in their courses within actual civic and work-based contexts that place them in a position to grapple with and reflect on real-world problems. This approach improves student engagement and retention because there are meaningful stakes involved and students can see how what they’re learning will be used in post-graduate situations.
Case-Based Learning
In case-based learning, students are presented with real-world scenarios and asked to apply their knowledge to come up with solutions or to advise on the best way to address the issue at hand. It is a form of guided inquiry where the problem is defined and students use knowledge and skills gained in the classroom to tackle the problem, or in some instances, choose from a set of possible solutions or analyze how others have resolved the scenario.
Project-Based Learning
In project-based learning, students are presented with a complex real-life scenario that has multiple potential solutions. Working in groups, students develop a plan and design and create a ‘hands-on-solution’ in the form of a product or artifact to address the problem.
Problem-Based Learning
Here, students are presented with a case or scenario where they define the problem, explore related issues, and identify a solution. While similar to case-based and project-based learning, problem-based learning is generally less structured and more open ended, and the problem is typically not as well defined as in case-based learning. Problem-based learning focuses on the process of discovery, with students working to define and solve the problem.
Service Learning and Community-Based Learning
Community-based learning (CBL) (also called service learning) integrate direct community engagement into academic courses to mutually benefit students and community partners. These approaches emphasize the development of students’ civic awareness, knowledge, skills, values and goals to produce tangible social change and promote students’ critical thinking, self-efficacy, interpersonal skills, civic and social responsibility, academic development, and educational success.
Process Oriented Guided Inquiry Learning (POGIL)
POGIL is a structured protocol in which students work collaboratively to investigate a topic. This approach begins with the assumption that we learn and complete tasks more effectively in groups because everyone has gaps in their skillset and knowledge base. By pooling assets, students are more able to tackle complex problems, thereby facilitating higher order tasks and ultimately promoting better learning experiences. Key elements of the POGIL approach are the use of persistent teams who together work through challenging, inquiry-based problems and the assigning of roles within those teams that enable students to self-manage the group’s work. Faculty members serve as guides while students learn through the process of inquiry.
Team-based learning (TBL) engages student knowledge through individual testing and collaborative work in persistent teams. There are four essential elements of team-based learning: 1. Groups: Groups must be intentionally formed and managed. 2.Accountability: Students must be accountable for the quality of their individual and group work. 3.Feedback: Students must receive frequent and timely feedback. 4. Assignment design: Group assignments must promote both learning and team development. When these four elements are implemented in a course, the stage is set for student groups to evolve into cohesive learning teams.
The Flipped Classroom
In traditional classrooms, students consume content during class time, generally through listening to lectures. The flipped classroom moves more passive learning activities–such as listening, watching, or reading–outside of class time to make space within the classroom to practice skills and receive feedback. Students gain first exposure to content prior to class, ideally complete a knowledge check before coming to class so they and the professor can assess understanding ahead of the class period, and then participate in in-class or in-clinic activities that prompt higher-level thinking about the content through collaborative learning.
Gamification
We enjoy games because they’re fun, interactive and in many cases, capitalize on our competitive tendencies. There are many ways to bring the energy of play to the classroom by gamifying learning, ranging from easy-to-implement options such as using the “Competition” activity option in Poll Everywhere (for which Temple has an institutional license) to more complex activities such as Reacting to the Past (RTTP), a role-playing and immersive pedagogy. For example, our 2022 STEM Educators’ lecturer, Dr. André Thomas, described his successful creation of a video game designed to educate calculus students on the concept of limits. Where games are devised in such a way that they are enjoyable, involve collaboration, and require students to retrieve and apply course material, they are a surefire mechanism for encouraging engagement and information recall. And where they involve exploring and contextualizing a subject position that the student then must inhabit through an assigned role, as in RTTP, they allow for meaningful reflection on the complexities of contemporary and historical situations.
Executing long-term structured active learning
As mentioned above,long-term active learning techniques can require additional planning and intentional steps for ensuring group success. Faculty often ask us if there are ways to have students work more equitably and effectively in team projects. Asset-mapping can be used to promote equitable teamwork.
Asset Mapping
We know that student group projects can be a valuable experience for students. However, even with an equal distribution of work, they may not always be equitable. This can be especially true in disciplines where underrepresented and marginalized groups might be stereotyped as not being capable enough to handle the project. Consistent with prior research in STEM fields, Stoddard and Pfeifer from Worcester Polytechnic Institute’s required first-year interdisciplinary project-based learning course, women and students of color more frequently experienced their ideas being ignored or shut down, being assigned less important tasks, dealing with an overpowering teammate, and having their work go unacknowledged or claimed by others.
They employed an equity-based approach using asset mapping originally developed by Kretzman and McNight in 1993. In essence, asset mapping gives students the opportunity to get to know their and their team’s strengths, interests, identities, and needed areas of growth related to the project. But it goes well beyond that. Asset mapping is just the initial step of a process that enables students to take a deeper dive into bias and stereotyping as they evaluate their own behaviors and the dynamics of their teams. As a way to operationalize asset mapping, Stoddard and Pfeifer developed this toolkit containing three modules that include the tools, activities, assignments, and rubrics needed at different times of the semester.
If you’re interested in trying one of these longer-term active learning techniques, don’t hesitate to reach out to a CAT staff member for support. Stay tuned for the next installment of our active learning blog series which will focus on active learning in large classes!
Bringle, R. G., & Clayton, P. H. (2012). Civic education through service learning: what, how, and why?. In Higher education and civic engagement: Comparative perspectives (pp. 101-124). New York: Palgrave Macmillan US.
Guo, P., Saab, N., Post, L. S., & Admiraal, W. (2020). A review of project-based learning in higher education: Student outcomes and measures. International journal of educational research, 102, https://doi.org/10.1016/j.ijer.2020.101586..
McLean, S. F. (2016). Case-Based Learning and its Application in Medical and Health-Care Fields: A Review of Worldwide Literature. Journal of Medical Education and Curricular Development, 3. https://doi.org/10.4137/JMECD.S20377
Pereira, O. P., & Costa, C. A. (2019). Service Learning: Benefits of Another Learning Pedagogy. Economic Research, 3(9), 17-33.
In Another Look At Active Learning, part 2 of this series, we put forward several easy to implement active learning activities. Here we will focus on activities geared towards accomplishing depth of knowledge through peer and collaborative learning – encouraging a space for synthesizing rather than memorizing. Peer learning allows students to teach one another while expanding and solidifying their knowledge. Collaborative learning is similar to peer learning, but the students are grouped and work towards a common goal, all the while developing communication skills, learning from each other, and sharing their own unique perspectives.
Benefits of Peer and Collaborative Learning
One of the biggest benefits of using intentional peer and collaborative learning in the classroom is that it promotes a sense of belonging, self-efficacy and community among our students. Several decades of empirical research have demonstrated the positive relationship between effectively implemented collaborative learning and not only our students’ emotional health, but their achievement, effort, persistence, and motivation (Scager, 2016). Students get to know one another and to forge connections. Their discussions help challenge false beliefs that get in the way of learning, such as the belief that they are the only one who doesn’t understand a particular concept or is struggling with material. A student’s peer may find ways of explaining a concept that is more comprehensible than the explanations or examples we use. And the process of peer learning promotes the development of so-called “soft skills” such as empathetic listening, communication, collaboration and problem solving.
Teaching Students How to Do Group Work Successfully
Learning with and from peers requires skills that our students are often still developing. It may be necessary to teach students some of the skills required for successful peer learning such as assigning tasks, asking follow-up questions or expressing disagreement. Here are some suggestions and activities to develop peer learning skills:
Talk explicitly with students about skills required for successful group work, particularly where they are tasked with completing a longer term project (more on that in the next blog). Discuss what active listening looks like in practice. Point out to students how you model these skills in your teaching. Stephen Brookfield’s “Conversational Moves” activity, described in Brookfield and Preskill’s Discussion As A Way Of Teaching: Tools and Techniques for Democratic Classrooms, can be a great way to introduce students to strategies for promoting effective discussion.
Explore the role of emotion in peer learning. How do students feel when a teammate drops the ball? How does disagreement impact the experience of working in teams?
Address specific approaches to managing disagreement and communicating when another student’s point is not clear. Discuss ground rules for discussion early in the semester and consider asking students to participate in the creation of guidelines. The Hopes and Fears Protocol can be a helpful tool for this process. You might also provide examples of language to use in order to disagree respectfully (“What I hear you say is… The way I think about this topic is…”).
Help students develop skills pertinent to collaboration by assigning roles such as leader, recorder, reporter, devil’s advocate and/or time-keeper. Process Oriented Guided Inquiry Learning encourages the use of the role of Analyst or Reflector, which is an individual who considers and periodically reports to the group on how successfully the group is communicating and collaborating.
Considerations When Implementing Peer/Collaborative Learning Activities
Articulate the “why” of the activity and how it relates to larger goals within the course and within students’ respective professions. For example, explain that a job in advertising is not an isolated work space; rather it is a highly collaborative work space where ideas and tasks are shared. Each person brings their own knowledge and skills, and participates in a reliable fashion. A manager will select group members as they deem appropriate, and it will often not be the grouping of friends that the students might be thinking. Remind students that developing collaboration skills in the classroom will hone their skills so that they can be more effective and successful professionals.
Clear instructions are essential when it comes to active learning and it is especially important as individual activities build into peer/collaborative activities. Early on you might need to help students by breaking out the tasks associated with the activity so that they can determine the most useful path to follow in order to achieve the goal. Providing the students with the opportunity to write out a few of their task-related skills on an index card before groups are formed might help to ensure that students do not get stuck trying to figure out who can contribute what. Ensure students know whether the activity is part of their grade for a course, if that grade is individual or a group grade, and how the grade is determined.
Make the deliverable something that is meaningful to the course and to the peer/collaborative groups. If the deliverable is considered “throw away” material, then the students are less likely to put much effort into the activity. Ensuring that the deliverable is something of value, like publishing their project on a public facing website, will encourage the students to actively participate as a whole rather than letting one or two students do all the work.
Regular group check-in’s are a necessity in peer/collaborative work. However, feedback can also create negative division within the group dynamic. To keep the group dynamic healthy, there might be a regular meeting at the start of each class where the group members identify items on a checklist that have been, or need to be, completed and by whom. Then, at the end of each class, the task list is revisited to ensure that all tasks are listed. This might mean that group members are adding to the list as they find they need additional work in one area or another to achieve the goal. The task list keeps each member accountable for their contribution and acts as a reminder of that accountability. In addition to a group task list, encouraging students to offer one another constructive feedback during their sessions is a great way to further build healthy communication skills.
Activities that encourage peer and collaborative learning
Investigating AI
Compare output – Students work in small groups using their own prompts to see how differently they might approach researching a topic.
Work on prompts together – Students work in small groups to co-write prompts to get the best (most closely related) response to a question they know the answer to.
Play “spot the AI generated content” – Faculty provide pre-generated content to student groups and ask the groups to vet the content.
Prompt Engineering – Students compete to engineer prompts to generate a result you’ve tested and obtained beforehand.
Prompting Competition – Have students compete in creating the best prompt to elicit the most complete, useful, or interesting output to a course-related question or topic. Formulating a useful prompt requires clear articulation of the student’s own understanding, and comparing results allows students to practice their analytical skills. (This one comes from our Survival Guide to AI and Teaching pt.4: Make AI Your Friend.)
Role play: Involve students in activities where they assume different roles and play out scenarios that you or they have created. Students might shy away from this activity if the focus is only on one group at a time, so you might consider having several groups role playing in front of one other group rather than the class.
Interpreted lecture: Ask individual students or small groups to provide a short summary of your professor’s lecture in varying increments (every 15-20 minutes). This works best if you inform students ahead of time that you will be calling on them for this purpose so that they will be prepared for the next study session. You may need to call on other students to fill in any gaps, or fill in the gaps yourself.
Case studies: Provide students with a case study or problem. Break students into groups of 3-5. Students work through the problem and present a proposed solution to the class. Note: students can be working on the same problem, or each team can receive a different problem.
Debates: Form teams of students. Each team takes a particular stance on an issue. Ask debaters to debate an issue based on evidence, to clearly state points, to logically organize their argument, and to be persuasive. Those not on a team are the judges.
Create a study guide: In pairs or groups, have students review their notes and create their own study guide. Review with the class as a whole.
Create possible board questions: In pairs or groups, have students draft questions that might appear on their board exams or other high stakes assessments.
Rotating Stations: Four to six white boards or poster-sized sticky notes are arranged around the room. Each has a different prompt at the top. Students circulate around the room, reading responses and adding their own.
Teach each other / Update your classmate: In groups, have students take turns trying to teach the rest of their group a section of material. This will help them (and you!) gauge the depth of their understanding on a particular topic/concept. You may also ask students to write a memo to a real or fictional student who missed the last class session. In the memo, they describe the missed content and anticipate why the information might be important for understanding new content.
Jigsaw:
Step 1: Organize students into a group of 4-6 people.
Step 2: Divide the day’s reading or lesson into 4-6 parts, and assign one student in each group to be responsible for a different segment.
Step 3: Give students time to learn and process their assigned segment independently.
Step 4: Put students who completed the same segment together into an “expert group” to talk about and process the details of their segment.
Step 5: Have students return to their original “Jigsaw” groups and take turns sharing the segments they’ve become experts on.
Snowball:
Step 1: Have students work in pairs for a few minutes to discuss a response to a prompt that you’ve given them.
Step 2: Direct each pair to sit with another pair and now share amongst the four of you.
Step 3: Repeat to form a group of 8.
Step 4: Repeat until you have your whole class as one group discussing the issue.
Formulate a report: Individually, students draft a report such as an incident report, a project report, meeting minutes, or progress reports, etc.. In small groups, peers review the report and suggest improvements. Individuals revise their reports and submit them. This activity is based on formulating Incident Reports, but the reports could be on a variety of subjects such as meetings, projects, medical reports, or other activities.
Peer review: In pairs or small groups have students peer review student-created materials such as documentation, treatment plans, exercise programs, or discharge recommendations. Students can meet as a group to discuss the findings. Once feedback is provided students revise the materials before submitting.
Operate a tool: In groups of 2 to 4, students practice operating a tool or piece of equipment. As each student takes a turn the rest of the group provides them with feedback on their use of the tool.
Pass the Answer: Students write the answer to a prompt on an index card. They then swap answers with a nearby colleague. Turn and repeat swapping with someone else. Then swap one more time with someone else nearby. The instructor then calls on students to read the answer they are holding. This makes it easier for students to speak out in a large lecture hall, because they are offering someone else’s answer rather than their own.
As we mentioned in blog post 2 of this series, you do not need to implement all of the activities listed above. We encourage you to use an activity or two during your class sessions and to select activities that are designed to meet the learning goals of your course. Once the activities are completed, reflect and determine if those activities helped to accomplish peer and collaborative learning. Peer and collaborative learning are learned skills just like any course content you might be delivering. Students have a similar learning curve when it comes to communication. Build in the time for this learning when you are creating peer/collaborative learning activities.
References:
Scager, Karin et al. “Collaborative Learning in Higher Education: Evoking Positive Interdependence.” CBE life sciences education vol. 15,4 (2016): ar69. doi:10.1187/cbe.16-07-0219 Brookfield, Stephen D. and Stephen Preskill. Discussion As A Way Of Teaching: Tools and Techniques for Democratic Classrooms. 2nd Edition. Jossey Bass, 2005
If I had a quarter for every time someone says something to me like “I had 4 years of French in high school and I don’t remember a word of it”, I could pay for a trip to Hawaii right now. As a world language instructor, I hate hearing that. I want everyone who studies language to feel as if they can travel and be able to communicate in the target language in everyday situations. But, of course, the way language was taught when I was younger was not effective in making this ultimate goal a reality. Plug-and-chug homework exercises, rote drills, and mandates to memorize long lists of vocabulary and verb tenses were the dominant modes of teaching. As anyone who has memorized loads of content for an exam and then promptly forgotten it can attest to, mastery and retention of information and the ability to apply it in varied situations is not served well by these methods.
What we know from decades of research on learning is that students learn best through active learning. (If you love lectures, don’t stop reading!! I’ll get to you in a minute.) Active learning engages students in the work of learning. It asks them to do more than just absorb information by listening to the experts tell them what to think. Instead, they participate in a wide variety of activities that ask them to cognitively engage with the course content by assessing their own knowledge of a topic, collaborating with others to solve problems, discussing key points, analyzing and evaluating information, and more. In active learning environments, students are moved beyond the remembering level of Bloom’s Taxonomy of the Cognitive Domain to higher order levels of thinking that lead to deep learning.
In 2014, Scott Freeman et al. published a meta-analysis of 225 studies on active learning (Freeman et al., 2014), in which they found that average grades on exams in active learning classes increased by half a letter grade, and that failure rates were 55% lower in active learning classes rather than in classes that utilized traditional lecturing (Again, hold on lecturers. I’m getting to you!) Freeman’s comment in an interview in Wired is telling: “The impact of these data should be like the Surgeon General’s report on ‘Smoking and Health’ in 1964–they should put to rest any debate about whether active learning is more effective than lecturing” (Wired, May 12, 2014). Since that time, research continues to add evidence to point us to the benefits of “hands-on” and “minds-on” learning (Yannier et al., 2021) and the increased benefits of active learning environments for underrepresented students (Eddy & Hogan, 2017), while a recent literature review adds that active learning environments also benefit students’ well-being (Ribeiro-Silva et al., 2022).
But what about lectures, you say? (See, I told you I’d get to you!) Students aren’t experts, so they would learn better from an expert, right? There is a place for lectures done well. The false dichotomy that embracing active learning means throwing lectures out entirely is unhelpful. As Stephen Brookfield reminds us, lectures are useful for explaining complex concepts with clarifying examples, introducing alternative perspectives, and modeling intellectual attitudes and behaviors. But a traditional lecture—that is, all-lecture-all-the- time—showcases what you know as the expert, but does not work well to bring novice learners along for the intellectual ride. When the dominant voice you hear in the room is your own, it’s time to stop and take stock of the teaching methods you are using. The best lecturers pause to ask questions, use demonstrations and media to support the point they are making, give students time for reflection—in short, they use active learning techniques embedded in their lectures to help students learn.
Today, in world language classes, students begin using the language from day one. They still need to memorize information, but it is in service to the actual use of the language. They make plenty of mistakes, but I remind them that struggle is part of learning and that they will come to a point where they are feeling less struggle and more triumph in their learning journey. It’s also scary. Instead of reading from pre-written scripts, they are creating language on the spot without a safety net. That mirrors authentic use of the language and helps them navigate real situations when they are faced with them. A supportive atmosphere that encourages experimentation and active effort in using the language, de-emphasizes perfection, and supports resilience in learning is what it’s all about. The best part is that we all enjoy learning so much more.
You and your students can too! There is a continuum of active learning strategies available to instructors, starting from simple and informal think-pair-share activities and brief polling questions that take a few minutes, all the way to semester-long and highly structured team-based learning activities that require intentional preparation. You can dip your toe in, starting out small with just a few strategies, or dive into active learning wholeheartedly. In this blog series, we will guide you through your choices, explore how to employ active learning in online and large class environments, and also consider how to set up active learning for success. We hope you’ll join us and try some active learning strategies on for size.
Rubrics are tools used by faculty to guide our assessment of student performance and to make our expectations transparent for students. Using a rubric can help make grading more efficient for faculty and fair for students, but when constructed well and shared along with assignment or activity descriptions, they also benefit student learning. Rubrics explicitly represent our performance expectations and allow students to direct their effort toward the intended goal of an activity or assignment. By asserting ahead of time our highest expectations, we encourage students to reach toward those high standards. The use of rubrics promotes more specific feedback and guidance on future performance which allows students to target specific areas for improvement. When we encourage students to review the rubric ahead of time and reflect on feedback after the fact, we can help our students develop the habit of reflecting on their learning.
Rubrics take a variety of forms from checklists of attributes that would demonstrate competence to analytic rubrics featuring descriptions of levels of competence in relation to different criteria. In this post, I will guide you through the steps of creating an analytic rubric (a rubric that features discrete dimensions and criteria descriptions of performance standards for each of those dimensions) featured in our rubric creation worksheet.
Parts of an Analytic Rubric
Analytic rubrics consist of dimensions, scale labels and descriptions of performance standards. A rubric may feature any number of dimensions, but including too many dimensions may make the rubric difficult for a student to interpret. Dimensions of a rubric may be weighted differently to indicate to students those that are most crucial to success on the assignment. Scales generally range from 3-5 criteria levels.
Scale label 1
Scale label 2
Scale label 3
Dimension 1(Number of points)
Description of performance standards
Description of performance standards
Description of performance standards
Dimension 2(Number of points)
Description of performance standards
Description of performance standards
Description of performance standards
Rubric Scale Example
Steps to Create a Rubric
1) Reflect
Begin with a freeform reflection on your goals for the assignment or activity. What are the main things you want this activity/assignment to accomplish; in other words, what are your goals? What content knowledge and skills is/are needed to productively complete this assignment/activity? What behaviors demonstrate achievement of the assignment’s goals? What are the highest expectations you have for students on this assignment? What evidence can students provide that would show they have accomplished what you hoped they would accomplish when you created the assignment/activity? What would the worst demonstration of this assignment look like?
2) List
Use your reflection to formulate a list of the most important attributes of success on the activity/assignment. What would an excellent submission or performance look like? What specific characteristics would it have? What are the most important attributes of success for this assignment/activity? Include a description of the highest level of performance you expect for the item.
3) Group
Group items with similar performance criteria and give your groups titles. These groups will become your rubric dimensions. For example, your list may look something like this:
Presentation is cogent
Presentation is organized
Thesis demonstrates thoughtful analysis of the text
Thesis and evidence demonstrates familiarity with the text
There is evidence for the thesis
Presentation anticipates counter-points
Specific position (perspective, thesis/hypothesis) is imaginative, taking into account the complexities of an issue*
Limits of position (perspective, thesis/ hypothesis) are acknowledged
Organizes and synthesizes evidence to reveal insightful patterns, differences, or similarities related to focus
Central message is compelling (precisely stated, appropriately repeated, memorable, and strongly supported)
The above list may be grouped as follows:
Thesis
Thesis demonstrates thoughtful analysis of the text
There is evidence for the thesis
Central message is compelling (precisely stated, appropriately repeated, memorable, and strongly supported)
Textual analysis
Thesis and evidence demonstrates familiarity with the text
Addresses complexity of text
Supporting points
Presentation anticipates counter-points
Limits of position (perspective, thesis/ hypothesis) are acknowledged
Creativity
Specific position (perspective, thesis/hypothesis) is imaginative, taking into account the complexities of an issue
Organizes and synthesizes evidence to reveal insightful patterns, differences, or similarities related to focus
4) Apply
You may now use your groups to fill in the left hand side of the rubric and your notes from the reflecting and listing phases of this exercise to establish your criteria. This worksheet includes a blank table that you may use to begin drafting your rubric. Remember to consider whether you want to assign point values to each of the dimensions in your rubric.
A Note on Scale Labels
Too often, the language we use for our scale labels can read as harsh and judgmental for students reading the scale. For example, scale labels such as “Weak,” “Poor” or “Unacceptable” do not imply for our students a belief that they can improve. Here are some suggestions for scale label language that is less likely to be discouraging.
Advanced, intermediate high, intermediate, novice
Exceeds expectations, meets expectations, developing towards expectations
Exceeds expectations, meets expectations, progressing, not there yet
Distinguished, proficient, intermediate, novice
Mastery, partial mastery, progressing, emerging
Sophisticated, highly competent, fairly competent, not yet competent
Concluding Thoughts
Taking the time to reflect on your goals for an activity or assignment and to concretely articulate your expectations will not only improve the quality of the rubric you create, but will help guide your instruction. Clearly identifying what you expect your students to know or be able to do will allow you to work backwards from those expectations to the exercises and materials needed in order for students to build the necessary skills and content knowledge.
For help designing and implementing rubrics, feel free to book an appointment with a CAT educational developer or educational technology specialist. Go to catbooking.temple.edu or email cat@temple.edu.
*Some of the performance criteria description language used here is borrowed from the AACU Value Rubrics.
Dana Dawson serves as Associate Director of Teaching and Learning at Temple University’s Center for the Advancement of Teaching
I love the beginning of the fall semester, but this fall, I’m feeling especially optimistic! The fall semester always brings such promise with it, as we plan what we’ll teach to a fresh crop of students that we hope (fingers crossed!) will respond to what we have to offer in positive and, dare I say it, soul-satisfying ways. There is nothing like that moment when you see the spark in a student’s eyes or the triumph they feel when they’ve mastered a difficult concept or skill. Every fall, we hope for more of these moments that reconnect us to the joy of teaching.
I still have imprinted on my memory one of these moments in an Italian course I created to improve student literacy in the language. In addition to the required reading for the class, I had students choose a book from a lending library I had created of all kinds of reading material in Italian, from romance novels to non-fiction to classic works of literature. They were to read 20 minutes a night, keep a log of what they were reading, and swap out the book for a new one when they had finished that one. The point was, of course, to get them reading frequently enough to develop their literacy and to cultivate the belief that they could read in the language. One day early in the semester, a student brought in the book she had just finished to exchange it for a new one and, as she was putting it in the box, she held it up and said for all to hear, “I can’t believe it, but I actually read this WHOLE book!” Her sense of accomplishment and, at the same time, disbelief, was palpable – a true moment of joy in her learning.
At the CAT, those moments often come in my work with faculty, and this August has been truly special, leaving me with a sense of great optimism for this academic year. Perhaps it has been the energy I’ve derived from large in-person events where I’ve been able to reconnect with colleagues, discuss teaching, and drink in your energy as you anticipate a promising new semester. The first-in-a-very-long-time university-wide New Faculty Orientation and the annual TA Orientation that the CAT hosts were generative events, full of new faces from all over the world, veteran instructors and staff who came to welcome them, and great conversations about teaching. The two interdisciplinary cohorts of faculty who completed the Teaching with AI Teaching Circle brought inspiring creativity and brave openness to change as they gathered together over two days to consider how to intentionally incorporate generative AI tools into teaching. And my numerous visits to collegial assemblies and departmental gatherings to discuss generative AI and teaching has meant for me reconnection, rethinking, and renewal. The long and the short of it is that I feel the same positive and soul-satisfying vibes derived from gratifying moments with students when you, my dear colleagues, experience a spark about teaching in reimagined ways.
I am keeping my fingers and toes crossed that you experience many of those shining moments in your classes this semester. Let’s go create some sparks!
Stephanie Laggini Fiore serves as Associate Vice Provost and Senior Director at Temple University’s Center for the Advancement of Teaching