Mindful Management of AI During Finals

by Dana Dawson

As we near the end of the semester, it’s important to carefully consider your plan of action should you suspect students have used generative AI in a manner that you explicitly prohibited. In past blog posts, we strongly encouraged faculty members to begin by meeting with the student in cases where you suspect unacceptable use of AI and to start with a conversation. However, in the case of final exams and projects, you may feel you don’t have time for that course of action. In this post, we offer some suggestions for how to prepare for and address AI use during the finals period.

Ensure Guidelines Are Clear

Review your final exams and final project instructions to determine whether you have clearly outlined where the use of generative AI is and is not allowed. Build guidelines into assignments as well as the syllabus to ensure students have it readily available. Have a conversation with your classes to ensure they understand the limitations of acceptable generative AI use and state the steps that will be taken if you suspect students have used generative AI (more on that below).

Test Your Final Exams and Final Projects Using Generative AI

Run final exam questions or final project prompts through tools such as ChatGPT and Claude.AI and prompt the tools to take the exam or complete the project. Note that in ChatGPT, you can simply copy and paste the entire exam or project prompt and rubric into the tool and ask it to generate a response. Claude.AI allows you to upload a pdf and enter a prompt. If you find that the tools can successfully complete your exams or assignments, reconsider the questions and prompts. Can you link questions or project prompts to in-class work that will draw on students’ past experiences? Can you add reflective or metacognitive questions that are difficult to replicate using generative AI? See this EDvice Exchange blog post for assessment ideas that are less prone to AI use.

Be Wary of AI Detectors

It has been well-established that AI detectors are not reliably able to differentiate between human- and AI-written text. Assessments we conducted of Turnitin’s AI detector, and four other applications available for free online, show that these detectors are prone to false positives (identifying human-written text as generated by AI) and false negatives (identifying AI-written text as generated by humans). AI detectors should never be used as the sole basis for a judgment on whether a student has used AI; companies such as Turnitin acknowledge this, for example, saying in their own explanatory materials that detector predictions should be taken with a grain of salt and that the instructor must ultimately make their own interpretations. Notably, TurnItIn also indicates that a score of 20% or less AI-created should not be considered valid. As you assess AI detector reports, keep in mind that there are currently no completely reliable detectors of generative AI use in writing available to instructors.

Step on the Brakes

Confronting possible cheating is always stress-inducing. We see a block of text or a pattern of answers that seem unlikely to have been generated by a student and the stress response kicks in. This is not the optimal time to make a decision. Take a breath, step away. Consider factors that might be influencing your assessment of the student’s work or your willingness to accept the results of an AI detector. Talk to a colleague or a CAT consultant and carefully consider all factors before making a determination as to your course of action.

You Can Still Have a Conversation with Students

If you strongly suspect a student of using generative AI in a manner you have stated is not acceptable, ask the student to meet, by Zoom if they are already off campus. If they are not able to meet prior to the end of the grading period, issue an Incomplete for the course and do not grade the final exam or project until you have met with the student.

Have a Back-Up Plan

If you speak with the student and they do not admit to using generative AI, have an actionable plan for how to proceed. Consider how you might replicate the element you suspect they used AI to complete. Can you conduct an oral exam? Can they write an essay or a reflective statement on their process of solving the exam question or completing the project in-person? To talk over your plan for considering possible AI use in these final weeks of the semester, don’t hesitate to reach out to schedule a consultation with a CAT specialist.

Err On the Side of Caution

The suspicion that a student may be taking shortcuts can be upsetting and we are all struggling to manage course design and delivery in the age of AI but the risk of falsely accusing a student should be taken very seriously. A false accusation can derail a student’s entire educational trajectory and not only because of the possible impact on their GPA; more importantly, it can shake their trust in their faculty members, their experience with higher education and their motivation to continue, particularly where their sense of belonging is tenuous. Turnitin has acknowledged that their detector is more likely to generate a false positive in the case of English language learners or developing writers as some of the writing patterns more common among these populations are the same patterns AI detectors look for in identifying AI-generated text. We must exercise the utmost caution in accusing any student and be sure to give them the benefit of the doubt when engaging in these conversations.

Plan for Next Semester

Finally, once finals are over and your grades are in, make an appointment with a CAT specialist to explore how to revise assignments that are particularly vulnerable to AI use. We can often avoid these problems in the future by revising our current assessments into ones that work better in the age of AI.

2024 STEM Educators’ Lecture Recap

By Cliff Rouder, Ph.D.

The CAT’s STEM Educators’ Lecture, held on April 10, 2024, featured guest speakers Dr. Tara Nkrumah and Cornelio “Coky” Aguilera. Dr. Nkrumah is an Assistant Professor in the Department of Teacher Preparation, Mary Lou Fulton Teachers College at Arizona State University. Her research is on equitable teaching practices for anti-oppressive discourse in education and science, technology, engineering, and mathematics (STEM). Coky Aguilera studied as an Acting Specialist at UW Madison, works professionally with Tampa-area theater companies, and along with Dr. Nkrumah and colleagues have brought the Theatre of the Oppressed to different universities to engage academic audiences in critical investigations of inequities. Check out this Youtube video to learn more about the historical roots of Theatre of the Oppressed.

We were delighted to have their colleagues Dr. Vonzell Agosto, Dr. Deirdre Cobb-Roberts, and doctoral candidate Maria Migueliz Valcarlos join as they engaged Temple STEM and theater faculty in an interactive and engaging session titled, Unmasking the “Isms” in STEM Education to Promote Equitable Teaching and Learning. The speakers began by introducing a framework for the session–Iris Marion Young’s Five Faces of Oppression. They used this framework to help us think about how “isms” such as racism, ableism or genderism can manifest through the five faces of oppression, which are

Exploitation
Marginalization
Powerlessness
Cultural Imperialism
Violence
For a more in-depth look at this framework, see Young’s “Five Faces of Oppression” in Geographic Thought: A Praxis Perspective.

As participants worked through definitions of these facets of oppression and shared examples of how they can manifest in our disciplines, departments, and classrooms, the speakers then engaged participants in a series of theater-based exercises that encouraged them to use mimicry and the creation of human tableaus to explore and address physical and emotional aspects of oppression.

For more on Dr. Nkrumah’s research, check out these recent publications:

Nkrumah, T. (2023). The Inequities Embedded in Measures of Engagement in Science Education for African American Learners from a Culturally Relevant Science Pedagogy Lens. Education Sciences, 13(7), 739.
Nkrumah, T., & Scott, K. A. (2022). Mentoring in STEM higher education: a synthesis of the literature to (re) present the excluded women of color. International Journal of STEM Education, 9(1), 1-23.
Nkrumah, T., & Mutegi, J. (2022). Exploring racial equity in the science education journal review process. Science Education, 1-15. https://doi.org/10.1002/sce.21719

As always, our CAT staff is ready to help you! To explore how to incorporate this work into your STEM courses or how to design and implement classroom-based research in this area, book a consultation appointment or email a CAT staff member directly.

Faculty Adventures in the AI Learning Frontier: Assignments and Activities that Address Ethical Considerations of Generative AI Use

by Benjamin Brock, Ph.D and Dana Dawson, Ph.D

In response to our fall 2023 survey on the use of generative AI (GenAI) in the classroom, we received a number of assignments and activities faculty members have designed to tackle the ethical issues raised by GenAI. Ethical concerns related to GenAI include such considerations as the implications for privacy when these tools are used, the possibility of over-reliance on GenAI for analytics and decision making, and exposure to inaccurate or biased information (Brown & Klein, 2020; Masters, 2023; Memarian & Doleck, 2023). The following activities and assignments equip students with the capacity to critically evaluate when and how it is appropriate to use GenAI tools and to protect themselves against possible risks of AI use.

Sherri Hope Culver, Media Studies and Production faculty member and Director of the Center for Media and Information Literacy (CMIL) at Temple University, asks students in her GenEd course, Media in a Hyper-Mediated World, to complete a reflection on the implications of AI use. She first asks them to listen to an episode of the podcast Hard Fork centered on data privacy and image manipulation and to read the Wired article “The Call to Halt ‘Dangerous’ AI Research Ignores a Simple Truth” (Luccione, 2023). Students are then instructed to write a 300-word reflection referencing the assigned material that addresses both concerns they have about use of AI and ways in which it could make their lives or society better. Professor Culver provides the following prompts to help students’ thinking:

What does critical thinking mean in a tech-centric, AI world?
How might AI affect your free will?
How might AI affect your concerns about privacy or surveillance?
How should we prepare ourselves for an increasingly AI world?
How might AI influence the notion of a public good?
How might AI influence K-12 education?
How might AI influence family life?
What worries you about AI?
What excites you about AI?
What is our responsibility as media creators when we use AI?
It has been said that AI will make life more “fast, free and frictionless.” Should everything first be “fast, free and frictionless”? Should that be the aim?
Is AI the end of truth?

In a dynamic, interactive, reflection-oriented honors course aimed at exploring the four pillars of Temple’s Honors Program (inclusive community, intellectual curiosity, integrity in leadership, and social courage), Dr. Amanda Neuber, Director of the Honors Program, is using AI as the discussion anchor for their unit on “integrity in leadership.” By way of multiple media modalities, students delve into the ethical and unethical uses of AI in academia. Students are asked to read “How to Use ChatGPT and Still Be a Good Person” and watch a related video exploring the meaning of integrity. Students then discuss whether or not AI can be used with integrity, how academic culture might frame one’s decision to use AI, and the “peaks and pitfalls” of AI use. Beyond the many important conversations focused on AI itself, the technology is used as a reference point as to what it means to lead with integrity and how to promote said quality in teams and organizations.

In another interactive, thought-based classroom initiative, mechanical engineer Dr. Philip Dames is bringing ethics and AI to Temple’s College of Engineering. Having reimagined for a modern era the “trolley problem” philosophical exercise in which one is faced with an ethical dilemma, students in Dr. Dames’ class consider having AI make decisions using autonomous cars as the basis for deliberation. They are prompted to think about how a vehicle should be programmed to respond to different scenarios by using examples from MIT Media Lab’s Moral Machine website. Students then reflect upon their scenario-based activities and experiences and engage in prompt-guided written reflection. Prompts include questions such as:

How does the ownership model of autonomous vehicles affect how they should behave? For example, does it make a difference if a vehicle is owned by a single private citizen vs. publicly owned by the city and hired by individuals?
What surprised you about the aggregated responses from different people shown to you at the end of the exercise?
Are there other factors that you feel are important but were not considered in Moral Machine?

In this way, students not only explore elements to consider when designing autonomous vehicles, but make concrete what was once only abstract via critical thinking and hands-on engagement.

If you’d like more guidance on exploring how to use AI tools in your class, please visit our Faculty Guide to A.I. and/or book an appointment for a one-on-one consultation.

Brown, M., & Klein, C. (2020). Whose data? Which rights? Whose power? A policy discourse analysis of student privacy policy documents. The Journal of Higher Education, 91(7), 1149–1178. https://doi.org/10.1080/00221546.2020.1770045

Masters, K. (2023). Ethical use of artificial intelligence in health professions education: AMEE Guide No. 158. Medical Teacher, 45(6), 574–584. https://doi.org/10.1080/0142159X.2023.2186203

Memarian, B., & Doleck, T. (2023). Fairness, accountability, transparency, and ethics (FATE) in artificial intelligence (AI) and higher education: A systematic review. Computers and Education: Artificial Intelligence, 5 (2023), 1-12. https://doi.org/10.1016/j.caeai.2023.100152

Faculty Adventures in the AI Learning Frontier: Teaching with Generative AI in Health Sciences Education

by Jonah Chambers, MA and Cliff Rouder, EdD

As part of our fall 2023 survey on generative AI (GenAI) in the classroom, we heard back from a wide variety of Temple faculty who teach a broad range of courses. In this installment, we’re going to take a look at how three health science instructors are incorporating GenAI tools like ChatGPT into their teaching.

Scott Burns, Professor of Instruction in the Department of Health and Rehabilitation Sciences, had his graduate physical therapy students prompt ChatGPT to create a generic plan of care for a specific health condition and then provide a detailed explanation of how the exercises it prescribes may or may not properly address the condition described in the scenario under consideration. In addition to having students demonstrate their knowledge of what constitutes a good plan of care by evaluating and critiquing the AI-generated plan, Professor Burns explains that the goal of the activity is to highlight that while generative AI may be useful for broad recommendations, it “currently lacks the ability to provide decision-making and rationale backed by anatomy, neuroscience, motor control/learning, and physiology.”

Before he launched the assignment, Dr. Burns surveyed his class about their experiences with and perceptions of GenAI. He also wanted to gauge the level of anxiety surrounding it, given that there is concern in health-related fields that AI could replace the human provider. Students reported that they appreciated the opportunity to interact with AI, since the experience level with AI varied, and some had never even used it before. Dr. Burns plans to administer a more formal survey for the end of the semester to see if student perceptions of AI have shifted.

Alissa Smethers, Assistant Professor in the Department of Social and Behavioral Sciences, had her nutrition students prompt ChatGPT to create a 1-day, 2,000 kcal dietary pattern for a popular diet of their choice (Keto, Paleo, Atkins, etc.) and then submit the outputs to an established dietary analysis program and answer the following questions:

Does the plan provide 2000 kcal? If not, how far off was it?
Does the macronutrient composition and food choices reflect the popular diet you chose? If not, what foods would you add/remove?

Her students were surprised at how far off ChatGPT was at times, in some cases generating plans that differed by over 800 kcal from what the dietary analysis program provided. The goal was not only to ensure that students are learning the correct information but also that they develop critical thinking and research skills crucial to their work as nutrition professionals. In the future, she is considering having students evaluate how well ChatGPT is able to tailor the dietary patterns based on culture, income level, or other more personalized factors as well as reflect on the limitations of using a generative AI tool to create dietary patterns vs. working with a nutrition professional like a Registered Dietitian.

Leah Schumacher, Assistant Professor in the Department of Social and Behavioral Sciences, invited Health Science and Human Behavior students to roleplay as someone who either wants to avoid or already has a chronic disease and has turned to ChatGPT to provide answers or advice. She first asked students to pick one of the diseases they covered in her class and then pose questions about it to ChatGPT such as “Why did I have a stroke?” or “How do I avoid getting cancer?” She then had students prepare a submission for the assignment that included:

The full prompt they submitted to ChatGPT
The full response ChatGPT provided
A short 5-7-sentence reflection that compared the ChatGPT response to what they had learned in class through textbook readings, lectures, videos, etc. Specifically, she asked students to reflect upon the extent to which ChatGPT’s response hit upon aspects of the biopsychosocial model they studied in class, whether it touched upon major risk factors they covered, and if ChatGPT presented any information that was new to them.

Dr. Schumacher was careful to have students clearly distinguish between text generated by ChatGPT and their own written work in their submission. Not only did this assignment have students apply their understanding of the biopsychosocial model to a diverse set of cases, it also gave them the opportunity to reflect upon (and illuminate problematic aspects of) how people may use ChatGPT in their everyday lives.

Each of these professors has illuminated one of the most powerful ways of using GenAI in teaching: instead of taking its outputs at face value, they have their students question, evaluate, analyze and verify them using a variety of methods. Not only does this provide students an opportunity to apply their knowledge (a proven way to promote deep learning), but it also helps them sharpen their critical thinking skills surrounding the use of GenAI. These skills will likely not only prove helpful to them now but also in their future professional lives.

In the next installment, we’ll be looking at ethics in AI. In the meantime, if you’d like more guidance on exploring how to use AI tools in your class or assistance running your assignments through GenAI to better assess the value of using it, please visit our Faculty Guide to A.I., attend a workshop on using generative AI for teaching and learning, or book an appointment for a one-on-one consultation.

Faculty Adventures in the AI Learning Frontier: AI and (First Year) Writing

by Jeff Rients

As part of our fall 2023 survey on AI in the classroom, we heard back from a wide variety of Temple faculty who teach a broad range of courses. In this installment, we’re going to take a look at what three First Year Writing instructors are doing with AI tools like ChatGPT.

First year writing instructor Jacob Ginsburg incorporated “AI and education” as a theme in his course. His students read Ted Chiang’s “Chat GPT is a Blurry JPEG of the Web,” Matteo Wong’s “AI Doomerism is a Decoy,” and some academic articles about the role of AI in education. In class, each student writes a paragraph about what it means to them to be a member of their generation. As homework, they then give ChatGPT four tasks:

Respond to the same prompt as they wrote about in class (i.e. what it means to be a member of their generation).
Make an argument FOR the use of AI in education.
Make an argument AGAINST the use of AI in education.
Each student devises a “silly” or “fun” task of their own.

Afterwards, everyone then discusses their prompts and results in class.

Professor Amy Friedman challenges her students to write an essay in which they summarize several disparate, current articles on generative AI in education and learning. She has used articles such as Valerie Pisano’s “Label AI-Generated Content,” Allison R. Chen’s “Research training in an AI world,” and Naomi S. Baron’s, “How ChatGPT Robs Students of Motivation to Write and Think for Themselves.” Her goal is for each student to formulate and articulate their own opinion about the role of generative AI in their own learning and education. Beforehand, students explore ChatGPT in class, including asking it to write in response to previous essay prompts. The class then collectively assesses the results and compares them to their own writing.

Meanwhile at Temple’s Japan campus, Ryan Rashotte has developed two activities for his first year writing students. In the first one, students writing essays about a film ask ChatGPT to write a paragraph regarding how a specified element in the film supports a theme they are exploring. In response, students write about the strengths and weaknesses of ChatGPT’s argument. In the second assignment, students working in groups explore which art form they think is superior – television or film. As part of this investigation, they query ChatGPT for reasons in support of their choice. Students identify new and/or interesting arguments and identify their strengths and weaknesses. They are asked to consider how well the ChatGPT output would work if it were incorporated into their essay.

In the next installment, we’ll be looking at the way AI tools are being used in a variety of health sciences learning environments. In the meantime, if you’d like more guidance on exploring how to use AI tools in your class, please visit our Faculty Guide to A.I. and/or book an appointment for a one-on-one consultation.

Faculty Adventures in the AI Learning Frontier: Introduction

by Dana Dawson, Ph. D

Associate Director’s log, stardate 4616.2. Temple University. While minding our own business over here, someone invented generative AI and made it readily accessible to the people of Earth, which includes our students. We find ourselves in a strange and unfamiliar landscape; computer probability projections are useless due to insufficient data¹. Some faculty members have boldly entered this new terrain.

_______

We decided to call this blog series Faculty Adventures in the AI Learning Frontier not only because Google’s new AI tool Gemini suggested the title but because of its resonance with Star Trek. The original television series and its many reboots and spin-offs depict intrepid adventurers exploring the deep reaches of space, the “final frontier,” as we were reminded at the beginning of each episode. With the rapid evolution of generative AI, we find ourselves standing on the threshold of a strange new world. Teaching in the age of AI is, indeed, a new frontier; instructors are boldly going where no instructor has gone before. With great ingenuity, and at times trepidation, faculty members throughout Temple have begun to explore what it means to integrate AI into their class planning and delivery.

Over the course of this series, we will showcase examples of activities and assessments that Temple faculty members used in their classes in Fall 2023. In our March 11th post, we will feature assignments used in First Year Writing courses. March 25th will focus on implementation of generative AI assignments and activities in the health sciences and our final post on April 15th will include examples of how instructors across different disciplines have addressed ethics in the use of generative AI. Some of the featured activities and assessments have been designed to help students practice implementing generative AI in their fields while others encourage students to critically interrogate the impact of AI.

Whether we like it or not, generative AI is now part of our–and our students’–world. It is our responsibility not just to familiarize ourselves with these tools but to help our students make decisions about their use and, should they choose to use them, to do so effectively and ethically. We hope this series will give you some concrete and applicable examples of how to address generative AI in your courses.

_______

¹ The Gamesters Of Triskelion, Original Airdate: 5 Jan, 1968.

Being Proactive About Student Success: Six Easy Interventions to Support Students in Week Five

Dana Dawson, PhD and Linda Hasunuma, PhD

It’s common for faculty members to use midterm exams or projects to assess student progress, however, for students who are struggling, a midterm check-in may come too late to effectively address challenges. In this post, we’ll talk about ways to check in with students earlier in the semester and what to do if students are missing classes and assignments or their work demonstrates a need for additional support.

Enter your Midterm Progress Ratings for Academic Progress

In spring 2024, Midterm Progress Ratings (MPRs) for undergraduate classes will be open from January 31, 2024 to March 11, 2024. This is three weeks earlier than in previous years so that instructors can provide targeted outreach to students who may need additional guidance or resources to support their learning and retention. It’s a good idea to check your rosters for students who have missed classes or assignments, or whose submitted work is not meeting a passing standard and enter progress ratings as early as possible. It won’t come as a surprise to faculty that missed classes and assignments in the first weeks of classes are a strong predictor of poor course outcomes, so the sooner these patterns are identified, the better.

Some advising units use MPRs to identify students who require additional outreach and support. Students are also notified if a professor has submitted an MPR. While this can be a helpful indicator to some students that they are at risk of not succeeding in the course, for others, a rating of “Unsatisfactory” can be discouraging, so we recommend reaching out to students who are identified as “Unsatisfactory” (more on that below). There is a helpful guide to completing MPRs available in TU Portal.

Reach Out to Students Whose Attendance, Course Engagement and/or Work on Assignments is Cause for Concern

If in the process of reviewing student performance and completing MPRs, you notice a student has not been regularly engaging with your course or is struggling with assignments, check in with the student. You might send an email using TUmail or the Canvas email function or have a brief chat with the student after class. You can also check the “People” function in Canvas to see how much time students have spent in the course and email them directly from there. Some faculty members schedule meetings with students around the quarter-semester mark, though the size or number of your classes may prohibit this option. If you have too many students to make bespoke outreach possible, Canvas’s “message students who” function can help.

Be sure to communicate to the student that you want them to succeed and that you’re there to help. Share information on resources such as the Student Success Center, Disability Resources Services, Cherry Pantry, and the Wellness Resource Center. If you want to learn more about available resources, the Dean of Students office has a “Red Folder” with advice on making appropriate referrals.Temple has also made new apps available to students who may need mental health counseling, such as TogetherAll and Welltrack Boost. Checking in with your students demonstrates your care and concern, which can also make a difference to a student who may be feeling overwhelmed or struggling.

Give a Word of Encouragement

This is the time in the semester when the full weight of their obligations begins to hit students. Assignment due dates start to amass. Midterm exams loom. A majority of Temple students hold at least one part-time job and many participate in extracurricular activities, some of which are required by their colleges. It’s a good time to remind our students that we see and appreciate their work and that we believe they can succeed. Some students may need more guidance about resources available to them for building their study skills, including note taking, time management, and mapping out their schedules with their various responsibilities outside of school; some may be managing challenges related to housing, food security, or other personal matters that may make it harder for them to manage coursework. We can be proactive and normalize help seeking by regularly reminding students about resources on campus during these stressful stages of the semester and ensuring we list available resources in our Canvas sites.

Use Informal Surveying or a Mid-Semester Instructional Diagnosis to Check In

While we collect student feedback at the end of the semester, at that point, it’s too late to change anything. Consider using an informal, anonymous survey that asks students what is most helping their learning and what is getting in the way of their learning. This can be done using a tool such as Google or Microsoft forms or simply by using index cards. Stephen Brookfield’s Critical Incident Questionnaire can also be a helpful tool for regular check-ins.

The CAT can also help! We invite you to schedule a Mid-Semester Instructional Diagnosis: a CAT staff person will visit your class for 35-40 minutes and (once you have left the room) gather consensus feedback from students on four questions relating to what you, and what they can do to improve their learning.

Encourage Students to Engage in Metacognitive Reflection

Invite students to reflect on their learning strategies and on what is working and what needs adjustment. Share strategies for studying or reading that encourage students to check in with themselves on their own understanding. While the semester is still relatively young, we have a window of opportunity to provide formative feedback that will motivate students and encourage them to take ownership of their learning.

As always, if you’d like assistance with supporting your students early in the semester, our faculty developers and educational technology specialists are ready to help. Make an appointment here or email a CAT staff member directly.

The 2024 Annual Faculty Conference on Teaching Excellence

Cliff Rouder, EdD

More than 225 faculty from universities across the region came together with the CAT on January 10 and 11 for the 2024 Annual Faculty Conference on Teaching Excellence. The event was co-sponsored by Temple Libraries, the Office of Digital Education, Information Technology Services, and the General Education Program.

This year’s theme was Teaching and Learning in the Age of Generative Artificial Intelligence. Participants grappled with the broad impacts of generative artificial intelligence (GAI) in higher education and the specific implications for teaching and learning–all evolving in real time! The availability of these tools to our students raises important and difficult questions about the nature of thinking and learning, academic integrity, and the purpose and effectiveness of our assessments and learning activities.

Keynote and Plenary Address

Dr. Sarah Elaine Eaton and Dr. Sharla Barry

The CAT was honored to have Dr. Sarah Elaine Eaton, Associate Professor at the Werklund School of Education at the University of Calgary, Canada, who also holds a concurrent appointment as an Honorary Associate Professor at Deakin University in Australia. Her day one keynote was titled, Academic Integrity in a Postplagiarism World: The Impact of Generative Artificial Intelligence on Teaching, Learning, and Assessment.

Dr. Eaton began by defining a post-plagiarism world as an era in human society in which advanced technologies are a normal part of life, including how we teach, learn, and interact daily. After introducing us to the breadth of areas beyond student academic integrity that concern generative AI integrity in higher education, (e.g., publication ethics, research and integrity ethics, instruction ethics, and institutional ethics), she urged us not to approach student academic integrity from a “crime and punishment/I will catch you if you try to cheat” mindset. Rather, she suggested faculty and administrators adopt a more humanist mindset, as cheating is often a symptom of other problems, be it a lack of understanding or trying to handle multiple life responsibilities.

Dr. Eaton then presented some likely realities of a post-plagiarism world, suggesting that some hybrid of human-AI technologies will be the norm, including wearable and implantable AI. Dr. Eaton reminded us that wearable AI is already here as is implantable AI (a cochlear implant), and thus we need to be preemptive rather than speculative in our thinking so that we are not caught off guard as we were with AI/ChatGPT. She stressed that we have an imperative as faculty to ensure the ethical use of future AI to leave the education system better than when we found it, and lastly, that we must also remember that students cannot relinquish their responsibility for what they generate and submit!

We were also delighted to have Dr. Sharla Berry, Associate Director of the Center for Evaluation and Educational Effectiveness at California State University, Long Beach. Her day two plenary session was titled, Teaching with Technology: Holistic Pedagogies in a Time of Change.

Dr. Berry helped us explore the sociocultural implications of our evolving digital learning landscape by posing some thought-provoking questions we need to reflect on regarding the development of AI and its use in education:

While AI increases our ability to gather information, how are we ensuring that students have the ability to synthesize and use that information to benefit their learning? Is getting the right answer considered learning?
Are we acknowledging and looking out for historical information from limited perspectives that result in biased output?
Are we helping students to give better prompts that enable more balanced perspectives?
What are the environmental impacts of AI? Dr. Berry shared a finding of U. of Massachusetts researchers cited in an MIT report titled Reducing the carbon footprint of artificial intelligence: “The amount of power required for training and searching a certain neural network architecture involves the emissions of roughly 626,000 pounds of carbon dioxide. That’s equivalent to nearly five times the lifetime emissions of the average U.S. car, including its manufacturing.”
What are the social impacts of AI? Dr. Berry asked us to consider a variety of impacts, such as the substandard hourly wages paid to AI content moderators, the potential for AI to increase loneliness and social isolation, and its potential to enhance social interactions and connections with others.

In sum, Dr. Berry’s primary message was that while there are benefits of AI to humanity and society, there are also costs which need to be considered and addressed as we take a more holistic approach to assessing AI and its impacts

Building on the Keynote and Plenary Address

In addition to keynote and plenary speakers, the conference featured interactive workshops, breakout sessions, lightning talks, and poster sessions–all designed to generate discussion and share ideas for best teaching practices (with and without generative AI).

New this year was our AI Playground where participants tried out these generative AI programs:

Claude AI (Can be used like ChatGPT; We used it to summarize PDF’s)
LitMaps (Research based, can explore connections between articles)
Gamma (Slide creation)
Stable Diffusion (Image creation)
Adobe Firefly (Image creation)

Let’s Continue the Conversation

Our 2024 Annual Faculty Conference generated many thought-provoking questions and teaching strategies, so let’s continue talking! Here are some ways you can keep the conversation going:

Share what you’ve learned with your program/department faculty.
Avail yourself of the robust AI resources on our website.
Schedule a consultation with the CAT to work on incorporating what you have learned into your courses.

Attend CAT workshops and consider joining one of our Faculty Learning Communities.
Follow us on social media: Instagram, Facebook and Youtube.
A full album of conference photos can be found on our Facebook!

On behalf of everyone at the CAT, we wish you a joyous new year and a fulfilling spring semester!

Another Look at Active Learning: Part 7: Overcoming Challenges to Active Learning

by Cliff Rouder Ed. D and Linda Hasunuma Ph. D

In this last post of our series on active learning, we identify the challenges faculty sometimes face when planning and implementing active learning. We also give you some strategies for meeting those challenges.

How can I make time in class or online for active learning when I have so much content to cover?

While there are active learning strategies that don’t take a lot of class time and are easy to implement, integrating active learning into your class sessions will require rethinking the content you cover in class to ensure there is adequate time to complete activities. There’s a saying that’s useful to remember as you wrestle with what content may have to be moved out of class time: “If you say it, that doesn’t mean they’ve learned it.” So, ask yourself what foundational knowledge (e.g., definitions, factoids, easy-to-understand/background information on a topic) can be moved out of class time and assigned prior to class. To ensure accountability, you can give students a short assessment before or at the start of class. Another way to help you decide is by categorizing your content as “crucial to know,” “good to know,” and “tangential or unrelated to the Topic.” Often we include content that really doesn’t enhance students’ learning and does not move students toward meeting course goals, so consider simply removing it. Finally, remember that active learning strategies are used to address course content; they simply involve students in the process. While you may not be delivering the content in the form of a lecture, a well-designed active learning strategy will require students to grapple with key concepts, apply knowledge or skills and test their understanding.

I’ll lose control of the class if I don’t lecture.

Active learning doesn’t mean you give up control; it means that you provide opportunities for other ways of learning where you don’t take center stage while continuing to monitor and assist as students actively engage with course content. This short video demonstrates how instructors continue to guide students during an in-class activity. Viewing our role more as a facilitator of learning rather than as the dispenser of all wisdom can be a useful mindset to help you let go of this concern, especially if you are teaching large lecture courses. And remember, your TA or Diamond Peer Teacher can play a significant role in helping set up and monitor students when they work in pairs or small groups.

My students are used to lecturing; they’re not going to be happy campers.

For a variety of reasons, you may get pushback from students who have never been in an active learning classroom or who have had negative experiences. It’s not unusual for faculty to hear some version of these student comments: “I pay your salary, and I expect you to be the one to teach me!”; “My peers don’t know enough, or I’ll get misinformation”; “I hate group work!”; or “I take five classes, work, and take care of my younger siblings. How can you expect me to be prepared for every class period?”

These statements (and your concerns about them) are understandable, but here’s the thing: active learning can improve your SFFs! A 2019 study reported that “when the percentage of class devoted to lecturing fell between 20% and 60%, the most likely outcome was an increase of scores on student evaluations.” Not only that, but the messaging we give around active learning will greatly increase the chances that students will value the experience (translating to stronger SFFs).

There are three points that can be helpful in your messaging to students about your decision to use active learning strategies: 1. The skills they’ll develop as a result of actively engaging in the course will be of value to them (now and in their future professional lives); 2. There is a large body of research demonstrating that students in classes where active learning strategies are used learn more and retain what they have learned for longer; and 3. Acknowledging that “stuff happens,” and thus what you are hoping (or expecting) to see is that more often than not, they will come to class prepared to engage with the material and with each other.

Messaging about your use of active learning strategies can start before the semester begins. You might create a “welcome to the course” email or video in which you share a little bit about how your course will run and why that’s of value to students. In addition to the benefits of deeper understanding and better course outcomes, you can share these other valuable benefits: You’ll practice working collaboratively (skills crucial in most workplaces and in life!); you’ll hear different perspectives and thus will become a better listener and a better citizen; you’ll help create trust and a sense of community–a crucial element to feeling a sense of belonging, especially for students from underrepresented or marginalized groups or who are first generation college students. Raising the value of active learning is key! Keep in mind that the messaging may need to be repeated during the semester as student motivation and effort ebb and flow.

Then, devote a paragraph or two in your syllabus to your expectations for students, your role in an active learning classroom or online course, and the value of active learning. Here’s one way you can structure the messaging in your syllabus:

- Here’s my role (e.g., facilitator/coach) and why.

- Here’s your role (e.g., active participant) and why it’s so important for you now and in the future.

As we’ve presented in this blog series, there are a wide variety of active learning activities from simply pausing your lecture in order to ask a question all the way up to devoting an entire class period to learning activities (a.k.a. flipping the classroom). If you are new to active learning, we encourage you to dip your toes in the water and pick a few easy-to-implement activities to try out in the next semester. If they don’t go as anticipated, be sure to take some time to reflect on why. Getting your students’ perspective on how they went can never hurt. With each subsequent semester, tweak the ones you’ve tried as needed and consider adding some that are more involved. Always remember that your course goals should guide your choice of active learning activities. For example, if a course goal is to have students deliver effective oral presentations, think about the types of active learning experiences that would give students practice and feedback to prepare them to give a strong oral presentation.

The CAT is here to assist. Make an appointment for a consultation to help create or refine your active learning activities or to have us come observe and give you feedback on what you’ve tried.

Cliff Rouder is Pedagogy and Design Specialist at Temple’s Center for the Advancement of Teaching (CAT). Linda Hasunuma is Assistant Director at the CAT.

Another Look at Active Learning, Part 6: Active Learning Online, Synchronously and Asynchronously

by Emtinan Alqurashi, Ed. D

In our ongoing series, “Another Look at Active Learning,” we’ve explored various active learning techniques. While active learning is an effective approach in all types of courses, its application can differ in online environments. This is especially true for asynchronous courses where students lack real-time contact with the instructor and their peers. So it becomes crucial to establish opportunities for active engagement with the instructor and fellow students in asynchronous settings. In this blog post, we delve into activities that can effectively engage students in both synchronous and asynchronous online learning settings.

Synchronous active learning strategies

Synchronous activities take place in real-time, often using platforms like Zoom. They often mirror the types of activities that we use in in-person settings, with some adjustments to help them work in this modality.

Examples

Strategy #1: Jigsaw Online

How it works:

Step 1: Identify a reading or learning unit that can be divided into parts.

Step 2: Form small groups and have each group focus on one of the parts. This can be completed prior to class, or by reading independently during class time.

Step 3: In class, form breakout rooms for each group to allow them to discuss their part with the goal of being able to explain it to other classmates. They should be working together to identify key concepts and clarify any gaps in understanding. Then, have them return to the main room.

Step 4: Form new groups in the breakout room so that each new group has one member for each of the different parts. I recommend asking students to add their Step 3 breakout room number next to their names to make it easier for instructors to reform the groups. Each group member now explains their part to the other members in the new group.

Step 5: Optional: Provide the new groups with a problem to solve that requires the integration of the different parts.

Strategy #2: Rotating Stations

How it works:

Step 1: Define the learning unit and craft a set of open-ended discussion questions before class.

Step 2: Create shareable collaborative documents (e.g. Google Docs) for each question, and change the sharing setting to enable “edit access for anyone with a link”. Provide all the links on a single Google Doc, using it as the central hub.

Step 3: In class, establish breakout rooms for group discussions. Have students record their answers in the documents and rotate every 10 minutes through the questions.

Step 4: After they’ve cycled through all stations (i.e. google docs), bring them back to the main room for discussion through chat, raised hands, or taking turns to speak.

Note: Monitor document activity to support groups if needed during the activity.

Strategy #3: Digital Sticky Notes

Sticky notes are great for getting lots of student ideas quickly. You can use them for brainstorming together in real time, making mind maps, and helping students sort out concepts to boost their critical thinking.

Digital sticky notes work just like the real ones, they can be added by everyone, and you can keep coming back to them. Padlet is an easy digital sticky note tool to use, great for sharing and collaborative editing.

Strategy #4: Live Polling

Uses for live polling:

Assess Learning: Use multiple-choice or open-ended polls to assess comprehension.
Build Community: Foster a sense of belonging using image or word cloud polls.
Gather Feedback: Collect course and teaching feedback.
Facilitate Peer Learning: Encourage discussions and decision-making through polls.

Use Poll Everywhere for both in-person and online teaching; it integrates into presentations with various question types. Kahoot, another polling tool, enables creating multiple-choice questions for instant feedback and leaderboards. Employ Kahoot games for knowledge reinforcement, review, or as individual challenges for asynchronous learning with set deadlines.

Asynchronous active learning strategies

Asynchronous activities occur at students’ own pace and on their schedule. Designed well, they can be successful at actively engaging students with the content and with others in the class.

Examples

Strategy #1: Collaborative Writing

Consider using collaborative writing tools like Google Docs, or Microsoft Word, when assigning group writing projects where students can work together asynchronously. These tools are very useful because they allow everyone to contribute and edit the same documents. In addition, they have features like tracking changes and adding comments, which make it easy for everyone to give feedback and improve the work together.

Strategy #2: Peer Review

Leverage peer review for student connections and enhanced learning using Canvas Peer Review in asynchronous classes, and keep the following considerations in mind:

Define expectations: Provide precise instructions for the criteria students should consider in their reviews.
Offer guidance: Provide students with guiding questions, rubrics, or worksheets to assist them in their peer reviews. This can aid in structured and focused evaluations.
Encourage author questions: Encourage students to include initial questions for their peer reviewers to guide them on what aspects the author would like them to focus on.

Strategy #3: Gamification, like Escape Games

Using gamification, like online escape games, is an exciting and effective approach to foster active learning, critical thinking, and problem-solving skills among students. To create and manage such games, select a suitable tool (e.g., Genially), and design the game with a storyline, puzzles, and challenges aligned with the learning objectives. Provide clear instructions, establish support and feedback channels, and encourage engagement through debriefing discussions to review solutions and outcomes. It’s worth noting that escape games can be utilized synchronously where you give students a link to the game and then return to debrief.

Strategy # 4: Online Discussions

Using tools like VoiceThread for online discussions is excellent for engaging students, especially in asynchronous courses. VoiceThread is an interactive collaboration tool where you can share materials and multimedia, and students can add text, audio, or video comments directly. It facilitates rich discussions and allows students to interact directly with shared material and also build digital presentations with comments for discussion.

Strategy #5: Generative AI

Generative AI, like ChatGPT, offers exciting opportunities for engaging students in active learning. Refer to the CAT AI guide on how to incorporate these activities in our EDvice Exchange blog post A Survival Guide to AI and Teaching pt.4: Make AI Your Friend.

If you’re interested in trying these techniques, we encourage you to reach out to the CAT. In the next post of this blog series, we will focus on overcoming challenges in active learning.

Emtinan Alqurashi is Assistant Director of Online and Digital Learning at Temple’s Center for the Advancement of Teaching.