Teaching Takeaway #1: AI and Effective Teaching Strategies

During Teaching Talks, faculty gather to discuss and debate ideas from a recent journal article or podcast episode (and make a dent in their TRL files and piles!). In Teaching Takeaway posts, we will share the key takeaways from the Teaching Talks discussion. These posts are a great way to get a pulse on ‘teaching thoughts’ at UMW.

Teaching Talk session: September 11, 2023

Article: “Using AI to Implement Effective Teaching Strategies in Classrooms” (Mollick & Mollick, 2023)

Resource Summary: Mollick and Mollick assert that AI can support implementation of evidence-based teaching practices requiring intensive faculty time commitments. The authors make cases for AI streamlining faculty workload related to five specific teaching practices:

  • generating multiple examples and alternative explanations for concepts
  • identifying and addressing student misconceptions
  • using frequent low-stakes testing
  • assessing student learning
  • creating items for distributed practice exercises

The authors offer model AI prompts related to each teaching practice with relevant considerations for evaluating output. Can we anticipate a new era of evidence-based teaching using AI? Mollick and Mollick contend that we may be in the early stages of a renewed focus on using strategies that work in classrooms.

Key takeaways from the group discussion:

1. Faculty saw great potential for AI to streamline labor-intensive teaching practices like creating formative assessment items (e.g., for an in-class Jeopardy game or retrieval practice exercises later in the semester) or generating multiple explanations and examples for complex concepts. Assessment items or examples could be tailored to the specific student audience or unique classroom contexts in ways that test banks and online searches cannot replicate efficiently.

2. Prompt engineering (guiding AI output through careful layering and refinement of prompts) is a skill that both faculty and students need to learn to most effectively use AI. Before we can do it with students, we need to learn it ourselves. (Yes, opportunities are coming soon!)

3. Mollick & Mollick suggested using AI to evaluate themes in student understanding by asking AI to analyze student exit tickets or minute papers. Our faculty participants were much less comfortable with using AI in this context. Concerns cited included privacy of student work, ethical considerations about reviewing individual student submissions vs. a whole group analysis, and potential errors in analysis (would verifying themes just require you to read all the responses anyway?). In the end, the group understood the authors’ premise, but were less likely to use AI for this purpose.

4. The article contained detailed examples of how to build prompts supporting targeted teaching objectives (see takeaway #2). If you have only played informally with AI tools but want to learn how to use them in a focused way for class design, the article models offer a solid step-by-step process to begin learning about prompt engineering.

Reach out with any questions and we hope to see you at a future Teaching Talk!

Faculty Spotlight: Alex Dunn and Samira Fallah

In our monthly Faculty Spotlight, CfT Faculty Fellow, Elizabeth Johnson-Young, goes out to find colleagues who are bringing energy and new ideas into their teaching, often turning that work into research in the Scholarship of Teaching and Learning (SoTL).

This month, we’d like you to meet two COB colleagues:

Alex Dunn, Associate Professor of Management

Samira Fallah, Assistant Professor/Strategy

You two have a SoTL article that was recently published. Can you tell us a little about what this project investigated and what you found?

We took a common executive strategic planning tool, called scenario planning, and translated the tool into a process that students can use when planning for various parts of their career and job search process. The activity walks students through evaluating external forces, developing possible future situations, and analyzing the implications of each of the situations. The activity can be completed in face-to-face classes, outside of class, and in online classes.

Our article, titled “The Future Is Scary!: A Job Search Scenario Planning Exercise to Encourage Student Resilience Capacity and Reduce Stress,” has been published in the Journal of Management Education.

What are the implications of the research?

Based on pretest-posttest data, students (N = 71) report that the exercise significantly reduced stress about their own job searches and increased positive mood. Most students also agreed that scenario planning can help with understanding how to prepare and approach different job search situations and can be a useful tool for dealing with future unknowns.

How was the project valuable to you as a teacher and as a researcher?

From a teaching perspective, we now have a great activity that we can use in a variety of classes and can cater it to the specific topic we are teaching. Alex teaches human resources and can use this while she teaches about recruitment. Samira teaches strategic management and can use this while she teaches about scenario planning as a planning tool.

From a research perspective, this project is part of a special issue called “Teaching about Contemporary Careers”. We hope it reaches other management educators who can adopt the exercise and use it in their classes to help students better prepare for their own job searches.

What does your research agenda look like right now? Has it changed in unanticipated ways?

We both have two streams of research: discipline-related discovery research and SoTL research. We have found a great organization called the Management and Organizational Behavior Teaching Society (MOBTS) that supports SoTL research in our discipline. We have plans to continue SoTL research and are working on our next project together that we plan to submit to the MOBTS conference this year, get feedback on, and then turn into another publication.

What is your favorite UMW class to teach?

Alex: Human Resources or Management & Films

Samira: Principles of Management and Strategic Leadership

What is your favorite way to start a class?

Alex: Hearing about student’s lives outside of class – their weekend plans, sports team updates, travels, etc.

Samira: Capturing students’ attention right from start! I prefer starting class with a question, an engaging video, or a relevant news article that gets students thinking about the session’s topic.

8 a.m. class or 4:00 p.m. class?

Alex: Despite being a morning person (like Samira), my speaking voice is not ready at 8am. So, 4pm all the way!

Samira: I am definitely a morning person but 8 am is a bit too early for me! Make it 9, and I am all in!

What is your dream class to teach?

Alex: an advanced OB/leadership class where students solve real-world leadership problems for companies and learn about themselves as leaders.

Samira: a class all about Chief Executive Officers (CEOs)!

What podcast would you currently recommend? (or book/show/etc.—you pick!)

Alex: I don’t want to embarrass myself too much here, but I listen to a daily pop culture podcast called The Toast. I also keep up with Adam Grant’s WorkLife podcast and anything Brene Brown.

Samira: A Podcast, in Persian, called Channel B which introduces interesting books. I am also a fan of “Wisdom From The Top with Guy Raz” and “Inside the Strategy Room podcasts” by McKinsey & Company