Generative AI Tutorials: "How do I know I can trust ChatGPT" - How to Critically Engage with Generative AI

This session is part of the 2025-2026 Generative AI tutorial series hosted by the Michigan Institute for Data & AI in Society (MIDAS)

About: Despite recognizing that Large Language Models (LLMs) can generate inaccurate or unacceptable responses, universities are increasingly making such models available to their students. Existing university policies defer the responsibility of checking for correctness and appropriateness of LLM responses to students and assume that they will have the required knowledge and skills to do so on their own. This lecture teaches attendees how to critically engage with LLMs to understand their strengths and weaknesses. As part of the lecture, the attendees engage in a hands-on activity to evaluate an LLM provided by the university; first by themselves, and then with a scaffolded design probe that guides them through an end-user auditing exercise.

IMPORTANT: This session will be in-person only and will not be recorded. A self-guided version will be available later this semester through the MIDAS AI Sandbox, where participants can explore the exercise at their own pace. Please contact midas-research@umich.edu for more information or questions.