LLMs for Intelligent Tutoring

Essential Readings

• MATHDIAL: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems (Macina et al., 2023)
• Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction (Wang and Demszky, 2023)
• The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues (Tack and Piech, 2022)
• Are We There Yet? - A Systematic Literature Review on Chatbots in Education (Wollny et al., 2021)
• Teaching the science of learning (Weinstein et al., 2018)
• AutoTutor and Family: A Review of 17 Years of Natural Language Tutoring (Nye et al., 2014)
• Intelligent tutoring systems with conversational dialogue (Graesser et al., 2001)
• The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring (Bloom, 1984)

General Overview and Background

• Opportunities and Challenges in Neural Dialog Tutoring (Macina et al., 2023)
• Are We There Yet? - A Systematic Literature Review on Chatbots in Education (Wollny et al., 2021)
• A Systematic Literature Review of Intelligent Tutoring Systems With Dialogue in Natural Language (Paladines and Ramirez, 2020)
• Intelligent tutoring systems with conversational dialogue (Graesser et al., 2001)
• The 2 sigma problem: The search for methods of group instruction as effective as one-to-one tutoring (Bloom, 1984)

Overview of the Learning Siences Principles

• Teaching the science of learning (Weinstein et al., 2018)
• The concise Corsini encyclopedia of psychology and behavioral science (Craighead and Nemeroff, 2004)

Technology-enhanced educational approaches

• Exploring the factors affecting mooc retention: A survey study (Hone and El Said, 2016)
• Individualization for education at scale: MIIC design and preliminary evaluation (Brinton et al., 2014)
• The determinants of students' perceived learning outcomes and satisfaction in university online education: An empirical investigation (Eom et al., 2006)

Pre-LLM Intelligent Tutoring Systems (ITS)

• AutoTutor and Family: A Review of 17 Years of Natural Language Tutoring (Nye et al., 2014)
• Gaze tutor: A gaze-reactive intelligent tutoring system (D'Mello et al., 2012)
• Data mining in education (Romero and Ventura, 2012)
• AutoTutor 3-D Simulations: Analyzing Users' Actions and Learning Trends (Graesser et al., 2006)
• Individualizing Self-Explanation Support for Ill-Defined Tasks in Constraint-based Tutors (Weerasinghe and Mitrovic, 2006)
• Interactive Conceptual Tutoring in Atlas-Andes (Rose et al., 2000)
• Jacob - An Animated Instruction Agent in Virtual Reality (Evers and Nijholt, 2000)

LLMs in STEM Education and Development of ITS

• Stepwise Verification and Remediation of Student Reasoning Errors with Large Language Model Tutors (Daheim et al., 2024)
• Backtracing: Retrieving the Cause of the Query (Wang et al., 2024)
• Bridging the Novice-Expert Gap via Models of Decision-Making: A Case Study on Remediating Math Mistakes (Wang et al., 2024)
• MATHDIAL: A Dialogue Tutoring Dataset with Rich Pedagogical Properties Grounded in Math Reasoning Problems (Macina et al., 2023)
• Improving Teachers’ Questioning Quality through Automated Feedback: A Mixed-Methods Randomized Controlled Trial in Brick-and-Mortar Classrooms (Demszky et al., 2023)
• GPTeach: Interactive TA Training with GPT-based Students (Markel et al., 2023)
• NAISTeacher: A Prompt and Rerank Approach to Generating Teacher Utterances in Educational Dialogues (Vasselli et al., 2023)
• Is ChatGPT a Good Teacher Coach? Measuring Zero-Shot Performance For Scoring and Providing Actionable Insights on Classroom Instruction (Wang and Demszky, 2023)
• Demographic Predictors of Students’ Science Participation over the Age of 16: an Australian Case Study (Cooper et al., 2020)

Evaluation of ITS

• The AI Teacher Test: Measuring the Pedagogical Ability of Blender and GPT-3 in Educational Dialogues (Tack and Piech, 2022)
• Measuring Conversational Uptake: A Case Study on Student-Teacher Interactions (Demszky et al., 2021)
• Evaluation methodologies for intelligent tutoring systems (Mark and Greer, 1993)

Ethical Considerations

• What if the devil is my guardian angel: ChatGPT as a case study of using chatbots in education (Tlili et al., 2023)