Abstract
Jill Watson is an example of an intelligent conversational AI Teaching Assistant that has been deployed across 24 class sections in different institutions, with 1102 unique student participants and over 17000 questions from Fall 2023 to present. Jill Watson’s RAG-based architecture built around OpenAI ChatGPT and user study results addresses some of the concerns related to domain knowledge, deployment, and data collection in online classrooms. In this work, a 3-tiered framework for personalization in online education using AI tools to enable a human-AI personalization loop, grounded in real-world human feedback is proposed.