AI Models Struggle to Replicate Teacher Feedback Nuances in Student Writing
A recent study evaluating Large Language Models (LLMs) in generating feedback for student writing has revealed that while these AI models can cover most feedback types, they fail to fully replicate the nuanced and adaptive feedback practices of expert human teachers. The research, which utilized a refined taxonomy of seven feedback focus types, compared feedback from six different LLMs with that provided by human instructors across university writing courses. Key findings indicate that LLMs often exhibit a strong preference for certain feedback types, such as 'Elaboration' or 'Mistakes,' leading to less balanced feedback compared to human teachers who distribute their comments more evenly. Furthermore, while some LLMs showed limited adaptivity in their feedback across different draft stages and student performance levels, none matched the comprehensive adaptive behavior demonstrated by human educators. The study highlights that even with various prompting strategies, LLMs struggle to achieve the same level...
