What's Happening?
New research from Duolingo indicates that scores from the writing section of the Duolingo English Test (DET) positively correlate with academic success in U.S. universities. The study, which analyzed transcript data from 444 test-takers, including 140
U.S. undergraduates and 148 U.S. graduate students, explored how DET writing performance relates to first-year GPA and grades in first-year writing courses. For U.S. undergraduates, the composite writing grade correlated with GPA at r = .27, a modest but typical finding in language testing predictive validity research. Furthermore, students with higher composite writing grades were significantly more likely to achieve a 4.0 in their first-year writing courses. This exploratory study utilized DET sessions completed between May 2022 and April 2024, before the introduction of Interactive Writing and the specific Writing subscore, meaning a composite writing grade was calculated for the analysis.
Why It's Important?
This research is important for U.S. higher education institutions as it provides further validation for the Duolingo English Test as a reliable measure of English proficiency for admissions. Universities rely on such tests to assess prospective students' readiness for academic work, particularly in writing. The findings suggest that DET writing scores offer a meaningful signal about a student's potential performance in academic writing, which is crucial for success in university-level studies. For international students seeking admission to U.S. universities, the DET offers an accessible and widely accepted alternative to traditional proficiency tests. The study's results could influence admissions policies, potentially increasing the acceptance and reliance on DET scores for evaluating writing proficiency, thereby broadening access for a diverse pool of applicants.
What's Next?
Duolingo's research team is continuing to collect transcript data, focusing on test-takers who completed the DET after the launch of Interactive Writing and who have a reportable Writing subscore. This relaunched study aims to apply the same research approach to a broader base, including more institutions, graduate programs, and larger Canadian samples. This will allow for a more direct examination of the current DET writing construct. The ongoing research is expected to provide more definitive insights into the predictive validity of the current DET Writing subscore, potentially leading to further refinements in the test and its interpretation by university admissions offices. Future findings could solidify the DET's position as a comprehensive and accurate assessment tool for English language proficiency.
Beyond the Headlines
The study highlights a broader trend in language proficiency testing: the increasing reliance on automated scoring models and the need for robust predictive validity research to support these innovations. While the study acknowledges limitations such as small sample sizes in some subgroups and the use of a retroactively reconstructed writing grade, it underscores the importance of continuous validation for evolving assessment tools. The shift towards more tasks, each shorter than a typical essay, and automated scoring, as seen in the DET, represents a departure from traditional human-rated essay tasks. This evolution in testing methodology raises questions about the future of language assessment and its ability to accurately capture complex writing skills, while also offering benefits in terms of scalability and accessibility.
