Government Accountability Office Warns Against AI-Generated 'Hallucinated' Legal Cases in Court Filings
The Government Accountability Office (GAO) is encountering a growing problem within the legal profession: court filings that cite non-existent legal cases, seemingly generated by artificial intelligence (AI). This issue is affecting both private firms and government lawyers, with the GAO specifically warning protesters about using such 'hallucinated' cases in their submissions. According to Crawford Appleby, a partner at Wisner Baum, AI's ability to quickly provide confident-sounding, polished answers to complex legal questions, combined with the pressure attorneys face to produce quality work rapidly, leads some to forgo verification. This results in fake cases appearing in official court documents. A federal judge recently criticized Justice Department attorneys for citing a non-existent AI-generated case, highlighting the severity of the problem. The core issue stems from large language models (LLMs) being designed to predict the next word in a sentence rather than to ensure factual accuracy, causing th... 
