A humorous take on the legal backlash against unverified AI-generated court filings
In a bold reminder of the clash between technology and legal ethics, a California federal judge has fined two law firms $31,000. Their mistake? Submitting a legal brief filled with fake citations created by AI.
The Case at Hand
Judge Michael Wilner of the U.S. District Court for the Central District of California issued the fine after reviewing a supplemental brief. The case involved a civil lawsuit against State Farm. The brief included multiple fabricated citations generated by AI tools like Google Gemini and Westlaw Precision with CoCounsel.
Wilner admitted the fake citations nearly convinced him. “That’s scary,” he said. “It almost led to the scarier outcome… of including those bogus materials in a judicial order.”
The Role of AI in Legal Research
This case adds to growing concerns over AI in legal work. These tools are fast and convenient, but they often “hallucinate” — producing false but convincing information.
Lawyers, however, must still verify everything. Whether AI or human, every citation and fact must be accurate before submission to the court.
A Growing Pattern
This isn’t an isolated incident. In June 2023, two New York lawyers faced a $5,000 fine. They used ChatGPT to generate a brief that listed six made-up cases. The judge called it a failure of responsibility. The lawyers submitted non-existent opinions filled with fake quotes and citations.
In another example, the Chief Justice of New South Wales, Australia, issued a strong order. He banned AI use in creating evidence-related documents. Lawyers must now certify that no AI tools were involved.
Moving Forward
AI is here to stay in the legal world. But with it comes responsibility. Lawyers cannot rely on AI as a shortcut. Courts demand accuracy, and negligence will not go unpunished.
This ruling sends a clear message. Legal professionals everywhere must adapt carefully as AI continues to reshape the industry.
Sources:
Schema Selected:
