The “Mercy v. Mankind” Glitch: Why LLMs Can’t Practice Law (Yet).
In the world of system-level programming, we have a saying: Garbage In, Garbage Out. But in the hallowed halls of the Supreme Court of India, a new and more dangerous iteration has emerged: Probability In, Perjury Out. Recently, a bench led by CJI Surya Kant and Justice Nagarathna expressed formal alarm over a trend that sounds like a tech-thriller plot but is a cold reality: lawyers are submitting petitions filled with "hallucinated" case law. From the fictitious Mercy v. Mankind to a series of fake judgments cited before Justice Dipankar Datta, the legal "craft" is facing a critical system failure....