AI in the Courtroom: Supreme Court Mandates BCI Probe into Fake Judicial Precedents

The Supreme Court of India has taken a significant step toward regulating the intersection of technology and law by directing the Bar Council of India (BCI) to constitute an expert committee. This panel is tasked with investigating the alarming trend of lawyers using Artificial Intelligence (AI) to fabricate judicial precedents. The directive comes in response to instances where legal practitioners cited non-existent judgments generated by Large Language Models (LLMs), a phenomenon known as 'AI hallucination' where AI tools provide confident but factually incorrect information. The use of fake judgments strikes at the heart of the adversarial system of the Indian judiciary, which relies heavily on the authenticity of cited precedents. It compromises the integrity of judicial proceedings and risks leading to miscarriages of justice. The court emphasized that while technology can enhance efficiency, it cannot replace the professional responsibility and ethical standards required of an officer of the court. This development underscores the urgent need for a regulatory framework for AI in professional sectors and raises questions about the accountability of legal professionals.