Supreme Court Warns Against AI-Generated 'Hallucinated' Precedents in Judicial Adjudication

The Supreme Court’s intervention serves as a stern reminder that technology must remain a tool for assistance rather than a substitute for judicial application of mind. The Court emphasized that judicial integrity, accountability, and the duty to provide reasoned orders rest solely with human judges. As quasi-judicial bodies increasingly integrate digital tools to manage mounting backlogs, this case underscores the necessity of rigorous verification protocols and the need for a 'human-in-the-loop' approach to ensure that technological convenience does not compromise the quality of justice delivery. For the legal and administrative ecosystem, this development necessitates the formulation of clear guidelines on the ethical use of AI in legal drafting. It highlights the tension between the efficiency of e-governance and the foundational requirement of accuracy and probity in public service. As India moves toward a more digitized judicial infrastructure, the focus must remain on balancing innovation with the ethical imperatives of the legal profession. UPSC Relevance: This issue is highly relevant for GS Paper II (Judiciary/Quasi-judicial bodies) and GS Paper IV (Ethics/Probity in Governance). Aspirants can use this as a case study to discuss the ethical dilemmas posed by emerging technologies in public administration, the importance of human accountability in automated systems, and the challenges of maintaining transparency and integrity in the digital age.