Can AI Judge Like a Justice?

The system models the dynamics of oral arguments by simulating justice responses-predicting each [latex]n^{th}[/latex] turn based on case facts, the legal question, prior conversational context from the preceding [latex]n-1[/latex] turns, and the identity of the speaking justice-through both prompt-based methods utilizing varied base models and agentic approaches leveraging tools like case docket searches and historical voting data, all evaluated by a framework assessing both the realism and pedagogical value of the simulations.

A new framework evaluates whether artificial intelligence can realistically simulate the challenging questioning of US Supreme Court oral arguments.