Litera's Legal Document Comparison: Insights from "My Cousin Vinny"

In 2026, Litera released a benchmarking report evaluating its document comparison tool, Litera Compare, against major AI models including ChatGPT 5.2, Claude 4.5 Opus, and Gemini 3. The report focused on the accuracy of these tools in comparing complex legal documents, revealing significant discrepancies in performance.

Above the Law

The benchmarking report indicated that while Litera Compare achieved 100 percent accuracy in comparing legal documents, the AI models struggled significantly. For instance, on a 53-page document, the AI models maintained an accuracy range of 85-90 percent, but this dropped to approximately 40 percent for ChatGPT on a 200-page document. Furthermore, the AI models performed poorly on non-text elements such as tables and images, scoring effectively zero in these areas. This highlights the limitations of using consumer-grade AI for legal tasks, where precision is paramount.

Above the Law

The report also examined the script of "My Cousin Vinny," noting that the film's final draft improved in legal procedural accuracy compared to earlier versions. For example, a scene where Lisa informs Vinny about prosecutorial disclosure evolved from a brief mention of discovery to a pivotal moment in the narrative, emphasizing the importance of legal research. This change reflects a commitment to authenticity in legal representation, contrasting with typical Hollywood portrayals that often simplify or distort legal processes.

Above the Law

Litera's AI tool, Lito, was utilized to assess the accuracy of legal references in the script, particularly focusing on the disclosure scene where Lisa asserts that the prosecution must share evidence. This assertion is rooted in the principles established by the Supreme Court in *Brady v. Maryland* and *Kyles v. Whitley*, which mandate the disclosure of favorable evidence to the defense. However, the report noted that Lisa's claim about the requirement for a witness list is overstated under Alabama law, where state rules can differ from federal standards.

Above the Law

Litera emphasized the importance of using specialized tools for legal work, stating that "the lesson, as always, is don’t do legal work with raw, consumer-grade LLMs." The partnership with Midpage further enhances Lito's capabilities, allowing users to verify compliance with legal standards directly within their workflow.

Above the Law

Despite the advancements, some critics argue that the reliance on AI tools may lead to overconfidence in their capabilities, potentially undermining the nuanced understanding required in legal contexts. The report suggests that while AI can assist in legal tasks, it should not replace the expertise of trained professionals.

Above the Law

• “The lesson, as always, is don’t do legal work with raw, consumer-grade LLMs.” — Litera

Above the Law

• “It’s Called Disclosure, You Dickhead” — Lisa, *My Cousin Vinny*

Above the Law

• “the individual prosecutor has a duty to learn of any favorable evidence known to the others acting on the government’s behalf in the case, including the police.” — *Kyles v. Whitley*

Above the Law

In conclusion, Litera's benchmarking report not only highlights the limitations of current AI models in legal document comparison but also showcases the potential for enhancing legal accuracy in popular media through careful script refinement.

Above the Law