Traditional legal practice, which includes reviewing documents by hand, doing thorough research, and writing contracts that take a lot of time, is quickly changing with the integration of AI. Legal AI solutions promise to be more efficient, less expensive, and more accurate, but they also raise questions about regulatory compliance, hallucinations undermining legal judgment and more.
Recently, researchers from the University of Minnesota Law School, University of Michigan Law School, Centre for the Governance of AI, and Ogletree Deakins conducted the first randomised controlled study evaluating students’ performance using RAG-based legal AI tool, an AI reasoning model, and without AI. The results showed that reasoning models have made a breakthrough in intelligent document processing and productivity of legal practice.
We talked to Sergii Bataiev, Director of Architecture and Technology at ELEKS, to learn more about these results and what they mean.
So, the experiment involved using Vincent AI as an AI tool and o1-preview OpenAI for a reasoning model. Vincent AI provided a productivity increase of approximately 38% to 115%, while o1-preview increased productivity from 34% to 140%, with particularly strong effects in complex tasks such as drafting persuasive legal letters and analysing legal complaints.
What's even more important is that the number of hallucinations proved to be extremely small. And for Vincent AI, it was approximately the same as for law students who didn't use AI at all.
The study suggests reasoning models can significantly transform litigation-oriented practice areas and complex legal analysis, where they demonstrated concentrated quality improvements and highly accurate exam feedback when given proper context. In contrast, transactional work, specifically contract drafting, showed minimal improvement with AI assistance.
First, the study results clearly showed that combining domain-specific RAG capabilities with reasoning models improves legal knowledge and work efficiency when working together. Second, these results mean that the next wave of AI-based legal tools is almost here, which will completely change the legal field.
Threat actors can leverage AI-powered attacks to deploy more advanced and quicker malware against their target companies. Although law firms can implement AI to oversee, automate, and assess their security systems, attackers may still find ways to train and outsmart these defences.
Yes, there are AI tools specifically designed for legal professionals that assist with document review, legal research, contract analysis, and due diligence.
AI in law is used for document review, contract analysis, legal research, predicting case outcomes, and automating routine tasks like drafting basic legal documents.
The breadth of knowledge and understanding that ELEKS has within its walls allows us to leverage that expertise to make superior deliverables for our customers. When you work with ELEKS, you are working with the top 1% of the aptitude and engineering excellence of the whole country.
Right from the start, we really liked ELEKS’ commitment and engagement. They came to us with their best people to try to understand our context, our business idea, and developed the first prototype with us. They were very professional and very customer oriented. I think, without ELEKS it probably would not have been possible to have such a successful product in such a short period of time.
ELEKS has been involved in the development of a number of our consumer-facing websites and mobile applications that allow our customers to easily track their shipments, get the information they need as well as stay in touch with us. We’ve appreciated the level of ELEKS’ expertise, responsiveness and attention to details.