The latest generation of generative artificial intelligence has proven capable of acing law school final exams, according to a recent study. OpenAI\u2019s new model, called o3, earned grades ranging from A+ to B on eight spring finals at the University of Maryland Francis King Carey School of Law. The findings, published in a new paper on SSRN, show significant improvement from earlier versions of ChatGPT, which scored lower grades in similar tests in 2022 and 2023.<\/p>\n\n\n\n
Previous versions of OpenAI’s ChatGPT, which took law school finals in earlier studies, scored B’s, C’s, and even a D. However, o3 has shown marked progress. Unlike ChatGPT, which immediately generates responses to queries, o3 is a reasoning model. This means that o3 generates tentative answers and evaluates multiple approaches before providing a final response. This more thoughtful approach is credited for its impressive performance on law exams.<\/p>\n\n\n\n
The study, conducted by seven law professors from the University of Maryland, tested o3 on exams graded on the same curve used for students. The AI model received an A+ in Constitutional Law, Professional Responsibility, and Property. It scored an A in Income Taxation, and an A- in Criminal Procedure. In other areas, it earned a B+ in Secured Transactions and Torts, and a B in Administrative Law. o3 performed well on both multiple-choice questions and essay-style responses.<\/p>\n\n\n\n