When OpenAI launched its fourth version of ChatGPT last March, the company made a sensational claim.
Its technology, OpenAI said, could now beat 90 percent of law students taking the US bar exam.
It was an idea that both fascinated Armin Alimardani, a lecturer in University of Wollongong’s School of Law, and left him sceptical.
“The OpenAI claim was impressive and could have significant implications in higher education, for instance, does this mean students can just copy their assignments into generative AI and ace their tests?” Alimardani said.
“Many of us have played around with generative AI models and they don’t always seem that smart, so I thought why not test it out myself with some experiments.”
Alimardani, who was the university’s co-ordinator for the subject Criminal Law last year, …