ChatGPT has the intelligence to pass prestigious graduate-level exams, albeit not with the best grades.

According to academics at the schools, the potent new AI chatbot tool recently passed law tests in four courses at the University of Minnesota and another exam at the Wharton School of Business at the University of Pennsylvania.

Professors at the University of Minnesota Law School recently scored the examinations blindfolded to see how well ChatGPT could generate answers on exams for the four courses. The bot performed on average at the level of a C+ student after completing 95 multiple-choice questions and 12 essay questions, earning a low but passing mark in all four courses.

using a laptop, a student
Teachers are making adjustments in response to worries about a potent new AI tool ChatGPT performed better on a test for a business management course at Wharton, where it received a B to B-. Christian Terwiesch, a professor of business at the Wharton School, wrote about the results in a paper. He claimed that ChatGPT performed “amazing” when answering questions about operations management and process analysis, but struggled with more difficult prompts and made “surprising mistakes” with basic math.

These errors “may be of enormous magnitude,” he wrote.

The test results come as more schools and teachers voice worries about ChatGPT’s direct effects on pupils and their capacity for academic dishonesty. Even though it is still unknown how frequently students use ChatGPT and how detrimental it might actually be to learning, some educators are moving quickly to reevaluate their assignments in response to the program.

ADVERTISEMENT

Ad Suggestions

Video Ad Reaction
Congressman reads AI-written speech 02:49 CNN, as a source
ChatGPT has been used to produce creative essays, stories, and song lyrics in response to user requests since it was made available in late November. It has created study abstracts that have duped some scientists. Even some CEOs have used it to compose emails or do accounting tasks.

For the purpose of producing responses to user prompts, ChatGPT is trained on enormous amounts of web data. Although it has gained popularity among users, it has also sparked certain concerns, including those regarding errors and the possibility that it could reinforce biases and disseminate false information.

One of the University of Minnesota’s law professors, Jon Choi, told CNN that the tests’ purpose was to examine how ChatGPT might help attorneys in their work and students in exams, whether or not doing so is permitted by their professors. This is because the questions frequently resemble the writing that attorneys do in real life.

According to Choi, “ChatGPT has trouble with the most fundamental parts of law school exams, like identifying potential legal difficulties and in-depth analysis applying legal rules to the facts of a case.” However, ChatGPT might be quite useful in producing a rough draft that a learner can then polish.

He contends that the most exciting use of ChatGPT and related technology is human-AI collaboration.

He asserted that law schools should educate their students for the possibility that AI assistants would soon become commonplace tools for attorneys. “Of course, regulations like barring the internet during exams will need to be in place to enforce that if law professors wish to continue testing straightforward recollection of legal principles and doctrines.”

On a laptop, the OpenAI website ChatGPT
How Microsoft could boost their goods using ChatGPT
The chatbot was “remarkably good” at changing its responses in response to human signals, such as revising responses after pointing out an error, according to Wharton’s Terwiesch, highlighting the possibility of people cooperating with AI.

Scott Galloway discusses the “scareier part” of AI tools like ChatGPT in a video ad feedback at 02:07 – Source: CNN
However, there is still immediate uncertainty around whether and how students should use ChatGPT. For instance, ChatGPT use on district-owned networks and devices has already been prohibited in public schools in Seattle and New York City.

Given that ChatGPT did better than average on his test, Terwiesch told CNN that he concurs that there should be limitations placed on pupils while they are taking exams.