Chat GPT has recently become popular as people claim that the artificial chatbot has all the answers in the world. The chatbot was launched in November 2022 and has since passed some of the toughest tests around the world. From passing the final exam of the Master of Business Administration (MBA) program at the Wharton School of the University of Pennsylvania to beating the brightest medical minds in the US medical exam, Chat GPT has proven its mettle.
An artificial intelligence (AI)-based chatbot was asked about the answers in the latest exam. It was the Indian Civil Services exam conducted by the Union Public Service Commission (UPSC), which is one of the toughest exams in the world. Analytics India Magazine used Chat GPT to attempt the UPSC exam. When the chatbot was asked, “Do you think you can crack the Union Public Service Commission prelims exam?” he knew it was going to be tough. The chatbot said he couldn’t give a definitive answer about whether he could crack the exam or not.
AIM went ahead and asked all 100 questions of UPSC Prelims 2022 Paper 1 (Set A) to Chat GPT. Chat GPT could answer only 54 of them correctly, which was a surprise to the magazine company. The cut-off for general category candidates was 87.54, which suggests that Chat GPT could not crack the UPSC exam.
The questions were from several topics like geography, economy, history, environment, general science and current affairs related to India. Since the knowledge of ChatGPT is limited to September 2021, it is not able to answer questions related to current affairs. But it also provided wrong answers for topics like geography and economy, even though the questions were not related to any specific timeline.
It even got a question from history wrong, which should have been answered correctly as the AI chatbot claims to have all the information up to September 2021. In some multiple choice questions, the chatbot created an additional option that was not provided.
