Is ChatGPT reliable in 2023 after failing India’s toughest exam?

ChatGPT is such a popular AI that blasts the internet world. It clears many important exams in the USA but it still struggles with the UPSC exams questions of 2022.

ChatGPT

Let’s get into the topic.

Introduction

ChatGPT is an Artificial Intelligence bot of OpenAI company that launched as a prototype in November 2022. It is an exceptional innovation by the OpenAI and it is the part of GPT 3 ( Generative Pre-Trained Transformer 3) family.

Do you know what is GPT3 showing all over the internet? It is an Autoregressive language model that generates human-like text without delaying any time.

What do you mean Autoregressive Language Model?

In this model when the user asks a question regarding his query it predicts the sequence of words and understanding of the user’s intention and language. This model is used in Natural language Processing(NLP).

This Model analyzes the behavior of the previous text and answers according to it. Autoregressive Language Model is mostly used in Chat AI, Machine translation, and Speech recognition.

what are the toughest exams in India?

India is one of the 5th largest economic countries in the world. To manage the country many govt institutions conduct exams. UPSC exam is one of them.

UPSC (Union Public Service Exam) is conducted for the post of IAS (Indian Administrative Service), IPS ( Indian Police Service), IFS (Indian Foreign Service), IFoS ( Indian Forest Service), etc.

This exam has 3 stages Preliminary, Main, and personal interview.

ChatGPT fails in UPSC preliminary exam

ChatGPT clears the exam of the Wharton MBA exam, the US medical exam, the US bar exam for law, and the Google interview but fails in the UPSC preliminary exam (1st stage of Exam).

Recently In India, Analytics India Magazine (AIM)  conducted an exam where 100 questions were asked to ChatGPT. Out of 100, 54 answers are given correctly and the remaining are incorrect. In INDIA’s general category students, the cut-off mark to clear the exam is about 87.54.

In this exam questions were asked to ChatGPT regarding Physics, Chemistry, Geography, History, and Economics. It does not clear the cut-off mark so ChatGPT fails in India’s Toughest Exam.

How ChatGPT collects data and gives answers

ChatGPT collects maximum data to reply to a question from Common Crawl on the websites, Articles, and research papers database. It contains 60% of the answer.

The rest are from other sources like web text 2 (22%), book 1(8%), book 2 (8%), and Wikipedia (3%).

the reason behind ChatGpt Fails

ChatGPT has some limitations. It has stored the data before September 2021. So it can’t give several updates in 2022.

Reasons are

  • The questions are asked from the 2022 question paper of the UPSC exam. But it does not mean all the questions came from Current Affairs.
  • ChatGPT lacks the Question understanding and the point of view of the questioner.
  • Lack showed in Geographical, Historical, and Economical issues.

Every people consider that it gives reliable answers but here it fails. There are much more updates that must be needed.

Conclusion

As it is an AI language model, ChatGPT is designed to make conversation with users and provide information on various topics. Its training data is sourced from a vast amount of online sources, which enables it to generate human-like responses and offer useful insights.

Through it has a chatbot interface, It is used for various applications, from corporate to educational, entertainment, gaining Medicine knowledge, and many more purposes.

Overall, ChatGPT is a powerful tool but can it is trustworthy in its answers. In my opinion, it is still in a progressive condition. Although it gives quite accurate answers but still lags in understanding the user question and intentions.

This is the reason why it fails in UPSC preliminary exam. what is your thought regarding this comment below?

A Mechanical Engineer who loves to research and update new Science and Technology updates.

Leave a Comment