Artificial Intelligence Marks Grammar Failures – Study
[ad_1]
Artificial intelligence is worse at recognizing grammatical errors than humans.
This was shown by a study by scientists from the Humboldt University of Berlin, the Autonomous University of Barcelona (UAB) and the Catalan Institute for Research and Advanced Studies (ICREA), writes Techxplore
Scientists have found that humans recognize grammatical errors in a sentence, while artificial intelligence (AI) does not.
The study used two chats GPT3 and ChatGPT based on GP3.5.
| Photo: agsandrew/Depositphotos |
Both the people who participated in the experiment and the language models were asked a very simple question: “Is this sentence grammatically correct?”
Humans answered correctly, while the AI gave many wrong answers.
The researchers found that AI applications mostly use a standard yes response strategy, regardless of whether the answer is correct or not.
“The result is surprising because these systems “learn” based on what is grammatically correct in the language and what is not“, – explains researcher Vittoria Dentella, who led the research.
Through a training process, these models are given examples of sentences that are grammatically incorrect, and then the correct version is provided. This is not the case with humans.
Thus, the study shows that there is a double discrepancy between humans and artificial intelligence.
People do not have access to “negative evidence”. But artificial intelligence cannot recognize simple grammatical errors, whereas humans can instantly and effortlessly.
“Developing useful and safe AI tools can be very rewarding, but we must be aware of their shortcomings. Since most AI applications depend on the understanding of commands, identifying their limited understanding of grammar, as we did in our study, is vital“, says ICREA research professor Evelina Leyvada.
As Vittoria Dentella concludes, the results of the study suggest that we need to think critically about whether AI really has human-like language skills.
Read also: Artificial intelligence will probably be able to predict a new outbreak of the coronavirus pandemic – scientists
[ad_2]
Original Source Link
