• Home
  • Insight
  • Blog
  • Business
  • Entertainment
  • Health
  • Politics
  • Shop
    • Gift Shop
    • Value Shop
    • Store
    • Bargain Shop
    • Discount
  • Sports
  • Tech
  • Travel
  • USA
  • Video
  • World
    • Asia
    • Africa
    • South America
    • North America
    • Europe
    • Oceania
Wednesday, November 18, 2026
No Result
View All Result
Subscribe Now
  • Home
  • Insight
  • Blog
  • Business
  • Entertainment
  • Health
  • Politics
  • Shop
    • Gift Shop
    • Value Shop
    • Store
    • Bargain Shop
    • Discount
  • Sports
  • Tech
  • Travel
  • USA
    Mary Peltola Emerges Victorious in Alaska Senate Race, Making History for Democrats

    Mary Peltola Emerges Victorious in Alaska Senate Race, Making History for Democrats

    Stranded in Conflict: Palestinians Navigate the Tenuous Balance of War and Peace Amid Ceasefire Efforts

    Stranded in Conflict: Palestinians Navigate the Tenuous Balance of War and Peace Amid Ceasefire Efforts

    Trump Administration Revokes Pay Increase for Head Start Educators

    Trump Administration Revokes Pay Increase for Head Start Educators

    Unexpected Triumph: Gay Candidates Achieve Unforeseen Victories in Challenging Races

    Unexpected Triumph: Gay Candidates Achieve Unforeseen Victories in Challenging Races

    Microsoft Outlook Experiences Prolonged Outage Affecting Users Nationwide

    Microsoft Outlook Experiences Prolonged Outage Affecting Users Nationwide

    Gunfire Erupts in D.C.: Authorities Search for Suspect Amid Rising Concerns Over Public Safety

    Gunfire Erupts in D.C.: Authorities Search for Suspect Amid Rising Concerns Over Public Safety

    LAUSD Takes Strong Action Against Hate Speech Following Racial Slur Incidents

    LAUSD Takes Strong Action Against Hate Speech Following Racial Slur Incidents

    Beloved Former Los Angeles Times Columnist Steve Harvey Passes Away at 80

    Beloved Former Los Angeles Times Columnist Steve Harvey Passes Away at 80

    Exploring Diversity: ‘Ten Lives’ Showcases the Varied Economic Journeys of Americans

    Exploring Diversity: ‘Ten Lives’ Showcases the Varied Economic Journeys of Americans

  • Video
  • World
    • Asia
    • Africa
    • South America
    • North America
    • Europe
    • Oceania
The Insight Post
  • Home
  • Insight
  • Blog
  • Business
  • Entertainment
  • Health
  • Politics
  • Shop
    • Gift Shop
    • Value Shop
    • Store
    • Bargain Shop
    • Discount
  • Sports
  • Tech
  • Travel
  • USA
    Mary Peltola Emerges Victorious in Alaska Senate Race, Making History for Democrats

    Mary Peltola Emerges Victorious in Alaska Senate Race, Making History for Democrats

    Stranded in Conflict: Palestinians Navigate the Tenuous Balance of War and Peace Amid Ceasefire Efforts

    Stranded in Conflict: Palestinians Navigate the Tenuous Balance of War and Peace Amid Ceasefire Efforts

    Trump Administration Revokes Pay Increase for Head Start Educators

    Trump Administration Revokes Pay Increase for Head Start Educators

    Unexpected Triumph: Gay Candidates Achieve Unforeseen Victories in Challenging Races

    Unexpected Triumph: Gay Candidates Achieve Unforeseen Victories in Challenging Races

    Microsoft Outlook Experiences Prolonged Outage Affecting Users Nationwide

    Microsoft Outlook Experiences Prolonged Outage Affecting Users Nationwide

    Gunfire Erupts in D.C.: Authorities Search for Suspect Amid Rising Concerns Over Public Safety

    Gunfire Erupts in D.C.: Authorities Search for Suspect Amid Rising Concerns Over Public Safety

    LAUSD Takes Strong Action Against Hate Speech Following Racial Slur Incidents

    LAUSD Takes Strong Action Against Hate Speech Following Racial Slur Incidents

    Beloved Former Los Angeles Times Columnist Steve Harvey Passes Away at 80

    Beloved Former Los Angeles Times Columnist Steve Harvey Passes Away at 80

    Exploring Diversity: ‘Ten Lives’ Showcases the Varied Economic Journeys of Americans

    Exploring Diversity: ‘Ten Lives’ Showcases the Varied Economic Journeys of Americans

  • Video
  • World
    • Asia
    • Africa
    • South America
    • North America
    • Europe
    • Oceania
No Result
View All Result
No Result
View All Result
Home International

Scientists Develop New Algorithm to Spot AI ‘Hallucinations’

by Theinsightpost
June 19, 2024
in International
0 0
0
Scientists Develop New Algorithm to Spot AI ‘Hallucinations’


An enduring problem with today’s generative artificial intelligence (AI) tools, like ChatGPT, is that they often confidently assert false information. Computer scientists call this behavior “hallucination,” and it’s a key barrier to AI’s usefulness. 

Hallucinations have led to some embarrassing public slip-ups. In February, AirCanada was forced by a tribunal to honor a discount that its customer-support chatbot had mistakenly offered to a passenger. In May, Google was forced to make changes to its new “AI overviews” search feature, after the bot told some users that it was safe to eat rocks. And last June, two lawyers were fined $5,000 by a U.S. judge after one of them admitted he had used ChatGPT to help write a court filing. He came clean because the chatbot had added fake citations to the submission, which pointed to cases that never existed. 

But in good news for lazy lawyers, lumbering search giants, and errant airlines, at least some types of AI hallucinations could soon be a thing of the past. New research, published Wednesday in the peer-reviewed scientific journal Nature, describes a new method for detecting when an AI tool is likely to be hallucinating. The method described in the paper is able to discern between correct and incorrect AI-generated answers approximately 79% of the time, which is approximately 10 percentage points higher than other leading methods. Although the method only addresses one of the several causes of AI hallucinations, and requires approximately 10 times more computing power than a standard chatbot conversation, the results could pave the way for more reliable AI systems in the near future.

“My hope is that this opens up ways for large language models to be deployed where they can’t currently be deployed – where a little bit more reliability than is currently available is needed,” says Sebastian Farquhar, an author of the study, who is a senior research fellow at Oxford University’s department of computer science, where the research was carried out, and is also a research scientist on Google DeepMind’s safety team. Of the lawyer who was fined for relying on a ChatGPT hallucination, Farquhar says: “This would have saved him.”

Hallucination has become a common term in the world of AI, but it is also a controversial one. For one, it implies that models have some kind of subjective experience of the world, which most computer scientists agree they do not. It suggests that hallucinations are a solvable quirk, rather than a fundamental and perhaps ineradicable problem of large language models (different camps of AI researchers disagree on the answer to this question). Most of all, the term is imprecise, describing several different categories of error.

Read More: The A to Z of Artificial Intelligence

Farquhar’s team decided to focus on one specific category of hallucinations, which they call “confabulations.” That’s when an AI model spits out inconsistent wrong answers to a factual question, as opposed to the same consistent wrong answer, which is more likely to stem from problems with a model’s training data, a model lying in pursuit of a reward, or structural failures in a model’s logic or reasoning. It’s difficult to quantify what percentage of all AI hallucinations are confabulations, Farquhar says, but it’s likely to be large. “The fact that our method, which only detects confabulations, makes a big dent on overall correctness suggests that a large number of incorrect answers are coming from these confabulations,” he says.


The methodology

The method used in the study to detect whether a model is likely to be confabulating is relatively simple. First, the researchers ask a chatbot to spit out a handful (usually between five and 10) answers to the same prompt. Then, they use a different language model to cluster those answers based on their meanings. For example, “Paris is the capital of France” and “France’s capital city is Paris” would be assigned to the same group because they mean the same thing, even though the wording of each sentence is different. “France’s capital city is Rome” would be assigned to a different group. 

The researchers then calculate a number that they call “semantic entropy” – in other words, a measure of how similar or different the meanings of each answer are. If the model’s answers all have different meanings, the semantic entropy score would be high, indicating that the model is confabulating. If the model’s answers all have identical or similar meanings, the semantic entropy score will be low, indicating that the model is giving a consistent answer—and is therefore unlikely to be confabulating. (The answer could still be consistently wrong, but this would be a different form of hallucination, for example one caused by problematic training data.)

The researchers said the method of detecting semantic entropy outperformed several other approaches for detecting AI hallucinations. Those methods included “naive entropy,” which only detects whether the wording of a sentence, rather than its meaning, is different; a method called “P(True)” which asks the model to assess the truthfulness of its own answers; and an approach called “embedding regression,” in which an AI is fine-tuned on correct answers to certain questions. Embedding regression is effective at ensuring AIs accurately answer questions about specific subject matter, but fails when different kinds of questions are asked. One significant difference between the method described in the paper and embedding regression is that the new method doesn’t require sector-specific training data—for example, it doesn’t require training a model to be good at science in order to detect potential hallucinations in answers to science-related questions. This means it works with similar effects across different subject areas, according to the paper.

Farquhar has some ideas for how semantic entropy could begin reducing hallucinations in leading chatbots. He says it could in theory allow OpenAI to add a button to ChatGPT, where a user could click on an answer, and get a certainty score that would allow them to feel more confident about whether a result is accurate. He says the method could also be built-in under the hood to other tools that use AI in high-stakes settings, where trading off speed and cost for accuracy is more desirable.

While Farquhar is optimistic about the potential of their method to improve the reliability of AI systems, some experts caution against overestimating its immediate impact. Arvind Narayanan, a professor of computer science at Princeton University, acknowledges the value of the research but emphasizes the challenges of integrating it into real-world applications. “I think it’s nice research … [but] it’s important not to get too excited about the potential of research like this,” he says. “The extent to which this can be integrated into a deployed chatbot is very unclear.”

Read More: Arvind Narayanan is on the TIME100 AI

Narayanan notes that with the release of better models, the rates of hallucinations (not just confabulations) have been declining. But he’s skeptical the problem will disappear any time soon. “In the short to medium term, I think it is unlikely that hallucination will be eliminated. It is, I think, to some extent intrinsic to the way that LLMs function,” he says. He points out that, as AI models become more capable, people will try to use them for increasingly difficult tasks where failure might be more likely. “There’s always going to be a boundary between what people want to use them for, and what they can work reliably at,” he says. “That is as much a sociological problem as it is a technical problem. And I don’t think it has a clean technical solution.”



Source link

ShareTweetSend
Previous Post

The speed of sound on Mars is constantly changing, study finds

Next Post

MoD Requests UK For 9 Jaguars, Spares To Help Maintain Fleet

Related News

Unauthorized Entry Blocked
International

Unauthorized Entry Blocked

November 18, 2026
L3Harris Telecom System Upgrade Triggers Ground Stop, Says Duffy
International

L3Harris Telecom System Upgrade Triggers Ground Stop, Says Duffy

November 15, 2026
Pentagon: U.S. Military Faces Challenges Due to Ongoing Ukraine Support
International

Pentagon: U.S. Military Faces Challenges Due to Ongoing Ukraine Support

November 14, 2026
Appeals Court Revives Injury Claim Against Motel 6 After Missouri Guest’s Ice Slip-Up Incident
International

Appeals Court Revives Injury Claim Against Motel 6 After Missouri Guest’s Ice Slip-Up Incident

November 13, 2026
Next Post
MoD Requests UK For 9 Jaguars, Spares To Help Maintain Fleet

MoD Requests UK For 9 Jaguars, Spares To Help Maintain Fleet

Discussion about this post

Subscribe To Our Newsletters

    Customer Support


    1251 Wilcrest Drive
    Houston, Texas
    77042 USA
    Call-832.795.1420
    e-mail – news@theinsightpost.com

    Subscribe To Our Newsletters

      Categories

      • Africa
      • Africa-East
      • African Sports
      • American Sports
      • Arts
      • Asia
      • Australia
      • Business
      • Business Asia
      • Business- Africa
      • Canada
      • Defense
      • Education
      • Egypt
      • Energy
      • Entertainment
      • Europe
      • European Soccer
      • Finance
      • Germany
      • Ghana
      • Health
      • Insight
      • International
      • Investing
      • Japan
      • Latest Headlines
      • Life & Living
      • Markets
      • Mobile
      • Movies
      • New Zealand
      • Nigeria
      • Politics
      • Scholarships
      • Science
      • South Africa
      • South America
      • Sports
      • Tech
      • Travel
      • Travel-Africa
      • UK
      • USA
      • Weather
      • World
      No Result
      View All Result

      Recent News

      Must-See Movies That Are Definitely Not Family-Friendly 😂🎬 #Humor #ContentCreator #FYP

      Must-See Movies That Are Definitely Not Family-Friendly 😂🎬 #Humor #ContentCreator #FYP

      November 18, 2026
      Opposition Leaders in Guyana Continue to Face Imprisonment

      Opposition Leaders in Guyana Continue to Face Imprisonment

      November 18, 2026
      Pat Cummins Stands Firm on Sandpapergate Remarks Amidst New Allegations Against Cameron Bancroft

      Pat Cummins Stands Firm on Sandpapergate Remarks Amidst New Allegations Against Cameron Bancroft

      November 18, 2026
      Florida International University Abandons Controversial Policy Aimed at Penalizing Silent Protests by Students

      Florida International University Abandons Controversial Policy Aimed at Penalizing Silent Protests by Students

      November 18, 2026
      • Home
      • Advertise With Us
      • About Us
      • Corporate
      • Consumer Rewards
      • Forum
      • Privacy Policy
      • Social Trends

      Theinsightpost ©2026 | All Rights Reserved. Theinsightpost is an Elnegy LLC company, registered in Texas, USA

      Welcome Back!

      Login to your account below

      Forgotten Password?

      Retrieve your password

      Please enter your username or email address to reset your password.

      Log In

      Add New Playlist

      We are using cookies to give you the best experience on our website.

      You can find out more about which cookies we are using or switch them off in .

      No Result
      View All Result
      • Home
      • Insight
      • Blog
      • Business
      • Entertainment
      • Health
      • Politics
      • Shop
        • Gift Shop
        • Value Shop
        • Store
        • Bargain Shop
        • Discount
      • Sports
      • Tech
      • Travel
      • USA
      • Video
      • World
        • Asia
        • Africa
        • South America
        • North America
        • Europe
        • Oceania

      Theinsightpost ©2026 | All Rights Reserved. Theinsightpost is an Elnegy LLC company, registered in Texas, USA

      The Insight Post
      Powered by  GDPR Cookie Compliance
      Privacy Overview

      This website uses cookies so that we can provide you with the best user experience possible. Cookie information is stored in your browser and performs functions such as recognising you when you return to our website and helping our team to understand which sections of the website you find most interesting and useful.

      Strictly Necessary Cookies

      Strictly Necessary Cookie should be enabled at all times so that we can save your preferences for cookie settings.

      Cookie Policy

      More information about our Cookie Policy