Flutterby™! : AI chatbots inaccurately "summarize"

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

AI chatbots inaccurately "summarize"

2025-02-12 17:25:53.864505+01 by Dan Lyke 0 comments

Not news to anyone who's been using LLMs to create summaries, but AI chatbots unable to accurately summarise news, BBC finds.

In the study, the BBC asked ChatGPT, Copilot, Gemini and Perplexity to summarise 100 news stories and rated each answer.

It got journalists who were relevant experts in the subject of the article to rate the quality of answers from the AI assistants.

Deborah Turness - AI Distortion is new threat to trusted information

[ related topics: Invention and Design Current Events Journalism and Media Monty Python Artificial Intelligence ]

comments in ascending chronological order (reverse):

Comment policy

We will not edit your comments. However, we may delete your comments, or cause them to be hidden behind another link, if we feel they detract from the conversation. Commercial plugs are fine, if they are relevant to the conversation, and if you don't try to pretend to be a consumer. Annoying endorsements will be deleted if you're lucky, if you're not a whole bunch of people smarter and more articulate than you will ridicule you, and we will leave such ridicule in place.


Flutterby™ is a trademark claimed by

Dan Lyke
for the web publications at www.flutterby.com and www.flutterby.net.