AI-powered Bing made several errors in its demo

Unveiled on 7 February by chief executive Satya Nadella, the new Bing uses Generative Pre-trained Transformer 3 (GPT-3) and promises ChatGPT-like experiences to users within the search.

At the unveiling event, Yusuf Mehdi, consumer chief marketing officer, also gave a demo of how the new Bing will handle searches and answer user queries.

It made several mistakes during the demo, much worse than Google’s Bard mistake,” said Brereton in a Twitter post. He also claimed that Bing AI erred again while summarizing a financial document and got most of the numbers wrong.

It’s important to note that last week we announced a preview of this new experience. We’re expecting that the system may make mistakes during this preview period, and user feedback is critical to help identify where things aren’t working well so we can learn and help the models get better. We are committed to improving the quality of this experience over time and to make it a helpful and inclusive tool for everyone,” said a Microsoft spokesperson.

Brereton has also published a blog post summarizing all the errors made by the new Bing during the demo.

Bing AI did a great job of creating media hype, but their product is no better than Google’s Bard. At least as far as we can tell from the limited information we have about both, said Brereton in the blog post.

AI-powered Bing isn’t the only transformer-based search and chat platform that has made errors in its demo. Last week, Google unveiled its AI chatbot Bard, based on Language Model for Dialogue Applications (LaMDA), which made an error during the demo. Bard claimed in the demo that the James Webb Space Telescope was the first to take pictures of a planet outside of Earth’s solar system, which was immediately flagged as inaccurate by space experts.

Google parent Alphabet’s shares fell 7.7% last week wiping $100 billion off its market value after the error by Bard was detected and reported by Reuters.