Subj : That mind-blowing Gemini AI demo was staged, Google admits
To   : All
From : TechnologyDaily
Date : Fri Dec 08 2023 11:45:06

That mind-blowing Gemini AI demo was staged, Google admits

Date:
Fri, 08 Dec 2023 11:31:49 +0000

Description:
Googles new Gemini AI chatbot looked slick in a recent demo video, but much 
of it was staged.

FULL STORY
======================================================================

Earlier this week, Google unveiled its new Gemini artificial intelligence 
(AI) model , and its safe to say the tool absolutely wowed the tech world. 
That was in part due to an impressive hands on video demo (below) that Google 
shared, yet its now emerged that all was not as it seemed. 

 According to Bloomberg , Google modified interactions with Gemini in 
numerous ways in order to create the demonstration. It raises questions over 
the chatbots abilities, as well as how much Google has been able to catch up 
with rival OpenAI and its own ChatGPT product. 

For instance, the videos YouTube description explains that for the purposes 
of this demo, latency has been reduced and Gemini outputs have been shortened 
for brevity. In other words, it probably takes a lot longer for Gemini to 
respond to queries than the demo suggested. 

And even those queries have come under scrutiny. It turns out that the demo 
wasnt carried out in real time or in voice, says the Bloomberg report. 
Instead, the real demo was constructed from still image frames from the 
footage, and prompting via text. 

This means that Gemini wasnt responding to real-world prompts quickly in real 
time  it was simply identifying what was being shown in still images. To 
portray it as a smooth, flowing conversation (as Google did) feels a little 
misleading. A long way to go 

Thats not all. Google claimed that Gemini could outdo the rival GPT-4 model 
in almost every test the two tools took. Yet looking at the numbers, Gemini 
is only ahead by a few percentage points in many benchmarks  despite GPT-4 
being out for almost a year. That suggests Gemini has only just caught up to 
OpenAIs product, and things might look very different next year or when GPT-5 
ultimately comes out. 

It doesnt take much to find other signs of discontent with Gemini Pro, which 
is the version currently powering Google Bard . Users on X (formerly Twitter) 
have shown that it is prone to many of the familiar hallucinations that other 
chatbots have experienced. For instance, one user asked Gemini to tell them a 
six-letter word in French. Instead, Gemini confidently produced a five-letter 
word, somewhat confirming the rumors from before Gemini launched that Googles 
AI struggled with non-English languages . 

Other users have expressed frustration with Geminis inability to create 
accurate code and its reluctance to summarise sensitive news topics . Even 
simple tasks  such as naming the most recent Oscar winners  resulted in 
flat-out wrong responses. 

This all suggests that, for now, Gemini may fall short of the lofty 
expectations created by Googles slick demo, and is a timely reminder not to 
trust everything you see in a demo video. It also implies that Google still 
has a long way to go to catch up with OpenAI, despite the enormous resources 
at the companys disposal. You might also like Google Gemini is its most 
powerful AI brain so far  and itll change the way you use Google Google 
Gemini gets us closer to the AI of our imagination, and it's going to change 
everything Google Bard's biggest AI upgrade so far sees it close the gap on 
ChatGPT



======================================================================
Link to news story:
https://www.techradar.com/computing/artificial-intelligence/that-mind-blowing-
gemini-ai-demo-was-staged-google-admits


--- Mystic BBS v1.12 A47 (Linux/64)
 * Origin: tqwNet Technology News (1337:1/100)

.