https://garymarcus.substack.com/p/chatgpt-has-gone-berserk

Marcus on AI

Subscribe
Sign in
Share this post
[https]

ChatGPT has gone berserk

garymarcus.substack.com
Copy link
Facebook
Email
Note
Other

ChatGPT has gone berserk

Not a joke

[https]
Gary Marcus
Feb 21, 2024
95
Share this post
[https]

ChatGPT has gone berserk

garymarcus.substack.com
Copy link
Facebook
Email
Note
Other
 
59
 
Share

That's not a joke, it's a quote. And also a warning.

Over the last few hours, people reporting having been report a
variety of problems with ChatGPT:

 
[https]

 
[https]
more at https://x.com/promisebender/status/1760092747468595346?s=61
 
[https]
Click through to the tweet for mor. Also see this animation

Devin Morse, a philosophy PhD student has collected more examples in
this thread.

OpenAI itself has acknowledged the issue:

 
[https]

I won't speculate on the cause; we don't know. I won't speculate on
how long it will take to fix; again, we don't know.

But I will quote something I said two weeks ago: "Please, developers
and military personnel, don't let your chatbots grow up to generals."

SS

In the end, Generative AI is a kind of alchemy. People collect the
biggest pile of data they can, and (apparently, if rumors are to be
believed) tinker with the kinds of hidden prompts that I discussed a
few days ago, hoping that everything will work out right:

 
[https]

The reality, though is that these systems have never been been
stable. Nobody has ever been able to engineer safety guarantees
around then. We are still living in the age of machine learning
alchemy that xkcd captured so well in a cartoon several years ago:

 
[https]
Thank you xckd for your generous license

The need for altogether different technologies that are less opaque,
more interpretable, more maintanable, and more debuggable -- and hence
more tractable--remains paramount.

Today's issue may well be fixed quickly, but I hope it will be seen
as the wakeup call that it is.

As ever, Gary Marcus longs for trustworthy AI. There is a fun profile
of him today by Melissa Heikkila in Technology Review, along with a
terrific podcast today on Sora and society, with Jayme Poisson, at 
CBC's Frontburner.

[                    ]
Subscribe
Share

95
Share this post
[https]

ChatGPT has gone berserk

garymarcus.substack.com
Copy link
Facebook
Email
Note
Other
 
59
 
Share
59 Comments
[https]
[                    ]
Share this discussion
[https]

ChatGPT has gone berserk

garymarcus.substack.com
Copy link
Facebook
Email
Note
Other

         
        Purnima Gauthron
        18 hrs agoLiked by Gary Marcus

        Isn't ChatGPT "Intelligent" enough to fix itself? I mean if
[https] I'm drunk and shouting at the toilet I can still fix myself.

        Expand full comment
        Reply
        Share

         
        Lizz Bacon
        Lizz at Devise
        19 hrs agoLiked by Gary Marcus
 
[https] Incredible manic poetry, corporate logic-bending -- I feel
        like we see its spilled guts in this glitch.

        Expand full comment
        Reply
        Share

2 replies by Gary Marcus and others
57 more comments...
Top
New
Community

No posts

Ready for more?

[                    ]
Subscribe
(c) 2024 Gary Marcus
Privacy [?] Terms [?] Collection notice
 Start WritingGet the app
Substack is the home for great writing
This site requires JavaScript to run correctly. Please turn on
JavaScript or unblock scripts