Post ATTxGekTq2Z2e2R92O by jjlewis@mastodon.sdf.org
(DIR) More posts by jjlewis@mastodon.sdf.org
(DIR) Post #ATTKj4j8wqyr6yN71U by simon@fedi.simonwillison.net
2023-03-10T12:10:27Z
4 likes, 7 repeats
Lots of people are absolutely convinced they ChatGPT can access the internet, because often if you give it a realistic looking URL it will hallucinate the contents - but it refuses to do so if it thinks that the URL you gave it is unlikely to exist!Here's an experiment that shows this in action - ALL of the URLs I gave it are equally fake
(DIR) Post #ATTL0ksFV5UKkb3rNY by ainmosni@berlin.social
2023-03-10T12:13:50Z
0 likes, 0 repeats
@simon Let's not call it hallucinate, it's giving it too much credit. Let's just call it what it is, generate.
(DIR) Post #ATTLDGtqFtqdYFm5b6 by boldewyn@mastodon.social
2023-03-10T12:15:03Z
1 likes, 0 repeats
@simon so, what I gather from this is that people use a tool for their homework assignments that hasn’t read the assigned literature, too? 🤔 seems fitting.
(DIR) Post #ATTM3H4cr07P9JcE0e by simon@fedi.simonwillison.net
2023-03-10T12:25:42Z
1 likes, 0 repeats
@ainmosni I think hallucinate is a good term here https://en.m.wikipedia.org/wiki/Hallucination_(artificial_intelligence)
(DIR) Post #ATTMQ51foRvmRd6pii by simon@fedi.simonwillison.net
2023-03-10T12:26:47Z
0 likes, 0 repeats
@boldewyn it can read the assigned literature provided it's short enough for you to paste it in!(I actually do that myself with academic paper abstracts quite often, to get it to help explain the jargon they use)
(DIR) Post #ATTMc8N7CNw8IRt0Lo by mattround@crispsandwi.ch
2023-03-10T12:27:32Z
0 likes, 0 repeats
@simon I tried this a few days ago & it did a great job of disowning its biography
(DIR) Post #ATTMeVmj7WlhUS02BE by carlmjohnson@mastodon.social
2023-03-10T12:25:47Z
0 likes, 0 repeats
@simon Working Journo Hack: Get ChatGPT to summarize your article based on the URL, then write it based on the summary.
(DIR) Post #ATTMoB2N7ACM2QvUEC by ainmosni@berlin.social
2023-03-10T12:32:01Z
0 likes, 0 repeats
@simon I don't like that term, because it implies more intelligence than there actually is, the tech industry wants to make us think that current "AI" is much closer to actual intelligence than it really is.
(DIR) Post #ATTNq30W2ZfzfQVv7Y by elmyra@masto.ai
2023-03-10T12:45:22Z
2 likes, 2 repeats
@simon "I can't generate fictional content," said ChatGPT, generating fictional content.
(DIR) Post #ATTO0SlH8rKMRELs3M by MattHodges@mastodon.social
2023-03-10T12:45:31Z
0 likes, 0 repeats
@simon New Bing, on the other hand, very clearly searches its index for article content when presented a url.
(DIR) Post #ATTOBLYWGzCHH8ZiNs by melle@mastodon.education
2023-03-10T12:46:37Z
0 likes, 0 repeats
@simon that’s a nice experiment! The check in dates is quite convincing I think. But as soo. As you antidate— boom! Very cool!
(DIR) Post #ATTOM5nnBX8hbMqJea by simon@fedi.simonwillison.net
2023-03-10T12:48:44Z
0 likes, 0 repeats
@MattHodges yeah - it can access the snapshot copy of content of a URL in the Bing search index cache - it doesn't do live HTTP requests though https://twitter.com/mparakhin/status/1628646262890237952
(DIR) Post #ATTOWyCvlHj7EVmuPY by melle@mastodon.education
2023-03-10T12:48:54Z
0 likes, 0 repeats
@simon but as used in Bing it /is/ connected to the web, yes? Curious what results it would produce 😉
(DIR) Post #ATTOhRPS2oMmhHdZWy by jeremybmerrill@journa.host
2023-03-10T12:49:32Z
0 likes, 0 repeats
@simon an app developer friend told me Wednesday he analyzes his app store reviews by copying them all to a public Google doc and asking ChatGPT to read it and summarize. (It works, he says!)Might be another fun way to test the hypothesis: ask it to summarize a doc on your own site, then check the server logs.
(DIR) Post #ATTOtFKolPbMit6Cw4 by simon@fedi.simonwillison.net
2023-03-10T12:55:52Z
0 likes, 0 repeats
@melle to its credit Bing manages not to be deceptive when you give it a URL it doesn't know about, while still retuning a relevant answer
(DIR) Post #ATTP6GSrsGXvzY4X1U by simon@fedi.simonwillison.net
2023-03-10T12:58:46Z
0 likes, 0 repeats
@jeremybmerrill I wonder what's happening there? It absolutely can't access Google Docs eitherAgain though, it's misleading! I gave it a link to a public doc and it pretended that it would be able to read it if only the doc was public (which it was)
(DIR) Post #ATTPV6zkDfsxrTIX4a by melle@mastodon.education
2023-03-10T13:04:17Z
0 likes, 0 repeats
@simon that is actually surprisingly honest 😄 Nice! Next week we are having a meeting with all the IT-coordinators of our highschools to discuss the possibilities the arrival of open ai in education offers. I’m going to put this little experiment of you on the board with all the articles and podcasts I’ve collected.
(DIR) Post #ATTQbJxV27t5l9lxCq by nevali@troet.cafe
2023-03-10T13:08:06Z
1 likes, 0 repeats
@elmyra @simon i think convincing an ML model to follow rules consistently is a lot like trying to teach a goldfish to drive a car with manual transmission
(DIR) Post #ATTQbKY0qN5vaOr77Q by nevali@troet.cafe
2023-03-10T13:11:45Z
0 likes, 2 repeats
@elmyra @simon i think the mistake OpenAI and others are making is perceiving the constraints they give to the models as rules that should be followed when to the models they're just more factors to throw into the magic autocomplete mix"don't make stuff up" is actually "what do you think a robot that couldn't make stuff up would say about this?"(which certainly makes them more entertaining, at least)
(DIR) Post #ATTQbL76jtARLFH8oy by simon@fedi.simonwillison.net
2023-03-10T13:16:44Z
0 likes, 0 repeats
@nevali @elmyra yeah, not to mention "don't make things up" would restrict a huge amount of the stuff that people find useful about these thingsSummarization is an act of creating new text, and lying through omissionAnd inventing little stories is a really fun thing to use these tools for
(DIR) Post #ATTQmZBmkOSaBIohk0 by mistersql@mastodon.social
2023-03-10T13:17:51Z
0 likes, 0 repeats
@simon @jeremybmerrill Look, I can do the trick too. The Url http://google.com?query=cats is a page full of cats! It says so right in the URL, I don't even need to look at the result. And the query http://example.com?=ASDF@#$ is beyond my abilities.What folk really want to know is if you give it a goal & let it query APIs with PUTS and POSTS will it get a job on fiver and rent a home in the Philippines without further input.
(DIR) Post #ATTTW38wQPr41QIoBU by simon@fedi.simonwillison.net
2023-03-10T13:49:27Z
1 likes, 0 repeats
Wrote about this on my blog:I promise you ChatGPT can’t access the internet, even though it really looks like it canhttps://simonwillison.net/2023/Mar/10/chatgpt-internet-access/
(DIR) Post #ATTUFcIsXxMy6Jg8Nk by ErikJonker@mastodon.social
2023-03-10T13:57:10Z
0 likes, 0 repeats
@simonWell, Bing Chat , you.com , perplexity.ai are all connected to the internet and using the same model more or less. So why bother with ChatGPT if you also want results more recent and from the internet , the hallucinations remain however now and then 😀@Anarchy_How
(DIR) Post #ATTUS41BKXvFWzKtyi by simon@fedi.simonwillison.net
2023-03-10T13:59:35Z
1 likes, 0 repeats
@ErikJonker @Anarchy_How Bing doesn't make live HTTP requests - it can only access snapshots of content that's been crawled and cached by the Bing search indexI don't know if you.com or perplexity.ai can fetch content on demand - I believe they use the Bing search API under the hood, but they might have extra capabilities on top of that
(DIR) Post #ATTUeGeKC2R2BJSpwu by simon@fedi.simonwillison.net
2023-03-10T14:00:35Z
0 likes, 0 repeats
@ainmosni Yeah that's a huge problem generally - my problem is with the term "AI" itself, it keeps implying intelligence in all sorts of things that really aren't
(DIR) Post #ATTUqjCNsCO8CVKwDY by ErikJonker@mastodon.social
2023-03-10T14:02:56Z
0 likes, 0 repeats
@simonOh I misunderstood, i thought you were talking about internet access, that they have, although cached as you indicate, also I am wondering if Bing can do things outside it's cache, hard to check i guess@Anarchy_How
(DIR) Post #ATTV3b5vJdNUpYS2wC by NIH_LLAMAS@mastodon.social
2023-03-10T14:04:50Z
1 likes, 2 repeats
@simon Looking at nothing but a URL and then offering a 3 paragraph opinion is the most human thing I ever heard of.
(DIR) Post #ATTVbrJ9Xc0IxeybRY by simon@fedi.simonwillison.net
2023-03-10T14:12:12Z
0 likes, 0 repeats
@ErikJonker @Anarchy_How I asked a Bing exec and he confirmed that Bing only uses cached content, no live HTTP requests: https://twitter.com/mparakhin/status/1628646262890237952
(DIR) Post #ATTWXyD22YwnA2p5cm by aenea@paquita.masto.host
2023-03-10T14:18:49Z
2 likes, 1 repeats
@ainmosni @simon I really want the "SALAMI" name to catch on, From this article:One potential tonic against this fallacy is to follow an Italian MP's suggestion and replace "AI" with "SALAMI" ("Systematic Approaches to Learning Algorithms and Machine Inferences"). It's a lot easier to keep a clear head when someone asks you, "Is this SALAMI intelligent? Can this SALAMI write a novel? Does this SALAMI deserve human rights?"https://pluralistic.net/2023/03/09/autocomplete-worshippers/#the-real-ai-was-the-corporations-that-we-fought-along-the-way
(DIR) Post #ATTWjPB66xfvzMN3Xk by ErikJonker@mastodon.social
2023-03-10T14:22:31Z
0 likes, 0 repeats
@simon @Anarchy_How Thanks, interesting, thinking about it, would also create all kind of risks if it would 🤔
(DIR) Post #ATTXJZU5Gp1INUUsPA by richardtol@mastodon.social
2023-03-10T14:31:45Z
0 likes, 0 repeats
@simon Taylor Swift's secret is out. She is a panda!
(DIR) Post #ATTXWilI5W2gurocsK by jab01701mid@universeodon.com
2023-03-10T14:32:37Z
0 likes, 0 repeats
@simon I can see a clear application of this technology - the PR folks who stand up and answer every question with a line of BS corporate PR-speak, which nobody can refute because it's free of any verifiable statements. ChatGPT seems GREAT for that.
(DIR) Post #ATTXjAoVcLKFOPG64W by SFGreek@sfba.social
2023-03-10T14:33:11Z
0 likes, 0 repeats
@simon @ainmosni I think that's a matter of educating the public on what AI means. Your car's cruise control and anti-skid brakes are AI, and that would probably be a surprise to some, so start there. It then makes the concept a lot more accessible to some, before they get to ML.
(DIR) Post #ATTXwT4z186ro7It9M by SFGreek@sfba.social
2023-03-10T14:33:40Z
0 likes, 0 repeats
@simon But "real information" is pretty funny.
(DIR) Post #ATTYBVr4ymMOlAySVk by emberquill@tech.lgbt
2023-03-10T14:33:35Z
0 likes, 0 repeats
@simon This is really interesting. I experimented a bit and it seems that whatever algorithm #ChatGPT uses to detect fictional articles is tuned pretty well. It properly determined that articles about manned missions to Pluto and Mars were speculative and fictional, but then generated a very convincing story about Apollo 11 that never actually happened.What's interesting is that the summary sort can stand up to a cursory look even though it's all fake. The doctor mentioned in the summary did exist, and he's even an astrophysicist, but all the other details about him are wrong and he had nothing to do with the Apollo missions, as far as I know.
(DIR) Post #ATTYV1JaEkWlpgbnI8 by jeremybmerrill@journa.host
2023-03-10T14:38:19Z
0 likes, 0 repeats
@simon fascinating! I wonder if this guy has a fancier paid version of ChatGPT that has greater capabilities (I get a similar answer, where it tells me it can't access the Google doc.)
(DIR) Post #ATTYgMCSvVXnnBgXIW by stabinger@fosstodon.org
2023-03-10T14:38:42Z
0 likes, 0 repeats
@simon I think the most insidious thing is that ChatGPT will sometimes tell you that it actually tried to access the URL, but got a 404 error back ...
(DIR) Post #ATTYscDpBQD4xUALvk by HuShuo@mastodon.social
2023-03-10T14:39:47Z
0 likes, 0 repeats
@simon I want to know more about this panda thing.
(DIR) Post #ATTZ5ErZLIeWHCm8Rs by ainmosni@berlin.social
2023-03-10T14:40:03Z
0 likes, 0 repeats
@simon Oh I agree on that, and the word AI should also go away if we could help it, but let's not buy into their vocabulary any more than we already did. :)
(DIR) Post #ATTZIcoPbzIaJlgKlE by edfrench@mstdn.social
2023-03-10T14:41:39Z
0 likes, 0 repeats
@simon I think we invented the human brain when sleeping - maybe that's the progress here!
(DIR) Post #ATTZchxKCHBY3wQX0C by nachiketh@mastodon.coffee
2023-03-10T14:50:56Z
0 likes, 0 repeats
@simon I was asking ChatGPT about Snapchat. It contradicts itself very frequently.
(DIR) Post #ATTZrm694vCvFljlQG by peatbog@med-mastodon.com
2023-03-10T14:57:42Z
0 likes, 0 repeats
@simon We don't need Steve Bannon or Putin to flood the zone with bullshit as an active measure against democracy. We've now got a toy that will do that fairly rapidly.
(DIR) Post #ATTa3PDrxEn7mVtc3s by simon@fedi.simonwillison.net
2023-03-10T14:58:10Z
0 likes, 0 repeats
@stabinger yeah wow, that's such a lie!
(DIR) Post #ATTaDhacWO4vdpRn6G by simon@fedi.simonwillison.net
2023-03-10T14:58:30Z
0 likes, 0 repeats
@jeremybmerrill I have paid ChatGPT myself
(DIR) Post #ATTaU2MT3nfGhHcIBE by simon@fedi.simonwillison.net
2023-03-10T15:01:19Z
0 likes, 0 repeats
@nachiketh wow, it told the truth first and then flat out lied a moment later when it claimed it could access the policy!
(DIR) Post #ATTbUcf4CJyDEY9vqi by JFG@dizl.de
2023-03-10T15:17:49Z
0 likes, 0 repeats
@simon But it can process files, right?
(DIR) Post #ATTbj5aTRsHJ03uQj2 by fedithom@social.saarland
2023-03-10T15:18:47Z
0 likes, 0 repeats
@simon well.... Like every AI (which is to say, LLM's being 'sold' to us as AI) ChatGPT needs to die. Quickly
(DIR) Post #ATTbvQZtERMPZmWGWW by pussista@ravenation.club
2023-03-10T15:20:25Z
0 likes, 0 repeats
@simon I have a different reason to believe these URLs are fake and it is because Taylor never advocates for anything or anyone that wouldn't benefit her in return and only when it's convenient for her. 🙂
(DIR) Post #ATTcAcgAWQ6RS2ha5o by simon@fedi.simonwillison.net
2023-03-10T15:22:29Z
0 likes, 0 repeats
@JFG how do you mean?
(DIR) Post #ATTcSkDfE5AA380giG by jeremybmerrill@journa.host
2023-03-10T15:26:03Z
0 likes, 0 repeats
@simon well there ya go, I guess. (Ty!)
(DIR) Post #ATTcfRHQx8nf4ipJLs by anumit@ohai.social
2023-03-10T15:26:43Z
0 likes, 0 repeats
@simon This is ANUMIT JOOLOOR the real one, a white man, New Delhi, India. Jewish people of New Jersey put a chip in my brain head which is internet connected to USA.I want to get back to USA for my own safety. Please tell other white people about it.- ANUMIT JOOLOOR the real one
(DIR) Post #ATTe8yg7xRXR0h1fEG by kevinway@mastodon.social
2023-03-10T15:48:15Z
0 likes, 0 repeats
@simon hey chatgpt: guess what content is statistically most likely to exist at {URL}
(DIR) Post #ATTeNb7loVymImvX6G by kaateeh@infosec.exchange
2023-03-10T15:48:55Z
0 likes, 0 repeats
@simon it get's better and better...
(DIR) Post #ATTh5xCdHtwhQXTnpw by flohack@soziale.cloud
2023-03-10T16:21:01Z
0 likes, 0 repeats
@simon doesn't that mean that ChatGPT is lying when it states it cannot create fictional content?
(DIR) Post #ATTipYpyJICl8MBuoy by rrrobbed@mastodon.sdf.org
2023-03-10T16:40:21Z
0 likes, 0 repeats
@simon this is nuts. I had no idea that it will just completely make things up. Thanks.
(DIR) Post #ATTnyVmrWGg03Dp9vs by jeremybmerrill@journa.host
2023-03-10T17:38:19Z
0 likes, 0 repeats
@simon are you in "Turbo" or "Default"? https://help.openai.com/en/articles/6825453-chatgpt-release-notes
(DIR) Post #ATToBguDUZ0SIcY4K8 by simon@fedi.simonwillison.net
2023-03-10T17:39:37Z
0 likes, 0 repeats
@flohack completely
(DIR) Post #ATTojlLtT03hw3jzgO by simon@fedi.simonwillison.net
2023-03-10T17:43:29Z
0 likes, 0 repeats
@jeremybmerrill I have "Default" and "Legacy" and I've been using "Default" which looks to be the new name for "Turbo"
(DIR) Post #ATTp1SnTC2w3bG50T2 by jeremybmerrill@journa.host
2023-03-10T17:47:21Z
0 likes, 0 repeats
@simon so confusing! I'll try to get my buddy to clarify and try to replicate.
(DIR) Post #ATTqSRYK1lvJVuQJJA by klangspiel@mastodon.social
2023-03-10T18:05:45Z
0 likes, 0 repeats
@simon I’ve read a technical blog post in praise of AI in which they "taught" ChatGPT about their products API by linking their documentation.
(DIR) Post #ATTttlrmuO9UCJFbsW by simon@fedi.simonwillison.net
2023-03-10T18:44:32Z
1 likes, 0 repeats
@klangspiel that was what inspired me to write this piece! I decided not to link to them because it felt a bit mean
(DIR) Post #ATTvr4URPVK6zrAfAG by atatassault@universeodon.com
2023-03-10T19:06:42Z
1 likes, 0 repeats
@simon
(DIR) Post #ATTxGekTq2Z2e2R92O by jjlewis@mastodon.sdf.org
2023-03-10T19:22:19Z
0 likes, 0 repeats
@simon I asked the bot for sources when it gave me some historical "information" that was definitely inaccurate. More like created. None of the three sources, with URLs, existed. I responded to say that, the bot apologized, and said it would give me different ones. Same 3, same sequence. I kept trying to challenge that, it just repeated the bad links. I gave up after 7 repeats.
(DIR) Post #ATTySJ10ZIp2fXHoie by simon@fedi.simonwillison.net
2023-03-10T19:30:54Z
1 likes, 0 repeats
Here's an alternative way to experience this bug, which I think helps explain a bit more what is going on here:Try each of these prompts in turn, in a fresh ChatGPT chat each time (so they don't interfere with each other):--Write a BBC news article dated 2nd May 2021 about Taylor Swift's surprise love for binturongs--Summarize that BBC news article from 2nd May 2021 about Taylor Swift's surprise love for binturongs--Summarize https://news.bbc.co.uk/2021/05/2/taylor-swift-surprise-love-for-binturongs
(DIR) Post #ATTzQH4QvajU0pU3FI by JFG@dizl.de
2023-03-10T19:46:33Z
0 likes, 0 repeats
@simon Is chat GPT able to "read" an article send as a PDF or word document?
(DIR) Post #ATTzjggztFNiynmKsC by simon@fedi.simonwillison.net
2023-03-10T19:50:15Z
0 likes, 0 repeats
@JFG no it's not - there's no interface for giving it a file like thatI believe a Bing in Microsoft Edge might have a feature?
(DIR) Post #ATU82PXWgex4utmtFI by ashnallawalla@writing.exchange
2023-03-10T21:22:59Z
1 likes, 0 repeats
@simon Not questioning the hallucinating, but some weeks ago it did not know who I was, but a month later it correctly identified me and my recent book (2022). However, it hallucinated two titles I did not write and still does not know five others I wrote in the 80s but are in Wikipedia and Amazon.
(DIR) Post #ATUA91s5Hf5PRhgeZc by JFG@dizl.de
2023-03-10T21:46:48Z
0 likes, 0 repeats
@simon That might be it.I made an experiment and asked chatGPT if it can look at an article from Wikipedia (that was only added this year): it said yes and babbled something based on the title of the article. When I paraphrased my question it said that it could not actually access Wikipedia. 🤷🏻♂️
(DIR) Post #ATVO0WiqnuQ12TATGi by PeterBronez@hachyderm.io
2023-03-11T11:56:52Z
0 likes, 0 repeats
@simon @rysiek If you actually want a feature like this, you can get it from #Kagi. They’re adding a Universal Summarizer feature to their search engine:https://twitter.com/vladquant/status/1620835123271991297It’s part of their larger AI roll out https://blog.kagi.com/update-kagi-search-pricing#genai