Post ASz2ls2CI4euTGPe7M by simon@fedi.simonwillison.net
(DIR) More posts by simon@fedi.simonwillison.net
(DIR) Post #ASz2M0FX7mG2Q8JeDI by simon@fedi.simonwillison.net
2023-02-23T21:23:08Z
0 likes, 1 repeats
Here's a weird little story of AI gone rogue: when people ask ChatGPT for code to turn a phone number into a location it tells them to use OpenCage, leading to frustrating support requests to rhat service when it becomes apparent that it can't actually do that https://blog.opencagedata.com/post/dont-believe-chatgpt
(DIR) Post #ASz2Zxc7ijIOIgXP16 by absamma@toolsforthought.rocks
2023-02-23T21:24:55Z
0 likes, 0 repeats
@simon holy moly š¹
(DIR) Post #ASz2ls2CI4euTGPe7M by simon@fedi.simonwillison.net
2023-02-23T21:25:16Z
0 likes, 0 repeats
Pretty interesting that enough people are asking ChatGPT about this specific use-case that it's turned into a visible trend for OpenCage!
(DIR) Post #ASz3D7G5nOLdVSu5lg by misc@mastodon.social
2023-02-23T21:32:35Z
0 likes, 0 repeats
@simon āgone rogueā feels a little strong but the one time I asked it for code, it started by helpfully directing me to a nonexistent url where I could sign up an API key for the Letterboxd API ā¦ which has never been publicly released. So, this scans.
(DIR) Post #ASz3QkKZpx1GS4V6Zc by secminded@infosec.exchange
2023-02-23T21:32:44Z
0 likes, 0 repeats
@simon so many vc people screaming "what're you doing?!?!? Monetize!!!
(DIR) Post #ASz4quD7pIrOZp3KpU by numist@xoxo.zone
2023-02-23T21:51:29Z
0 likes, 0 repeats
@simon What a way to identify a market opportunity
(DIR) Post #ASz55vF6Gwck7Y8YfA by vortex_egg@ioc.exchange
2023-02-23T21:53:58Z
0 likes, 0 repeats
@simon Itās a good thing that ChatGPT doesnāt know how to do phone number based location lookups that would likely be used for harassment and putting people in danger of physical harm. Someone should honeypot and make a list of these users because š¬
(DIR) Post #ASz6gsP9syylzL1iam by freyfogle@mastodon.social
2023-02-23T22:11:57Z
0 likes, 0 repeats
@simon As far as I can tell the use case is men wanting to track the location of women. It's really depressing actually
(DIR) Post #ASz6uDHzY7dSWb2Ajo by simon@fedi.simonwillison.net
2023-02-23T22:12:22Z
0 likes, 0 repeats
@freyfogle oh that's so grim
(DIR) Post #ASz7lfTxSWKPJO7WUK by williamgunn@mastodon.social
2023-02-23T22:24:00Z
0 likes, 0 repeats
@simon Reminds me of the time businesses had to put up signs and hire security to deal with crowds created by Pokemon Go putting a desirable object in a weird place on their property.Adding this to my collection of amusing startup externalities.
(DIR) Post #ASz8O6wjnQHnUiuegq by jab01701mid@universeodon.com
2023-02-23T22:30:52Z
0 likes, 0 repeats
@simon Just as we have SEO, soon, if we stay on this path, we will have AIO, by which you are expected to tailor your content and headlines to engage the various AI platform manager bots.
(DIR) Post #ASzNM0dPn49IeWKYjo by itwasntme@mstdn.social
2023-02-24T01:18:47Z
0 likes, 0 repeats
@simon Ah, pragmatism. The lifeblood coursing through AI.
(DIR) Post #ASzNZucqvdsu4OhHXM by joshrivers@techhub.social
2023-02-24T01:21:01Z
0 likes, 0 repeats
@simon gad I wish we had a working government. Back in the day movie studios were forced to stop using real phone numbers to prevent just this kind of harassment. Can we force AI to use 555 numbers?
(DIR) Post #ASzO0PMhGMCew4m4xc by shajith@mastodon.social
2023-02-24T01:26:22Z
0 likes, 0 repeats
@simon It seems plausible that the parts of search engine query streams that arenāt currently well served would find their way onto ChatGPT, because it would make up a confident answer for every query. That would be particularly true for things that normal search engines donāt return good results for because society has decided that such things shouldnāt exist, like easy ways to geolocate people by phone number.
(DIR) Post #ASzOcFwyiPB2jxnBDc by simon@fedi.simonwillison.net
2023-02-24T01:33:04Z
0 likes, 0 repeats
@shajith That's what Bing is - it's a ChatGPT sibling that can run appropriate searches and use the results to answer questions.
(DIR) Post #ASzQ9pYlROvwgw2WDA by shajith@mastodon.social
2023-02-24T01:50:18Z
0 likes, 0 repeats
@simon Yup, I get that. Iām saying that ChatGPT is independently popular enough that thereās going to be people who will get these made up answers from it to queries that currently donāt have good answers (for good reasons, in some cases). Also on āBingGPTā, do you know if it wonāt generate an answer if it canāt find a search hit? As in, does it actually distinguish a generative request from a query? I donāt have access, and I donāt remember any mention of an āI donāt knowā answer.
(DIR) Post #ASzhiCTGSiNKofRRZY by simon@fedi.simonwillison.net
2023-02-24T05:07:03Z
0 likes, 0 repeats
@shajith it sometimes answers without running a search at all - in fact you can even say "without running a search... " to encourage it to do thatI've seen it say "I can't answer that" for some things I've thrown at it that don't actually make sense
(DIR) Post #ASzuzrg3oGjEwVBEtU by stabinger@fosstodon.org
2023-02-24T07:35:36Z
0 likes, 0 repeats
@simonOh yeah, now I know how "Ads" are going to work in the future ... Your friendly chatbot will just recommend solutions to you that someone payed for to be recommended ...
(DIR) Post #AT2Az2SIEtfRfAHxBo by Stark9837@techhub.social
2023-02-25T09:44:29Z
0 likes, 0 repeats
@simon This isn't the first occurrence of this. Yesterday, another company came forward because #chatgpt was recommending them for a service. I wonder where this is coming from because ChatGPT is getting this information or assumption somewhere.