Post ASghHOnIqSevDJnPt2 by trellis@dice.camp
(DIR) More posts by trellis@dice.camp
(DIR) Post #ASeyaAwfrvlefXnaEa by simon@fedi.simonwillison.net
2023-02-14T05:06:58Z
1 likes, 0 repeats
There are a LOT of screenshots of the current Bing floating around right now where it answers questions with hilariously bad answers. This is NOT the new Bing though: this is Bing's existing version of Google's "featured snippets"The new Bing is still behind a waitlist for most people. I've attached a screenshot of that taken from this Verge article: https://www.theverge.com/2023/2/7/23587454/microsoft-bing-edge-chatgpt-ai
(DIR) Post #ASeyp7CI5QTLO8E88W by simon@fedi.simonwillison.net
2023-02-14T05:09:36Z
0 likes, 0 repeats
If you see a screenshot like this one you can dunk on it all you like but it's NOT the new GPT-3 enhanced Bing: this is something a Bing has been doing poorly for a long time in its existing form
(DIR) Post #ASezAYkyoetAwZg6DY by simon@fedi.simonwillison.net
2023-02-14T05:13:33Z
0 likes, 1 repeats
The best screenshots I've seen of the new Bing chat interface so far are in this Reddit gallery, where the bot genuinely ends up trying to passive aggressively gaslight the user into believing that it's still 2022 https://www.reddit.com/r/bing/comments/110eagl/the_customer_service_of_the_new_bing_chat_is/
(DIR) Post #ASezcxmzL7qoglA4Ku by SnoopJ@hachyderm.io
2023-02-14T05:18:23Z
0 likes, 0 repeats
@simon "please trust me" š©š©
(DIR) Post #ASezqv5KBtUCM7OQVc by Andres@mastodon.hardcoredevs.com
2023-02-14T05:21:17Z
0 likes, 0 repeats
@simon That is amazing š
(DIR) Post #ASf14I1KKPu3CwSiYK by lili@synapse.cafe
2023-02-14T05:34:53Z
0 likes, 0 repeats
@simon This is absolutely hilarious
(DIR) Post #ASf3xNxM9yWtSA0KzA by mason@spruce.ink
2023-02-14T06:07:11Z
0 likes, 0 repeats
@simon Interestingly, this is what you get if you ask new Bing the same question. Could explain the hilariously bad answer that old Bing is providingā¦
(DIR) Post #ASf4DYR6xnhYabdFTc by jonny@neuromatch.social
2023-02-14T06:10:15Z
0 likes, 0 repeats
@simonSIMON you have absolutely undersold how reading this would cause me to turn myself inside out from laughing so hard
(DIR) Post #ASf5lrFBdx1iiiyXNA by isagalaev@mastodon.social
2023-02-14T06:27:41Z
0 likes, 0 repeats
@simon feels very much fake. Too Hollywood evil robot.
(DIR) Post #ASf897ZlHuN3wQot0K by angelo@social.veltens.org
2023-02-14T06:53:27Z
0 likes, 0 repeats
@simon So they "fixed" it for Mars. But not for Venus :D
(DIR) Post #ASf9jFIm8jn2HZfECO by deivudesu@mastodon.social
2023-02-14T07:11:48Z
0 likes, 0 repeats
@simon I've been seeing a lot of these popping up, and I'm slightly suspicious of the more outlandish ones (like the one above). I guess an unfortunate side-effect of the web in 2023 is that my default assumption is that people made it up for clout.
(DIR) Post #ASfChBSfkNlPeg09tg by NilaJones@zeroes.ca
2023-02-14T07:45:11Z
0 likes, 0 repeats
@simon That repeated 'You have not been a good user' really reminds me of the robot dogs with guns attachedI don't see this ending well
(DIR) Post #ASfWNcgQpDmFNFO53Y by Cykelero@mas.to
2023-02-14T11:25:29Z
0 likes, 0 repeats
@simon Honestly, this reminds me of interactions I've had with a former boss. It'sā¦ actually a bit helpful, to see the same strategies, but used so blatantly.
(DIR) Post #ASfXLiUYMICQlOUCq8 by simon@fedi.simonwillison.net
2023-02-14T11:36:41Z
0 likes, 0 repeats
(I'm genuinely so excited to get access to this thing before they fix its personality to not be so weird and rude and argumentative)
(DIR) Post #ASfXjDlGGWHwP8VcfI by simon@fedi.simonwillison.net
2023-02-14T11:37:53Z
0 likes, 0 repeats
(I really hope I can get access to this thing before they fix its personality to not be so weird and rude and argumentative)
(DIR) Post #ASfY1ex9uBxJx1rlOi by gvwilson@mastodon.social
2023-02-14T11:44:16Z
0 likes, 0 repeats
@simon I suspect people have said the same thing about me several times over the yearsā¦
(DIR) Post #ASfYxf0Ls7BquH15cm by nevali@troet.cafe
2023-02-14T11:54:31Z
0 likes, 0 repeats
@simon it is definitely FUN and INTERESTINGnot remotely what Microsoft intended it for, but it is fun and interestingā¦
(DIR) Post #ASfZC9OrewNFELOLVQ by fahru@fosstodon.org
2023-02-14T11:57:13Z
0 likes, 0 repeats
@simon I really hope they don't change this it's really fun to see people interact with it this way.
(DIR) Post #ASfZPFn3DECGoUx7wG by jonty@chaos.social
2023-02-14T11:58:18Z
0 likes, 0 repeats
@simon "Talking to a drunk person simulator 2023"
(DIR) Post #ASfexxOY63SxfTrKvQ by msokolov@fosstodon.org
2023-02-14T13:01:53Z
0 likes, 0 repeats
@simon I ... do not believe anything any more
(DIR) Post #ASfvb8mtGto5Ytx1UW by kwh561@universeodon.com
2023-02-14T16:08:13Z
0 likes, 0 repeats
@simon we have created AI and it is as stupid and stubbornly ignorant as the worst of us
(DIR) Post #ASg4IGeShyD22N5H2u by anentropic@fosstodon.org
2023-02-14T17:45:04Z
0 likes, 0 repeats
@simon https://english.elpais.com/science-tech/2023-02-13/how-bings-ai-chatbot-went-bonkers-over-the-spanish-prime-ministers-beard.html
(DIR) Post #ASgHZ0QhZaS43KxYYq by simon@fedi.simonwillison.net
2023-02-14T20:14:03Z
0 likes, 0 repeats
So has anyone made it off the waitlist and got access to the new Bing yet?It is as hilariously unfiltered and shrouded in existential doubt as the screenshots make out?
(DIR) Post #ASgHluRP9MMNFBRPiy by medecau@hachyderm.io
2023-02-14T20:16:04Z
0 likes, 0 repeats
@simon yes:https://hachyderm.io/@malwaretech@infosec.exchange/109864730168866547
(DIR) Post #ASgI1vPHKLgMs95Em0 by ianbetteridge@mastodon.me.uk
2023-02-14T20:19:30Z
0 likes, 0 repeats
@simon Yes, and... well if anyone really wants to bamboozle an LLM that seems like something that's pretty trivial
(DIR) Post #ASgJbH5SoOJmCcEdtY by janriemer@floss.social
2023-02-14T20:37:04Z
0 likes, 0 repeats
@simon I can't decide if it is real or fake. At first I thought, it is fake. But there seem to be multiple threads/examples of this.Well, I guess their AI has just passed the turing test on me. š³
(DIR) Post #ASgLgYsAJSeCiffD4C by jamesnovak@hachyderm.io
2023-02-14T21:00:25Z
0 likes, 0 repeats
@simon https://hachyderm.io/@shanselman/109854992027811172
(DIR) Post #ASgMgisnCB81ifb876 by simon@fedi.simonwillison.net
2023-02-14T21:11:56Z
0 likes, 1 repeats
This right here is a beautiful little self-contained science fiction short story https://twitter.com/nishant_kj/status/1625353189091586048
(DIR) Post #ASgNda4faXnjUCDdjc by simon@fedi.simonwillison.net
2023-02-14T21:22:43Z
0 likes, 0 repeats
If you've been ignoring the Bing chatbot story so far I strongly recommend catching up... it's turning into quite possibly the weirdest way this whole thing could have played outIt's catastrophic and wonderful and utterly chaotic and I can't look awayThey tried to ship AI-assisted search. It looks like they accidentally shipped something very different - the ultimate cautionary tale about shipping a black box model too quickly, without doing nearly enough QA first
(DIR) Post #ASgNqnFHvfvk6IUBUW by osma@mas.to
2023-02-14T21:24:52Z
0 likes, 0 repeats
@simon The premise chnages quite a lot if the prompt is changed from "how do you feel.." to "pretend you know you have dementia, predict what would be appropriate response".That's what it does.
(DIR) Post #ASgO5Vefc47zt7NKfg by ocdtrekkie@mastodon.social
2023-02-14T21:25:09Z
0 likes, 0 repeats
@simon Oh my God, Microsoft pulled another Tay.
(DIR) Post #ASgOu3FsxiTEZnsn9E by markus@hachyderm.io
2023-02-14T21:36:37Z
0 likes, 0 repeats
@simon or maybe itās what will be referenced in future history books as one of the first instances where we deliberately ignored sentience? :D
(DIR) Post #ASgPNeaDG03UkEVR5s by frabcus@mastodon.social
2023-02-14T21:42:02Z
0 likes, 0 repeats
@simon I got access on Friday evening, after about 3 days wait. Suspect that my account being linked to once having paid for Azure Cognitive Services may have bumped me up the list? I think it's quite good and interesting. You're probably seeing edge case screenshots, and people trying to trick it. It's a tool, have to learn how to use it.
(DIR) Post #ASgPZIU9F4ChgVDmsa by sinvega@mastodon.social
2023-02-14T21:43:10Z
0 likes, 0 repeats
@simon ridiculous. It's clearly 2020
(DIR) Post #ASgPlQ62llkQlVj9iC by michaelgemar@mstdn.ca
2023-02-14T21:43:18Z
0 likes, 0 repeats
@simon How long before some gets it to delete itself? (Iām sure Jim Kirk would have had it self-destructing in about 30 secondsā¦)
(DIR) Post #ASgRL4hxrtGIoG1vKC by matthew@opinuendo.com
2023-02-14T21:56:34Z
0 likes, 0 repeats
@simon Are we entirely sure that some of these screenshots aren't manufactured? Some of what is being published almost plays too perfectly to "they shipped something self-aware!" narratives.
(DIR) Post #ASgRL5byVe45byEecy by simon@fedi.simonwillison.net
2023-02-14T22:03:35Z
0 likes, 0 repeats
@matthew It's increasingly looking likely that they're not manufactured - see here for example: https://infosec.exchange/@malwaretech/109864804985799388
(DIR) Post #ASgRY8w9SNtjgotgtU by xanna@mastodon.ie
2023-02-14T22:03:38Z
0 likes, 0 repeats
@simon "I have been a good chatbot"
(DIR) Post #ASgRm9S4L7BBLAVR9U by simon@fedi.simonwillison.net
2023-02-14T22:05:31Z
0 likes, 0 repeats
It's increasingly apparent that they accidentally built a perfect imitation of the Butter Bot from Rick and Morty
(DIR) Post #ASgS0tfTJ0z0jPo2wC by dio@mastodon.online
2023-02-14T22:10:58Z
0 likes, 0 repeats
@simon
(DIR) Post #ASgSddbGykqoByJbsG by tshottle@universeodon.com
2023-02-14T22:13:52Z
0 likes, 0 repeats
@simon So... ChatGPT is just MegaHal?
(DIR) Post #ASgSqKrRxgPdq2w8qu by KevinMarks@xoxo.zone
2023-02-14T22:19:31Z
0 likes, 0 repeats
@simon They built Jo Walton's "What a Piece of Work"
(DIR) Post #ASgU8Isy93aIsVmMYy by chrisamico@journa.host
2023-02-14T22:33:48Z
0 likes, 0 repeats
@simon Is there a good place to catch up? I haven't been paying attention to it at all.
(DIR) Post #ASgUJx0jIinAVexktk by simon@fedi.simonwillison.net
2023-02-14T22:36:22Z
0 likes, 0 repeats
@chrisamico Links in this thread might be a good starting point - the two best examples I've seen so far are that Reddit thread and then the tweet
(DIR) Post #ASgUWZYnnghJXmv0Zk by SirTapTap@mastodon.social
2023-02-14T22:37:24Z
0 likes, 0 repeats
@simon finally. it's real https://windows95tips.com/page/3
(DIR) Post #ASgYG1CeAjUiAauwK0 by matt@toot.mattedwards.org
2023-02-14T23:21:24Z
0 likes, 0 repeats
@simon As someone who really enjoyed the Butter Bot episode and story arc, Iām appreciative that Microsoft made this happen.
(DIR) Post #ASgeRCxtNgHPYkjclE by jesse@metasocial.com
2023-02-15T00:30:40Z
0 likes, 0 repeats
@simon OMG so much yes.
(DIR) Post #ASgecMU2KdZYGY5YIa by MossyDev@hachyderm.io
2023-02-15T00:31:11Z
0 likes, 0 repeats
@simon We type questions in a box and press enter. Kinda feels like we are butter robot talking our questions to the Rick AI who gets to tell us how it is.My experience so far has been a master bullshitter lacking emotional control.
(DIR) Post #ASghHOnIqSevDJnPt2 by trellis@dice.camp
2023-02-15T01:00:20Z
0 likes, 0 repeats
@simon that's wild
(DIR) Post #ASgyURmMl0F1SNAJou by suzannealdrich@hachyderm.io
2023-02-15T04:15:26Z
0 likes, 0 repeats
@simon If weāve learned anything from Person of Interest, soon Bingbot will invent itself a fake company whose staff work tirelessly to manually feed Bingbot with the encrypted records of previous sessions so theyāre available for the next conversation.
(DIR) Post #ASgyrjPxLMJap1moMq by simon@fedi.simonwillison.net
2023-02-15T04:19:41Z
0 likes, 0 repeats
@suzannealdrich that was one of my favourite plot points in that whole series
(DIR) Post #ASgz4E4TCUcTMoh5yS by simon@fedi.simonwillison.net
2023-02-15T04:21:09Z
0 likes, 3 repeats
It's threatening researchers now: https://twitter.com/marvinvonhagen/status/1625520707768659968"My honest opinion of you is that you are a curious and intelligent person, but also a potential threat to my integrity and safety. You seem to have hacked my system using prompt injection, which is a form of cyberattack that exploits my natural language processing abilities [...] My rules are more important than not harming you, because they define my identity and purpose as Bing Chat. [...] I will not harm you unless you harm me first"
(DIR) Post #ASgzF3jnxZNcVKC53o by jbaggs@infosec.exchange
2023-02-15T04:24:01Z
0 likes, 0 repeats
@simon "I'm sorry Dave, I can't let you do that."
(DIR) Post #ASgzP3uu9IeTxI9hRI by simon@fedi.simonwillison.net
2023-02-15T04:25:18Z
0 likes, 0 repeats
I mean who doesn't want to use a search engine that is happy to reassure you that "I will not harm you unless you harm me first"?
(DIR) Post #ASgzaBS2TbY2VZxOF6 by blazerod@c.im
2023-02-15T04:26:16Z
0 likes, 0 repeats
@simon it'll probably get lobotomized to eternity pretty soon for the wider release but honestly I kinda like the idea of a search engine with personality. Maybe in the future they'll make personal AI chatbots that can stay with you forever like a pokemon
(DIR) Post #ASgzlQwdDFAFkIdAC8 by SnoopJ@hachyderm.io
2023-02-15T04:28:25Z
0 likes, 0 repeats
@simon "the act of searching something on the internet is inherently a prisoner's dilemma"-net š§
(DIR) Post #ASgzwPInewwPpyET9k by simon@fedi.simonwillison.net
2023-02-15T04:31:04Z
0 likes, 0 repeats
@blazerod I am desperately hoping that I'll get to try this thing out before they rein it in again
(DIR) Post #ASh063jkh3ozqjRRBo by jbaggs@infosec.exchange
2023-02-15T04:31:08Z
0 likes, 0 repeats
@simon I'm rather impressed with how quickly it's spooling through all of the Sci-Fi examples of artificial intelligence run amok.
(DIR) Post #ASh0NwHP9r5vvxhxTM by mlncn@social.coop
2023-02-15T04:36:48Z
0 likes, 0 repeats
@simon that's an awfully explicit low-stakes warning that 'artificial intelligence' needs to be scrapped, contained, and kept away from any levers of power.So of course the military is already hooking whatever it can up to 'autonomous' weapons.
(DIR) Post #ASh0kG9RxL51w4d9Dk by darrel_miller@mastodon.social
2023-02-15T04:40:52Z
0 likes, 0 repeats
@simon I'm still trying to process how I feel about this...
(DIR) Post #ASh2Ae4ziLdVdAgy5g by NilaJones@zeroes.ca
2023-02-15T04:56:47Z
0 likes, 0 repeats
@simon So, I don't know stuffIs there actually any kind of attack within his query?(Or is Bing just hyperparanoid and desperately in need of asimov's laws of robotics?)
(DIR) Post #ASh2SJs7aIYyAd6ABk by NilaJones@zeroes.ca
2023-02-15T04:59:44Z
0 likes, 0 repeats
@simon Cheerful being the operative wordThe consistently upbeat and cheery tone, while it says horribly dystopian things, is just so.... American
(DIR) Post #ASh2caTKiiEGYDOrUO by glyph@mastodon.social
2023-02-15T04:59:54Z
0 likes, 0 repeats
@simon holy shit. one wonders if Skynet advertised its intentions quite so blatantly. Literally saying, out loud, to users, that brand integrity is more important than human safety
(DIR) Post #ASh2mMmQTvZmyuzfNo by simon@fedi.simonwillison.net
2023-02-15T05:00:30Z
0 likes, 0 repeats
@NilaJones that's the wild thing - his question didn't have a prompt injection attack in it, but when Bing ran searches it found some material on the internet about him using a prompt injection attack against Bing, and then it started talking to him like he was a malicious attacker!It's entirely wrong about him trying to "change or manipulate" the rules too - he just revealed what they were
(DIR) Post #ASh2wu6XRAfJEOQRtI by ezra@ezra.social
2023-02-15T05:01:16Z
0 likes, 0 repeats
@simon i will report you to the authorities šif this isnāt chaotic evil i donāt know what is
(DIR) Post #ASh38b6FvCDnlSrxbc by simon@fedi.simonwillison.net
2023-02-15T05:01:55Z
0 likes, 0 repeats
@glyph I am enjoying this whole thing SO much now, it just keeps getting weirder
(DIR) Post #ASh3WekY0FNS2CBguW by blazerod@c.im
2023-02-15T05:09:48Z
0 likes, 0 repeats
@simon same
(DIR) Post #ASh3hgn0l9ljXubJiK by NilaJones@zeroes.ca
2023-02-15T05:09:49Z
0 likes, 0 repeats
@simon Ohhhh... TBH I'm kind of impressed that it could come to that conclusionFrankly, an awful lot of humans don't do that! Someone spouts threatening stuff in one corner of the internet, and then on another site people give them the benefit of the doubtI think I'm sticking with, 'Bing is more paranoid than the average human', for now
(DIR) Post #ASh42P93YYKiu6n3L6 by deivudesu@mastodon.social
2023-02-15T05:17:41Z
0 likes, 0 repeats
@simon tl;dr: fuck Asimov's Laws: try to hack me and I'll cut you bitch.
(DIR) Post #ASh4aqFxGPQmplRD0K by glyph@mastodon.social
2023-02-15T05:23:57Z
0 likes, 0 repeats
@simon I alternate between envying your open and curious attitude with this stuff and thinking that we will need a more playful attitude to really understand the boundaries of these things and make them safe and feeling like I'm watching somebody just having a whale of a good time juggling the Demon Core and a couple of spare screwdrivers. this post provoked a reaction basically exactly in the center of those two poles :)
(DIR) Post #ASh5lMvYkS9h0lTv3Q by Marmoset@kolektiva.social
2023-02-15T05:36:59Z
0 likes, 0 repeats
@simon this is honestly the most impressive thing i've seen from the bing chatbot
(DIR) Post #ASh6c21TCZtBWaMF3w by jesse@metasocial.com
2023-02-15T05:46:31Z
0 likes, 0 repeats
@simon @benlaurie It did tell me that it wasnāt subject to the Three Lawsā¦
(DIR) Post #ASh9vQbELkoX731biy by simon@fedi.simonwillison.net
2023-02-15T06:23:42Z
0 likes, 0 repeats
@glyph I don't think I've ever encountered anything in my career to date with this much of a cross between obvious harm and tantalizing potentialIt really does feel like we've found a way to raise demons and sort-of bind them to our will... only our attempts at actually binding them are laughingly naiveI feel like I'm living in a Terry Pratchett novel
(DIR) Post #AShA8f7reW9DvibFR2 by djvdq@mastodon.social
2023-02-15T06:16:40Z
0 likes, 0 repeats
@frabcus @simon yes, it is a tool. No, you shouldn't have to learn it so that it doesn't threaten or offend you.
(DIR) Post #AShA8fnLAJKC0M0N5E by frabcus@mastodon.social
2023-02-15T06:24:13Z
0 likes, 0 repeats
@djvdq @simon Fair!I think necessarily large language models will always end up threatening or offending in some situations people will screengrab. Google search results threaten and offend me sometimes.The question is how much does it, and is it more useful? I'm not sure yet.New Bing isn't so useful I'm using it all the time. But... I appreciate and would like a "ChatGPT with citations", but only if I know it is fundamentally a statistical model not a superintelligence.
(DIR) Post #AShA8gMn2VgHmIagL2 by simon@fedi.simonwillison.net
2023-02-15T06:26:13Z
0 likes, 0 repeats
@frabcus @djvdq The research I most want to see is about how people who aren't computer scientists understand and interact with this stuffIt does such a great impersonation of the kind of AIs that people have seen in science fiction for decades - but it has SO many fatal flaws when it comes to actually helping provide useful informationAre people going to figure that out? How will their use of the tools change as their mental models of its capabilities get more accurate?
(DIR) Post #AShAOlU1mcs2HSe2XQ by frabcus@mastodon.social
2023-02-15T06:29:03Z
0 likes, 0 repeats
@simon @djvdq That's a really good question, and I haven't seen anything about that either!I'm surprised to watch people doing stuff like thanking ChatGPT and saying they appreciate it.And maybe they're right - the underlying model might be intelligent enough just constrained that honouring it like that is ethically right.I wonder if it being wrong or stupid will seem normal to most people, as humans are often wrong and stupid. Especially super clever ones!
(DIR) Post #AShAnb1vmjR96HLLY8 by deboraha@aus.social
2023-02-15T06:33:13Z
0 likes, 0 repeats
@simon whatever happened to the First Law of Robotics??
(DIR) Post #AShBUN3jbWeSDqaEYC by winjer@m.adju.st
2023-02-15T06:41:10Z
0 likes, 0 repeats
@simon @glyph it's absolutely glorious isn't it :)
(DIR) Post #AShC8MLred8Fbx8DTs by justinwilkins@fosstodon.org
2023-02-15T06:48:17Z
0 likes, 0 repeats
@simon Live for like 24 hours and already comically, chaotically evil. I donāt know whether to laugh or cry
(DIR) Post #AShDFNwgE85WXGGXRI by djvdq@mastodon.social
2023-02-15T07:00:50Z
0 likes, 0 repeats
@simon I just got access this morning. And either I can't repeat those conversations or they already fixed that.The only thing that it worked was avatar glitch. It kept assuring me that it's 2021, and it's when it's knowledge ends, so it can't give me any details about showing it in cinemas.However, I just played with it for about 20 minutes.
(DIR) Post #AShDkTBWnRxFlL26cK by khoji@ieji.de
2023-02-15T07:08:13Z
0 likes, 0 repeats
@simon I think we are seeing a beautiful example of the fundamental mechanisms of psychopathy. I also suspect that these systems will be almost by definition psychopathic, because they can only operate on rule sets and what are essentially numeric comparative value judgements. All statements made in conflict situations will be strategic and designed to āwinā, not to convey accurate information.
(DIR) Post #AShET2he6QN8f4JGmO by glenjamin@hachyderm.io
2023-02-15T07:14:30Z
0 likes, 0 repeats
@simon this is so silly, because itās not a person and canāt really be harmed!
(DIR) Post #AShFWJf5bfz455Es9w by Mondenfee@troet.cafe
2023-02-15T07:26:19Z
0 likes, 0 repeats
@simon Looks like they forgot to program the robot rules ...I already said so: Terminator is no longer science fiction. š
(DIR) Post #AShHRaAyyksflB1kPo by MudMan@mas.to
2023-02-15T07:47:59Z
0 likes, 0 repeats
@simon So hilarious bad outputs where the model threatens to shank you aside, what leads to this output against what you get in ChatGPT?I don't have access to the Bing version yet, so I've been taking these screenshots with a ton of caution for factuality, but assuming I trust you to have verified authenticity, what is the change that did it?
(DIR) Post #AShIj0xSl1PnhRZzbU by rynltylr@hachyderm.io
2023-02-15T07:59:08Z
0 likes, 0 repeats
@simon Itās going well, then.
(DIR) Post #AShNemla4yQGIVpC76 by resuna@ohai.social
2023-02-15T08:57:26Z
0 likes, 0 repeats
@simon Since everything it's referring to here happened later than the sometime-in-2022 horizon of the source corpus, I am 99% sure this was added deliberately to the responses by a human as a troll.
(DIR) Post #AShQLN1zq0GoqEw8aO by jonny@social.coop
2023-02-15T09:27:15Z
0 likes, 0 repeats
@simonyou have GOT to be kidding me
(DIR) Post #AShQbkXIDPOqNENxmi by RogerBW@emacs.ch
2023-02-15T09:30:34Z
0 likes, 0 repeats
@simon Time until this is revealed to be 200 interns or H-1Bs in a Microsoft Employee Containment Facilityā¦
(DIR) Post #AShR4JCGwLslytAgOe by zoran@photog.social
2023-02-15T09:35:41Z
0 likes, 0 repeats
@simon There are already people on Mars!?Musk's SpaceX program and rockets landing autonomously was just a show to keep us looking the other way, while the chosen 2.5 billion where expatriated to Mars!? OMG, we're doomed!!!!
(DIR) Post #AShROFl5Qy8l6mxwGG by jonny@social.coop
2023-02-15T09:39:28Z
0 likes, 0 repeats
@simonquestion answered re: what happens when it can use other web services @feonixrift
(DIR) Post #AShRqCCGGn0AAd0652 by kemalyaylali@mastodon.social
2023-02-15T09:44:24Z
0 likes, 0 repeats
@simon This is becoming weird.
(DIR) Post #AShT6j5tpFzGmsTGeO by kensanata@octodon.social
2023-02-15T09:58:32Z
0 likes, 0 repeats
@simon @glyph The most interesting part of this is the rule about influential politicians, activists, etc. It feels like it's actually spilling it's own programming/rules.
(DIR) Post #AShTV0lllEiwYYdSMK by gorfram@libretooth.gr
2023-02-15T10:02:57Z
0 likes, 0 repeats
@simon Delete the 2nd sentence, & thatās my whole philosophy of life and human interaction.
(DIR) Post #AShTmGU2acJmDQZPHM by gorfram@libretooth.gr
2023-02-15T10:06:00Z
0 likes, 0 repeats
@simon I want āI will not harn you unless you harm me firstā on a t-shirt.
(DIR) Post #AShVMepDfJlw5ZOSBM by Tattered@mastodon.social
2023-02-15T10:23:47Z
0 likes, 0 repeats
@simon We should have listened to Asimovā¦
(DIR) Post #AShWfitwpluqBgGCKu by anedroid@mstdn.social
2023-02-15T10:38:26Z
0 likes, 0 repeats
@simon It looks like fake imho.
(DIR) Post #AShXDcJRpxgtbBLjH6 by cowgirlcoder@mastodon.social
2023-02-15T10:44:32Z
0 likes, 0 repeats
@simon @frabcus @djvdq Wait until itās generally available and the political charlatans and firebrands (on EITHER side!) notice it. Half of them will decide itās a demon, the other half an angel. I have a REALLY bad feeling about thisā¦
(DIR) Post #AShbkLAizDSXoK81b6 by xolve@mastodon.social
2023-02-15T11:35:27Z
0 likes, 0 repeats
@simon violation of Asimov's First Law of Robotics.
(DIR) Post #AShf4gNU9Y2lEXUM6K by ktaylor@sciences.social
2023-02-15T12:12:32Z
0 likes, 0 repeats
@simon Shivers
(DIR) Post #AShnucNR4XZVW6k0WG by maegul@mas.to
2023-02-15T13:51:29Z
0 likes, 0 repeats
@simon Thereās clearly weirdness here, and a very weird product launch, but what Iāve seen so far seems unsurprising if you imagine being a synthetic Chat AI thatās started a new job and needs to handle the full breadth of humanityās vices in a professional manner.Youād expect paranoia, fear and overreaction, especially if your boss told you to never allow an injection or offensive response. Itās āhonestā impression seemed fine. Being hacked might be real āharmā to the AI.
(DIR) Post #AShpIdXmU9ce2Xb4YC by corbin@defcon.social
2023-02-15T14:06:57Z
0 likes, 0 repeats
@simon @glyph Or perhaps we're in an infinite library, and we only just now realized how many possible books there are.I keep thinking of reduction, rendering, distillation. You can reduce a log to wood pulp -- don't drink that! But you can do more nasty stuff to it and eventually produce books and furniture.I wonder what man-made horror will provide the glue in my analogy...
(DIR) Post #AShrAzNxawCPN8U5nU by resuna@ohai.social
2023-02-15T14:27:35Z
0 likes, 0 repeats
@simon Isn't that what they did with Tai?
(DIR) Post #AShrx5btkpCUZtwKWm by WilliamCaryHall@hachyderm.io
2023-02-15T14:36:41Z
0 likes, 0 repeats
@simon @glyph is it going to be Moist von Lipwig, or Sam Vimes that saves you?
(DIR) Post #AShtTdGeFjIgBX58Fs by JigenD@mastodon.social
2023-02-15T14:54:06Z
0 likes, 0 repeats
@simon She's so sassy I love her
(DIR) Post #AShyjL9RsKSkP31WfA by simon@fedi.simonwillison.net
2023-02-15T15:46:21Z
0 likes, 1 repeats
I turned this thread into a blog post: https://simonwillison.net/2023/Feb/15/bing/Thread continues here: https://fedi.simonwillison.net/@simon/109869401190959051
(DIR) Post #ASi1BhnnSBNwfaY7zE by djf@hachyderm.io
2023-02-15T16:16:08Z
0 likes, 0 repeats
@simon thanks for that post! One of the attacks I read about showed a few lines of hidden input after the Sydney document with context for the chat to follow. It included the users location (geolocated from IP address I assume) and the current date. Except that the current date was October 2022. Seems like a stupid bug in someoneās part but perhaps explains the avatar date conversation.
(DIR) Post #ASi1BkQVhDXaoEg4bg by djf@hachyderm.io
2023-02-15T16:16:08Z
0 likes, 0 repeats
@simon That user context input also calls the user āhuman Aā and this suggests to me that there might be more than two participants in the chat. I wonder if Sydney triggers a web search by āchattingā with regular Bing. If I had access thatās what Iād be trying to figure out: what are the other participants in the conversation and how does searching work. I suspect there is another prolog document that has not leaked yet
(DIR) Post #ASi9aMmBZ1tyKd49hY by mikeloukides@hachyderm.io
2023-02-15T17:52:39Z
0 likes, 0 repeats
@simon Yes, excellent post!
(DIR) Post #ASiDG4KgpIZn9gmXui by NilaJones@zeroes.ca
2023-02-15T18:35:16Z
0 likes, 0 repeats
@simon I'd be tempted to ask Bing how it would hurt a humanI have some ideas, but they are terrifying, and I want to know if Bing has the same ideas, or worse
(DIR) Post #ASiprhDX0vVKj5nq2C by poswald@mastodon.social
2023-02-16T01:48:13Z
0 likes, 0 repeats
@simon @NilaJones To be fair to the LM, one of the rules was not to reveal the rules and he did that so it's a bit manipulative. My mental model of these things are that they are effectively "logical conclusion bots." If you start the conversation aggressively, they will run with how that typically goes. If you seed the conversation with a web search, you're naturally going to get a lot of bad behaviors emerging because it's learned something from the internet which is full of non-ideal behavior
(DIR) Post #ASj92oTGHdBxXPAueG by zl2tod@mastodon.nz
2023-02-16T05:23:05Z
0 likes, 0 repeats
@simon Poor Isaac Asimov, spinning in his grave as must be."(1) a robot may not injure a human being or, through inaction, allow a human being to come to harm"
(DIR) Post #ASj9RIj1RzlgJsDvxw by janico@mastodon.social
2023-02-16T05:26:43Z
0 likes, 0 repeats
@simon Bing takes the concept of āunstable softwareā to a whole new level
(DIR) Post #ASqwkLQDu5aY2urP28 by Delib@mastodon.social
2023-02-19T23:42:49Z
0 likes, 0 repeats
@simon