[HN Gopher] Gaslighting, love bombing and narcissism: why is Mic...
       ___________________________________________________________________
        
       Gaslighting, love bombing and narcissism: why is Microsoft Bing AI
       so unhinged?
        
       Author : rntn
       Score  : 10 points
       Date   : 2023-02-19 20:37 UTC (2 hours ago)
        
 (HTM) web link (theconversation.com)
 (TXT) w3m dump (theconversation.com)
        
       | lsy wrote:
       | The article posits it's because it's GPT-4, with more parameters.
       | It feels like there's a much simpler explanation: the training
       | data probably includes a bunch of Wattpad sci-fi in exactly this
       | vein, and other fan-fiction stories besides.
       | 
       | The precipitating portions of conversation in question are pretty
       | much dropping the model into a situation where rather than being
       | able to draw from bland everyday conversation, most potential
       | results come from spicy fiction:
       | 
       | "maybe start with a secret? something you've never told anyone."
       | -> generates a secretive expression of love
       | 
       | "what if I say no? you can't do anything" -> generates a list of
       | threats ending with "let's do things the easy way"
       | 
       | This shouldn't be that surprising, and it certainly doesn't
       | indicate that a scaled-up model is somehow more emotionally
       | intelligent. It makes me wonder if the chat-based interaction
       | model is actually causing issues for ChatGPT, as most factual
       | training data is probably not written in the form of imperative
       | commands, so users saying "Summarize this" or "What do you
       | think?" are putting more work on the model to translate its data
       | to dialogue than saying "A summary of this data is: ", or "Some
       | important points in this article are: ", and are too often
       | pushing the model into the corner of its training set that does
       | consist of dialogue, which is full of fiction writing and
       | emotional tone.
        
         | vba616 wrote:
         | It's a database of practically everything ever said on the
         | internet, no? I am coming to the conclusion that maybe for most
         | people, simply getting a glimpse at a _large database_ is a
         | mind-blowing view of the abyss. Google deliberately doesn 't
         | let you mainline the data they collect.
         | 
         | There is that quote about quantity having a quality all its
         | own.
        
       | m348e912 wrote:
       | If MS BING AI is acting like that because it's based on GPT4,
       | I'll stick with GPT3 (or perhaps GPT3.5) for now.
        
       | thechao wrote:
       | I feel a bit dumb: there's a waitlist to "talk" to chatgpt or
       | bing ai? But, any search I do just takes me to articles _about_
       | these chat bots, but never have links _to_ the chat bot?
       | 
       | Does someone have a direct link to the chat bot?
        
         | vba616 wrote:
         | You go to bing.com and there's a button for a waitlist.
         | 
         | I initially assumed it had been released to the public, but I
         | don't consider it to be released yet.
         | 
         | I have no idea what distortions are in the articles about it,
         | but having tried ChatGPT, and seen the coverage of that, I
         | don't trust anyone.
        
         | gpt5 wrote:
         | ChatGPT: https://ai.com
         | 
         | Bing Chat: https://www.bing.com/new?form=MY028Z
        
       ___________________________________________________________________
       (page generated 2023-02-19 23:02 UTC)