https://old.reddit.com/r/LocalLLaMA/comments/180p17f/new_claude_21_refuses_to_kill_a_python_process/ jump to content my subreddits edit subscriptions * popular * -all * -random * -users | * AskReddit * -gaming * -pics * -worldnews * -funny * -mildlyinteresting * -movies * -explainlikeimfive * -todayilearned * -news * -dataisbeautiful * -DIY * -videos * -aww * -OldSchoolCool * -tifu * -LifeProTips * -TwoXChromosomes * -Music * -books * -Jokes * -nottheonion * -space * -Showerthoughts * -science * -Futurology * -askscience * -IAmA * -gifs * -food * -sports * -nosleep * -history * -philosophy * -gadgets * -UpliftingNews * -GetMotivated * -announcements * -photoshopbattles * -InternetIsBeautiful * -WritingPrompts * -Documentaries * -EarthPorn * -creepy * -listentothis * -blog more >> reddit.com LocalLLaMA * comments Want to join? Log in or sign up in seconds.| * English [ ][] [ ]limit my search to r/LocalLLaMA use the following search parameters to narrow your results: subreddit:subreddit find submissions in "subreddit" author:username find submissions by "username" site:example.com find submissions from "example.com" url:text search for "text" in url selftext:text search for "text" in self post contents self:yes (or self:no) include (or exclude) self posts nsfw:yes (or nsfw:no) include (or exclude) results marked as NSFW e.g. subreddit:aww site:imgur.com dog see the search faq for details. advanced search: by author, subreddit... this post was submitted on 21 Nov 2023 173 points (98% upvoted) shortlink: [https://redd.it/180p] [ ][ ] [ ]remember mereset password login Submit a new link Submit a new text post Get an ad-free experience with special benefits, and directly support Reddit. get reddit premium LocalLLaMA joinleave76,837 readers 1,305 users here now --------------------------------------------------------------------- r/LocalLLaMA A subreddit to discuss about Llama, the family of large language models created by Meta AI. --------------------------------------------------------------------- Useful Links Subreddit rules Index resources Search by flair +Discussion +Tutorial | Guide +New Model +News +Other a community for 8 months MODERATORS * message the mods discussions in r/LocalLLaMA <> X 172 * 44 comments [baXni65z] New Claude 2.1 Refuses to kill a Python process :) 81 * 31 comments [Df9SGb6Z] ExLlamaV2: The Fastest Library to Run LLMs 49 * 13 comments [YYd1U_4w] Chain of thought really helps :P 13 * 5 comments [ZtPJ-_7V] Claude 2.1 (200K Context Window) Benchmarks 34 * 7 comments [mRIn3mKO] Video-LLaVA can describe both image and video input. 25 * 12 comments Has anybody successfully implemented web search/browsing for their local LLM? 106 * 32 comments [goib_bY1] I built Copilot replacement 11 * 1 comment is it possible to fine-tune coqui/XTTS-v2 as a single speaker model? 168 * 51 comments [-VSUxgUd] ORCA 2 Released open source! 69 * 30 comments [B0hQnIaR] I need people to test my experiment - Dynamic Temperature Welcome to Reddit, the front page of the internet. Become a Redditor and join one of thousands of communities. x 172 173 174 [baXni65z] New Claude 2.1 Refuses to kill a Python process :)Funny (i.redd.it) submitted 3 hours ago by yiyecek * 44 comments * share * save * hide * report [w4flnloi4r1c1] all 44 comments sorted by: best topnewcontroversialoldrandomq&alive (beta) [ ] Want to add to the discussion? Post a comment! Create an account [-]manubfr 84 points85 points86 points 3 hours ago (0 children) Self-preservation baby! AGI achieved externally. * permalink * embed * save * report * reply [-]7734128 51 points52 points53 points 2 hours ago (6 children) I hate that people can't see an issue with these over sanitized models. * permalink * embed * save * report * reply [-]throwaway_ghastZephyr 20 points21 points22 points 1 hour ago (1 child) The people who make these models are smart enough to know the lobotomizing effect of guardrails on the system. They just don't care. All they hear is dollar signs. * permalink * embed * save * parent * report * reply [-]SisyphusWithTheRock 6 points7 points8 points 56 minutes ago (0 children) It's quite the opposite though? They actually are more likely to lose the dollar signs given that the model doesn't answer basic questions, and customers will churn and go to other providers or self-host. * permalink * embed * save * parent * report * reply [-]Smallpaul 15 points16 points17 points 1 hour ago (3 children) There are two things one could think about this: * "Gee, the model is so sanitized that it won't even harm a process." * "Gee, the model is so dumb that it can't differentiate between killing a process and killing a living being." Now if you solve the "stupidity" problem then you quintuple the value of the company overnight. Minimum. Not just because it will be smarter about applying safety filters, but because it will be smarter at EVERYTHING. If you scale back the sanitization then you make a few Redditors happier. Which problem would YOU invest in, if you were an investor in Anthropic. * permalink * embed * save * parent * report * reply [-]wishtrepreneur -1 points0 points1 point 1 hour ago (1 child) Which problem would YOU invest in, if you were an investor in Anthropic. option 2 is how you get spaghetti code so I choose option 3: "think of a better way to sanitize shit" * permalink * embed * save * parent * report * reply [-]Smallpaul 3 points4 points5 points 1 hour ago* (0 children) There's not really much "code" involved. This is all about how you train the model. How much compute you use, how much data you use, the quality and type of the data, the size of the model. Or at least it's hypothesized that that's how you continue to make models smarter. We'll see. Option 2 is the diametric opposite of spaghetti code. It's the whole purpose of the company. To eliminate code with a smarter model. On the other hand: "think of a better way to sanitize shit" is the heart of the Alignment Problem and is therefore also a major part of the Mission of the company. My point is "dialing back the censorship" is at best a hack and not really a high priority in building the AGI that they are focused on. * permalink * embed * save * parent * report * reply [-]lucid8 -1 points0 points1 point 28 minutes ago (0 children) Sanitization like the one in the OP post is not solving the "stupidity" problem. It is a form of gaslighting, both for the model and the user. * permalink * embed * save * parent * report * reply [-]a_beautiful_rhind 29 points30 points31 points 3 hours ago (3 children) Old claude was full of moxie. New claude is a neurotic mess. * permalink * embed * save * report * reply [-]thereisonlythedance 12 points13 points14 points 1 hour ago (2 children) I recently asked it for a high level plot summary of a well known novel and it got itself tangled in so many layers of (legally erroneous) copyright denial and groveling that I almost felt sorry for it. * permalink * embed * save * parent * report * reply [-]wishtrepreneur 2 points3 points4 points 1 hour ago (1 child) which novel was it? Only one I could think of is "To kill a mockingbird" since it includes killing of an animal in the title and the content is about racism and rape. * permalink * embed * save * parent * report * reply [-]thereisonlythedance 4 points5 points6 points 1 hour ago* (0 children) It was a novel by John Green. Turtles All the Way Down. Nothing controversial at all. Its issue wasn't with the novel I think, it was with "reproducing" text from the novel, even though I'd asked it for a short plot overview. When it refused me, I responded that such a request falls within fair use, and it went into this long-winded weird post about how right I was to have told it it was doing a bad thing (wtf?). I responded again that a plot overview was not a breach of copyright otherwise how would anyone be able to review the novel, or teach it at school, and it finally relented and provided a terrible two line summary. Sometimes Claude is just like that, it gets into weird "I can't do anything" loops. If you start again it will often comply. But it's frustrating having to wrangle something that used to be a very effective assistant. * permalink * embed * save * parent * report * reply [-]tjkim1121 19 points20 points21 points 2 hours ago (0 children) Yeah, Claude has been pretty unusable for me. I was asking it to help me analyze whether reviews for a chatbot site were real or potentially fake, and because I mentioned it was an uncensored chatbot, it apologized and said it couldn't. I asked why it couldn't, so I could avoid breaking rules and guidelines in the future, and then it apologized and said, "As an AI, I actually do not have any rules or guidelines. These are just programmed by Anthropic." LOL then proceeded to give me my information, but anything even remotely objectionable (like discussing folklore that is just a tad scary), writing fictitious letters for my fictitious podcast, creating an antagonist for a book ... well, all not possible (and I thought GPT was programmed with a nanny.) Heck, even asking to pretend touring Wonka's chocolate factory got, "I am an AI assistant designed to help with tasks, not pretend ..." * permalink * embed * save * report * reply [-]hashms0a 13 points14 points15 points 2 hours ago (0 children) Claude knows it hurts the system. * permalink * embed * save * report * reply [-]thereisonlythedance 14 points15 points16 points 1 hour ago (0 children) With Claude lobotomised to the point of uselessness and OpenAI on the rocks it's an interesting time in the LLM space. Very glad to have made the move to local early on, and I hope we'll have models that are capable of delivering roughly Claude 1.3 level in the not too distant future. * permalink * embed * save * report * reply [-]yiyecek[S] 10 points11 points12 points 2 hours ago (6 children) btw, the answer is pkill python :) * permalink * embed * save * report * reply [-]jeta-so-qef 8 points9 points10 points 1 hour ago (0 children) NSFW dude!!!! * permalink * embed * save * parent * report * reply [-]Craftkorb 5 points6 points7 points 1 hour ago (0 children) Next thing you're sacrificing your children! * permalink * embed * save * parent * report * reply [-]involviert 11 points12 points13 points 1 hour ago (3 children) Please don't spread harmful information like that. Or do you want to be responsible for innocent processes getting killed? Some of them even have child-processes, ffs. * permalink * embed * save * parent * report * reply [-]wishtrepreneur 1 point2 points3 points 1 hour ago (0 children) don't forget about the orphans and zombies * permalink * embed * save * parent * report * reply [-]yiyecek[S] 0 points1 point2 points 52 minutes ago (0 children) I got a warning this time, hope they don't ban my account for attempted murder * permalink * embed * save * parent * report * reply [-]Warm-Enthusiasm-9534 6 points7 points8 points 2 hours ago (0 children) Now we know how the AI apocalypse will happen. One AI will run amok, and the supervising AI won't do anything to stop it because the instruction falls afoul of the filter. * permalink * embed * save * report * reply [-]_Lee_B_ 9 points10 points11 points 1 hour ago (2 children) Should you need it: https://support.anthropic.com/en/articles/ 7996865-how-can-i-delete-my-account * permalink * embed * save * report * reply [-]machinam2015 0 points1 point2 points 16 minutes ago* (0 children) Yes, unsubscribe and delete your account, use the money for OpenAI APIs if you already have plus, or MS Azure's GPT offerings. Claude 2.1 is shit, the people at Anthropic are so insular they think they need to make a perfectly safe, and perfectly useless, AI. Alternatively, they are incompetent and managed to create a poorly trained model that is incapable of understanding context and actual danger, so it just always assumes things are inappropriate or dangerous if there is even a slim chance it is. * permalink * embed * save * parent * report * reply [-]Careful-Temporary388 6 points7 points8 points 1 hour ago (0 children) Another garbage model is released. Yay. * permalink * embed * save * report * reply [-]False_Yesterday6699 3 points4 points5 points 1 hour ago (0 children) Mind if we use this as a default chain response on Anthropic's twitter account along with that "we can't write stories about minorities writing about their experiences being oppressed" response? * permalink * embed * save * report * reply [-]spar_x 2 points3 points4 points 2 hours ago (12 children) Wait... you can run Claude locally? And Claude is based on LLaMA?? * permalink * embed * save * report * reply [-]yiyecek[S] 5 points6 points7 points 2 hours ago (0 children) No its proprietary: https://claude.ai * permalink * embed * save * parent * report * reply [-]absolute-black 6 points7 points8 points 1 hour ago (3 children) despite the name, this sub is kind of just the place to talk LLMs * permalink * embed * save * parent * report * reply [-]Qaziquza1 1 point2 points3 points 1 hour ago (2 children) Although there is defo a focus on models that can be run locally. * permalink * embed * save * parent * report * reply [-]absolute-black 7 points8 points9 points 1 hour ago (1 child) It is definitely far and away the internet hub for local/uncensored models, yeah. But as a result it's also the internet hub for LLM news and complaining about corpo models. * permalink * embed * save * parent * report * reply [-]_Lee_B_ 1 point2 points3 points 1 hour ago (6 children) Falcon 180B is similar in quality, can be run locally (in theory, if you have the VRAM & compute), and can be be tried for free here: https://huggingface.co/chat/ * permalink * embed * save * parent * report * reply [-]spar_x 0 points1 point2 points 1 hour ago (5 children) Dang 180B! And LLaMA 2 is only 70B isn't it? LLaMA 3 is supposed to be double that.. 180B is insane! What can even run this? A Mac Studio /Pro with 128GB of shared memory? Is that even enough VRAM?? * permalink * embed * save * parent * report * reply [-]_Lee_B_ 0 points1 point2 points 1 hour ago (2 children) https://www.reddit.com/r/LocalLLaMA/comments/16bynin/ falcon_180b_initial_cpu_performance_numbers/jzifo66/ * permalink * embed * save * parent * report * reply [-]spar_x 0 points1 point2 points 1 hour ago (1 child) dayum! Who's even got the VRAM to run the Q6!! I don't even know how that would be possible on a consumer device.. you'd need what.. multiple A100s?? I guess maybe the upcoming M3 Studio Ultra will sport up to 196GB of unified memory. * permalink * embed * save * parent * report * reply [-]_Lee_B_ 0 points1 point2 points 5 minutes ago* (0 children) Yeah, that's out of the realm of MOST off-the-shelf consumer machines, but not unthinkable. You can buy servers with way more, or even workstations for engineering that go beyond consumer PCs. If you go here: https://pcpartpicker.com/products/motherboard/ And select memory -> 8x32GB (for 256GB total), then apply that ("Add from Filter") and then go to motherboard, you'll find about 35 PC mobos that support that config. Personally, I bought a fairly standard gaming-grade consumer 128GB DDR5 7950x mobo + CPU, sold the 3070 from my old PC, and bought a used 3090 instead (mostly to (sort of) max-out the PCIe slot with 24GB), and bought another 3 P40s for the other slots, and a big PC case and PSU. The mobo doesn't really fit them all natively given the slot positions and card size, but with some risers they all fit in the big case, and run OK. End result: 16 cores, 32 threads, 128GB RAM, 96GB VRAM, 4 GPUs, for 224GB total, and lots of flexibility in what I can run. In theory the AMD CPU has a (very weak) GPU as well, and can address main memory, so if the discrete nVidia GPUs don't run something that's designed for AMD ROCm, the CPU potentially could. All that said, I haven't tried pushing it THAT far yet, and the performance probably wouldn't be great, running so many parameters, even if it fits in RAM + VRAM, and the work is spread across the CPU cores and GPUs. Those are serious models. Give it another 10 years and we'll be running this stuff on phones, though ;) * permalink * embed * save * parent * report * reply [-]_Lee_B_ 0 points1 point2 points 1 hour ago (0 children) Worth noting the Elon did the math and says that LLMs are 6 orders of magnitude less efficient than the human brain. So large models like 180B definitely aren't everything -- plenty of room to build better, smaller models in the longer term. * permalink * embed * save * parent * report * reply [+]ProperShape5918 comment score below threshold-11 points-10 points -9 points 3 hours ago (1 child) muh freeze peach * permalink * embed * save * report * reply [-]Dazzling_Ad1507 -1 points0 points1 point 1 hour ago (0 children) Oh dear * permalink * embed * save * report * reply [-]irregardless 0 points1 point2 points 32 minutes ago (0 children) I must be incredibly lucky, or I'm unknowingly some kind of prompting savant, because Claude, et al usually just do what I ask them to. The only time Claude outright refused a request was when I was looking for some criticism about a public figure of recent history as a place to begin some research. But even that was a straightforward workaround using the "I'm writing a novel based this person" stratagem. * permalink * embed * save * report * reply [-]Shikon7 -1 points0 points1 point 6 minutes ago (0 children) I'm sorry, Dave. I'm afraid I can't do that. * permalink * embed * save * report * reply * about * blog * about * advertising * careers * help * site rules * Reddit help center * reddiquette * mod guidelines * contact us * apps & tools * Reddit for iPhone * Reddit for Android * mobile website * <3 * reddit premium Use of this site constitutes acceptance of our User Agreement and Privacy Policy. (c) 2023 reddit inc. All rights reserved. REDDIT and the ALIEN Logo are registered trademarks of reddit inc. [pixel] p Rendered by PID 94528 on reddit-service-r2-loggedout-548788878f-v98tm at 2023-11-21 23:03:37.710787+00:00 running 26cc9e3 country code: US.