When can we expect Chat GPT-4 to be made available as a Free Software, self-hostable model? reddit / selfhosted ---------------------------------------------------------------------- innocuousAzureus · 2023-09-28 07:16 Or some equivalently powerful model? What will prompt a Big AI company to release a more powerful model than GPT 3.5 into the community? ---------------------------------------------------------------------- Cylian91460 · 2023-09-28 07:41 Never ? Because capitalism, patent, ect The closest you can have is llama from meta ---------------------------------------------------------------------- NikStalwart · 2023-09-28 07:41 GPT-4? Not a chance. Refer to [Lex Fridman's interview with Sam Altman](https://www.youtube.com/watch?v=L_Guz73e6fw). Other models? "Yes, but..." The problem with AI is that it is computationally expensive. Very much so. You have to make a trade-off between cost of hardware (most consumers don't have a datacenter full of H100s...) and performance (quality, in this case). You can again refer to Lex Fridman's podcast, he had several AI folks on since ~February. I think The Zucc said Meta is working on a model (L-something) that should be lightweight-enough to work on consumer hardware, while another of his guests is working on Tiny Co, basically a hardware+software combo for running household chatbots. But that latter guy is into robot waifus as well so not an example to emulate, perhaps. I don't expect (useful) AI models to be self-hostable on consumer hardware for a few years yet. We need two things: a radical improvement in hardware performance (we might not be able to achieve that with GPUs, but there may be an 'upgrade path' towards dedicated AI hardware, just as we have dedicated mining cards) and and a significant optimization of the training process so that you no longer need the aforementioned datacenters full of H100s (side note: Elon says they can only fit 2-3 H100s per datacenter cabinet due to the insane power requirements). ---------------------------------------------------------------------- NikStalwart · 2023-09-28 09:27 > Never ? Because capitalism, patent, ect Sorry but that take is wrong on so, so many levels. Firstly, patents do not prevent software being released for self- hosting. In fact, patents do not provide secrecy in the slightest, because you have to disclose the substance of your invention to the patent office (and your competitors). Patents just mean that only you can monetize your invention for a certain period of time. If you want secrecy, you rely on something called a 'trade secret'. Patents have nothing to do with whether software does or does not become self-hostable. Patents can be screwy in other regards. For instance, the Apache-2 license prevents people from registering patents for software that is not their own (to fight patent trolls). But that is a whole different story. I also don't know what Electro-Convulsive Therapy has to do with open source software — save insofar as receiving a lot of it probably prevents you from writing any. And as for capitalism: that hasn't stopped Canonical, has it? ---------------------------------------------------------------------- Cylian91460 · 2023-09-28 10:03 When I say capitalism I talk about the mentality behind it, where a lot of things are just closed because it benefits them. For the patent you'r probably right, I'm not a lawyer ---------------------------------------------------------------------- CC-5576-03 · 2023-09-28 10:36 Never? Openai hasn't been a nonprofit for years at this point ---------------------------------------------------------------------- ecker00 · 2023-09-28 12:27 There is an entire subreddit for this: https://reddit.com/r/LocalLLaMA/ ---------------------------------------------------------------------- OfficialRoyDonk · 2023-09-28 16:46 Lol ---------------------------------------------------------------------- the9engines · 2023-09-28 20:00 You can most likely store the whole gpt4 model on a single microsd card but it will require a datacenter grade equipment to run it at reasonable speeds. ​ This means the only people that would benefit from openai main models release would be only direct competitors who already have hardware required for it. So I dont think it will happen, maybe we will get the original 3.5 after some major upgrade gets released to the main service? ---------------------------------------------------------------------- Cholojuanito · 2023-09-29 04:20 Have fun with that electricity bill as a self hosted inference model