Self-host ChatGPT like AI tools reddit / selfhosted ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 02:14 Hey Self-Hosted community, 👋 At [WorkAI.tools](https://workai.tools/), we are working on self- hosted alternative to ChatGPT like AI tools. We just launched the Individual Edition — a self-contained desktop app that runs ***everything*** locally including the large language model itself, so that all your data remains private and secure on your own computer. Here is a quick demo video of the Individual Edition: [youtu.be/69ch00ADHPQ](https://youtu.be/69ch00ADHPQ) You can download the Individual Edition for MacOS at [WorkAI.tools/ie- download-mac-os](https://WorkAI.tools/ie-download-mac-os) **Please try it out and give us your feedback.** Please note that this is just an MVP so it’s feature lite today. But we do have some exciting features on our roadmap, including a chat- with-documents feature (like ChatPDF for example) and many more improvements. Please consider joining our discord community at [WorkAI.tools/discord](https://workai.tools/discord) if you would like to follow along our progress. Cheers, Jay More resources about WorkAI Tools: * [What is WorkAI Tools?](https://workai.tools/blog/what-is-workai- tools) * [Frequently Asked Questions](https://workai.tools/FAQs) ---------------------------------------------------------------------- LumpyStatistician992 · 2023-10-08 02:46 I just tried it on M2 MacBook and it looks promising ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 02:56 Thank you for trying it out. Please let us know if you have any feedback for us. ---------------------------------------------------------------------- BfrogPrice2116 · 2023-10-08 04:52 Anything coming to Windows? ---------------------------------------------------------------------- bobbarker4444 · 2023-10-08 08:49 Or even linux lol. Probably the first time I've seen something like this exclusive to mac ---------------------------------------------------------------------- BaritonX · 2023-10-08 09:54 Privacy policy ? Terms of service ? open source ? Nationality ? ---------------------------------------------------------------------- FishSpoof · 2023-10-08 10:34 Is it woke AI ? If I ask it how many genders there are, will I get a factual 2 gender response or a list of 70 ? ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 13:20 Thank you. We definitely want to make the Windows version available. However, the current blocker for us is the price of a [Windows code signing certificate](https://www.electronforge.io/guides/code- signing/code-signing-windows#acquiring-a-certificate) \-- they cost upwards of $430/year at the moment, and being as small as we are, we would need to have a strong case to spend that much on Windows certificate right now. We can make an unsigned Windows app available to you fairly quickly. Would you be interested in using an unsigned Windows desktop app? You may have to run through a few hurdles that Microsoft has put in place when running an unsigned app -- [this article](https://www.theregister .com/2020/06/05/windows_10_microsoft_defender_smartscreen/) goes into some of the details of these popups and warnings for unsigned apps. ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 13:21 Thank you. This is a valid point. In the mad rush to get the MVP out, we missed releasing the Linux version. Give us a couple of hours and we will make the .deb and .rpm versions available :) ---------------------------------------------------------------------- otherwise_pretty · 2023-10-08 13:26 . ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 13:34 These are all great questions. In the mad rush to get the MVP out, we missed these. So thank you for calling them out.  **Privacy Policy, and Terms of Service:** We will make these available on our website pretty soon. In the meantime though, I can tell you that it would be pretty standard without any fancy or complex clauses.  **Nationality:** We are a team of a couple of engineers from the US and Canada working on this passion project at the moment. We would like to convey this to all of our future potential users. What would be the best way to do this? Would putting a simple "made with love in the US and Canada" on our website be sufficient? I am asking because I am genuinely curious how others do this, and what the best practice is. **Open source:** At this point, we are not open source yet, but we can make the source code available on request for our enterprise customers. We chose not to be open-source because being open-source requires a certain level of effort from our side to nurture/maintain the open-source community. We would also need to keep the code to a pretty good standard otherwise we'd probably get roasted publicly. So being as small as we are today we would need a *compelling* reason to invest efforts in being open source. That being said, we are open to hearing use cases and arguments in favor of being open-source. So please let us know the use cases or arguments for us being open-source :) ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 14:24 Hi community We are getting an equal amount of downvotes and upvotes. Our sincerest apologies if we unintentionally did something wrong here. ​ I would love to understand why some folks are downvoting this. I am genuinely curious to know what we did wrong here because we would like to improve our behavior in case :) ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 15:37 Hi u/bobbarker4444, I wanted to give you a quick update on the Linux build. I spent the last hour or so digging into what it would take for us to ship a Linux build. I underestimated the amount of effort required to ship a good experience as we would need to (1) compile for arm64 and amd64 both architectures and (2) also provide some scripts to users to install NVIDIA drivers (if missing). Unlike MacOS, Linux does not have a concept of universal binary so each binary needs to be compiled for specific host CPU architecture. While we really want to ship something in a couple of hours and delight you all, I don't think it can provide a good experience if we rush it. So please allow us about a day or so to build this properly. I will post here something soon. Stay tuned :) ---------------------------------------------------------------------- BaritonX · 2023-10-08 18:04 Thanks for your answer, it’s important for me because I prefer using european products than american, canadian or chinese one if I found equivalent for privacy law reasons. And if you’ll publish the terms of service the mention made with love in … will not be necessary ;) ---------------------------------------------------------------------- bobbarker4444 · 2023-10-08 18:56 Hey! Super cool that you're looking in to it! I totally get that the Linux ecosystem is far less unified than Mac (or even Windows) so that's completely fair. Building (and supporting) for linux is never as easy as Mac/Windows Wish you the best on the project, looks really neat! ---------------------------------------------------------------------- unengaged_crayon · 2023-10-08 19:49 for me i'd say the fact that this is macOS exclusive makes it a dealbreaker. most people here run headless linux or windows servers, this can't really be selfhosted behind a headless server at this minute. ---------------------------------------------------------------------- dangernoodle01 · 2023-10-08 21:04 >we can make the source code available on request for our enterprise customers. Probaby this: "At this point, we are not open source yet, but we can make the source code available on request for our enterprise customers. " Sounds a bit like we are not opensource, but if someone pays, they can get the code. This, in a subreddit called r/selfhosted.. not flying well. :) ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 22:18 Thank you :) ---------------------------------------------------------------------- jay-workai-tools · 2023-10-08 22:23 Thank you. ​ As I mentioned in [another comment thread](https://www.reddit.com/r/se lfhosted/comments/172nlgb/comment/k400sns/?utm_source=share&utm_medium =web2x&context=3), I am working on Linux build as we speak. I am aiming to have a Linux build available by tomorrow. Stay tuned. ​ For Windows, I also mentioned our [biggest blocker is the cost of a signing certificate](https://www.reddit.com/r/selfhosted/comments/172n lgb/comment/k3zgnnf/?utm_source=share&utm_medium=web2x&context=3). Would you all be interested in an unsigned Windows app? It may require you to jump through [7-8 popups](https://www.theregister.com/2020/06/0 5/windows_10_microsoft_defender_smartscreen/) that Microsoft has put in place for unsigned apps for now. The idea would be for us to start with an unsigned app, and then in future, as we scale, we can spend money on getting the expensive code signing certificate. ---------------------------------------------------------------------- unengaged_crayon · 2023-10-08 22:56 i think if the *only* blocker is the signing cert, i would say just publish it anyways, get the cert later, and distribute and md5 hash and like with it. however, open sourcing this software would certainly ease fears about unsigned software. ---------------------------------------------------------------------- [deleted] · 2023-10-09 05:46 [removed] ---------------------------------------------------------------------- jay-workai-tools · 2023-10-09 05:48 Hi u/bobbarker4444, Great news! We now have Linux builds available 🎉 Please download them from the following short links. * [Linux .deb for amd64 (x86\_64)](https://WorkAI.tools/ie/download- linux-deb-amd64) * [Linux .deb for arm64](https://WorkAI.tools/ie/download-linux-deb- arm64) * [Linux .rpm for amd64 (x86\_64)](https://WorkAI.tools/ie/download- linux-rpm-amd64) * [Linux .rpm for arm64](https://WorkAI.tools/ie/download-linux-rpm- arm64) ​ I will update the website tomorrow morning, but I wanted to give the self-hosted community these Linux builds as early as possible :) Please note that for WorkAI Tools to use NVIDIA GPUs, you will need to install the necessary drivers and restart the app. Here is a script that could help install necessary CUDA drivers: [https://github.com/WorkAI-tools/individual-edition/blob/main/install- cuda-drivers-linux.sh](https://github.com/WorkAI-tools/individual- edition/blob/main/install-cuda-drivers-linux.sh) Please try these and let us know if you have any feedback for us.