๐Ÿ†• Cosmos 0.12 - HUGE update! All in one secure Reverse-proxy, container manager with app store, integrated VPN, and authentication provider, now has a Full Monitoring suite with alerts and notifications (including presets for anti crypto miner hacks!) ๐Ÿ“ˆ๐Ÿ“Š reddit / selfhosted ---------------------------------------------------------------------- azukaar ยท 2023-11-08 13:08 link: [https://github.com/azukaar/Cosmos- Server/](https://github.com/azukaar/Cosmos-Server/) Hello everyone! The "elusive", blurred out dashboard W.I.P. screen is almost a meme at this point. But all good things come to an end, to welcome even better things! Monitoring is finally fully implemented! Along side other improvements, the 0.12 is a HUGE update to Cosmos, with sexy graphs everywhere! [I added graphs everywhere! :D](https://preview.redd.it/fgx6wun1m3zb1. png?width=1280&format=png&auto=webp&s=a89cb3202053ae653cd0fa3ddef94b6a d13bbb7d) โ€‹ As a reminder, this exists alongside the existing features: * **App Store** ๐Ÿ“ฆ๐Ÿ“ฑ To easily install and manage your applications, with simple installers, automatic updates and security checks * **Customizable Homepage** ๐Ÿ ๐Ÿ–ผ To access all your applications from a single place, with a beautiful and customizable UI * **Reverse-Proxy** ๐Ÿ”„๐Ÿ”— Targeting containers, other servers, or serving static folders / SPA with **automatic HTTPS**, and a **nice UI** * **VPN** ๐ŸŒ๐Ÿ”’ To securely access your applications from anywhere, without having to open ports on your router. * **Authentication Server** ๐Ÿ‘ฆ๐Ÿ‘ฉ With strong security, **multi-factor authentication** and multiple strategies (**OpenId**, forward headers, HTML) * **Container manager** ๐Ÿ‹๐Ÿ”ง To easily manage your containers and their settings, keep them up to date as well as audit their security. Includes docker-compose support! * **Identity Provider** ๐Ÿ‘ฆ๐Ÿ‘ฉ To easily manage your users, **invite your friends and family** to your applications without awkardly sharing credentials. Let them request a password change with an email rather than having you unlock their account manually! * **SmartShield technology** ๐Ÿง ๐Ÿ›ก Automatically secure your applications without manual adjustments (see below for more details). Includes anti-bot and anti-DDOS strategies. โ€‹ So what is this fully featured monitoring system? WELL, first of all it's important to note it is fully persistent. A lot of software have graphs, but they start populating only when you open the webpage, and then the data is forgotten when you close it. Cosmos has a fully persistent 24/7 highly optimizedd data gathering system, so that all graph shows data at all time. โ€‹ [Graaaphs](https://preview.redd.it/oqz4j9ubm3zb1.png?width=1920&format =png&auto=webp&s=3d511a33d99e72332264e89d2d4befdad728149c) Why doing this? Isn't it a lot of storage? This is a good question: Monitoring is useless if it's not being looked at. And if not persistent, not only you have to be very lucky to open the webpage at the right time to detect a problem, but also you can't have an alert system, which is the core of any good monitoring. But worry not, Cosmos has a pipeline that optimize your data in real time: the older the data, the less precise they get, in order to save your storage. It is also highly optimized in order to keep the RAM and CPU usage extremely low, even on very cheap servers. Monitoring is difficult to get right but I think you will find this will hit the spot! โ€‹ [Customizable alerts](https://preview.redd.it/ulh4jgufm3zb1.png?width= 1920&format=png&auto=webp&s=8b74f79b77afd73a807461a05329673ea5dd5c35) So how do you use this awesome tool? When designing it, I was very conscious of thinking "how will users use it". I did not want to just show graphs for the sake of having graphs, that is why I imagined an entire workflow, that starts in the dashboard. You see, you can zoom in and out of the graphs (you can test this in the demo: [https://cosmos-cloud.io/cosmos-ui/](https://cosmos- cloud.io/cosmos-ui/)) and when you do so, all the graph and the data in the tables are updating everywhere as you navigate. For example, highlight a peak of resources, and the right hand side table will tell you which container caused the resources peak: [synchronizing, but also all the other graphs are changing at the same time](https://preview.redd.it/jdy0p8vim3zb1.png?width=1599&format=png& auto=webp&s=01f9e661a68c73635fd4312916b36fddfa55dec0) Once you have identified a potential culprit, you can click on it to get their isolated metric: โ€‹ [Looks like we have a culprit!](https://preview.redd.it/y74tz3anm3zb1. png?width=1369&format=png&auto=webp&s=79f59d70cdb988dc869b054746136d15 7525f515) You might think, "alright pretty cool", but it's over! Now that we know "who" caused the issue, we might also want to know why. For this, we want to go to the last tab: "events". This is an improved version of logs with advanced search (including BSON requests). That screen will tell us what happened. That screen also is synchronized with zooming into the graphs! โ€‹ [Looks like someone tried to force the shield!](https://preview.redd.i t/cmeqnfuqm3zb1.png?width=1584&format=png&auto=webp&s=50f90cad29cd4837 523f13207e416b6df38329f2) โ€‹ Alright so that's neat, but also graphs are just pretty so I added them everywhere! Home screen, URL screen, container screen... โ€‹ [I will let you discover the other places ;\)](https://preview.redd.it /cxnm52jum3zb1.png?width=1666&format=png&auto=webp&s=25ed7ce709f697f8d 95bed365c7f413d0a9e1a64) โ€‹ So anything else in that already huge updates? Well we have notifications! You will get notifications for many things including certificate renewing, alerts and container updates! https://preview.redd.it/ct2lx22ym3zb1.png?width=522&format=png&auto=we bp&s=bc458b7800b8c417282ca94cee54c566142158df Here's the entire changelog, and as always, Happy hosting! \- New real time persisting and optimized metrics monitoring system (RAM, CPU, Network, disk, requests, errors, etc...) \- New Dashboard with graphs for metrics, including graphs in many screens such as home, routes and servapps \- New customizable alerts system based on metrics in real time, with included preset for anti-crypto mining and anti memory leak \- New events manager (improved logs with requests and advanced search) \- New notification system \- Added Marketplace UI to edit sources, with new display of 3rd party sources \- Added a notification when updating a container, renewing certs, etc... \- Certificates now renew sooner to avoid Let's Encrypt sending emails about expiring certificates \- Added option to disable routes without deleting them \- Improved icon loading speed, and added proper placeholder \- Marketplace now fetch faster (removed the domain indirection to directly fetch from github) \- Integrated a new docker-less mode of functioning for networking \- Added a dangerous IP detector that stops sending HTTP response to IPs that are abusing various shields features \- Added CORS headers to openID endpoints \- Added a button in the servapp page to easily download the docker backup \- Added Button to force reset HTTPS cert in settings \- Added lazyloading to URL and Servapp pages images \- Fixed annoying marketplace screenshot bug (you know what I'm talking about!) \- New color slider with reset buttons \- Redirect static folder to host if possible \- New Homescreen look \- Fixed blinking modals issues \- Add AutoFocus on Token field for 2FA Authentication (thanks u/InterN0te) \- Allow Insecure TLS like self-signed certificate for SMTP server (thanks u/InterN0te) \- Improve display of icons \[fixes #121\] \- Refactored Mongo connection code \[fixes #111\] \- Forward simultaneously TCP and UDP \[fixes #122\] ---------------------------------------------------------------------- dustinjack99 ยท 2023-11-08 13:33 Fantastic work as always ๐Ÿ‘ ---------------------------------------------------------------------- azukaar ยท 2023-11-08 13:35 Thanks :D !! ---------------------------------------------------------------------- Mintfresh22 ยท 2023-11-08 14:08 This looks like a great update. You are doing some really good work. I am starting to see videos about your project on YouTube, so that means you hit the big time! ---------------------------------------------------------------------- aoristdual ยท 2023-11-08 14:10 Without diminishing the achievement here, I just want to call out that this product is not technically open source. The customized version of the Apache license used for this project is not approved by the Open Source Initiative and it is not clear whether it meets the Open Source Definition. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:10 Let's goo โœจ Working on the code is difficult, but getting people to actually talk about it is even harder :p ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:12 It does not claim to be open source, but as long as you are an individual using Cosmos without selling it, the license gives you the same amount of rights, aka. use the product, fork it, redistribute it. This is done to prevent companies to sell Cosmos as a SaaS product ---------------------------------------------------------------------- Mintfresh22 ยท 2023-11-08 14:23 I think this update will help a lot with that problem. If nothing else it makes it look more like a completed project than an alpha. The one thing I see people complain about is there is no built in file browser like CasaOS. Do you plan something like that or is there a reason it won't work on your platform? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:25 Definitely will add it, I want to add remote storage management too, to attach say dropbox to a container directly as if it was a volume ---------------------------------------------------------------------- Mintfresh22 ยท 2023-11-08 14:28 Nice. When I see that complaint again, I will let people know it is coming! ---------------------------------------------------------------------- sadhgurukilledmywife ยท 2023-11-08 14:29 I'm sure you have gotten this before, but what's the difference between using this and configuring your own system with Nginx, Portainer and a bunch of other stuff? I'm planning to expose my server finally, and am wondering if I should use this or learn and setup everything manually.. any insights? ---------------------------------------------------------------------- keixver ยท 2023-11-08 14:37 Not OP or developing the app, but based on previous posts and what i read about it, this is intended to be an all-in-one solution that should incorporate the basic needs of securely self-hosting. Ofc you can replicate all that and have a more granular control, but some don't want the hassle ---------------------------------------------------------------------- Stetsed ยท 2023-11-08 14:38 So I am not the developer, but it seems like it just integrates a bunch of diffrent projects into a nice UI. Personally I would rather use a few smaller tools instead of 1 massive one but that's more my personal preference. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:41 PROS of Cosmos: \- This takes 15min to setup \- Everything is integrated together (for example each pieces report to the monitoring, product notifications, the URL can point directly to container instead of IPs, etc...) \- It's more lightweight, a single container using < 100mb of RAM and almost not CPU compared to many containers using more than that \- Has a consistent UI across everything PROS of DIY: \- More controls \- More choices ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:42 It does not use other projects, most things are actually built-in, which makes it very consistent, integrated seamless and lightweight (to a level you couldn't reach if you did things with individual projects) On the other hands doing things yourself does give you more control/choices ---------------------------------------------------------------------- starxraider ยท 2023-11-08 14:45 Huh! Just stumbled across this! Will take a more in depth look at this tonight. :) I assume this could replace my NPM? ---------------------------------------------------------------------- Stetsed ยท 2023-11-08 14:47 I should have said other functionalities, not other projects. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:53 correct! \^\^ ---------------------------------------------------------------------- starxraider ยท 2023-11-08 14:54 Very cool! Love the look and layout! :) ---------------------------------------------------------------------- azukaar ยท 2023-11-08 14:59 Thanks!! ---------------------------------------------------------------------- Simplixt ยท 2023-11-08 15:00 Sounds to good to be true :D I'm using Portainer + Caddy + certbot + Authentik + WireGuard + Watchtower to achieve the exact same goals, but with much higher effort to setting it up ... To be honest - I'm not a fan of an All-in-One "blackbox" who is doing everything automatically, but really want the transparency / security / reliability of configuring established tech stacks to fit my needs. But for beginners, this looks awesome! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:03 Completely understandable! (do note that using Cosmos does not lock you out of most of those things, as a blackbox is exactly what I want Cosmos **not** to be \^\^ for an-all-in-one kind of deal it is very flexible and transparent and will open up even more in the future with APIs) ---------------------------------------------------------------------- RiffyDivine2 ยท 2023-11-08 15:03 Awesome, thanks for the update. ---------------------------------------------------------------------- kn33 ยท 2023-11-08 15:13 This is terrific. If I wanted to integrate with CloudFlare Access for authentication and CloudFlare Proxy for WAF would that be possible? I ask because if I'm sharing with others, I can have them sign into CloudFlare Access with Google and not have to deal with them having a separate account. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:20 It does not support login in with external OpenID provider such as google, apple, etc... As it is an OpenID provider that would make the experience off WAF is usable thought, but you need to enable full strict TLS mode and use the DNS challenge ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:21 no problems :D ---------------------------------------------------------------------- Spaceman_Splff ยท 2023-11-08 15:36 Looks amazing. Iโ€™m just a little scared because I tried this probably about a year ago and was using the nextcloud app and it completely reset the instance. ---------------------------------------------------------------------- kn33 ยท 2023-11-08 15:36 That pretty well makes sense. [Reading the docs](https://cosmos- cloud.io/doc/2%20setup/#step-3-https), it looks like I can use a CF origin server certificate if I'd like. Is it possible to use a CF [Authorization Cookie](https://developers.cloudflare.com/cloudflare- one/identity/authorization-cookie/) for authentication instead of OpenID? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:38 This means you haven't properly mounted the Nextcloud volume and the data gets reset everytime the container is updated (that's how Docker works: VM are completely immutable) ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:39 You can use the CF Origin server certificate but this is very unsecure compared to locally sourced HTTPS with LE No it does not support the CF authorization cookie ---------------------------------------------------------------------- edgan ยท 2023-11-08 15:47 It looks like a very sweet project. But it has one sour note, MongoDB. It is a tolerable dependency, but an SQL would have been a better choice. There are many reasons that almost no one uses MongoDB both professionally or personally. ---------------------------------------------------------------------- Tempestshade ยท 2023-11-08 15:49 I would love to test. Is migrating from CasaOS possible? I have several running containers. ---------------------------------------------------------------------- root_switch ยท 2023-11-08 15:53 Super awesome project although looks like a monolith approach, if cosmos goes down so does half my tools which is the exact opposite decoupled approach I want in my container environment. But seriously great work, this looks like an awesome solution for some that want the all-in-one approach ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:56 I beg to differ, Mongo is a widely used Database, and while I understand that there are advantages to using relational databases, Mongo gives me a much easier to manage dependency from DevEx perspective. And considering how much work this project already all is, any help from tooling is more than welcomed ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:56 Yes just install it it will see all your containers out of the box ---------------------------------------------------------------------- edgan ยท 2023-11-08 15:58 I would agree if this was more of a professional project, but given the scale of self-hosted I think it is the right balance for complexity. Unless you are running a highly available Kubernetes cluster of all the microservices for a large extended family. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 15:59 Thanks! The advantages of coupled containers are \- easier setup and maintenance, no situation where one of the container is down, updates are out of sync, no docker setup/networking issues, etc... \- much more lightweight (all the features together consume 30mb to 100mb RA M depending on request load, and almost no CPU at all) ---------------------------------------------------------------------- clarksonswimmer ยท 2023-11-08 16:05 Am I the only one who doesn't want all in one containers? ---------------------------------------------------------------------- kn33 ยท 2023-11-08 16:06 I'm confused why you consider that to be less secure. ---------------------------------------------------------------------- LostPixelArt ยท 2023-11-08 16:07 Can I get a link for a YouTube video about it? ---------------------------------------------------------------------- Tempestshade ยท 2023-11-08 16:08 Excellent. Outside of your lane, but do you know if I uninstall CasaOS will it uninstall/stop/remove all of my docker containers as well? ---------------------------------------------------------------------- bjjit ยท 2023-11-08 16:08 Any reason this wouldn't work with Podman? Sorry for the lazy question. I won't have time to check until tomorrow evening or Friday. ---------------------------------------------------------------------- Significant-Neat7754 ยท 2023-11-08 16:14 Whoa! This looks so cool! ---------------------------------------------------------------------- arvigeus ยท 2023-11-08 16:14 It would be nice if it had some ntfy or similar integration. I want to receive notifications on my phone if an app has an update or crashed, or if monitoring has something important to report. I plan to use Cosmos as soon as I have time to figure out how to migrate my docker-compose setup and files. Maybe you should add instructions for migrating from other setups in the documentation, unless it's trivial / too specific. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:15 The advantages of coupling in one container are \- easier setup and maintenance, no situation where one of the container is down, updates are out of sync, no docker setup/networking issues, etc... \- much more lightweight (all the features together consume 30mb to 100mb RA M depending on request load, and almost no CPU at all) \- This takes 15min to setup \- Everything is integrated together (for example each pieces report to the monitoring, product notifications, the URL can point directly to container instead of IPs, etc...) \- It's more lightweight, a single container using < 100mb of RAM and almost not CPU compared to many containers using more than that \- Has a consistent UI across everything ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:16 Sorry I misread to CF's shared cert in this case it's not less secure but wouldn't you need to update these manually? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:17 Honestly no idea but I doubt it ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:17 Some stuff are slightly different so it does not work with Podman at the moment, but it is planned eventually ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:18 Thanks! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:18 I am actually planning on adding notification support to the Cosmos app directly :) ---------------------------------------------------------------------- clarksonswimmer ยท 2023-11-08 16:20 I understand the benefits but it's also an anti-pattern for containerization ---------------------------------------------------------------------- Spaceman_Splff ยท 2023-11-08 16:21 I will spin up another instance and give it another shot. Iโ€™ll look out for those settings. ---------------------------------------------------------------------- arvigeus ยท 2023-11-08 16:23 Wouldn't that be too big of a task itself? Anyway, happy to hear this! Consider some people might want something like custom hooks for their projects. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:23 It's not, it's only an anti pattern if you run NGINX+Portainer+etc... which are different software into a single container Cosmos is not using those under the hood, it's a single software that have all those feature built-in, even if you wanted to you couldn't break it into multiple containers Containerization does not say you should break features into multiple containers, only applications ---------------------------------------------------------------------- Significant-Neat7754 ยท 2023-11-08 16:26 Do the LE SSL certificates get generated in case of CGNAT? (When the LetsEncrypt servers can't reach the server) In my case, for example, Certbot doesn't work and I have to use other ACME clients for this. I was wondering if this is taken care of by the software at your end. ---------------------------------------------------------------------- kn33 ยท 2023-11-08 16:27 You select the lifetime of the certificate - between 7 days and 2038. Normally I'd consider such a long lifetime insecure, but it's not a publicly trusted certificate, just trusted by CF's proxy servers, and they have the option to revoke it through the dashboard if you believe it's compromised. I'd probably set it to either the 3 year or maximum length option so that renewing it isn't a headache. ---------------------------------------------------------------------- clarksonswimmer ยท 2023-11-08 16:28 >It's not, it's only an anti pattern if you run NGINX+Portainer+etc... which are different software into a single container I agree with that but I believe the intent is to avoid creating monolithic containers ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:30 No not really, Cosmos already have an app so it's just a matter of having a notification channel plugged into the existing notification system in the server :) API to integrate into Cosmos is going to be the focus of next year, but I want it to be the other way around: other services integrating into Cosmos, as Cosmos is the platform not the app ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:30 It will only work with the Let's Encrypt DNS challenge ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:30 Understood! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:32 Monolithic server management makes sense in the scale of self-hosting a home server. Breaking it down only offers downsides IMO ---------------------------------------------------------------------- Mintfresh22 ยท 2023-11-08 16:33 It is about 4 months old so a lot is outdated but [here it is.](https://www.youtube.com/watch?v=_Yz_rtpOeLE&t=383s) ---------------------------------------------------------------------- Cobthecobbler ยท 2023-11-08 16:33 Been interested since I saw one of the first posts. Looks like it's coming along yet. I've yet to experiment with this but one day I'll muster up the motivation ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:42 Good luck ahah! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:45 Completely agree, especially if you have a HUGE family ahah ---------------------------------------------------------------------- superior_ ยท 2023-11-08 16:46 This looks really amazing. I will try it this weekend! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:48 Thanks you! :) ---------------------------------------------------------------------- Defiant-Ad-5513 ยท 2023-11-08 16:53 Is the "firewall"/security completely custom? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 16:55 Yes it is ---------------------------------------------------------------------- arvigeus ยท 2023-11-08 17:01 Wow. Just wow! :) ---------------------------------------------------------------------- superior_ ยท 2023-11-08 17:03 Even though I haven't deep dived into this. Can I ask you a question? I am using portainer to also add portainer agents on remote servers to get a general view. Does this in any way replace portainer? :) ---------------------------------------------------------------------- Potajito ยท 2023-11-08 17:03 Lovely how a random internet dude has the audacity to tell the project maintainer that this is better than than without knowing anything about the project and its needs... I also use Mongo here and there, and the only thing (could be big thing or not, depends) that could be better is the license. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:06 You can use both, Portainer has a few advanced feature that Cosmos does not have, but Cosmos does not complain if you edit Cosmos-managed containers from Portainer, it is built to react to changes in real time to allow you to do exactly that! ---------------------------------------------------------------------- superior_ ยท 2023-11-08 17:08 Sounds promising! I really like this. So it also means that I can keep my containers as is from stacks in Portainer and then just turn on auto update on the containers from cosmos? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:09 Correct, all other features will work to: reverse proxy, monitoring, etc... ---------------------------------------------------------------------- superior_ ยท 2023-11-08 17:10 Love what I am hearing. Looking forward to trying this out. :) ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:12 Coincidentally just stumble across this comment that perfectly encompasses the added complexity of going full relational in such as fast moving software: https://github.com/fastenhealth/fasten- onprem/issues/237#issuecomment-1684021801 ---------------------------------------------------------------------- MDSExpro ยท 2023-11-08 17:16 Still waiting for such tool, but build on top of Kubernetes, not Docker. ---------------------------------------------------------------------- csolisr ยท 2023-11-08 17:41 Just in time for me to test it! I've been using YunoHost for a few years, but yet again we've reached that awkward phase where the new Debian stable version is out, but YNH hasn't been updated to support it, while the apps I depend upon move to the new Debian as a dependency. I tried CasaOS and found it severely lacking, I also tried something called DockStarter but it's even more primitive and requires much more manual configuration. I'm going to test Cosmos probably tonight, thanks in advance! ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:42 GLHF! ---------------------------------------------------------------------- csolisr ยท 2023-11-08 17:42 In related news: have you tried to "dog-food" your social networks and try hosting Discord / GitHub / Reddit alternatives by yourselves? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:47 I'd love to self-host those, but fediverse being severely under- developed I would missing out on the exposure Discord / GitHub / Reddit are providing me. May be in the future when Cosmos is widely spread to people's home will I be able to transition to that model :D ---------------------------------------------------------------------- csolisr ยท 2023-11-08 17:49 Fair enough! Although trying at least a bridge for Discord and a GitHub mirror would be a nice start. Second: if I already pay for a network-facing VPS to bypass the CG-NAT block on my home server, can I still use Constellation for free to connect them with each other, or do I need to subscribe anyway? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 17:53 Yes, it would be nice but they would be high maintenance for lower returns compared to their counterparts. May be I can consider it when development slows down and I have more time for it And yes you will still need it, the subscription is more like an unlock feature kind of subscription, not a rent a VPS kind of subscription (it does not provide you with a VPS or anything, although that will probably change one day but no official plan) ---------------------------------------------------------------------- Hawtre ยท 2023-11-08 18:10 If you think of containerisation and microservices as indepedent things I think it makes more sense ---------------------------------------------------------------------- Tempestshade ยท 2023-11-08 18:17 Thank you! I really appreciate you taking the time to answer my questions by the way! I will be installing tonight and giving a test :) ---------------------------------------------------------------------- RiffyDivine2 ยท 2023-11-08 18:24 Weird thing, maybe it's just me. But when I get to step two and tell it to create the database, I can see it under docker ps but it just sits on the installer saying loading. I figured after ten minutes it should be up but it's still not seeing it and redoing it just made another database. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 18:28 make sure Docker and your system are up to date and try again with a clean install (the checkbox on screen 1) :) ---------------------------------------------------------------------- Mandus_Therion ยท 2023-11-08 18:29 Trying to find a list of the apps available on the market but i cant ---------------------------------------------------------------------- RiffyDivine2 ยท 2023-11-08 18:32 Can do. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 18:35 You can see the market here: https://cosmos-cloud.io/cosmos-ui/market- listing Other than that if an app is missing you can import a docker-compose and get going ๐Ÿ™‚ ---------------------------------------------------------------------- clegmir ยท 2023-11-08 18:36 This looks great! Just to make sure I'm understanding correctly, I would still need something like a NAS on the side to serve up the storage to the server Cosmos would run on? Using NextCloud as an example, if I wanted to use something like unRAID or TrueNAS to have a storage array with parity and then carve out a share from that which gets mounted on the host where Cosmos is running? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 18:40 \> Just to make sure I'm understanding correctly, I would still need something like a NAS on the side to serve up the storage to the server Cosmos would run on? Your server can be your NAS, your NAS can be your server You can also run Cosmos on TrueNAS for example. It's just an app ---------------------------------------------------------------------- clegmir ยท 2023-11-08 18:41 That makes sense, thanks! ---------------------------------------------------------------------- GrabbenD ยท 2023-11-08 19:23 Wow, great work!! This would be the ultimate dashboard if you could monitor/manage virtual machines u/azukaar ---------------------------------------------------------------------- RiffyDivine2 ยท 2023-11-08 19:37 Can you do smb/nfs volumes? I went under the servapps to add one and only see local as a choice. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 19:38 You need to mount the share somewhere on your server then you'll be able to use the path to them Mounting from UI is an upcoming feature ---------------------------------------------------------------------- tradinghumble ยท 2023-11-08 19:39 great ---------------------------------------------------------------------- Snowmobile2004 ยท 2023-11-08 20:21 Is there some way to export my hosts from NPM into this? I have like 150 hosts I donโ€™t wanna manually migrate ---------------------------------------------------------------------- azukaar ยท 2023-11-08 20:23 Sorry no way to do this automatically :/ ---------------------------------------------------------------------- Amwo ยท 2023-11-08 20:24 I have been eyeballing this project for a while to replace my proxmox setup, which to be honest is way over complicated for my knowledge and the amount of time I have to tinker with things. I do have two questions though: I have a nordVPN subscription and would like to run couple apps through it (qbittorrent, *arrs). Is this doable decently easy? For speed sake, I think I would rather keep the rest running without vpn. Also how would I go about hosting VMs? I have a need for one or two VMs (one windows, one linux), can I do it somehow through Cosmos or would I need to run vmware on the host? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 20:26 You can run Cosmos inside Promox to continue using your VM To run your app through NordVPN (dont know if thats possible??) you'd just have to setup NordVPN yourself and change the network mode of your containers (the same way you would without Cosmos basically) ---------------------------------------------------------------------- Amwo ยท 2023-11-08 20:31 >You can run Cosmos inside Promox to continue using your VM I guess I could, but I am really tired of the file permission hell I am facing now having my ZFS bind mounted to all LXCs that require access to it. I want to simplify this as much as possible. >To run your app through NordVPN (dont know if thats possible??) you'd just have to setup NordVPN yourself and change the network mode of your containers (the same way you would without Cosmos basically) Right now I just have my *arrs and qbit in a LXC container with headless nordvpn app installed. I don't use docker. ---------------------------------------------------------------------- Judman13 ยท 2023-11-08 20:38 Yep this is the exact lesson I learned using homeassistant to be my appstore/dashboard/reverse proxy/vpn/adguard solution. Technically all those things can be installed and run in containers under homeassistant, but with homeassistant breaks I lose everything. Now I have proxmox running lxc's with all the services segregated and am working on clustered HA to reduce the single point failure. Is my infrastructure/hosted software mission critical? No, but a few of my family and friends use it regularly and I use it religiously so I want to reduce downtime as much as possible. ---------------------------------------------------------------------- azukaar ยท 2023-11-08 20:40 You need to use this [https://github.com/bubuntux/nordvpn](https://git hub.com/bubuntux/nordvpn) And then set the network mode on the other containers to be that container, then you can point yur URLs to the right port on the nordvpn container ---------------------------------------------------------------------- MacGyver4711 ยท 2023-11-08 21:02 Guess I have some tinkering to do this weekend. Haven't tried it yet, but it looks very promising. I did use NPM for a while, but I ended up replacing it with Cloudflare for various reasons. Will surely give this a shot. Great work..!! ---------------------------------------------------------------------- TheDrunker ยท 2023-11-08 21:58 Newbie here: would this work on an Orange Pi 5+? Could I set this up on an OPI5+ acting as a middle connection between my isp modem and my own home network? Can it be used as a router as well? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 22:21 It's an ARM based raspberry alternative yes? So it should be just fine yes you can do that, the included VPN allows you to access stuff on other networks by router you mean reverse proxy? Then yes ---------------------------------------------------------------------- RiffyDivine2 ยท 2023-11-08 22:24 No worries, I was going to play around with loading a stack in from portainer to test it. Can't wait for the update, I am loving it so far. ---------------------------------------------------------------------- TheDrunker ยท 2023-11-08 22:26 By router, I mean: could this replace/work together with pfsense (or something similar)? ---------------------------------------------------------------------- UnfairerThree2 ยท 2023-11-08 22:48 Outside of the open source initiative and FSF, donโ€™t most people consider it anyway to be โ€œopen sourceโ€ but not FOSS? ---------------------------------------------------------------------- azukaar ยท 2023-11-08 23:10 alongside yes, replace no ---------------------------------------------------------------------- JigSawFr ยท 2023-11-08 23:17 Very nice project. Is it possible to use Tailscale instead of constellation ? ---------------------------------------------------------------------- bjjit ยท 2023-11-09 00:03 Right on, pardner. Thanks for the response! I'll keep an eye out for it. ---------------------------------------------------------------------- azukaar ยท 2023-11-09 00:41 Yes! But of course you'll have to set it up yourself ---------------------------------------------------------------------- noeyedeeratall ยท 2023-11-09 02:04 This update is amazing. Discovered Cosmos about two months ago just as I was beginning my (2nd attempt) self-hosted journey. Cosmos is fantastic. Thanks so much for your excellent work. ---------------------------------------------------------------------- xtigermaskx ยท 2023-11-09 02:16 Very cool project! I may give it a try ---------------------------------------------------------------------- sanjosanjo ยท 2023-11-09 03:06 Is there an explanation somewhere of how the https certificate works when using this on a home network? I'm only familiar with using a domain name and a fixed IP address to get the certificate. ---------------------------------------------------------------------- ContentMountain ยท 2023-11-09 06:59 How does the reverse proxy perform compared to showing like nginx and caddy? Is it similar? ---------------------------------------------------------------------- Moultrex ยท 2023-11-09 07:42 Can i replace NPM with this? I just use NPM for reversing proxying inside my containers. ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:27 Thank you!! ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:27 Thank! ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:28 You can use a domain name in your home network if you dont have a static IP you can DynDNS it ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:29 I would expect it does not scale as high as NGINX (ex. large amount of requests) but it is similar performance for a home server ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:29 You can ! ---------------------------------------------------------------------- tech2but1 ยท 2023-11-09 09:32 I like the idea of Cosmos and tried it out a little while ago but got wrapped up in the domain/certificates settings and lost access so gave up (I know I know, I should have persevered). I already have NPM set up and would like to continue using that so won't have Cosmos internet facing directly. Am I just going to make this hard for myself doing this or did I just select the wrong options last time? ---------------------------------------------------------------------- azukaar ยท 2023-11-09 09:58 always make sure you try with the incognito mode of your browser HTTPS certs and HTTTPS redirections get cached and that can easily mess you up ---------------------------------------------------------------------- catmandx ยท 2023-11-09 10:38 I noticed there is a open redirection vulnerability in the login page. I have created a PR to fix it. Please review if you have the time. [https://github.com/azukaar/Cosmos- Server/pull/128](https://github.com/azukaar/Cosmos-Server/pull/128) ---------------------------------------------------------------------- azukaar ยท 2023-11-09 11:36 Thanks I will review and merge it right now :) ---------------------------------------------------------------------- JustNathan1_0 ยท 2023-11-09 13:08 Yknow this looks awesome. I am installing on my server as we speak ---------------------------------------------------------------------- Footz355 ยท 2023-11-09 13:26 Greetings, I have Ubuntu server with portainer and docker, about 12 services running. Would installing Cosmos possibly breake my setup? I'm selfhosting noob, my small server is working fine so I wouldn't like to brake it. I access services via Hompage, and maintain the server itself via Webmin. For outside access I use Zerotier so no ports ezposed. Would love to try Cosmos but is it safe to install it on top of my server to try it out, or better to start fresh? ---------------------------------------------------------------------- gintoddic ยท 2023-11-09 13:27 i'm not certain i could use this. I already have my plex etc installed on a debian server, does this supplement that? ---------------------------------------------------------------------- scubieman ยท 2023-11-09 13:30 Do you have a docker image so I can add to my unraid? ---------------------------------------------------------------------- azukaar ยท 2023-11-09 13:32 do not use Unraid to manage Docker, or any other containers that might be edited outside of Unraid. Unraid is not compatible with this kind of things You can use the docker image with the docker run command on your Unraid ---------------------------------------------------------------------- azukaar ยท 2023-11-09 13:32 as a proxy yes ---------------------------------------------------------------------- scubieman ยท 2023-11-09 13:32 >use the docker image with the docker run command on your Unr Thank you! ---------------------------------------------------------------------- azukaar ยท 2023-11-09 13:33 It wouldnt, it doesnt do much until you tell it to, and it's quite widely compatible ---------------------------------------------------------------------- azukaar ยท 2023-11-09 13:33 thanks! ---------------------------------------------------------------------- gintoddic ยท 2023-11-09 13:38 so i can just install alongside existing services and use it as a more secure tunnel? ---------------------------------------------------------------------- azukaar ยท 2023-11-09 13:50 exactly ---------------------------------------------------------------------- dalso0418 ยท 2023-11-09 14:12 Can I also see the log of http/https on the dashboard?? I think it would be more complete in security if it could be integrated with WAF / Crowdsec in conjunction with those logs!! \+http3 is also looking forward to it!! ---------------------------------------------------------------------- dalso0418 ยท 2023-11-09 14:24 \++The smart shield function is very good I hope the administrator can specify the black list ip himself. (Separate list(?) ---------------------------------------------------------------------- azukaar ยท 2023-11-09 14:25 You can whitelist IPs for URLs so that only a specific IP or range can access them (ex. local ip only) ---------------------------------------------------------------------- dalso0418 ยท 2023-11-09 14:31 Whitelist is good, too If a particular host uses a lot of resources and is suspected to be malicious, a blacklist that can be blocked would also be good. If it works with Crowdsec, it would be fantastic to query Crowdsecapi for malign activities and if it is malign, it would be automatically reflected in the blacklist. \*Please understand even if there are mistranslation due to the use of the translator. It's a fantastic project! ---------------------------------------------------------------------- szatan-norakurczaka ยท 2023-11-09 15:45 I will check it out. ---------------------------------------------------------------------- preyed ยท 2023-11-09 15:49 If I wanted to use NAS shares for apps like Sonarr/Radarr/Media..ect Do I need to declare those during the docker run command or can those be defined in within the apps? ---------------------------------------------------------------------- Tr4nn3 ยท 2023-11-09 17:04 I tried installing Uptime-Kuma from the marketplace but can't access it due to the websocket not being enabled, which is required when using a reverse proxy. Looking over the documentation it says you need 2 extra headers for this, Upgrade and Connection if I remember correctly. Only I can't find where to add these in Cosmos anywhere. What am I doing wrong here? ---------------------------------------------------------------------- azukaar ยท 2023-11-09 17:08 Websocket is supported and enabled usually websocket fails if the app tries to use a WS:// (insecure socket) over an HTTPS connection which is blocked by the browser ---------------------------------------------------------------------- chall3ng3r ยท 2023-11-09 19:19 This is nice, and on time when I'm looking for better option than managing my server and containers manually. Going to give it a spin. ---------------------------------------------------------------------- JustNathan1_0 ยท 2023-11-10 01:33 Biggest feature I request is a app on the apple appstore for it but that is likely going to be a lot of work so I don't expect that anytime soon lol. I installed it and I love it. I've tried all those alternatives like yunohost and I hated yunohost. This is like perfect. It even picked up my already running AMP instances and everything. ---------------------------------------------------------------------- azukaar ยท 2023-11-10 09:43 IOS app is on the work... Actually a good chunk of it is written but there is still a good 2 week ends of work on it left. So don't be too pessimistic ;p Good to hear you are enjoying it! ---------------------------------------------------------------------- ParticularCod6 ยท 2023-11-10 23:50 https://github.com/YoRyan/mailrise Something like this would be good. Most applications support SMTP notification and then we ca take that and convert how we like it ---------------------------------------------------------------------- AKAManaging ยท 2023-11-16 00:59 I know there's installation documentation, but is there a guide or unrelated documentation (not associated with Cosmos) that would be a bit more "dumbed down" version for installation? I feel like my level of knowledge is juuuust a bit under what's required in order to set this up properly, and it's frustrating not being able to figure out the proper thing to Google in order to alleviate my frustration. ---------------------------------------------------------------------- azukaar ยท 2023-11-16 10:11 Tutorial: https://cosmos-cloud.io/blog/getting-started-with-cosmos- cloud-a-beginners-guide-to-self-hosting.html Another tutorial by Engel: https://guides.engels.zip/ A video tutorial by BigBearTechWorld: https://www.youtube.com/playlist ?list=PL2RAscIdkpt\_xLNFsYzXSETZjeX8zdBYj ---------------------------------------------------------------------- volrod64 ยท 2023-11-21 18:53 I'll try to give it a go, look amazing ! ---------------------------------------------------------------------- azukaar ยท 2023-11-21 18:57 have fun! ---------------------------------------------------------------------- volrod64 ยท 2023-11-21 21:54 I'm actually kinda worried, as a noob at self hosting .. I have everything running with a docker compose right now, do I have to remap everything again ? ---------------------------------------------------------------------- azukaar ยท 2023-11-21 22:19 Cosmos will just see the containers you already have it's ok ---------------------------------------------------------------------- volrod64 ยท 2023-11-22 18:42 After the first setup (creating database, create admin account) it restarted and ask for a user/password ... Am i suppose to know what to write ? ---------------------------------------------------------------------- AKAManaging ยท 2023-11-23 21:17 Not dumbed down enough, I guess. Unsure of how I managed it, but somehow I got it so my publicfacedIP:80 brings me to my router login page. Good job, me. ---------------------------------------------------------------------- azukaar ยท 2023-11-23 23:17 It's always the silliest mistakes that gets you :p