Post Ad0ffP047sbMLAIQTY by Salastil@pleroma.salastil.com
(DIR) More posts by Salastil@pleroma.salastil.com
(DIR) Post #Ad0dXyaTjIjeUHewMq by graf@poa.st
2023-12-20T18:37:50.714861Z
10 likes, 5 repeats
alright i just spent an entire hour configuring several RAID10 and RAID5 (and a single RAID6) in this storage server lets fucking go 120TB
(DIR) Post #Ad0eGeSnOeTX6bMuxs by Shlomo@poa.st
2023-12-20T18:45:55.701952Z
1 likes, 0 repeats
@graf Spamming large files go brrrr
(DIR) Post #Ad0eWcv2uFJUwuCSRc by graf@poa.st
2023-12-20T18:48:47.832798Z
3 likes, 2 repeats
@Shlomo yeah the poast matrix will support up to 30GB files when I'm done
(DIR) Post #Ad0edBlCHSGekDiq6C by Shlomo@poa.st
2023-12-20T18:50:00.055173Z
2 likes, 0 repeats
@graf See niggas. This is why we should support our fellow admin. Donate if you havent!
(DIR) Post #Ad0ekv9Bvn4fXLdGV6 by graf@poa.st
2023-12-20T18:51:23.310829Z
2 likes, 0 repeats
@Shlomo there's still 6 10TB drives free in this chassis I might add more to that raid, we'll see. currently media for the matrix is only at like 240GB. the database is fucked tho, like 450GB. I hate matrix protocol so much
(DIR) Post #Ad0epuJ8TpdCNff4Ou by graf@poa.st
2023-12-20T18:52:17.390012Z
4 likes, 0 repeats
@Shlomo somebody just uploaded a windows xp sp3 iso
(DIR) Post #Ad0eqPlZW9nTwqCiWm by coldacid@shitposter.club
2023-12-20T18:52:23.422832Z
1 likes, 0 repeats
@graf @Shlomo >database is almost twice the size of the files it is trackinghow the fuck
(DIR) Post #Ad0etZxO5NhyQFEv9k by graf@poa.st
2023-12-20T18:52:57.172881Z
1 likes, 0 repeats
@coldacid @Shlomo #matrixHQ and a couple other russian channels with like ~50k users you regularly have to compact room states or it will be >2TB on disk
(DIR) Post #Ad0f51kr4fYLoypwC8 by coldacid@shitposter.club
2023-12-20T18:55:01.820160Z
1 likes, 0 repeats
@graf @Shlomo ok so it's more than just metadata for uploads then
(DIR) Post #Ad0fC1cLyyczQICHCK by graf@poa.st
2023-12-20T18:56:16.926583Z
2 likes, 0 repeats
@coldacid @Shlomo yeah it s full of garbage. matrix-synapse does not come with maintenance in mind or tools baked in to do it. you have to use third party scripts/programs to trim the database and compact the states. how fucked up is that? "well just dont join those rooms"thats fine for a small server, but we host it publically for our users. you can't just tell them not to join a room that isnt violating any laws or rules
(DIR) Post #Ad0fQ3lIo4j07z4hvs by Moon@shitposter.club
2023-12-20T18:58:48.474344Z
3 likes, 0 repeats
@graf @Shlomo @coldacid This is exactly why SPC doesn't have one.
(DIR) Post #Ad0fQ9I6FYvlH9STFQ by coldacid@shitposter.club
2023-12-20T18:58:50.183027Z
0 likes, 0 repeats
@graf @Shlomo we live in an age where 80% of professional developers are still nothing more than script kiddies, what do you expect? There's no appreciation for tight code nor tight data like there used to be.Going beyond 640kB was a mistake.
(DIR) Post #Ad0fczEkwRE1rI12Y4 by graf@poa.st
2023-12-20T19:01:08.127886Z
1 likes, 0 repeats
@Moon @Shlomo @coldacid now that I know what I'm doing ours has run like a top for two years. just needs a kick in the balls every couple months to clear the database out. there's like no documentation on it at all. there's a bunch of software tools in various states of abandonment on github. if you have patience you can make it work but most people dont want to spend a couple hours every couple months for upkeep so i get it
(DIR) Post #Ad0ffP047sbMLAIQTY by Salastil@pleroma.salastil.com
2023-12-20T19:01:36.129751Z
1 likes, 0 repeats
@coldacid @Shlomo @graf Matrix is a flawed protocol that tracks the state of every single person that enters, exits, goes online, offline, away or whatever in a room. The larger the room the more events that you get and the faster your database bloats. There are some benefits to doing this, but they pale in comparison to that cost, it just becomes nonviable to run the platform, particularly at scale. Truth be told, Matrix is just a bad protocol design that over complicates things. All people want is IRC with modern UI and mobile apps that allows you to upload media directly, push notifications and chat history for when you're offline. Federation and E2EE is just sweeteners.
(DIR) Post #Ad0fkxQBZltUXnA8wq by coldacid@shitposter.club
2023-12-20T19:02:35.489352Z
0 likes, 0 repeats
@graf @Shlomo @Moon any way you can automate the cleanup so you don't have to spend a couple hours on it a month unless something actually fucks up? Would be nice to just stick that on like a monthly cron job and just tell everyone "shit's gonna be down between 3am and 5am second Sunday of the month" or something
(DIR) Post #Ad0flPsVm3Bmnkd9zE by sjw@bae.st
2023-12-20T19:02:40.993404Z
0 likes, 0 repeats
@graf TFW no RAID 60
(DIR) Post #Ad0fr7t7Ze18k9de5I by graf@poa.st
2023-12-20T19:03:42.905037Z
1 likes, 0 repeats
@coldacid @Shlomo @Moon the only automated task I do with database is offsite backup. no way i will trust any modifications to database that I'm not aware of and focused on
(DIR) Post #Ad0fr8nUC56VYy0ewK by Moon@shitposter.club
2023-12-20T19:03:42.302413Z
1 likes, 0 repeats
@graf @Shlomo @coldacid is it specific to the implementation of Matrix you have or does it use an API or something
(DIR) Post #Ad0fud16IKL09k2a9I by UnityOstara@poa.st
2023-12-20T19:04:21.550749Z
1 likes, 0 repeats
@graf @Moon @Shlomo @coldacid I feel bad when I critique others work when they obviously are more talented than me.
(DIR) Post #Ad0fvHPG7vQhQFeRMG by graf@poa.st
2023-12-20T19:04:27.957388Z
1 likes, 0 repeats
@Moon @Shlomo @coldacid no you have to use the API to do itthis has been a godsend github.com/matrix-org/rust-synapse-compress-state
(DIR) Post #Ad0g1aNKVvDBzUkv8S by Moon@shitposter.club
2023-12-20T19:05:34.407664Z
1 likes, 0 repeats
@graf @Shlomo @coldacid SPC does have one but it's private and for site business, I use Conduit. I guess would have to have a popular server like synapse to do this lol
(DIR) Post #Ad0g9S2HP6KoRWf04m by graf@poa.st
2023-12-20T19:07:01.534968Z
2 likes, 0 repeats
@Moon @Shlomo @coldacid morg is working on dendrite which is supposed to be nu-matrix but i'll be in a nursing home before its even in a stable state for productiongithub.com/matrix-org/dendrite
(DIR) Post #Ad0goxTBRDgdo42JjU by romin@shitposter.club
2023-12-20T19:14:32.079137Z
2 likes, 0 repeats
@graf @Shlomo @Moon @coldacid oh this is the designated matrix hate thread? A friend recently ran out of space on his small private homeserver and upon inspection one of the tables was eating 50GB of state spam.
(DIR) Post #Ad0gvH5JQHVmNXsmwq by graf@poa.st
2023-12-20T19:15:39.643105Z
1 likes, 0 repeats
@romin @Shlomo @Moon @coldacid yeah and the shit thing is you can compress states and remove old states but without having the space to do a vacuum you can't do fuck all about it so you cant fix it without moving the database to a larger disk or god forbid mounting S3 via goofys and doing it over S3
(DIR) Post #Ad0rwrxysjssYDPtFw by moth_ball@shitposter.club
2023-12-20T21:19:10.187763Z
1 likes, 0 repeats
@graf raid these nuts