Post APqC24eWUvJVWhXIv2 by js@mstdn.io
(DIR) More posts by js@mstdn.io
(DIR) Post #APq8fBLb8nuxlc4os4 by js@mstdn.io
2022-11-21T20:47:11Z
0 likes, 1 repeats
Can anybody share some stats on how much database space a single user Mastodon instance needs?
(DIR) Post #APq8sETioM6rF56ELo by rappet@chaos.social
2022-11-21T20:48:44Z
0 likes, 0 repeats
@js SPARC64 Mastodon server?
(DIR) Post #APq8tM16Gko8uaFMSO by js@mstdn.io
2022-11-21T20:49:46Z
0 likes, 0 repeats
@rappet Die SPARC64 ist dank Rust decomissioned.
(DIR) Post #APq8zmn3dfebgZkHSq by rappet@chaos.social
2022-11-21T20:50:57Z
0 likes, 0 repeats
@js F
(DIR) Post #APq99B0Iyy45OCQ4um by lucas@fitt.au
2022-11-21T20:52:35Z
0 likes, 0 repeats
@js ~150MB for a week on mine
(DIR) Post #APq9CW8yqD03p34Qfw by js@mstdn.io
2022-11-21T20:53:16Z
0 likes, 0 repeats
@lucas I'm guessing you are capping the weeks and it throws out old data?
(DIR) Post #APq9ImJLe1pthYuBhg by lucas@fitt.au
2022-11-21T20:54:09Z
0 likes, 0 repeats
@js no, it's just been up for a week now
(DIR) Post #APq9rCHhaAVM6QY0PY by js@mstdn.io
2022-11-21T21:00:37Z
0 likes, 0 repeats
@lucas Ah, so it's not necessarily growing by that per week, given there might be some "base load".
(DIR) Post #APqAAmZOtk028sAHXk by rappet@chaos.social
2022-11-21T21:03:48Z
0 likes, 0 repeats
@js kannst ja WASI als target nehmen und das in nem WASM interpreter schmeißen :D
(DIR) Post #APqAQbF6mRf1e1DQbw by lucas@fitt.au
2022-11-21T21:06:48Z
0 likes, 0 repeats
@js I think so, but I'm not 100% yet. I'm assuming it's going to grow semi-infinitely until I enable retention limits A) I've been following more people over timeB) it does keep lists of users and stuff in the database, but if one of those users posts a lot, their posts will be more than the "base data" they carry with them (I think, at least)
(DIR) Post #APqBjI9m495ZuGCJO4 by robryk@qoto.org
2022-11-21T21:21:35Z
0 likes, 0 repeats
@js Do you mean only the backing sql database, or all storage altogether (incl. media and possibly some other sundry things)? Everything-but-database takes ~15GB for @delroth's single-user instance.(Note that you can not cache any remote media at all; it will at most incur a delay when viewing that media.)
(DIR) Post #APqBuqWYd2kRgGMcIy by vandys@noagendasocial.com
2022-11-21T21:23:49Z
0 likes, 0 repeats
@js DB space isn't huge. It's the endless river of media and icons which grows anad grows. You can trim the media by age (I only kept two weeks) which helps. Depending on how many instances and how many users you follow, it's easy to climb upward of 20GB overall storage.On install you can point a bunch of storage at S3 instead of local filesystem. If I was doing it over, that's the config I'd use, even if it hurts performancce.
(DIR) Post #APqC24eWUvJVWhXIv2 by js@mstdn.io
2022-11-21T21:25:02Z
0 likes, 0 repeats
@robryk @delroth Was looking for everything. Wondering if my poor RockPro64 could handle it :)
(DIR) Post #APqC44ZVlkz1r493K4 by js@mstdn.io
2022-11-21T21:25:22Z
0 likes, 0 repeats
@rappet Zu spät. Wurde auch was langsam.
(DIR) Post #APqC4kAT7FuIrYke7U by lucas@fitt.au
2022-11-21T20:53:39Z
0 likes, 0 repeats
@js and 15Gb of media
(DIR) Post #APqC4kiV4j84Z6fpAG by js@mstdn.io
2022-11-21T21:25:32Z
0 likes, 0 repeats
@lucas For a week? That's insane.
(DIR) Post #APqCCnG3VjsClOCebg by delroth@mastodon.delroth.net
2022-11-21T21:25:22Z
0 likes, 0 repeats
@robryk @js and my current postgres database for Mastodon is 35MB pg_dump gzip'd, 171MB on disk
(DIR) Post #APqCCngdut8m5qdt32 by js@mstdn.io
2022-11-21T21:26:58Z
0 likes, 0 repeats
@delroth @robryk Ok, that's extremely reasonable. Guess I'll give it a try then. I only have a 64 GB eMMC in that machine right now and it's also running Synapse, which is taking an insane 20 GB right now just for DB.
(DIR) Post #APqCyqSSuqryaXv82S by delroth@mastodon.delroth.net
2022-11-21T21:35:30Z
0 likes, 0 repeats
@js @robryk do you regularly run the synapse autocompressor tool? I found it to be pretty helpful. My Synapse DB is only 3.8GB on disk and I'm on a good amount of high traffic rooms (e.g. a bunch of NixOS related stuff).https://github.com/matrix-org/rust-synapse-compress-state
(DIR) Post #APqD51LdLByc6Gfa40 by js@mstdn.io
2022-11-21T21:36:47Z
0 likes, 0 repeats
@delroth @robryk Hah, I did not, because until recently, I didn't have Rust for NetBSD/ARM64. But now that Synapse requires Rust, I needed to cross-compile Rust anyway, so I might give this a try as well now :).
(DIR) Post #APqDFHmv4Vhdz4KLtQ by delroth@mastodon.delroth.net
2022-11-21T21:38:31Z
0 likes, 0 repeats
@js @robryk https://gitlab.com/mb-saces/synatainer/-/tree/main/scripts has some other interesting maintenance scripts, I'm running a few of these as daily/weekly on my own instance. https://github.com/delroth/infra.delroth.net/blob/master/roles/matrix-synatainer.nix#L56
(DIR) Post #APqDNjvuJUFBagYveS by js@mstdn.io
2022-11-21T21:40:07Z
0 likes, 0 repeats
@delroth @robryk Thx! I'll have a look. So far, what has the most effect for me was `VACUUM FULL`. With the disadvanage that the tables are locked for quite some while and it needs almost double the disk space temporarily.
(DIR) Post #APqDeIFCVrJAddTpAW by robryk@qoto.org
2022-11-21T21:42:54Z
0 likes, 0 repeats
@js @delroth In case you're not aware: non-FULL VACUUM makes some unused space available for usage _by pgsql_. So, running that will not decrease file sizes and whatnot, but will decrease future growth.I don't know how much space is not freeable in that way by non-FULL VACUUM though.
(DIR) Post #APqDlPNcNf4knRoH0y by js@mstdn.io
2022-11-21T21:44:24Z
0 likes, 0 repeats
@robryk @delroth I think autovacuum is on by default anyway :). At least, I definitely have it on ;)
(DIR) Post #APqDogEmA5cbwoEZuq by js@mstdn.io
2022-11-21T21:45:00Z
0 likes, 0 repeats
@robryk @delroth I think autovacuum is on by default anyway :). At least, I definitely have it on ;)When I did the VACUUM FULL though, that shrank it by more than half.
(DIR) Post #APqE722NqdtAlvBkau by robryk@qoto.org
2022-11-21T21:48:18Z
0 likes, 0 repeats
@js @delroth D'oh. Forgot that autovacuum exists (there used to be something that made manual non-FULL vacuums sensible, but that might have been in some very specific situation~).> When I did the VACUUM FULL though, that shrank it by more than half.Oh, that makes me somewhat surprised.I wonder whether pgsql plans to ever have vacuum full be non-locking (which should be doable if tombstones are a thing).
(DIR) Post #APqLM6O0f2PuHZR9k0 by lucas@fitt.au
2022-11-21T23:08:55Z
0 likes, 0 repeats
@js I do follow hashtags like #art, but yeah, a week!