Post APU6MaBA9d7my9Fdke by seb@ioc.exchange
(DIR) More posts by seb@ioc.exchange
(DIR) Post #APU0mWTNxMvBHMlEJc by seb@ioc.exchange
2022-11-11T04:35:24Z
0 likes, 0 repeats
12,000 !!! (added more CPU to the fleet just now to keep it humming along...)
(DIR) Post #APU18AvojB3aqANswq by nova@hachyderm.io
2022-11-11T04:39:07Z
0 likes, 0 repeats
@seb how many nodes are you running? We just popped our 3rd one in the rack.
(DIR) Post #APU1bg7lpgNVyt2l0a by ajn142@infosec.exchange
2022-11-11T04:44:38Z
0 likes, 0 repeats
@seb @jerry are the stats for infosec.exchange visible somewhere?
(DIR) Post #APU3Fn3PaTf30ihAg4 by seb@ioc.exchange
2022-11-11T05:03:04Z
0 likes, 0 repeats
@nova For ioc.exchange we run: 1x 8-core for web-service2x 4-core for sidekiq1x 4-core for postgres1x 2-core for redisFor sfba.social we run:1x 8-core for web service1x 8-core for sidekiq1x 4-core for postgres1x 2-core for redis
(DIR) Post #APU5A2vRrdpyPFMLCa by evanphx@ruby.social
2022-11-11T05:24:26Z
0 likes, 0 repeats
@seb @nova Would you mind sharing your puma settings? Trying to put together a tuning guide and wanna try help folks correlate active users with cpu/mem/settings. Thanks!
(DIR) Post #APU5bJdVqHFk3IyOW0 by TheDukeDK@noc.social
2022-11-11T05:29:23Z
0 likes, 0 repeats
@seb New to Mastodon. Super curious as to the infra that it is ran on.Mostly your own bare metal?Cloud hosted(AWS,GC,AZ)?...
(DIR) Post #APU6MaBA9d7my9Fdke by seb@ioc.exchange
2022-11-11T05:37:56Z
0 likes, 0 repeats
@evanphx @nova We run one puma process (with 20 threads each) per core. Don’t do this when you are still mixing sidekiq with puma on the same host. Move the sidekiq processes to a different host first.
(DIR) Post #APU6SjaA6eVNs0sU76 by seb@ioc.exchange
2022-11-11T05:39:02Z
0 likes, 0 repeats
@TheDukeDK Linode
(DIR) Post #APU7MC2227b822MHrs by evanphx@ruby.social
2022-11-11T05:49:02Z
0 likes, 0 repeats
@seb @nova 1 worker and 20 threads? So WEB_CONCURRENCY=1 and MAX_THREADS=20?
(DIR) Post #APUFwhPzcEhRQwU6LY by dcid@noc.social
2022-11-11T07:25:14Z
0 likes, 0 repeats
@seb @nova Is there any guide you took to run sidekiq on a separate host? We pretty easy to run postgres/redit on separate servers, but nothing for sidekiq and the mastodon processes.
(DIR) Post #APV2Y83GLsPuY9lZL6 by seb@ioc.exchange
2022-11-11T16:29:54Z
0 likes, 0 repeats
@evanphx @nova No. We have 8 CPU cores on that machine, so our settings are:WEB_CONCURRENCY = 8MAX_THREADS = 20
(DIR) Post #APV33sUxiJvPZxrTk0 by seb@ioc.exchange
2022-11-11T16:35:39Z
0 likes, 0 repeats
@dcid @nova We just cloned the host that had both on it and disabled the services vice versa. The key is to create more sidekiq processes by cloning/copying the sidekiq service. Just make sure that you only have one sidekiq worker that subscribes to the scheduler queue. For all other queues you can have multiple subscribers.
(DIR) Post #APV4Q6BLcR3YLKqYAC by evanphx@ruby.social
2022-11-11T16:50:43Z
0 likes, 0 repeats
@seb @nova Ah! So that’s 8 processes, each running 20 threads.
(DIR) Post #APVAklpr3tpb2s29jc by evanphx@ruby.social
2022-11-11T17:01:55Z
0 likes, 0 repeats
@seb @nova One more quick question: how many users does your instance have? (I dunno if mastodon has this metric, but active users would be useful too I think?)
(DIR) Post #APVAkmBTlV827w9QRM by seb@ioc.exchange
2022-11-11T18:01:49Z
0 likes, 0 repeats
@evanphx @nova sfba.social20.9K (17.2K active)ioc.exchange12.4K (10.1K active)
(DIR) Post #APVD5SvMlfeQNobjJQ by evanphx@ruby.social
2022-11-11T18:27:57Z
0 likes, 0 repeats
@seb @nova Thank you!