Post 9quyj8eFyoBUAgb3FQ by sjw@blob.cat
(DIR) More posts by sjw@blob.cat
(DIR) Post #9quEqBlED6gxxaHUxc by sjw@blob.cat
2020-01-11T22:51:53.248025Z
3 likes, 3 repeats
Sorry for the downtime everyone. Looks like the migrations are going smoothly. NB should startup once everything is done.
(DIR) Post #9quF4OqKMrFIaWRViq by sjw@blob.cat
2020-01-11T22:54:26.983620Z
1 likes, 0 repeats
The server is working hard]https://neckbeard.xyz/netdata/#update_always=true
(DIR) Post #9quFIpt6c2GGWJcroG by sjw@blob.cat
2020-01-11T22:57:03.779669Z
1 likes, 0 repeats
@sjw
(DIR) Post #9quFTn2pWWUQt6Oijg by sjw@blob.cat
2020-01-11T22:58:57.960042Z
1 likes, 0 repeats
@sjw @mewmew @p @matrix
(DIR) Post #9quFVcnsZSGdhkHOG8 by sjw@blob.cat
2020-01-11T22:59:19.911572Z
1 likes, 2 repeats
@matrix @mewmew @p @sjw
(DIR) Post #9quFfpvCeXF9HlZg3c by sjw@blob.cat
2020-01-11T23:00:29.002745Z
1 likes, 2 repeats
@matrix @mewmew @p @sjw @Nobody @fluffy
(DIR) Post #9quGBKybF3OmZrBSzo by sjw@blob.cat
2020-01-11T23:03:16.683027Z
1 likes, 3 repeats
@Nobody @fluffy @matrix @mewmew @p @sjw @Kommando Alright, NB should be back up. The whole process took about 30 minutes. Not bad.
(DIR) Post #9quGQgzZfbq9CYxgga by p@freespeechextremist.com
2020-01-11T23:09:41.957739Z
4 likes, 0 repeats
@sjw @Kommando @Nobody @fluffy @matrix @mewmew @sjw > 30 minutes> Not badNot good at all.
(DIR) Post #9quGYWmbVmEnr4dBwW by sjw@neckbeard.xyz
2020-01-11T23:11:04.300277Z
1 likes, 0 repeats
@p @sjw @Kommando @Nobody @fluffy @matrix @mewmew Sorry I don't have a nasa computer running my db
(DIR) Post #9quGZ3GUkBA4b2rVya by march@neckbeard.xyz
2020-01-11T23:11:11.588300Z
3 likes, 0 repeats
@p @sjw @Kommando @Nobody @fluffy @matrix @mewmew @sjw I forgive you sjw
(DIR) Post #9quGu5PnwdQFLXFMWm by p@freespeechextremist.com
2020-01-11T23:15:00.700124Z
4 likes, 0 repeats
@sjw @Kommando @Nobody @fluffy @matrix @mewmew @sjw This can be done in such a way that it doesn't hose your DB for 30 minutes. I will make a ticket later.
(DIR) Post #9quHHC5TIvcahRkrHk by sjw@neckbeard.xyz
2020-01-11T23:19:07.293920Z
1 likes, 0 repeats
@p @Kommando @Nobody @fluffy @matrix @mewmew @sjw I reverted migrations from a different branch, got back on develop, and updated to current. I was about 3 months behind so a fuck ton of migrations was expected. Plus, I had to rebuild a few indexes.
(DIR) Post #9quau5WPXxSQlBcCRc by sjw@blob.cat
2020-01-12T02:59:01.303297Z
1 likes, 0 repeats
@Kommando @Nobody @fluffy @matrix @mewmew @p @sjw @march @redneonglow @redneonglow Sorry for the downtime again. Shouldn't be too much longer now.
(DIR) Post #9qud7wHiszBc4hTefg by sjw@blob.cat
2020-01-12T03:24:00.470704Z
1 likes, 0 repeats
@Kommando @Nobody @fluffy @march @matrix @mewmew @p @redneonglow @redneonglow @sjw I wish migrations had a progress bar
(DIR) Post #9qudA5FAY3AaRIIzei by fluffy@blob.cat
2020-01-12T03:24:24.263107Z
1 likes, 0 repeats
@sjw @Kommando @Nobody @march @matrix @mewmew @p @redneonglow @redneonglow @sjw nice pfp
(DIR) Post #9qudJLFMQ0Nqg6oFe4 by sjw@blob.cat
2020-01-12T03:26:04.121870Z
4 likes, 0 repeats
@fluffy @Kommando @Nobody @march @matrix @mewmew @p @redneonglow @redneonglow @sjw Thanks. @mewmew said I needed a blobcat pfp so I made this.
(DIR) Post #9qugXp9SKVLhLJe39s by sjw@blob.cat
2020-01-12T04:02:17.057768Z
1 likes, 0 repeats
@Kommando @Nobody @fluffy @march @matrix @mewmew @p @redneonglow @redneonglow @sjw Jesus christ! How long is this going to take?
(DIR) Post #9qujNiUmWOy3fMUYtM by sjw@blob.cat
2020-01-12T04:34:05.324967Z
2 likes, 0 repeats
@Nobody @Kommando @fluffy @march @matrix @mewmew @p @redneonglow @redneonglow @sjw What the fuck am I reading?
(DIR) Post #9qumSG1s5NVwgppI1Y by sjw@blob.cat
2020-01-12T05:08:24.488694Z
4 likes, 1 repeats
@Nobody Yeah, DB migration (going back to rum indexes). It's taking way longer than expected. :blobcatsadreachrev:
(DIR) Post #9quoYBwQOftLepEgzI by sjw@blob.cat
2020-01-12T05:32:00.809983Z
1 likes, 0 repeats
@Nobody Welp, that was a 2.5 hour migration and now everything's fucked. I hope that's just a backlog of federation and it'll even out soon.
(DIR) Post #9quof4D9XIOVi4L4Cm by mewmew@blob.cat
2020-01-12T05:33:14.135982Z
1 likes, 0 repeats
@sjw @Nobody what's fucked?if the instance is running like shit run a vacuum analyze
(DIR) Post #9quooaPHCeeyAWY50y by a1batross@expired.mentality.rip
2020-01-12T05:34:59.068799Z
1 likes, 0 repeats
@mewmew @sjw @Nobody what is vaccum analyze?
(DIR) Post #9quothz2Sacd7EicGe by mewmew@blob.cat
2020-01-12T05:35:53.105306Z
0 likes, 0 repeats
@a1batross @Nobody @sjw you run it in postgres and it frees up a bit of space and also increases the query planner's iq by 10000% because it goes from being really slow to really fast
(DIR) Post #9qupNBxU5pXoTm3BdQ by sjw@neckbeard.xyz
2020-01-12T05:40:27.505309Z
1 likes, 0 repeats
@mewmew @sjw @Nobody It was offline for a few hours doing a migration to rum indexes. Now it's just catching up on what it missed (I think)
(DIR) Post #9quqF9e0ue6WwKfspM by sjw@neckbeard.xyz
2020-01-12T05:50:58.582097Z
1 likes, 0 repeats
@mewmew @Nobody @sjw Yeah, it's starting to level out.
(DIR) Post #9quyj8eFyoBUAgb3FQ by sjw@blob.cat
2020-01-12T07:26:02.177793Z
2 likes, 0 repeats
@mewmew @a1batross @Nobody I've got good auto vacuum and auto analyse but I've made a ton of changes and the query planner is probably all kinds of fucked up so I'm running vacuum(analyse); now. I'll try letting tags on again and see how it goes.
(DIR) Post #9quz0mN3XsSeI8xlK4 by sjw@blob.cat
2020-01-12T07:29:13.375931Z
1 likes, 0 repeats
@mewmew @Nobody @a1batross Oh yeah, it's removing a fuck tonne of row versions.
(DIR) Post #9qvKiyTI10INbFnGkK by p@freespeechextremist.com
2020-01-12T11:32:32.088048Z
1 likes, 0 repeats
@sjw @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw :pressf:
(DIR) Post #9qvORWwxUBGx8ZbnUm by p@freespeechextremist.com
2020-01-12T12:14:12.138089Z
1 likes, 0 repeats
@sjw @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw I just use iotop and this:select CURRENT_TIMESTAMP-query_start as runtime, * from pg_stat_activity where datname = 'YOUR_DB_NAME_HERE' and state <> 'idle' order by query_start asc;That gives you an ordered list of what queries are running. It's no progress bar, but you can more or less see how expensive something is.
(DIR) Post #9qvYJD9IDkuqwz38tM by sjw@blob.cat
2020-01-12T14:04:43.408238Z
1 likes, 0 repeats
@p @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw Yeah, postgres seems to have shat itself while I was asleep. Funkwhale and Plume DBs seem to be working fine but Misskey and Pleroma DBs are fugged. Doesn't look like any data was lost and I can probably fix it but it'll take a little while. ETA 2 hours.
(DIR) Post #9qvYK8xFIhk4EPrLAO by sjw@blob.cat
2020-01-12T14:04:53.823473Z
0 likes, 0 repeats
@p @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw
(DIR) Post #9qvYpA2jItk2aIDNC4 by p@freespeechextremist.com
2020-01-12T14:10:31.389874Z
2 likes, 0 repeats
@sjw @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw Shat itself? What happened?There's one Palormo index that takes, like, 8 hours to build on FSE. Watch the active queries and the disk I/O, if it's shitting itself you'll know.
(DIR) Post #9qvZVnRbCZ3iwnB3Oi by sjw@blob.cat
2020-01-12T14:18:12.666600Z
3 likes, 0 repeats
@p @Kommando @Nobody @fluffy @march @matrix @mewmew @redneonglow @redneonglow @sjw Maybe some driver crashed or stuttered or something. Not entirely sure. :youmushrug:Those two databases are angry in the logs tho. I think I've fixed it tho. Now we just play the waiting game.