Post AQDXm9nUGlNETZcfOi by samhain@freeradical.zone
(DIR) More posts by samhain@freeradical.zone
(DIR) Post #AQDNr21fahmoHQwTce by announce@freeradical.zone
2022-12-03T01:45:02Z
0 likes, 0 repeats
#FreeRadical blog: "Goodbye, S3"I configured Free Radical to use S3 to serve media assets, like images and videos, almost immediately after launching it. There are compelling reasons to use something like S3 instead of serving those files directly from the Mastodon server, such as freeing that server from getting clogged [...]https://blog.freeradical.zone/post/goodbye-s3/(posted at Fri, 02 Dec 2022 17:41:00 +0000)
(DIR) Post #AQDP5CBWiVOtnPs1Z2 by tek@freeradical.zone
2022-12-03T02:09:34Z
0 likes, 0 repeats
@admin It’s *so* much cheaper. Either they’re using it as a loss leader, or AWS is charging way too much.
(DIR) Post #AQDPVvcmOclEFmMgam by admin@2br02b.online
2022-12-03T02:14:27Z
0 likes, 0 repeats
@tek I think AWS is overcharging. Storage is still relatively cheap compared to CPU and GPU processing power, which Is why I wanted to host from home, I have more than enough locally. I have Google fiber and I think it's doable. May spin up a Dev server locally to test it out.
(DIR) Post #AQDPtMXMVAm4Nk0NNI by tek@freeradical.zone
2022-12-03T02:18:44Z
0 likes, 0 repeats
@admin That’s how I host the database. I use DO for the VPC so I don’t have a bunch of randos connecting into my house, but have plenty of bandwidth and storage for the “heavier” processes.
(DIR) Post #AQDVYmRLbE0mMWlDvs by samhain@freeradical.zone
2022-12-03T03:22:15Z
0 likes, 0 repeats
@tek Did you set up the bucket policy correctly? Getting a lot of errors on my end
(DIR) Post #AQDVdSN7diwdZP0wbo by tek@freeradical.zone
2022-12-03T03:23:01Z
0 likes, 0 repeats
@samhain I’m pretty sure, but wouldn’t rule out a mistake. What are you seeing?
(DIR) Post #AQDVwVO0emNsQ9VpSK by samhain@freeradical.zone
2022-12-03T03:26:32Z
0 likes, 0 repeats
@tek For example, on mobile, I’m seeing what I guess to be the default for an unavailable profile picture. When I try to click on their picture to see it on their profile, I get that I don’t have permissions
(DIR) Post #AQDW3F9FQawc5PowTo by tek@freeradical.zone
2022-12-03T03:27:45Z
0 likes, 0 repeats
@samhain Ah, yeah. Part of the migration involved blowing away the cache of remote users’ avatars. I’m running a process to re-download them now, and it should be done by tomorrow.
(DIR) Post #AQDWEoDzM3lW3kYLui by samhain@freeradical.zone
2022-12-03T03:29:50Z
0 likes, 0 repeats
@tek getting the same for images. That being said, that might fall under the same issue
(DIR) Post #AQDWXDw4V5zR0sxAXI by tek@freeradical.zone
2022-12-03T03:33:11Z
0 likes, 0 repeats
@samhain It’s the same root cause. Turns out Mastodon *never* clears the cache. There are issues out for it. The image cache of tiny avatar images had grown to about 200GB, and I blew it away during the migration. The server’s re-fetching missing stuff now.
(DIR) Post #AQDXm9nUGlNETZcfOi by samhain@freeradical.zone
2022-12-03T03:47:04Z
0 likes, 0 repeats
@tek Now that I'm on my computer, I'm seeing 403s for everything in my network tab, whether they said it was an image encoding issue or permissions issue. It's interesting that my mobile app decided to represent the same response two different ways.
(DIR) Post #AQDY56lJmGnqZ6e1eC by tek@freeradical.zone
2022-12-03T03:50:29Z
0 likes, 0 repeats
@samhain Annoyingly, that’s what Spaces returns for a 404 here. I think it’s because I didn’t allow directory listing on the space, so when we try to fetch /foo/bar/baz.jpg, and bar doesn’t exist, it’s a 403 because you don’t have permission to list foo to see if bar exists. Or something.Copy a working imagine URL and alter it. I think you’ll see a 403.
(DIR) Post #AQDYgsurhm10cv7igC by samhain@freeradical.zone
2022-12-03T03:57:17Z
0 likes, 0 repeats
@tek Can confirm that's what happens. I guess it's technically more secure as it doesn't give a yes or a no if the path exists or not.Also, even if you only change the file name (rather than a directory), it likewise returns a 403 instead of a 404.
(DIR) Post #AQDbHuSN8lXe1kZwOW by samhain@freeradical.zone
2022-12-03T04:00:10Z
0 likes, 0 repeats
@tek That being said, I think everything will clear up. If the strange use of 400 response codes is the worst thing that happens when you save 100 dollars, I think it's a win.
(DIR) Post #AQDbHuu1TxexPVW1Ue by tek@freeradical.zone
2022-12-03T04:26:23Z
0 likes, 0 repeats
@samhain That’s how I was looking at it. 😀 “Alright, that’s… unusual… but OK, fine.”