Post A61Sf5UGXGiHNSIQro by Votton@very.lewd.cat
(DIR) More posts by Votton@very.lewd.cat
(DIR) Post #A61NhnOrjw1qNZF6My by graf@poa.st
2021-04-08T01:37:20.608460Z
6 likes, 4 repeats
me waiting for four days for our data transit provider to send poast an invoice for semi-annual data because we worked out a 25% discounted rate which will save poast about 1200$ USD a year
(DIR) Post #A61RlVxsuAqvHPeQbo by Votton@very.lewd.cat
2021-04-08T02:19:37.851324Z
0 likes, 0 repeats
@graf What's your actual costs if don't mind telling, you must be eating shit tons of bandwidth. I used to host a public file hosting site a few years back which used 300TB a month and it only worked at the time because CloudFlare didn't care then.
(DIR) Post #A61RlWrXZFN841gsMK by graf@poa.st
2021-04-08T02:22:49.418751Z
1 likes, 1 repeats
@Votton our CDN charges 0.001/GB beyond 10TB so that cut it down quite a bit last month, the first month before the spike we were at about 57TB egress, last month with the CDN we sat around 92TB combined but we have ditched the CDN in favor of caching servers ourselves so next month I suspect will be somewhere between that. we have negotiated for 100TB per line (4x 10gbps bonded) and we will come in at just under 300$ USD/mo for just poa.stsomeone sent some btc so we are playing around with peertube streaming now I want to eventually implement utilizing pleroma as an oauth server so I suspect this will get a little more costly but for now we are self sufficient and donations are helping us try out new shit like PT
(DIR) Post #A61SBNODPVOCDHIahc by Votton@very.lewd.cat
2021-04-08T02:24:52.124029Z
1 likes, 0 repeats
@graf That def seems costly but at least have it covered. I personally have my shit being covered by donations too and without them it would be hell to run these services.
(DIR) Post #A61SBNtPXWLJm1tVKK by graf@poa.st
2021-04-08T02:27:29.635994Z
1 likes, 1 repeats
@Votton I originally set up mastodon as a test while I was drunk one night for friends in our guilded server and it got 1k users overnight on a small 2 core 2gb 2tb vps that cost 48$ usd/yearly so I went as big as I could from the get go when we switched to pleroma. the setup is compartmentalized enough its easy to scale as you go so we are good probably for maybe another 20k users before it starts getting laggy as fuck our avg connections/s is between 3-6k which is ehh. bandwidth has and will always be the major cost in hosting anything like this because you have to mediaproxy (in poasts case) literally thousands of instances for thousands of users
(DIR) Post #A61SLJWgd4BL7w03Qe by IRLStreamer@poa.st
2021-04-08T02:29:18.361100Z
0 likes, 1 repeats
@graf @Votton but it is already laggy as fuck? No offense, we all appreciate it. But maybe you're getting a different experience
(DIR) Post #A61SajPefKazky3wC8 by graf@poa.st
2021-04-08T02:32:05.467652Z
0 likes, 1 repeats
@IRLStreamer @Votton not at all so i presume you are living off the north american continent or you have potato internet both of which we are planning to address in the future by deploying our own CDN when we have the time to get to it using Varnish
(DIR) Post #A61Sf5UGXGiHNSIQro by Votton@very.lewd.cat
2021-04-08T02:31:55.718349Z
0 likes, 0 repeats
@graf Can imagine what it's like on Mastodon if would have stayed on that and makes a lot of the instances shutdown because they don't end up migrating to Pleroma, the amount of resources that are needed is so different. Bandwidth is pretty much the most costly thing with hosting anything large scale user base wise like you said when everything else like the hardware requirements do come out as rather cheap in comparison.
(DIR) Post #A61Sf5uqwPyqhujfJA by graf@poa.st
2021-04-08T02:32:51.798550Z
0 likes, 1 repeats
@Votton@very.lewd.ca actually we were fine on pleroma, the issue was the fact it transcodes webm and everyone on social medias like this are ripping webm from 4chan so it was constantly locked up trying to transcode them
(DIR) Post #A61SkHegiqNQZ1eIoi by IRLStreamer@poa.st
2021-04-08T02:33:49.172027Z
0 likes, 1 repeats
@graf @Votton I have gigabit fiber but yes I'm far away. It's not so much the latency, but the throughput
(DIR) Post #A61Spe8yXPs9l6NB7Q by IRLStreamer@poa.st
2021-04-08T02:34:47.336214Z
0 likes, 1 repeats
@graf @Votton oh yeah watching that video it's a compleeeeetly different experience
(DIR) Post #A61SshOQuhXOhm3gx6 by graf@poa.st
2021-04-08T02:35:20.302872Z
1 likes, 1 repeats
@IRLStreamer @Votton this is the backend server under current load
(DIR) Post #A61T3vBjxmw4fxTNnU by IRLStreamer@poa.st
2021-04-08T02:37:22.118496Z
1 likes, 1 repeats
@graf @Votton yeah video was just loading fine. I've had times where video content was unwatchable but I could download the file and watch it after waiting
(DIR) Post #A61THhzZp6ERnpMF2e by graf@poa.st
2021-04-08T02:39:51.502707Z
0 likes, 1 repeats
@IRLStreamer @Votton when we are ready to deploy ill see if you're around to test. hoping to have at least one edge server on each continent
(DIR) Post #A61TKgDQsue3A5FuBU by Votton@very.lewd.cat
2021-04-08T02:35:15.680934Z
1 likes, 0 repeats
@graf Yeh my instance has been using Pleroma too and I used Pleroma too back some years ago but shutdown because lost interest with the Fediverse but came back. If I would have kept running the file hosting site I had which is now private instead with steady consistent users, probably would have just shutdown because of the bandwidth costs as didn't have any other CDN options at the time either like now there are. BitMitigate used to be owned by a guy I knew at IRC as there was a concept before that but now it's owned by the Epik company I think too.
(DIR) Post #A61TQn3cMOzO7OZv0K by graf@poa.st
2021-04-08T02:41:29.982881Z
0 likes, 1 repeats
@Votton poast cant use bitmitigate, its fine 80% of the day but the 20% of the day we have the most traffic it takes down their cdn and the bitmitigate website. when I was checking IPs to add it to nginx to pass the X-Real-IP header they use dedipath servers and there's only maybe 11 of them
(DIR) Post #A61TRdLTxEB0HrKv4K by IRLStreamer@poa.st
2021-04-08T02:41:39.237981Z
1 likes, 1 repeats
@graf @Votton OK can do
(DIR) Post #A61U26cgZwNtVxm5I0 by Votton@very.lewd.cat
2021-04-08T02:43:34.658619Z
0 likes, 0 repeats
@graf Well good to know as planned to use it for some personal things but seems like better to stay away because of that unfortunately. I used to use the predecessor of BitMitigate which worked fine back then but nowadays it's obv used by 8chan and whatever too if correct.
(DIR) Post #A61U27C8S8jzHuMOXo by graf@poa.st
2021-04-08T02:48:13.748133Z
2 likes, 2 repeats
@Votton i mean for us we talked to our transit provider and told them what we were doing and gave them a few days to decide if they wanted to take poast on or not so if you are going to get into something like this make sure you communicate your intent with the provider. for vps its kind of hit and miss in this aspect because some of them are fine with it but their upstream isnt and then you start introducing 3rd party censorship in and blablabla its something people like parler and to more of an extent gab didnt consider going into it. they launched their original products on aws (in the case of parler) and Azure (in the case of gab) both of which had clauses about preventing service from users under any circumstance they see fit whereas if there is something illegal on poast our transit will send us an email addressing it as apposed to just turning service off after x hours for whatever reasoni wish i had the ability to get fibre to my home but they cut off service literally 200m away otherwise i'd just host the backends here and pop up a bunch of clandestine VPS all over the world to serve the content cached from home for pennies compared to the dollars we spend now