Post AoNU928IX2pFrQuiFk by ryantownsend@webperf.social
(DIR) More posts by ryantownsend@webperf.social
(DIR) Post #AkMJTQkMoPgei1Rt5s by ryantownsend@webperf.social
2024-07-27T11:11:55Z
3 likes, 4 repeats
👏 more 👏 developers 👏 need 👏 👏 hear 👏 thisI can count on one hand the number of my clients over the past couple of years who haven't either over-architected for scale or were unnecessarily concerned about it.You don't need to understand Distributional Little's Law to figure this out, it's obvious with primary school level math.Excerpt from https://tailscale.com/blog/new-internet
(DIR) Post #AkNBsZmDlsWlTlkthQ by jens@social.finkhaeuser.de
2024-07-27T15:16:49Z
1 likes, 0 repeats
@ryantownsend back in the day, we only measured requests per second. If I read about longer time spans, I already know it's rubbish without looking at the actual number.Page views are more realistic in some ways, but they map relatively neatly onto requests once you take caching into account. Modern dev frameworks complicate this as well, but the upshot is, you can still get away with applying an application specific multiplier to request to get page views and vice versa across sufficient...
(DIR) Post #AkNBsbqY4lB3tlnNiq by jens@social.finkhaeuser.de
2024-07-27T15:19:07Z
0 likes, 0 repeats
@ryantownsend ... amounts of samples.To complicate things more, the size of the requested file also matters, though often less so thee days.Long story short, back in the early 2000s we had Pentiums that modern mobile phones would be embarrassed to call CPUs regularly process hundreds of requests per second if pushed.0.2 is shameful.
(DIR) Post #AkNosonfoL48HmXc6S by mensrea@freeradical.zone
2024-07-27T11:58:39Z
1 likes, 0 repeats
@ryantownsend but if you don't keep layering complexity over everything you might have to start addressing the tech debt
(DIR) Post #AkNot5fR6DZsb9om7k by skaverat@skaverat.net
2024-07-27T11:49:09Z
0 likes, 0 repeats
@ryantownsend just last week I talked to a client if we would use kubernetes for their new shop.And I had to explain that "no. that's complete overkill. A single medium sized server is more than enough for what you're going to do"
(DIR) Post #AkNot6S0BeQT1mXYp6 by xchange@chaos.social
2024-07-27T12:10:03Z
1 likes, 0 repeats
@skaverat @ryantownsend the problem is cargo cult everywhere amirite?
(DIR) Post #AoLnY8bD8YYny6CZqS by ryantownsend@webperf.social
2024-07-27T13:38:46Z
0 likes, 0 repeats
@ceulig I find it's more often driven by developers themselves.For the past decade+ we've had big tech firms fighting over talent, so they present solutions to their specific problems as panacea to keep the spotlight on them and drive open source adoption.On the flip side, developers want to believe they will need that level of scale, that they'll witness the same problems and they want their CVs to include the tech that shows they are in the big leagues.A vicious cycle.
(DIR) Post #AoLnY9eRE2jhEOifVw by konnorrogers@ruby.social
2024-07-27T16:39:39Z
0 likes, 1 repeats
@ryantownsend @ceulig Resume driven development
(DIR) Post #AoN4q99RiQ1BGwLdwW by ferki@fosstodon.org
2024-07-27T14:37:23Z
1 likes, 0 repeats
@ryantownsend I designed/built/ran infra where we considered 100k/s requests a nice quiet period, with ~350k/s daily peaks, plus ingest ~1TB/hour data.Up to this scale, we never found a challenge for which cloud, containers, or Kubernetes would have been the simplest solution that could work – also far from cheapest.All bare metal on #Gentoo. Managed with #Rex. Globally from ~30 to ~400 servers, then beyond.Solve problems _you_ have. Not what others think you should solve.
(DIR) Post #AoN5axcsNrsR8aR7iK by lanodan@queer.hacktivis.me
2024-11-24T15:08:46.799559Z
1 likes, 0 repeats
@ryantownsend Heh seeing it again on my timeline made me wonder about the views-per-month on my main server box that easily could serve 100× more requests without changing anything:$ wc -l /var/log/syslog/NightmareMoon/local7_nginx/2024/10/*.log | grep total3893344 total$ wc -l /var/log/syslog/NightmareMoon/local7_nginx/2024/09/*.log | grep total3997733 totalYeaah, ~3.9M requests per month, I guess for page views you could divide by something like 10 although my stuff has caching so a page view can easily be just 1 request.
(DIR) Post #AoN7iOmY16bfIOdPea by anokasion@hidamari.apartments
2024-11-24T15:32:38.676178Z
0 likes, 0 repeats
@lanodan @ryantownsend honest question, do you some business or it's any other kind of site? if it's the later, broad question but it's not my area of expertise, how do you get so many views?
(DIR) Post #AoN8MVU6W4aLfO8Igi by lanodan@queer.hacktivis.me
2024-11-24T15:39:45.587569Z
1 likes, 0 repeats
@anokasion @ryantownsend Nah, but well a lot of it isn't web browser traffic. I have fedi (including multimedia), git, tarballs of my software, … on that box. And well… scrapper bots are a thing.fedi does count for a lot but it's still in the same order of magnitude:$ grep -v queer.hacktivis.me /var/log/syslog/NightmareMoon/local7_nginx/2024/10/*.log | wc -l1172360And reminder: It's per-month.
(DIR) Post #AoN8OI1DYMQuTwTIZc by wolf480pl@mstdn.io
2024-11-24T15:19:24Z
1 likes, 0 repeats
@ryantownsend UI developers, especially web UI developers, need to hear this even more.
(DIR) Post #AoNIz9hsQ1dexWduc4 by anokasion@hidamari.apartments
2024-11-24T17:38:55.771313Z
0 likes, 0 repeats
@lanodan @ryantownsend I see, thanks for the reply; makes sense, specially due to your Fedi instance and if the Gitea/git server has a lot of external usage, that can generates moderate traffic. No idea about the usage of the scrapper bots though...
(DIR) Post #AoNU8zBNV8VUi7Kd8a by grumpasaurus@infosec.exchange
2024-07-27T13:06:57Z
0 likes, 0 repeats
@ryantownsend a lot of engineers suffer from focusing on executing a solution, rather than solving a problem. With that said, going to click the link and read!
(DIR) Post #AoNU8zziTylzEEspbE by grumpasaurus@infosec.exchange
2024-07-27T13:39:55Z
0 likes, 0 repeats
@ryantownsend mm. I do agree with where they're getting at and it will be really cool to see if they unlock startups to self host again. The great MailChimp server migration story being something similar. I don't think that's the cause for the insane complexity of "just launch a service" comes from though.
(DIR) Post #AoNU90nLVSTJiA6SxM by ryantownsend@webperf.social
2024-07-27T13:47:56Z
0 likes, 0 repeats
@grumpasaurus fwiw, I see Kubernetes as basically self-hosting, yes it might be atop IaaS but your own team is responsible for uptime, security patching etc.Most businesses should be outsourcing to a PaaS like Heroku, Render etc.For 99%+ of use-cases, until your bill hits six figures monthly, it just doesn't make sense to hire DevOps/Infra people.
(DIR) Post #AoNU91Y8hTu03HzptQ by grumpasaurus@infosec.exchange
2024-07-27T13:52:32Z
0 likes, 0 repeats
@ryantownsend I think it just depends on your situation, use cases, and constraints that a vendor may have on your needs. Of course the most paramount situation being the type of people you have on hand and the budget you have to hire what function you're lacking.
(DIR) Post #AoNU928IX2pFrQuiFk by ryantownsend@webperf.social
2024-07-27T13:58:23Z
0 likes, 0 repeats
@grumpasaurus absolutely, context is always important, hence my use of "most businesses" and "99%+"Ultimately: most applications just aren't special. Many are barely more than simple CRUD.It's not uncommon that the people on hand are the problem... they are the ones driving the infrastructure complexity in order to keep their jobs and pad their CVs. It can mean swapping them out for more productive people who focus on shipping.
(DIR) Post #AoNU92u9f76gFrIvqa by grumpasaurus@infosec.exchange
2024-07-27T14:04:10Z
0 likes, 0 repeats
@ryantownsend I'd like to think that people aren't necessarily being malicious to keep their jobs, but moreso maybe a bit too immature in understanding the complexity of taking on a new-to-them solution, especially when they haven't had the past experience of operating a similar process."Let's adopt this CI/CD pipeline so that my job in troubleshooting it is secure" - said no one
(DIR) Post #AoNU93ZdAuHeKUi3Um by ryantownsend@webperf.social
2024-07-27T14:11:03Z
0 likes, 0 repeats
@grumpasaurus not directly, but a DevOps team isn’t going to advocate moving away from Kubernetes/IaaS/bare metal and just using Heroku or Render.React has seen enormous, continuous adoption despite very apparently flaws because “that’s where the employment/money is” (I’ve researched this before for my conference talks, it was the #1 voted answer on Reddit for why people use it)
(DIR) Post #AoNU94CGrFByGKmuiu by wolf480pl@mstdn.io
2024-11-24T16:32:40Z
1 likes, 0 repeats
@ryantownsend @grumpasaurus > a DevOps team isn’t going to advocate moving away from Kubernetes/IaaS/bare metal Unless the DevOps team is overworked / burnt out, they can barely keep the existing stuff running, and the devs are making a new app that needs unusual stuff, and most new apps in the company die after a quarter - I think in that situation, many DevOps would advocate for running that one app on Heroku if that's what the devs already know.though that's an extreme case I guess
(DIR) Post #AoNU95vKRCpPcMsPaq by wolf480pl@mstdn.io
2024-11-24T16:37:00Z
1 likes, 0 repeats
@ryantownsend @grumpasaurus Also, I think a large problem is that while we teach people to Kubernetes and stuff, we don't teach them why, and when.It took me a few years of hating k8s from sidelines, and then a couple years of working with k8s at $dayjob, to finally figure out what it's for:It's for when you have multiple programs and multiple computers and you have trouble figuring out which program should run on which computer.How many companies would avoid k8s if they knew that?
(DIR) Post #AoNUGymirbV1nHbwZM by grumpasaurus@infosec.exchange
2024-11-24T16:40:07Z
1 likes, 0 repeats
@wolf480pl @ryantownsend yeah that happens quite often! Not too long ago a company I worked at was running bare metal and keeping the business going and in a huge multi year scaling initiative, some architects chose to adopt an entirely different stack expecting to run in AWS despite having no experience running in AWS and the stack itself. In those situations, where there's timeline and technological cliffs that the company is barreling towards, decisions to buy into something you may not understand but gives you the confidence that it *just works* are extremely easy to make.
(DIR) Post #AoNUIGRCiRoypi9t8S by grumpasaurus@infosec.exchange
2024-11-24T16:39:38Z
0 likes, 0 repeats
@wolf480pl @ryantownsend yeah you really need someone with either a lot of foundational background to learn k8s (like early in its inception) or someone who has a lot of operational background in k8s to know its kinks to help the team get onboard
(DIR) Post #AoNUIHFXhI5TLpi5b6 by wolf480pl@mstdn.io
2024-11-24T16:41:14Z
1 likes, 0 repeats
@grumpasaurus @ryantownsend I mean, if you tell people what kubernetes is for, and they realize they have one computer... or many computers but they want to run the exact same programs on each of them, then they might realize they don't need kubernetes.
(DIR) Post #AoUowd2EnB5vUpTozg by icedquinn@blob.cat
2024-11-28T08:39:59.472774Z
0 likes, 0 repeats
they're just proud they got through the manual enough to turn kube on.