Hosting for high traffic services reddit / selfhosted ---------------------------------------------------------------------- Annual-Comfort8027 · 2023-10-08 15:38 Hello, I run a high traffic HTTP server (20-100 requests per client per second). I need a VPS or server hosting provider which REALLY offers enough bandwidth to handle this. Many providers claim to offer "unlimited traffic / bandwidth" which turns out to be a false claim for most of them. So I'm looking for a provider which really can offer this, the pricing is not so important. But it would be great if there was an ability to get a German / European server because of our GDPR compliance. ---------------------------------------------------------------------- mtetrode · 2023-10-08 16:22 Get a machine at hetzner or OVH, perhaps a physical one for that many requests, using proxmox / docker ---------------------------------------------------------------------- lilolalu · 2023-10-08 16:51 AWS? ---------------------------------------------------------------------- BitchyPolice · 2023-10-08 16:58 OCI is the only major cloud provider that I know of that gives you 10TB total data per month for free. ---------------------------------------------------------------------- amarao_san · 2023-10-08 17:07 (warning on conflict of interest, I work there, but not in sales position) You can try to contact servers.com. You get 20Gbit per server by default, and if you need more, it's totally doable in custom configurations. I also do not recommend putting such load on VM, as latency for VM is less predicable and is always higher due to additional context switching. You hadn't said how much clients are there, but I assume (arbitrary) it's 100+, that's 10k+ rps, a descent load for a decent server. ---------------------------------------------------------------------- 20PlaysGaming · 2023-10-08 17:18 For high traffic, that's not a good idea... ---------------------------------------------------------------------- roman5588 · 2023-10-08 17:20 Will second a Hetzner dedicated server, have a couple of the AX41’s & the new AX52’s with nvme and they are sweet. Excellent machines for web hosting. Maybe consider putting them behind a load balancer and having 2 servers for some greater scalability and reliability. ---------------------------------------------------------------------- 20PlaysGaming · 2023-10-08 17:25 If you really need high traffic, you could look on dedicated.pfcloud.io, they have two Germany locations, and 10 gigabit. If you choose Netherlands, you can get 20 gigabit. I'm a happy client there. ---------------------------------------------------------------------- ElevenNotes · 2023-10-08 17:28 Your employeer does not offer 20Gbps WAN. It offers 20Gbps interconnect between data centres but not general WAN peering. ---------------------------------------------------------------------- ElevenNotes · 2023-10-08 17:31 High traffic != bandwidth. I often see 50k connections per second in my own data centre company and bandwidth rarely goes above 30Gbps total. VPS is a bad idea because of prices, bare metal is the better. Price does matter, 10G dedicated is several thousand €/month. ---------------------------------------------------------------------- lilolalu · 2023-10-08 17:40 Really depends on your business, or not? For a lot of online businesses availability and speed is more important than saving a couple of hundred bucks. ---------------------------------------------------------------------- 2containers1cpu · 2023-10-08 17:46 Hey there Working for a high traffic website. We use Akamai to offload. All 100% GDPR compliant. But costs a fortune. ---------------------------------------------------------------------- 20PlaysGaming · 2023-10-08 17:46 A couple hundred bucks a lot of money. OP is talking about a lot of traffic. If you can get the same speed or better for a "couple hundred bucks" less somewhere else, I would definitely go there instead. ---------------------------------------------------------------------- lilolalu · 2023-10-08 17:49 You will not get the same scalability, so it depends on his business case. If he is hosting a non-commercial site, yes, that's relevant. If you are hosting a busy online shop the advantages might easily trump the disadvantage in cost. ---------------------------------------------------------------------- -markusb- · 2023-10-08 17:53 There are missing some numbers: - how many clients - how big are the requests (and/or response) - requirements towards latency ... ---------------------------------------------------------------------- opensrcdev · 2023-10-08 17:53 Linode and Digital Ocean both have locations in Frankfurt ---------------------------------------------------------------------- wrath_of_reaper · 2023-10-08 18:22 Try Exoscale. ---------------------------------------------------------------------- Annual-Comfort8027 · 2023-10-08 18:42 Basically I am running a proxy service, so all the HTTP requests of our customers are redirected through our HTTP service. Some of those are major companies, running big shop websites. The biggest traffic factor are automatic scans which are being run against those websites, those scans produce like 50-100 requests/s per client. ---------------------------------------------------------------------- MaximilianGT500 · 2023-10-08 18:48 [https://avoro.eu](https://avoro.eu): Maincubes with 10Gbit/s unlimited. ---------------------------------------------------------------------- CyberHouseChicago · 2023-10-08 19:11 hetzner Will be your best value in the eu , if you want a quality managed service tho expect to spend 3-5x more , it all depends on your needs. ---------------------------------------------------------------------- amarao_san · 2023-10-08 19:16 It does. We can provide up to 400Gbit/s per server (which is impossible to use for most types of server load, but nevertheless we can for a generous fee) with egress into multiple carriers, including few tier I. We have reserved capacity which is more than enough for any kind of legitimate load spike. Obviously, we can't guarantee that this bandwidth goes into a specific AS (if that AS has 100mps uplink, no magic in the world can fit 200 there), but for a reasonably wide AS destinations (most types of workload are like that), we can provide any requested capacity. Staring from some numbers ... let's say over 50 gbps, it's better to contact support for adjusted capacity and better traffic prices, but, with a simple 2x10G you can just order a server and start to use it. And yes, we also provide intra-dc connectivity, via separate network segment (different switches), which is, actually, not DC, but global private, e.g. allowing private connectivity between servers in different DCs). I understand what you are implying. Many cheap hostings gives 'best efforts' network with something like 10-40 uplink on whole DC, but servers.com is not a cheap hosting. We're specializing in high end hosting where redundant and underutilized network is essential for definition of 'high-end'. ---------------------------------------------------------------------- maty2200 · 2023-10-08 19:37 Why not scale horizontally rather than vertically? It sounds like it would make more sense to divide the traffic between multiple hosts within a cluster instead of getting more bandwidth for a single machine. And as a bonus it's easier to scale horizontally for future expansion. ---------------------------------------------------------------------- skmcgowan77 · 2023-10-08 20:32 Have you checked out [Vultr](https://vultr.com)? ---------------------------------------------------------------------- LibrarianSure6698 · 2023-10-08 20:38 Netcup ---------------------------------------------------------------------- DigitalWhitewater · 2023-10-08 20:54 AWS Lightsail? ---------------------------------------------------------------------- -markusb- · 2023-10-08 20:57 Also anycast comes into play for low latency and high availability. ---------------------------------------------------------------------- hmoff · 2023-10-08 21:12 Have you reinvented Cloudflare? ---------------------------------------------------------------------- FalseRegister · 2023-10-08 22:07 Why not? ---------------------------------------------------------------------- 20PlaysGaming · 2023-10-08 22:11 You have to pay for how much traffic transfer you use on AWS, which ends up costing a lot of money, and you can get unmetered pretty cheap elsewhere. ---------------------------------------------------------------------- viktae · 2023-10-08 22:57 Scaleway, OVH, AWS... ---------------------------------------------------------------------- ithakaa · 2023-10-09 01:17 AWS ---------------------------------------------------------------------- Annual-Comfort8027 · 2023-10-09 02:05 No ---------------------------------------------------------------------- jared555 · 2023-10-09 02:15 There is no such thing as unlimited, only really big numbers at really big prices. You need an estimate on how much bandwidth you actually need. 100mbit? 1gbit? 10gbit? 25gbit? 40gbit? 100gbit? More? Do you need multiple servers for redundancy or load scaling? Do those servers need to share a single ip? ---------------------------------------------------------------------- redoubledit · 2023-10-09 05:51 He IS cloudflare ---------------------------------------------------------------------- fab_space · 2023-10-09 05:54 Contabo VPS haproxy Contabo n*VPS for webserver private network from servers to db, again Contabo VPS ---------------------------------------------------------------------- blue30 · 2023-10-09 12:46 I have servers on Linode. When I see one website getting spammed to fuck by a bot I generally google the user agent of the bot to see if it's worth anything then block it with a rewriterule. ---------------------------------------------------------------------- anaxaos · 2023-10-09 12:51 \> It's really true, I use about 300TB per month Thx for avoro.eu. But using 300TB a month results in usage of 1GBit/s You could do \~ 3EB per Month with 10GBit/s ---------------------------------------------------------------------- ElevenNotes · 2023-10-09 13:20 It states this nowhere on the website. You are just making stuff up. ---------------------------------------------------------------------- violet-crayola · 2023-10-09 13:35 Can u actually use it? ---------------------------------------------------------------------- amarao_san · 2023-10-09 15:53 I don't. Those who need quotes may ask and get them from sales. For "non-believers", just check traces from cogent/level 3/atnt/orange to see interconnects. ---------------------------------------------------------------------- Fluffer_Wuffer · 2023-10-09 17:40 Sounds like you need to scale horizontally.. I.e. multiple VPSs with DNS Round Robin, with something Route53. ---------------------------------------------------------------------- ElevenNotes · 2023-10-09 17:51 Quote me 100G dedicated here on Reddit. ---------------------------------------------------------------------- amarao_san · 2023-10-10 07:48 As I said, I don't work in sales. I asked sales guy, he said: * It will be a custom configuration (e.g. negotiation for specific detail of workload, which carriers are needed, etc). * Gross estimation (not a quote): Dell R730xd 2xIntel Xeon E5-2680 v3 / 256 GB RAM / 2 x 480 GB SSD / Perc H730 with one non-redundant 100Gb NIC in DFW region (USA) will cost about $1400 per month. * This includes default 20TB of free traffic per month, and 0.03$/GB after, which is inadequate for 100G NIC. Better prices are available on request to sales, this is gross estimation via 'rnd guy asked sales guy in chat'. ---------------------------------------------------------------------- ElevenNotes · 2023-10-10 08:04 lol not unlimited traffic. I asked for 100G peering not a server but okay. ---------------------------------------------------------------------- amarao_san · 2023-10-10 08:29 I never said about unlimited traffic, not it was in original request. Also, you can negotiate 95% percentile billing, if you need. It's all sales domain. And no, servers.com is not the cheapest option out there, hetzner will give you lower prices on desktop hardware. ---------------------------------------------------------------------- ElevenNotes · 2023-10-10 10:51 I don't use hetzner nor would I ever use any provider since I am a provider myself. ---------------------------------------------------------------------- amarao_san · 2023-10-10 11:19 okay. Then I don't understand your questions. Check traces, you'll see connectivity. ---------------------------------------------------------------------- ElevenNotes · 2023-10-10 12:23 Then you did not get the point I wanted to make that nothing you said standa on your employeers website, probably for a very simple reason. ---------------------------------------------------------------------- amarao_san · 2023-10-10 13:11 No I don't.