[HN Gopher] Optimizing the kernel to saturate a 100Gbps link (2017)
       ___________________________________________________________________
        
       Optimizing the kernel to saturate a 100Gbps link (2017)
        
       Author : ComputerGuru
       Score  : 33 points
       Date   : 2021-12-13 19:05 UTC (3 hours ago)
        
 (HTM) web link (netflixtechblog.com)
 (TXT) w3m dump (netflixtechblog.com)
        
       | walrus01 wrote:
       | re: 2017 vs late 2021 in x86-64 100Gbps hardware, lots has
       | changed.
       | 
       | one of the biggest differences is that PCI-E 4.0 100Gbps cards
       | (dual port) now exist.
       | 
       | https://newsroom.intel.com/wp-content/uploads/sites/11/2021/...
       | 
       | and systems with more than 16 or 20 PCI-E 3.0 lanes are not so
       | ridiculous in price.
        
       | syoc wrote:
       | https://people.freebsd.org/~gallatin/talks/euro2019.pdf
       | 
       | https://people.freebsd.org/~gallatin/talks/euro2021.pdf
       | 
       | More recent versions by the same author.
       | 
       | HN article on the most recent one with comments from the author.
        
         | walrus01 wrote:
         | one of the things I worry about is that with mellanox now being
         | owned by nvidia, they're going to be much more hostile in the
         | future to having real open source full capability drivers for
         | the linux and freebsd kernels.
         | 
         | the drivers you can download from the mellanox website to build
         | them as DKMS modules already have absurd licenses.
        
         | ComputerGuru wrote:
         | I've come across those but - perhaps because they're just
         | slides - they really don't go into the same depth the 100Gbps
         | article does. They're amazing resources but a little more high
         | level and feature very little kernel hacking.
        
         | jaytaylor wrote:
         | Novel concept: Include the described link so every curious soul
         | doesn't have to dig.
         | 
         | https://news.ycombinator.com/item?id=28584738
         | 
         | Just sayin', clickable links are pretty nice.
        
       | gigatexal wrote:
       | I love that Yahoo showed FreeBSD love and so does Netflix.
        
       | moonbug wrote:
       | I'm surprised they keep the kernel in the critical path, rather
       | than driving the NIC from usersoace.
        
         | wmf wrote:
         | Userspace isn't magic. (Unfortunately the "userspace
         | networking" people have done a poor job of explaining it.) When
         | you're serving static files like Netflix, you want the storage
         | drivers, filesystem, cache, network stack, and NIC drivers to
         | be in the same address space. Whether that address space is
         | userspace or kernel is not that important.
        
       ___________________________________________________________________
       (page generated 2021-12-13 23:01 UTC)