[HN Gopher] Ordering Requests to Accelerate Disk I/O
       ___________________________________________________________________
        
       Ordering Requests to Accelerate Disk I/O
        
       Author : pkolaczk
       Score  : 10 points
       Date   : 2021-04-05 06:14 UTC (1 days ago)
        
 (HTM) web link (pkolaczk.github.io)
 (TXT) w3m dump (pkolaczk.github.io)
        
       | the8472 wrote:
       | A few things that can make walking HDDs by physical layout even
       | faster:
       | 
       | * also do it when walking directories! on ext4 you can FIEMAP the
       | directories while walking them.
       | 
       | * keep a readahead buffer that spans multiple files, that way you
       | can keep X megabytes in flight even when the files are small
       | 
       | * do readaheads on directories (can only be done as root for
       | ext4)
       | 
       | * do drop-behind to prevent page cache thrashing
       | 
       | I wrote some crates for that: https://crates.io/crates/platter-
       | walk https://crates.io/crates/reapfrog
        
       ___________________________________________________________________
       (page generated 2021-04-06 23:00 UTC)