[HN Gopher] Serving ML at the Speed of Rust
       ___________________________________________________________________
        
       Serving ML at the Speed of Rust
        
       Author : dropbox_miner
       Score  : 7 points
       Date   : 2022-06-23 18:27 UTC (4 hours ago)
        
 (HTM) web link (shvbsle.in)
 (TXT) w3m dump (shvbsle.in)
        
       | occupant wrote:
       | > Rust is not mature enough to support ML out of the box ... If
       | you want to serve your Xgboost or deep learning model then Rust
       | is not the right choice (yet).
       | 
       | Would have liked to hear more about the parenthetical 'yet' even
       | if its just links to other blog posts.
        
         | minimaxir wrote:
         | As the article notes, there isn't any official Rust-native
         | support for any common frameworks, and using a C wrapper limits
         | its advantages.
         | 
         | tract (https://github.com/sonos/tract) seems like the most
         | mature for ONNX (for which TF/PT export is good nowadays), and
         | recently it successfully implemented BERT via Hugging Face ONNX
         | export.
        
       ___________________________________________________________________
       (page generated 2022-06-23 23:02 UTC)