[HN Gopher] Joblib: Running Python functions as pipeline jobs
       ___________________________________________________________________
        
       Joblib: Running Python functions as pipeline jobs
        
       Author : gjvc
       Score  : 13 points
       Date   : 2023-04-12 20:59 UTC (2 hours ago)
        
 (HTM) web link (joblib.readthedocs.io)
 (TXT) w3m dump (joblib.readthedocs.io)
        
       | biomcgary wrote:
       | I am not a Pythonista, but joblib is such an easy wrapper to use.
       | 
       | I use joblib at work (it handles edge cases that pickle does not)
       | to package up trained ML models for deployment by a colleague. I
       | train the models outside of a Python environment, pull the models
       | into the Python version of the ML library I use, and then
       | serialize the models to a compressed joblib file. The joblib
       | object takes up less space than the text based model file and
       | deploys quickly for almost instant predictions.
       | 
       | To ensure that the input fields for training line up with the
       | input fields for classification/regression, we add a hash to the
       | joblib object, which is trivially easy. Dump the object on s3
       | using the hash as the key and it's trivial to have a library of
       | ML models ready to deploy very quickly.
        
       ___________________________________________________________________
       (page generated 2023-04-12 23:01 UTC)