[HN Gopher] The death of feature engineering is greatly exaggerated
       ___________________________________________________________________
        
       The death of feature engineering is greatly exaggerated
        
       Author : agnosticmantis
       Score  : 30 points
       Date   : 2021-12-20 03:17 UTC (19 hours ago)
        
 (HTM) web link (petewarden.com)
 (TXT) w3m dump (petewarden.com)
        
       | anonymousDan wrote:
       | As a non ML expert, I never quite understand where you draw the
       | line between feature engineering and the architecture engineering
       | required for Deep Learning to work. Is it just a spectrum or is
       | there some fundamental difference?
        
         | ford wrote:
         | I'm assuming by architecture engineering you mean the process
         | of choosing the model + hyperparameters that perform best.
         | 
         | I think of feature vs architecture engineering as two not-quite
         | perpendicular axes that you can do work on. Feature engineering
         | involves selecting & transforming inputs such that the model
         | has access to the most meaningful/easiest to interpret data.
         | Architecture engineering involves choosing the appropriate
         | model architecture.
         | 
         | Suppose we were building a model to predict a business's sales
         | for the next 12 months based on the prior 12 months.
         | 
         | An important input is the sales for the prior year. A feature
         | engineering task would be choosing to take the sum, median, or
         | average sales per day based on what you know about the
         | distribution.
         | 
         | Architecture engineering would involve trying a few different
         | models & tuning their hyperparameters to be most accurate.
         | 
         | The two areas are related - because you may know that the
         | business's sales on one day are highly dependent on the
         | previous few days. Knowing this, you may instead choose
         | features + an architecture that instead of predicting sales for
         | an entire 12 months period, predicts sales on a day-by-day
         | basis (which can then be summed).
        
       | 1cvmask wrote:
       | Here is a post on why feature engineering is easier in fact:
       | 
       | https://gab41.lab41.org/feature-engineering-is-just-easier-1...
        
       ___________________________________________________________________
       (page generated 2021-12-20 23:00 UTC)