[HN Gopher] Show HN: Incremental learning of polynomials (and ot...
       ___________________________________________________________________
        
       Show HN: Incremental learning of polynomials (and other LIP models)
       with IRMA
        
       Author : MrBusch
       Score  : 12 points
       Date   : 2021-01-06 13:10 UTC (9 hours ago)
        
 (HTM) web link (buschermoehle.org)
 (TXT) w3m dump (buschermoehle.org)
        
       | MrBusch wrote:
       | I developed a new incremental learning approach (called IRMA)
       | during my PhD in 2014 and haven't touched that research for a few
       | years. But it has always been on the back of my mind as an
       | approach worth following up on.
       | 
       | Now I decided to make it a bit more approachable through an
       | interactive tool that lets you play with a polynomial that learns
       | from incremental examples you provide. I also included some
       | background on how the method works.
       | 
       | Incremental learning (in contrast to batch learning) poses a
       | unique set of problems as the learning algorithm needs to adapt
       | with just a single new example. Compared to the state of the art,
       | IRMA does this through minimizing what it "forgets" about past
       | learned data while adapting to the new example. I chose
       | polynomials as an example as it doesn't work well with the
       | typically used gradient descent but can be learned with IRMA in a
       | much more stable manner.
       | 
       | The same approach has a closed form solution for a variety of
       | other models (that are linear in the parameters, i.e. LIP) and
       | I'd be interested to try and apply it to more models (like neural
       | networks) or other tasks (like classification) as well.
       | 
       | I'm excited about any questions or feedback!
        
         | verdverm wrote:
         | Interesting, I'll have to dig in some more. I have a similar
         | story with Prioritized Grammar Enumeration (PGE) for Symbolic
         | Regression. It's my PhD work that has been sidelined since 2015
         | and I've been thinking of resurrecting it.
         | 
         | Nice work!
        
       | saiojd wrote:
       | Nice work and great presentation.
        
       | yorwba wrote:
       | I'm sure it's a nice visualization, but unfortunately I'm only
       | seeing a white gap between the two sliders and tapping randomly
       | doesn't seem to have any effect. I _assume_ I should be seeing a
       | polynomial graphed even before doing anything.
       | 
       | Tested on Android using both Firefox and Chrome.
        
       ___________________________________________________________________
       (page generated 2021-01-06 23:01 UTC)