[HN Gopher] Freewire: An Experiment with Freely Wired Neural Net...
       ___________________________________________________________________
        
       Freewire: An Experiment with Freely Wired Neural Networks
        
       Author : optimalsolver
       Score  : 34 points
       Date   : 2021-03-18 09:25 UTC (1 days ago)
        
 (HTM) web link (github.com)
 (TXT) w3m dump (github.com)
        
       | mpoteat wrote:
       | If freely wired neutral networks are DAGs, I wonder how cyclic
       | graphs of neurons behave, or even if that model would be
       | theoretically meaningful, or computationally feasible.
        
         | goldenkey wrote:
         | https://en.wikipedia.org/wiki/Boltzmann_machine
         | 
         | You generally run them until they settle down. You can train
         | them, in a difficult process, by using the idea of thermal
         | equilibrium.
        
         | LeegleechN wrote:
         | Yep, they've existed for decades. Look up "RNN" (recurrent
         | neural network) and "LSTM" (long stort-term memory). They were
         | the standard for neural-network based time-series processing
         | for a while until recently supplanted by Transformers.
        
       | ttul wrote:
       | Can anyone link to a recent paper discussing the benefits or
       | advantages of freely wired networks vs. prescribed networks?
        
         | nujrabes wrote:
         | Haven't heard the term "freely wired" before, but FAIR released
         | an exploration of randomly wired neural networks which seems
         | conceptually similar. https://arxiv.org/abs/1904.01569
        
       ___________________________________________________________________
       (page generated 2021-03-19 23:01 UTC)