[HN Gopher] Mirror, Mirror on the Wall, What Is the Best Topolog...
       ___________________________________________________________________
        
       Mirror, Mirror on the Wall, What Is the Best Topology of Them All?
        
       Author : rbanffy
       Score  : 51 points
       Date   : 2024-11-25 12:33 UTC (4 days ago)
        
 (HTM) web link (cacm.acm.org)
 (TXT) w3m dump (cacm.acm.org)
        
       | glonq wrote:
       | Anything that's not Token Ring.
        
       | aabhay wrote:
       | Biology has an incredible set of priors for this, given that
       | actual neurons have been experimenting with topologies for
       | millions of years. The neuron itself can be thought of as a meta-
       | topology in that it constructs potentially arbitrary hypergraphs
       | with the basic building block of axon/dendrites, albeit with a
       | locality bias.
       | 
       | Neurons actually have different topologies across different brain
       | regions, such as the more striated hippocampus versus the
       | stratified cerebral lobes. These have been hypothesized to
       | function as different forms of gradient descent, as pure back
       | propagation style bidirectional communication is perhaps only
       | present in a few specific brain regions or body extremities. But
       | I think a more popular interpretation is that these are
       | neighborhoods of co-activation that emphasize different kinds of
       | distributed learning.
        
       | da25 wrote:
       | Related to something similar Richard Feynman worked on - called
       | Connection Machine: https://tamikothiel.com/theory/cm_txts/
        
       ___________________________________________________________________
       (page generated 2024-11-29 23:01 UTC)