[HN Gopher] The many ways that digital minds can know - A better...
___________________________________________________________________
The many ways that digital minds can know - A better way to think
about LLMs
Author : moultano
Score : 37 points
Date : 2023-07-05 17:17 UTC (5 hours ago)
(HTM) web link (moultano.wordpress.com)
(TXT) w3m dump (moultano.wordpress.com)
| troft wrote:
| [dead]
| turnsout wrote:
| Nice article, and I like the choice of the word "integration"
| rather than "generalization" to describe the ability of a model
| to take an internal representation and apply it in a new
| scenario.
|
| I continue to think that Relational Frame Theory [0] both
| explains _why_ these models work so well, and also _how_ they 're
| able to integrate knowledge through nothing but language. I
| believe that a researcher could show that LLMs emergently encode
| "frames" that describe relationships between concepts; that
| frames can be combined to form more complex expressions; and that
| frames can be reused in different contexts to make "novel"
| connections.
|
| [0]: https://en.wikipedia.org/wiki/Relational_frame_theory
___________________________________________________________________
(page generated 2023-07-05 23:01 UTC)