[HN Gopher] Traveling words: a geometric interpretation of trans...
___________________________________________________________________
Traveling words: a geometric interpretation of transformers
Author : d4rkp4ttern
Score : 59 points
Date : 2023-10-05 13:42 UTC (9 hours ago)
(HTM) web link (arxiv.org)
(TXT) w3m dump (arxiv.org)
| dleeftink wrote:
| I like this definition. Simple, clean, effective.
|
| Maybe the start of a new field tackling 'travelling wordsman'
| (smith?) problems.
| dpflan wrote:
| To anyone knowledgeable: where does geometric deep learning fit
| in here? Is this paper just another geometric view, or is it an
| attempt at a formalization for transformer mathematics? I don't
| see prominent GDL authors in this paper's references (Bronstein,
| Cohen, Bruna, Velickovic, ...).
| esafak wrote:
| Geometric learning is more about group- and invariant theory.
| This paper only goes as far as linear algebra, as far as I see.
___________________________________________________________________
(page generated 2023-10-05 23:01 UTC)