[HN Gopher] Diffusion vs. Autoregressive Language Models: A Text...
___________________________________________________________________
Diffusion vs. Autoregressive Language Models: A Text Embedding
Perspective
Author : doener
Score : 6 points
Date : 2025-05-28 20:27 UTC (2 hours ago)
(HTM) web link (arxiv.org)
(TXT) w3m dump (arxiv.org)
| Klathmon wrote:
| > We propose adopting diffusion language models for text
| embeddings, motivated by their inherent bidirectional
| architecture and recent success in matching or surpassing LLMs
| especially on reasoning task.
|
| I didn't realize diffusion language models were at this point
| yet. But what's the catch? why aren't diffusion models (or some
| kind of hybrid) taking over?
___________________________________________________________________
(page generated 2025-05-28 23:01 UTC)