[HN Gopher] Language Entropy
___________________________________________________________________
Language Entropy
Author : astledsa
Score : 12 points
Date : 2024-08-25 09:59 UTC (2 days ago)
(HTM) web link (streams.place)
(TXT) w3m dump (streams.place)
| curiousgibbon wrote:
| This seems like a new definition of entropy unrelated to existing
| notions of entropy relevant to language. I'm not sure I buy
| "entropy = 1/abstractness"...
| kayo_20211030 wrote:
| I don't buy any of it.
|
| > f(word) -> R
|
| What on earth is that? If f === "the meaning of", we'll all
| have different R's.
| ttpphd wrote:
| Sounds like someone is interested in some classic Shannon.
|
| Prediction and Entropy of Printed English, Shannon 1951
| https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf
___________________________________________________________________
(page generated 2024-08-27 23:01 UTC)