Post ASlvPTEEc1SCQqw4um by moultano@sigmoid.social
(DIR) More posts by moultano@sigmoid.social
(DIR) Post #ASlvPTEEc1SCQqw4um by moultano@sigmoid.social
2023-02-16T21:29:20Z
0 likes, 1 repeats
Shibboleths rule every statistical system trained on text. The meaning of a word is deeply coupled to the characteristics of the slice of the people who use it.It would not surprise me at all if fine tuning to use a lot of emojis is what unleashed the unhingedness characteristic of someone who uses a lot of emojis.
(DIR) Post #ASlvPVGR2oP0kFyrce by moultano@sigmoid.social
2023-02-16T21:41:30Z
0 likes, 0 repeats
Consider the difference between "Did dinosaurs really exist?" and "When did dinosaurs go extinct?" Both of these would be satisfied by similar completions, but the social context of the former implies either a young-earth creationist or a kid, so entails different subsequent text.
(DIR) Post #ASlvPWustuLtrzugJE by moultano@sigmoid.social
2023-02-16T21:48:08Z
0 likes, 0 repeats
LLMs don't generally include the domain name of their source in their context window (They should!) so you don't get magic keywords like "Artstation" to elicit a certain social context like in image models. Instead, if you talk like a particular website, you keep doing so.