Posts by bastelwombat@chaos.social
 (DIR) Post #B98kzFIVIQXvgkJJKK by bastelwombat@chaos.social
       0 likes, 0 repeats
       
       @mntmn Supposedly CXMT is picking up speed. Who knows if that’ll work out. But I guess if the margins are getting as obscene as they currently are, that’s bound to attract some competition.
       
 (DIR) Post #B9L0Oc6NQP5Tcm9zM0 by bastelwombat@chaos.social
       0 likes, 0 repeats
       
       @mntmn This limit is well known by LLM users. In their language it’s called „context window“. It’s usually measured in „number of tokens“ and is one of the metrics used to advertise (bigger means better, but also more expensive).People usually avoid getting even close to that limit, because apparently these things get dumber, the closer you get to the limit. Practically all LLM-manuals talk about how to be resourceful about that limited context window.