Post B6BBRRpGwLWPYkmiSe by marius851000@mastodon.mariusdavid.fr
 (DIR) More posts by marius851000@mastodon.mariusdavid.fr
 (DIR) Post #B6AGgSZckR36poU10i by inex@pony.social
       0 likes, 0 repeats
       
       looking rn at how a local LLM goes over 300 pages of my German conspects to enrich and generate Anki cards for vocabularyand it is kinda accurate?and reasonably fast?and it would cost me hundreds of dollars if I used commercial models for this volume of work?huh
       
 (DIR) Post #B6AHF2VrdHy891DHoO by inex@pony.social
       0 likes, 0 repeats
       
       The only downside is that it will take hours, and I won't be able to use my PC as it cosumes 96% of VRAM.But that's where the magic of having multiple computers kicks in.
       
 (DIR) Post #B6BBRRpGwLWPYkmiSe by marius851000@mastodon.mariusdavid.fr
       0 likes, 0 repeats
       
       @inex A typical stuff I do in such case is to let it run overnight. Or switch to the IGPU (which is absolutly fine for coding).