Post AdS1vuUjZGxgOIQv7Q by pamelafox@fosstodon.org
 (DIR) More posts by pamelafox@fosstodon.org
 (DIR) Post #AdS1vuUjZGxgOIQv7Q by pamelafox@fosstodon.org
       2024-01-02T22:35:53Z
       
       0 likes, 0 repeats
       
       step 1 to using local LLMs: clear enough space in your hard drive (or buy a separate drive like @simon )
       
 (DIR) Post #AdS1vvlQqfueKNFlmi by cfbolz@mastodon.social
       2024-01-02T23:09:16Z
       
       0 likes, 0 repeats
       
       @pamelafox @simon out of curiosity, what's the order of magnitude of disk space needed?
       
 (DIR) Post #AdS1vwrUlcMBjT67sG by simon@fedi.simonwillison.net
       2024-01-02T23:46:40Z
       
       0 likes, 0 repeats
       
       @cfbolz @pamelafox Most of the useful models I'm playing with around around 4GB, the largest I've tried myself was around 20GBThe smallest that was interesting was 1.1GB