Post B7K4cZOVkRi2LmKnjM by ganbold@hiradai.space
 (DIR) More posts by ganbold@hiradai.space
 (DIR) Post #B7K4cZOVkRi2LmKnjM by ganbold@hiradai.space
       0 likes, 0 repeats
       
       re-introducing myself, my name in fedi is ganbold. I named myself in AI/ML work with codename "asa".I previously work on blockchain related stuff (independent), and currently in AI/ML (independent). I had never consider using local LLM previously simply because "my hardware is bad" and "I don't have time for that". but my accounts started to get banned left and right despite I am very comfortable using a certain model (closed source). by that time, I decided to start to reduce my dependency to closed source model, and start to use open weight one. Deepseek V4 is my favorite now despite I don't run it myself because of the gigantic params. but then I realized that someday my access to Deepseek can be blocked as well, so I started to research local LLM.that is where I am right now, running bunch of LLM in local using only my CPU (iGPU) which I never able to believe such thing is possible.and recently I just made my own lab, where I want to contribute and boost open weight and open source further.so you will find me mostly in:- low param models (<9B)- huggingface- vulkan- AMD - iGPU- creative ai genI am prepared if this post gained a slash, we are in fedi. you have right to dislike, I have right to post my researchviva la open sourceopen source must win!RE: https://hiradai.space/notes/ad9pww11p0lo005i