Posts by VD-15@fediffusion.art
(DIR) Post #AmfMOSfyt5SuRVFubI by VD-15@fediffusion.art
2024-10-03T19:36:57.405570Z
0 likes, 0 repeats
Good news: My manifold fits the card, fan and case.Bad news: I have to re-design my manifold because the power cable doesn't fit.
(DIR) Post #AmfMOTCEx9Gm3YLfsm by VD-15@fediffusion.art
2024-10-03T23:21:42.042927Z
0 likes, 0 repeats
Guess I gotta use supports and shrink the manifold after all
(DIR) Post #AmfMOTG8ieOAFeAmxc by VD-15@fediffusion.art
2024-10-02T21:50:38.827858Z
0 likes, 0 repeats
Oh, forgot:How to fit the power connector in
(DIR) Post #AmfMOTjuvwCxk06ZNI by VD-15@fediffusion.art
2024-10-04T14:32:01.767605Z
0 likes, 0 repeats
Long print ahead.Hope nothing fails 🤞
(DIR) Post #AmfMOUNGZdgRi2Vzhw by VD-15@fediffusion.art
2024-10-04T14:38:33.650081Z
0 likes, 0 repeats
Correction: my PETG is wet. I'll have a long print in about eight hours
(DIR) Post #AmrtRlCjwMg4xfbUxs by VD-15@fediffusion.art
2024-10-10T16:03:27.494560Z
1 likes, 0 repeats
Experimenting.Wanna put together some style LoRAs when I get the cooling for the new rig
(DIR) Post #AnKAeqA0TE62b4haAy by VD-15@fediffusion.art
2024-10-20T21:35:26.652723Z
0 likes, 0 repeats
goes kinda hard
(DIR) Post #AnlZU2Y8uEPAbeQPMu by VD-15@fediffusion.art
2024-10-04T16:07:10.700046Z
0 likes, 0 repeats
This arrangement should work
(DIR) Post #AnlZU3kESlfaJR5Zqq by VD-15@fediffusion.art
2024-11-06T12:42:53.485271Z
4 likes, 5 repeats
A poor fit is still a fit.If I stop posting, it means I have died in a house fire.
(DIR) Post #AnpWRv7KQxnG8cxMhs by VD-15@fediffusion.art
2024-11-06T12:53:53.170795Z
0 likes, 0 repeats
THE DRAGON BREATHES!
(DIR) Post #AnpWRvtXXiMGY9Vrqy by VD-15@fediffusion.art
2024-11-06T13:09:28.463811Z
0 likes, 0 repeats
Damn, the dragon is slow as shit.Might just be my settings. I'll do some fiddling.
(DIR) Post #AnpWRwjePy2f9ltU4u by VD-15@fediffusion.art
2024-11-06T14:07:44.816088Z
0 likes, 0 repeats
Couple of observations:I can finally load GGUF models properlyGGUF is MUCH faster than GPTQ on pascalThese P40s are running surprisingly cool compared to my RTX 3060s
(DIR) Post #AnpWRwzxRL5NyLWVUm by VD-15@fediffusion.art
2024-11-06T13:13:26.683981Z
0 likes, 0 repeats
Temps are manageable, at least. Haven't gone above 40°C yet.
(DIR) Post #AnpWRxNM2Lnj8uTBxo by VD-15@fediffusion.art
2024-11-07T18:12:05.482607Z
0 likes, 0 repeats
DUDE llama 70b is something else, holy shit!
(DIR) Post #AnpWRxnEU8V8RAZrIe by VD-15@fediffusion.art
2024-11-07T18:16:55.114013Z
0 likes, 0 repeats
Could also be that I'm used to Yi, which tends to shit the bed after ~4000 tokens
(DIR) Post #AnpWRyLGRbiu8iV2LQ by VD-15@fediffusion.art
2024-11-07T18:13:35.113651Z
0 likes, 0 repeats
And I have VRAM to spare! I'm loading a 4bit quant right now, might be able to get away with 6bit?
(DIR) Post #AnpWRyelH7Jr7Bcbjc by VD-15@fediffusion.art
2024-11-07T18:18:02.462655Z
1 likes, 0 repeats
If you told me last August that I'd be loading a 70b model the next year, I would've laughed you out of the room.
(DIR) Post #AnpoqRrM9GRboOKajg by VD-15@fediffusion.art
2024-11-08T13:54:59.751850Z
0 likes, 0 repeats
@lain The plot thiccens...
(DIR) Post #Aq0DDvTuUQWtUQ4kW8 by VD-15@fediffusion.art
2025-01-07T11:06:32.211779Z
0 likes, 0 repeats
BigCould be a game-changer for local LLMs. I'm excited to see how they perform once they release
(DIR) Post #Aq0DDwea8Eez7o4mn2 by VD-15@fediffusion.art
2025-01-07T23:51:56.292251Z
0 likes, 0 repeats
This is EXACTLY the kind of device I've been asking someone to make for a year now. No graphics cores, no RT cores, just all tensor cores all the way.Bonus points for ARM, that shit's neat.