Post AYxwRZaYlnVBZdV0F6 by fuggy@marsey.moe
(DIR) More posts by fuggy@marsey.moe
(DIR) Post #AYxg019J6oEpfyafjs by fuggy@marsey.moe
2023-08-21T16:52:47.203240Z
1 likes, 1 repeats
Uhhhh~So... What should I do? Either I can get an AMD GPU with 16GBs of VRAM, definitely an upgrade compared to what I have currently, but also annoying to set up without CUDA support, but I also get a better non-AI general experience on Linux. Or, I could get 2 older 24GBs VRAM Pascal cards for a total of 48 GBs and be able to run even 70B LLMs, but just very slowly. Having a hard time deciding, either I can have better drivers with AMD but worse AI support, or I can go with NVIDIA and have garbage drivers and great AI support and more VRAM, but it will be very slow since it's an older card. AMD seems like a little less of a gamble since I should be able to cool and power it, where with 2 older NVIDIA cards, it's close to the limit of what my PSU can do theoretically and cooling would be a nightmare
(DIR) Post #AYxkhGuolWOaqKh5EW by paula@marsey.moe
2023-08-21T17:45:24.909109Z
0 likes, 0 repeats
no way the 2 old nvidia ones is a realistic option, it's just a funny gimmick to boast max possible performance at the severe stability cost
(DIR) Post #AYxlNLZ3s2DNQNa32e by i@declin.eu
2023-08-21T17:53:00.367588Z
0 likes, 0 repeats
@paula @fuggy it is, but you really have to know your stuff and prepare for it actually being two banks of 12GB memory, and CUDA support for it being beyond EOLpeople have done it though: https://www.reddit.com/r/StableDiffusion/comments/xcfree/tesla_k80_24gb/
(DIR) Post #AYxpKaEDIJ5Dqplb1s by pernia@cum.salon
2023-08-21T18:37:14.049521Z
0 likes, 0 repeats
@i @fuggy @paula i have an rx6800, very comfy
(DIR) Post #AYxpT8IoUVgBqZzkmW by ElDeadKennedy@shitposter.club
2023-08-21T18:38:54.011390Z
0 likes, 0 repeats
@fuggy I've been using an RX 6800 XT on Arch for almost a year now and it's been a great experience, can't complain
(DIR) Post #AYxs59TmlO1GPTNqym by fuggy@marsey.moe
2023-08-21T19:08:10.607080Z
0 likes, 0 repeats
What about for AI though?
(DIR) Post #AYxsGNA0EpkK1fTsm0 by ElDeadKennedy@shitposter.club
2023-08-21T19:10:11.491706Z
0 likes, 0 repeats
@fuggy haven't looked into that kind of thing so can't say anything
(DIR) Post #AYxseOV4uMLH8DnEqe by fuggy@marsey.moe
2023-08-21T19:14:33.025035Z
0 likes, 0 repeats
Oh well hardware encoding would be ideal, but I don't think it's well supported on AMD either. Luckily my new CPU I got a while back can handle CPU encoding a lot better than my old FX 8350 so it should be fine
(DIR) Post #AYxsodK2efotzsVtJ2 by fuggy@marsey.moe
2023-08-21T19:16:23.548487Z
0 likes, 0 repeats
Well from what I read it's just going to need a little bit more involved setup, we will see though. AMD seems to be committed to improving it as well. Worst comes to worst I can use my old GPU for things I guess if have to, but ideally want to sell it and never have to run the proprietary NVIDIA drivers again
(DIR) Post #AYxssE6cLqaIwowoqG by fuggy@marsey.moe
2023-08-21T19:17:03.034851Z
0 likes, 0 repeats
Although if I have to, I'm pretty sure I can set it up where the GTX 1080 will just be for CUDA and AMD GPU for everything else
(DIR) Post #AYxsx7p58dBmuT56iO by fuggy@marsey.moe
2023-08-21T19:17:56.052650Z
0 likes, 0 repeats
Or maybe I can do something with Grub since I think it loads at boot anyway, probably could just have two boot options for whichever driver I want to load?
(DIR) Post #AYxu1g9zVzVmW8b48e by benis@cawfee.club
2023-08-21T19:29:55.960959Z
0 likes, 0 repeats
@mischievoustomato @fuggy >i trust intel's software quality more than i do amd'sdid your nana drop you on your head when you were little or were you just born this way? were you around for the launch of Alchemist?
(DIR) Post #AYxu44dtSfMz1jj2IK by fuggy@marsey.moe
2023-08-21T19:30:23.514155Z
1 likes, 0 repeats
I think I might get a Intel card next time, but they seem to need to have more time in the oven for me to consider. Really hope they bring real competition though, I think newer cards are coming out 2024
(DIR) Post #AYxuQavY6kyHWkiqcy by fuggy@marsey.moe
2023-08-21T19:34:27.681017Z
1 likes, 0 repeats
Personally, haven't had good experiences with Intel made software lol. Clear Linux package management is retarded, and their Intel HD drivers are complete garbage especially the control center, also not really software but the whole X86 architecture is retarded. They are making new drivers from the ground up with Arc, so we will see. But even then the Linux drivers are mostly community driven, so if the hardware is good, the software will probably be good anyway regardless of Intel's software brainlet software engineers
(DIR) Post #AYxupnDzWVpuuHMdEW by fuggy@marsey.moe
2023-08-21T19:39:01.255444Z
1 likes, 0 repeats
The Intel Arc drivers, not to be confused with Intel HD drivers seem to be good for being a new codebase and making rapid improvements. Just Arc Control center which apparently sucks balls, I guess UI is not their expertise perhaps
(DIR) Post #AYxuseChWEyTnX7bIO by fuggy@marsey.moe
2023-08-21T19:39:32.206292Z
1 likes, 0 repeats
Of course I'm talking about the Windows ones
(DIR) Post #AYxux1ZmYzSdRb0MOe by fuggy@marsey.moe
2023-08-21T19:40:19.661599Z
0 likes, 0 repeats
I thought it was done by Mesa and Intel like AMD just does the most they can to help out
(DIR) Post #AYxvWdXJQ7RLJKpZ5s by fuggy@marsey.moe
2023-08-21T19:46:45.787664Z
0 likes, 0 repeats
AMDs control panel is great though, It's basically GeForce experience and overclocking software all in the same UI. NVIDIAs control panel gets the job done but not much else and looks like Windows XP. But doesn't really matter I guess, because I'll mostly be using Linux anyway
(DIR) Post #AYxvYKO3aVQSV2J9kG by fuggy@marsey.moe
2023-08-21T19:47:04.133215Z
0 likes, 0 repeats
I don't even think AMD on Linux has a control panel lol
(DIR) Post #AYxvkaZLFW20A7Qtqi by fuggy@marsey.moe
2023-08-21T19:49:16.736979Z
1 likes, 0 repeats
Yeah the whole multiple driver thing on AMD confuses me a tad tbh as NVIDIA user, I'm sure I'll figure it out
(DIR) Post #AYxw3Fb7RbvEcgA9ke by fuggy@marsey.moe
2023-08-21T19:52:39.483891Z
1 likes, 0 repeats
Really confused if I need AMD Pro drivers for ROCm or not, I think you might be able to run ROCm without them?
(DIR) Post #AYxwGMxZNpx1Djv47M by fuggy@marsey.moe
2023-08-21T19:55:01.440333Z
1 likes, 0 repeats
Okay, so am I understand correctly here? You have the open source ones my AMD themselves, then you have the open source ones by Red Hat and Valve, then you have the proprietary AMD Pro drivers that only has niche use case anyway (might still play with them for lols and curiosity)
(DIR) Post #AYxwPAOLTsCMqbde1A by fuggy@marsey.moe
2023-08-21T19:56:37.117532Z
1 likes, 0 repeats
The open source drivers just replace the Vulkan rendering part, so I think I heard you don't even have to reboot to use them right?
(DIR) Post #AYxwRZaYlnVBZdV0F6 by fuggy@marsey.moe
2023-08-21T19:57:03.235451Z
1 likes, 0 repeats
I think it's just a command line argument or something correct?! I'm honestly confused a little
(DIR) Post #AYxx26UrtZly3tFwKe by fuggy@marsey.moe
2023-08-21T20:03:39.073393Z
0 likes, 0 repeats
Dear God okay... SEVERAL?!
(DIR) Post #AYynb2taTKUqe0nizI by fuggy@marsey.moe
2023-08-22T05:52:37.655285Z
0 likes, 0 repeats
NVIDIA has brain washed me into thinking of a driver of a monolithic blob instead of individual components