Post AWf2MjBgYONVER83jU by ParadeGrotesque@mastodon.sdf.org
 (DIR) More posts by ParadeGrotesque@mastodon.sdf.org
 (DIR) Post #AWf2MiPpQK64q0jq8e by ttkciar@mastodon.sdf.org
       2023-06-13T21:12:48Z
       
       0 likes, 0 repeats
       
       My pocket cluster hardware died a year ago, and after much agonizing I finally pulled the trigger on buying hardware for a "new" one (albeit with old hardware).  Got four Dell T7910 with two E5-2990 v3 each, mostly for running GEANT4, ROCStar hydrocode, and (more recently) llama.cpp and nanoGPT.  They each have four PCIe x16 3.0 slots, and I'm eyeing refurb GPUs for them (or at least one of them) for LLM acceleration, both training and inference.  #HPC #LLM #homelab
       
 (DIR) Post #AWf2MjBgYONVER83jU by ParadeGrotesque@mastodon.sdf.org
       2023-06-13T21:19:40Z
       
       0 likes, 0 repeats
       
       @ttkciar That is NOT a "pocket cluster".Yes, I envy you.