Post B48o2w7uMpCTQstU7k by azonenberg@ioc.exchange
(DIR) More posts by azonenberg@ioc.exchange
(DIR) Post #B48VtACVO27x0oEatk by azonenberg@ioc.exchange
0 likes, 0 repeats
Well, I still feel like I got run over by a truck on its way to a BSL-2 waste incinerator.But I've had enough energy this evening to move my core router down 2U, freeing up 4U of space for the VM server.Now I'm doing a bunch of monthly patching and IT infrastructure work before hauling the new VM server chassis over to the lab, installing the power supply, then suspending all of the VMs and beginning the move of all of the existing VM server guts to the new platform.I'll also be removing the AMD GPUs that I never got working right and adding another GTX 1630.
(DIR) Post #B48XuvplyLNWwTZY6C by azonenberg@ioc.exchange
0 likes, 0 repeats
Not liking this chassis so far it feels cheap fit-and-finish wise. I probably missed the bad reviews in my sickness lol.But it's big and airy so hopefully it'll have better thermals
(DIR) Post #B48Z8hTYFl4aQ1J8i0 by azonenberg@ioc.exchange
0 likes, 0 repeats
One of the standoffs in the hardware bag was covered in rust and zinc oxide from the factory. Good sign lol
(DIR) Post #B48alv4NkE1rpNnenw by azonenberg@ioc.exchange
0 likes, 0 repeats
This thing was cooking. Took a SFP out while preparing to unrack the server and almost burned my finger on it.
(DIR) Post #B48cbyFBHv8EgWEcq0 by azonenberg@ioc.exchange
0 likes, 0 repeats
The case has pems of two different lengths.The shorter ones i guess you're supposed to screw a stand off extension into to mount the mobo.But if you have a long where you need a short what do you do? I can't get them off
(DIR) Post #B48cdzeh0koNdq8GSO by azonenberg@ioc.exchange
0 likes, 0 repeats
See here
(DIR) Post #B48cx4PLZ8SDsp3DHM by azonenberg@ioc.exchange
0 likes, 0 repeats
Looks like i have 4 too long studs to get rid of
(DIR) Post #B48d1SNIOoQnNEBPqS by emily@fedi.uni.horse
0 likes, 0 repeats
@azonenberg angle grinderless fun answer: longer ones into all the other holes to raise the board up high enough that they're not in the way?
(DIR) Post #B48d1SdxOrl6Ctyioa by azonenberg@ioc.exchange
0 likes, 0 repeats
@emily that will mean all the pci slots and back panel connectors won't line up
(DIR) Post #B48d41B3yU7ZtKgOLw by azonenberg@ioc.exchange
0 likes, 0 repeats
@emily attempting to rip and tear with visegrips, a hammer, and punches is getting nowhere so far
(DIR) Post #B48dB18EXhjVmEhGCG by azonenberg@ioc.exchange
0 likes, 0 repeats
@emily I wonder if i could use a drill and just go in from the top using the threads like a center drill mark lol
(DIR) Post #B48dIQcaAhjsrHQTj6 by emily@fedi.uni.horse
0 likes, 0 repeats
@azonenberg could work. do the holes go all the way down?
(DIR) Post #B48dIQsXDOV1ektDai by azonenberg@ioc.exchange
0 likes, 0 repeats
@emily not sure but if i go deep enough they won't short to the mobo that's all i need
(DIR) Post #B48dkF9UPKQrOa56My by azonenberg@ioc.exchange
0 likes, 0 repeats
Nothing I've tried nondestructively has worked. They're seized on.Looks like they're probably f-f studs into hex pems at the bottom.Gonna try drilling this one out.
(DIR) Post #B48e0CadhWnQ5BOFUm by azonenberg@ioc.exchange
0 likes, 0 repeats
Worked better than i expected. They seem to be soft metal. A 5/32 bored it out in seconds now let's try bigger to get the rest
(DIR) Post #B48fm3aoYUug24r3s8 by azonenberg@ioc.exchange
0 likes, 0 repeats
It's not pretty but it'll do in a pinch. Never buying this case again
(DIR) Post #B48fqYThfO0Ayofp1U by azonenberg@ioc.exchange
1 likes, 0 repeats
Added two layers of electrical tape to be extra safe
(DIR) Post #B48fxRRgDD6DCC0jeS by azonenberg@ioc.exchange
0 likes, 0 repeats
Ten full height (or short + extended) pems. Ten mounting holes in the mobo. Every hole is over a standoff.Here goes nothing.
(DIR) Post #B48hC3AYqtlyCcX8Qy by azonenberg@ioc.exchange
0 likes, 0 repeats
Mobo mounted and cabled up, still need to swap heatsinks
(DIR) Post #B48iBHTyFcocG4oEhk by azonenberg@ioc.exchange
0 likes, 0 repeats
Which direction should CPU cooling air flow? Options are toward GPUs or PSU, front to back isn't possible on this mobo
(DIR) Post #B48iKLREucYr8LqzTM by gsuberland@chaos.social
0 likes, 0 repeats
@azonenberg PSU probably has a clearer path to outside and will be fine with the heat load.
(DIR) Post #B48iLiy8uYO0P0ty3k by azonenberg@ioc.exchange
0 likes, 0 repeats
@gsuberland that was my thought too
(DIR) Post #B48jHrvzjhhD0Icei8 by azonenberg@ioc.exchange
0 likes, 0 repeats
Next up, swapping brackets on all the pcie cards to full height
(DIR) Post #B48jYi61ZG2rPjLPHs by azonenberg@ioc.exchange
0 likes, 0 repeats
The chassis has 8 pcie slots even though the mobo only has 7. Meaning i can put a dual slot gpu overhanging empty space st the far edge of the case.This will let me fit the planned three Nvidia cards, the 10g nic, *and* an AMD single slot card
(DIR) Post #B48jZD3yQvpBSLchtY by jpm@aus.social
0 likes, 0 repeats
@azonenberg towards the PSU, because that’s where the major case exhaust lives. Towards the GPU will add the CPUs heat to the GPU
(DIR) Post #B48jsk9VdGo7aCWj9U by azonenberg@ioc.exchange
0 likes, 0 repeats
Or not, I can't find a full height pcie bracket lol.Maybe I'll put an oculink card or thunderscope or something in the free space down the road.
(DIR) Post #B48kVnShGHfh8n7jg8 by RichiH@chaos.social
0 likes, 0 repeats
@azonenberg I was honestly a bit in awe that anyone would stock extra for a home lab. I stopped doing this kinda thing some years ago, but even I didn't OCD that hard(I am certain I could find 1-2 in The Box though)
(DIR) Post #B48kc4o5gavCfn7oX2 by astraleureka@social.treehouse.systems
0 likes, 0 repeats
@azonenberg What chassis is that? The fixed standoffs are crude and the chassis itself looks flimsy...
(DIR) Post #B48kxZxl2nhRNmtrAO by azonenberg@ioc.exchange
0 likes, 0 repeats
Anyway it's racked and passed POST so I didn't screw up too badly.
(DIR) Post #B48l3JWn3teo9F1LYe by azonenberg@ioc.exchange
0 likes, 0 repeats
@astraleureka something from athena power I'll look up the p/n when I'm booted (i ordered from a browser on this box lol)Do not recommend but i was already down and didn't want to deal with a rma + more shipping delays
(DIR) Post #B48l9bKXmlan6CI4cC by astraleureka@social.treehouse.systems
0 likes, 0 repeats
@azonenberg Good to know never to buy one 🙃 supermicro chassis might be $$$ even used but at least they're fully configurable, standoffs, fans, PSUs etc
(DIR) Post #B48lDoMLHn72fM8h9c by azonenberg@ioc.exchange
0 likes, 0 repeats
@astraleureka i wanted one but stock seemed very poor for anything with the space and capacity for a bunch of GPUs. I wonder why *glares at slop machine*
(DIR) Post #B48lLfx2QmpguC3NSq by astraleureka@social.treehouse.systems
0 likes, 0 repeats
@azonenberg yeah... they're one of the top choices I see for OEM whitelabel boxes so I'd imagine they're totally swamped for stupid LLM appliances right now.
(DIR) Post #B48lNOHx4UXqhkeZmK by azonenberg@ioc.exchange
0 likes, 0 repeats
@astraleureka other than the dell which is a friend's backup server everything here is super micro lol.I paid like 900ish for this piece of trash. Was super sick and clearly made a bad decision
(DIR) Post #B48lYESpwGXhQ6ul2e by astraleureka@social.treehouse.systems
0 likes, 0 repeats
@azonenberg 😭 the last 4U/full tower supermicro I got was $850 *new* and it could fit 4 GPUs comfortably with the right EEATX board. that's ridiculous, I am sorry
(DIR) Post #B48m2e2TPu5BQV5KnA by azonenberg@ioc.exchange
0 likes, 0 repeats
Network isn't working so that's the next problem. I did swap nics but they were both x520-da2's so should have been fine unless it pinned the mac somewhere
(DIR) Post #B48mApG9aBHAXkNv0K by manawyrm@chaos.social
0 likes, 0 repeats
@azonenberg i'm sure PCIe IDs changed and "predictive" network interface naming just bit your ass :)that's what net.ifnames=0 and using eth0/eth1 like in the past is for :D
(DIR) Post #B48mHTNrJYF6ix9tDM by azonenberg@ioc.exchange
0 likes, 0 repeats
@manawyrm this is a 4.x ultra lts kernel still using ethX names
(DIR) Post #B48mOLWmvAVUO0c2HA by manawyrm@chaos.social
0 likes, 0 repeats
@azonenberg yiikes, that's vintage :D
(DIR) Post #B48mQASn1tS2eKbwES by azonenberg@ioc.exchange
0 likes, 0 repeats
@manawyrm seems eth1 is now eth3
(DIR) Post #B48mSaVTAkiq051CEa by azonenberg@ioc.exchange
0 likes, 0 repeats
@manawyrm 4.19.0+1 compiled in 2026 lol
(DIR) Post #B48mVRjQFo3NebuL3Y by azonenberg@ioc.exchange
0 likes, 0 repeats
@manawyrm and xcp-ng 8.3 will be supported out until like 2030 or so
(DIR) Post #B48maLm5pSoycvUlQO by manawyrm@chaos.social
0 likes, 0 repeats
@azonenberg ahh, you're doing Xen!! OK then!
(DIR) Post #B48nfsoKWrS8ULkAiG by azonenberg@ioc.exchange
0 likes, 0 repeats
I give up i might just recreate the virtual networks from scratch
(DIR) Post #B48o2w7uMpCTQstU7k by azonenberg@ioc.exchange
0 likes, 0 repeats
Actually let's try putting the original nic with same mac back in
(DIR) Post #B48pF2mrWrdNWFO3lY by uint8_t@chaos.social
0 likes, 0 repeats
@azonenberg consider an AIO water cooler?
(DIR) Post #B48pJlom30G6L1XDvM by azonenberg@ioc.exchange
0 likes, 0 repeats
@uint8_t I'll see how thermals are once everything is booted but right now I'm more busy fighting network config so i can ssh in, mount storage, and run vms
(DIR) Post #B48wRygEoD8GE3P2YK by azonenberg@ioc.exchange
0 likes, 0 repeats
Oook well I'm not sure what i did wrong but once i got to the point I could ssh in again, the rest of the network reconfiguration was easy