• 0 Posts
  • 4 Comments
Joined 1 year ago
cake
Cake day: October 27th, 2023

help-circle
  • Got an H11SSL-i from squaredpartner, 7302p from another seller in China, no vendor locks, no other issues with the parts, saved about $100 or so versus a bundle from tugm, if you’re looking at alternative sellers. As others have said, ES/QS is clearly labeled, vendor locked CPUs seem to be pretty clearly labeled (though I did have to message one seller to confirm due to translation issues), worst case you’ve got the money-back guarantee to cover you if you get something DOA or locked that wasn’t listed as locked.



  • One challenge with the 4090 specifically is I don’t believe there are any dual-slot variants out there, even my 4080 is advertised as a triple-slot card (and actually takes four because Zotac did something really, really annoying with the fan mounting)…you could liquid-cool and swap the brackets, but then you have the unenviable task of mounting sufficient radiators and support equipment (pump, res, etc) into a rackmount server. That assumes you’re looking at something 2-3U, since you mentioned an R730; if you’re willing to do a whitebox 4U build it’s a lot more doable.

    Of course if money is no object, ditch plans for the GeForce cards and get the sort of hardware that’s made to live in 2U/3U boxes, i.e. current-gen Tesla (or Quadro, if you want display outputs for whatever reason). If money is an object, get last-gen Teslas. Tossed an old Tesla P100 (Pascal/10-series) into my Proxmox server to replace a 2060S with half the VRAM, for LLMs I didn’t really notice an obvious performance decrease (i.e. still inferences faster than I can read), and in a rack server you won’t even have to mess with custom shrouds for cooling, since the fans in the server are going to provide more than enough directed airflow.