|
Building WOPR: A 7x4090 AI Server
Bill of Materials
Component |
Description |
Source |
Qty |
Motherboard |
ASROCK ROMED8-T2 |
Newegg |
1 |
CPU |
AMD Epyc 7763 Engineering Sample |
eBay |
1 |
RAM |
256GB 4x64GB DDR4-3200 RDIMM ECC Registered Memory |
Newegg |
2 |
CPU Cooler |
Noctua NH-U14S TR4-SP3 |
Amazon |
1 |
SSD - Boot |
SAMSUNG 870 EVO Series 2.5" 1TB SATA III |
Newegg |
1 |
SSD - Models |
SABRENT Rocket 4 PLUS SSD with Heatsink 2TB |
Newegg |
1 |
Risers |
LINKUP - AVA5 PCIE 5.0 Riser Cable (see below for lengths) |
Amazon |
6 |
Retimer Host Adapter |
PCIe gen5 MCIO Host Adapter x16 to 2* 8i - retimer |
C-Payne |
1 |
Retimer Device Adapter |
MCIO PCIe gen5 Device Adapter 2* 8i to x16 |
C-Payne |
1 |
Retimer Cables |
MCIO PCIe gen5 Device Adapter 2* 8i to x16 - 75mm |
C-Payne |
2 |
Power Supplies |
Corsair RM1000x Shift (see below for better alternative) |
Amazon |
4 |
Frame |
Mining Case 8 GPU Stackable |
Amazon |
2 |
GPUs |
Nvidia RTX 4090 |
??????? |
7 |
Notes
- Riser Lengths: You will want the following (I'm double-checking though so maybe wait until I clear this): 60mm, 50mm, 50mm, 30mm, 30mm, 30mm
- Power Supply: Please read the Power and Cooling page for more information on the server power supply package sold by Parallel Miners
- SSDs: Obviously there's nothing special about what I selected. My rationale was to use a reliable SATA SSD for boot, and the fastest M.2 drive I could run to load models from. One thing to consider is the idea of losing a GPU and running a quad-or-more M.2 to PCI card in the open slot for use with ZeRO infinite offload.
- RAM: I went with 512GB but if you want you can go with 256GB. As described on the Motherboard / CPU / RAM page, make sure that you fill all 8 slots to get the full rated memory bandwidth. For 256GB RAM you'll want eight 32GB DIMMS (two 4x32GB kits).
- CPU Cooler: I love Noctua, have used their products practically since they first came out. That cooler is large, but it works. You could try something smaller to get more clearance on the riser cables but you might be unhappy with the CPU temps.
|
|