Hardware Specifications
CPU
| Specification | Value |
| Model | AMD EPYC™ 7742 |
| Cores | 64 cores / 128 threads |
| Base Clock | 2.25 GHz |
| Boost Clock | 3.35 GHz |
| TDP | 225W |
| Cache | 256MB L3 |
| Memory Support | DDR4-3200 (2-socket) |
| Price | €1,200 |
Performance characteristics:
- Single-thread performance supports inference workloads
- 64 cores provide headroom for OS overhead and background processes
- 2-socket configuration enables future expansion
GPU
| Specification | Value |
| Model | AMD Instinct MI250X |
| Architecture | CDNA 2 (Compute DNA 2) |
| VRAM | 128GB HBM2e |
| Memory Bandwidth | 3.28 TB/s |
| FP16 Performance | 95.74 TFLOPS |
| FP32 Performance | 47.87 TFLOPS |
| Tensor Performance | 95.74 TFLOPS (FP16) |
| TDP | 560W |
| Interconnect | Infinity Fabric 2.0 (600 GB/s per link) |
| ROCm Version | 6.x |
| Price | €3,500 |
Memory characteristics:
- 128GB HBM2e accommodates GLM-4.7's 200K context window
- Q4_K_M quantization requires approximately 91GB VRAM
- Memory bandwidth supports sustained inference throughput
Multi-GPU characteristics:
- Infinity Fabric enables scaling up to eight GPUs per domain
- Multi-GPU scaling efficiency: 0.85x
Sources:
- AMD MI250X Specifications
- AMD ROCm MoE Documentation
- Hugging Face ROCm Optimization Guide
RAM
| Specification | Value |
| Capacity | 256GB (8× 32GB modules) |
| Type | DDR4-3200 ECC Registered |
| Speed | 3200 MT/s |
| Channels | 4-channel |
| Latency | CL22 |
| Error Correction | ECC (single-bit error correction) |
| Form Factor | DDR4 UDIMM |
| Price | €500 |
Memory characteristics:
- Four-channel configuration maximizes bandwidth for CPU-GPU communication
- ECC improves stability for production workloads
- 256GB provides headroom for model inference and system operations
Motherboard
| Specification | Value |
| Form Factor | EEB (Extended ATX) |
| Chipset | AMD EPYC™ Platform |
| Socket | SP3 |
| PCIe Slots | 8× PCIe 4.0 x16 slots (x16 electrical) |
| PCIe Lanes | 128 lanes (x16, x8, x4 configurations) |
| Memory Slots | 8× DDR4 DIMM slots |
| Storage Interfaces | 4× M.2 NVMe, 6× SATA 6Gb/s |
| Networking | Dual 10GbE LAN (optional 25GbE) |
| BIOS | UEFI with secure boot support |
| Price | €800 |
PCIe characteristics:
- PCIe 4.0 maximizes GPU bandwidth (up to 64 GB/s per x16 slot)
- Eight slots accommodate multiple GPU configurations
- Flexible lane allocation supports various expansion scenarios
Storage
| Specification | Value |
| Boot Drive | 2× 2TB NVMe SSD (RAID 1) |
| Data Storage | 4× 4TB HDD (RAID 5) |
| Interface | NVMe 3.0 x4, SATA 6Gb/s |
| Cache | 32MB DRAM cache (NVMe) |
| IOPS (NVMe) | ~500,000+ |
| IOPS (HDD) | ~100-200 |
Configuration:
- NVMe RAID 1 provides boot drive redundancy
- HDD RAID 5 provides capacity with fault tolerance (3TB usable)
Storage characteristics:
- NVMe offers low latency for system operations
- RAID configurations reduce risk of data loss
Network
| Specification | Value |
| Primary LAN | 1× 10GbE SFP+ |
| Secondary LAN | 1× 10GbE SFP+ |
| Backup LAN | 1× 1GbE RJ45 |
| Throughput | 20 Gbps total (10 Gbps per link) |
| Latency | <1ms (local network) |
Network characteristics:
- 10GbE interfaces support multiple concurrent inference requests
- Redundant links improve availability
- Local network latency supports cluster communication
Power Supply
| Specification | Value |
| Capacity | 1600W per PSU (2× redundant) |
| Efficiency | 80+ Platinum (94% at 50% load) |
| Form Factor | ATX 3.0 |
| Modular Cables | Fully modular |
| Connectors | 12VHPWR (GPU), EPS 12V (CPU), PCIe (NVMe) |
| Redundancy | 2× PSUs with hot-swap capability |
| Protection | OCP, OVP, UVP, OPP, SCP |
| Price per PSU | €800 |
Power characteristics:
- Total system power consumption: ~1,185W
- 30% headroom accommodates peak loads
- Redundant PSUs eliminate single point of failure
Component power draw:
- GPU: 560W
- CPU: 225W
- Memory: ~30W
- Storage: ~50W
- Motherboard: ~100W
- Networking: ~20W
- Cooling: ~200W
Case
| Specification | Value |
| Form Factor | 4U Rack-Mounted Server Chassis |
| Dimensions | 600mm (H) × 483mm (W) × 660mm (D) |
| GPU Clearance | 3-slot for MI250X |
| Drive Bays | 12× 3.5" drive bays + 8× 2.5" drive bays |
| Fan Speed | 4× 120mm high-static-pressure fans |
| Airflow | Front-to-rear intake/exhaust |
| Price | €300 |
Case characteristics:
- Support for dual-socket motherboards
- Adequate clearance for MI250X (3-slot height)
- Multiple drive bays for storage expansion
- Front-to-rear airflow maintains thermal balance
Cooling System
| Specification | Value |
| GPU Cooling | Dual 240mm AIO liquid cooling loop |
| CPU Cooling | High-performance air cooler |
| Case Fans | 4× 120mm high-static-pressure fans |
| Airflow | Front-to-rear intake/exhaust |
| Liquid Cooling | 240mm radiator, dual 120mm pumps |
Cooling characteristics:
- Liquid cooling for MI250X manages sustained thermal load
- Air cooler for CPU provides cost-effective thermal management
- Case fans maintain balanced airflow throughout the system
Total Configuration Cost
| Component | Cost (€) |
| CPU | €1,200 |
| GPU | €3,500 |
| RAM | €500 |
| Motherboard | €800 |
| Storage | €600 |
| Network | €400 |
| Power Supply (2×) | €1,600 |
| Case | €300 |
| Cooling System | €400 |
| Total | €9,100 |
Sources:
- AMD MI250X Specifications
- AMD EPYC Documentation
- ROCm Documentation
- NVMe Specification
- PCIe Specification