4 GPU PCIe AI server, 2U
- GPUs
- 4 x RTX PRO 6000 Blackwell Server Edition
- CPU
- 2 x AMD EPYC 9005 or 2 x Intel Xeon 6
- Memory
- Up to 1.5 TB DDR5 RDIMM
- Chassis
- 2U, about 3.5 kW, air cooled
The Ada Lovelace universal data center GPU with 48 GB GDDR6 ECC, 1,466 TFLOPS sparse FP8 and 350 W, for inference, rendering and video in PCIe servers.
L40S is NVIDIA's universal data center GPU of the Ada Lovelace generation. It has 48 GB of GDDR6 with ECC at 864 GB/s, 18,176 CUDA cores, 568 fourth generation Tensor cores rated at 1,466 TFLOPS of sparse FP8, 142 third generation RT cores, and three NVENC and three NVDEC engines with AV1 support. It draws 350 W, sits in a dual slot passive form factor, and supports vGPU but not MIG or NVLink.
It remains a sensible choice for inference of small and mid sized models, for virtual desktops and cloud gaming, for rendering and for video transcoding, and it is widely available in validated PCIe servers. Where FP4 throughput or 96 GB of memory per card matters, RTX PRO 6000 Blackwell Server Edition is the successor. We supply L40S across the 1U, 2U, 4U and 5U inference server classes, from the single GPU edge server to the 10 GPU 5U server.
We quote every class that carries it, from a single node to a pod. Tell us the workload and we propose the chassis.