400G Ethernet leaf switch
1U Ethernet leaf switch with 32 ports at 400 GbE QSFP112, 25.6 Tb/s and breakout to 100 and 200 GbE, for frontend, storage and management networks.
- Ports
- 32 x 400 GbE QSFP112, breakout to 64 x 200 GbE or 128 x 100 GbE
- Throughput
- 25.6 Tb/s aggregate switching
- Features
- RoCE v2, VXLAN and EVPN, streaming telemetry
- Form factor
- 1U, air cooled, redundant PSUs
- Software
- Cumulus Linux or SONiC
- Use
- North south leaf for BlueField-3 and ConnectX-7 ports, storage network, server access layer
Overview
Every GPU cluster has a second network beside the GPU fabric: the frontend that carries storage, user access, container images and management, and it usually runs on 400 GbE. This 1U leaf switch provides 32 ports at 400 GbE, which terminates the BlueField-3 and ConnectX-7 ports on HGX and PCIe servers and connects the storage servers at full rate.
The same switch is the access layer for CPU and storage racks, with breakout cables giving 64 ports at 200 GbE or 128 ports at 100 GbE for lower speed servers. RoCE v2 with priority flow control makes it suitable for NVMe over Fabrics and parallel file system traffic, and VXLAN with EVPN supports multi tenant deployments.
We quote it as a pair for redundancy, with uplinks into the 800G Spectrum-X class spine or your existing core, optics and cables matched to the rack elevation, and the operating system of your choice. When ordered with servers, the port map and VLAN plan are delivered with the rack elevation so the network is ready at installation.
Use cases
- Frontend and storage networks
- Server access layer
- Management and out of band aggregation
- Small Ethernet GPU fabrics
Specifications
| Speed | 400 GbE per QSFP112 port, 200 GbE and 100 GbE with breakout |
|---|---|
| Count | 32 x QSFP112 plus management ports |
| Optics | 400G QSFP112 transceivers, direct attach and active optical cables |
| Switching capacity | 25.6 Tb/s |
|---|---|
| Overlay | VXLAN and EVPN for multi tenant segmentation |
| RoCE | Lossless RoCE v2 with PFC and ECN for storage traffic |
| Form factor | 1U, air cooled, reversible airflow |
|---|---|
| Power supplies | Redundant hot swap PSUs |
| Operating system | Cumulus Linux or SONiC |
Figures describe the system class. Exact configuration, weights and power draw are confirmed on the quotation.
What's included
- Rails, power cords and airflow kit matched to your rack
- Operating system license and subscription as quoted
- Port map and cabling plan when ordered with servers
- Burn in and port test report
- Manufacturer support contract, 3 to 5 years
Compliance
This product is not a data center GPU system and does not require NVIDIA end user registration. Standard export documentation applies. Read about export compliance.
Related
Related systems
800G Spectrum-X Ethernet switch
- Ports
- 64 x 800 GbE OSFP
- Throughput
- 51.2 Tb/s aggregate switching
- AI features
- Spectrum-X RoCE with adaptive routing
- Form factor
- 2U, air cooled
ConnectX-7 400 Gb/s adapter
- Speed
- 400 Gb/s single port, or 2 x 200 Gb/s
- Host interface
- PCIe Gen5 x16
- Offloads
- RDMA and RoCE, GPUDirect RDMA
- Form factor
- PCIe HHHL card with OSFP or QSFP112 port
BlueField-3 DPU, 400 Gb/s
- Speed
- 400 Gb/s, 1 x 400 Gb/s or 2 x 200 Gb/s
- Compute
- Arm cores with onboard DDR memory running the DOCA software stack
- Offloads
- Software defined networking
- Host interface
- PCIe Gen5 x16
Compare it with the next class up or down
The nearest classes we quote are the 800G Spectrum-X Ethernet switch and the ConnectX-7 400 Gb/s adapter. If neither is quite right, tell us the workload and we specify the system between them.
- (858) 613-1818
- sales@computermodules.com
- Monday to Friday, 8am to 5pm Pacific