eight or even 16 A100 GPUs that can be interconnected with Nvidia’s NVLink and NVSwitch interconnect technology, which provides nearly 10 times the bandwidth of PCIe 4.0, according to Kharya.
Dell EMC says it’s increased the speed of storage with NVMe and reduced data latency with PCIe to accelerate ... to have the new Nvidia NVLink baseboard with Nvidia’s A100 chips in it.