PCIe Gen 6 is... Abnormal | The Future is PCIe (Part 3), ft. Wendell of Level1 Techs

Summary

Key Points

• —PCIe Gen 6 has arrived and is first seen linking GPUs to networking, marking a major shift in data‑center architecture. 1:33
• —The convergence of PCIe and networking enables GPUs to access remote memory and storage with latency comparable to local PCIe connections. 4:18
• —Modern servers are merging PCIe lanes with Ethernet, using technologies like RDMA to make networking behave like PCIe. 5:08
• —On‑chip photonics, which integrates optical transceivers directly into silicon, is expected to replace traditional optics and lower cost and power. 11:13
• —Software support, especially for RDMA in Linux, is crucial for realizing the performance benefits of the PCIe‑network convergence. 26:44
• —Recycling and refurbishing data‑center hardware could provide affordable high‑performance GPUs and networking for researchers and enthusiasts. 26:55
• —Optical PCIe adapters (e.g., low‑cost 100 Gbps optics) demonstrate that cheap, high‑speed links are becoming feasible for hobbyist and home‑lab setups. 30:18
• —Enterprise‑grade components such as Bluefield DPUs, HBM‑2E, and high‑bandwidth adapters can be repurposed for consumer use through re‑engineering and second‑hand markets. 36:20
• —High‑speed networking cards (e.g., 800 Gbps to 1.6 Tbps) are now built on PCIe Gen 5/6 platforms, but their cost remains high for consumers. 36:39
• —The industry is moving toward open standards like PCIe Gen 7 and CXL, reducing reliance on proprietary interfaces and paving the way for broader adoption. 36:52