Intel's Optical Chiplet Breakthrough: 4 Tbps Data Link for AI

Intel's Optical Chiplet Breakthrough: 4 Tbps Data Link for AI

2024-06-27 semicon

Santa Clara, Thursday, 27 June 2024.
Intel unveils a groundbreaking optical I/O chiplet, capable of 4 Tbps data transmission. This innovation promises to revolutionize AI infrastructure by boosting bandwidth, reducing power consumption, and increasing reach in data centers.

A Leap in Semiconductor and Photonics Technology

Intel’s recent demonstration of the Optical Compute Interconnect (OCI) chiplet marks a significant advancement in the semiconductor and photonics industry. By leveraging integrated photonics, Intel’s OCI chiplet can support 64 channels of 32 Gbps data transmission in each direction, achieving an impressive total of 4 terabits per second (Tbps) data links. This breakthrough is poised to meet the exponentially growing demands of AI and high-performance computing (HPC) applications, providing a robust solution for high-bandwidth, power-efficient, and low-latency data communication.

How It Works: Silicon Photonics Integration

The OCI chiplet utilizes silicon photonics technology, integrating both photonic and electrical components into a single package. The Photonic Integrated Circuit (PIC) handles the optical data transmission, while the Electrical Integrated Circuit (EIC) interfaces with the host processors via PCI-Express 5.0. This co-packaged solution enables data transmission over fiber links up to 100 meters, significantly enhancing the reach and efficiency of data centers. The OCI chiplet consumes only 5 picojoules (pJ) of energy per bit, making it more power-efficient than traditional pluggable optical transceiver modules which consume around 15 pJ/bit[1][4][6].

Benefits and Impact on AI Infrastructure

The OCI chiplet addresses several critical challenges in AI infrastructure, including the need for higher bandwidth, lower power consumption, and longer reach. By integrating optical I/O directly into CPUs and GPUs, the chiplet enables faster data transfer between components, reducing latency and improving overall system performance. This advancement is particularly beneficial for machine learning (ML) workloads, which require massive amounts of data to be processed quickly and efficiently[2][3].

Intel’s Innovation and Future Plans

Intel’s Integrated Photonics Solutions (IPS) Group, based in the United States, is the driving force behind this groundbreaking technology. The company has a long-term roadmap to further enhance the performance and integration of optical interconnects. Future developments include the creation of next-generation photonic integrated circuits (PICs) to support emerging 800 Gbps and 1.6 Tbps applications, as well as the implementation of a new silicon photonics fabrication process for improved device performance and economics[5][7].

Collaborations and Industry Impact

Intel is actively working with select customers to co-package the OCI chiplet with their system-on-chips (SoCs), aiming to provide a seamless optical I/O solution tailored to specific needs. This collaboration is expected to accelerate the adoption of optical interconnects in data centers and HPC environments, driving innovation and shaping the future of AI infrastructure. The OCI chiplet’s ability to deliver high-speed, low-latency, and energy-efficient communications fabric marks a milestone in the evolution of data communication technologies[8][9].

Bronnen


www.intel.com Intel www.heise.de www.theregister.com insidehpc.com Optical I/O www.hardwareluxx.de