Co-Packaged Optics Become AI Bottleneck
The growth of AI and robotics is causing a surge in demand for co-packaged optics (CPO), leading to what some are calling massive shortages. The components, which are insanely complex to manufacture, are now seen as the next major AI bottleneck. Investors are taking note, with some highlighting companies like Marvell as leaders in the technology.
- Co-packaged optics can reduce power consumption by 30-50% compared to traditional pluggable optical modules by shortening the electrical signal path from centimeters to millimeters. This integration of the optical engine with the switch chip eliminates the need for power-intensive components like Digital Signal Processors (DSPs) that are necessary in pluggable optics to compensate for signal loss over longer distances. - The global market for co-packaged optics is projected to grow significantly, with one forecast predicting an increase from USD 161.67 million in 2024 to USD 1449.72 million by 2033. Another market analysis projects growth to over $20 billion by 2036, indicating strong investor confidence in the technology's future. - Major technology firms like Broadcom, Intel, NVIDIA, and Cisco are key players in the development of co-packaged optics. Foundries such as TSMC are also crucial, as they are developing the advanced semiconductor packaging technologies necessary for mass production, which is anticipated to begin in the latter half of 2025. - The complexity of manufacturing co-packaged optics stems from several factors, including the precise, sub-micron alignment of optical fibers to the photonic integrated circuits. Thermal management is also a significant challenge, as the heat from the high-powered processing chips can interfere with the performance and reliability of the sensitive optical components. - The move towards co-packaged optics is driven by the limitations of current technology in meeting the demands of AI and high-performance computing. Pluggable transceivers are facing constraints in bandwidth scalability and power consumption at higher speeds like 800G and 1.6T, making them less suitable for future data center needs. - Industry experts predict that mass adoption of co-packaged optics in data centers will likely occur between 2026 and 2028. It is expected that by 2027, co-packaged optics ports could represent nearly 30% of all 800G and 1.6T port shipments. - Co-packaged optics technology enables a significant increase in bandwidth density. By integrating optical and electronic components in a single package, it's possible to achieve bandwidths of over 1 Tbps per millimeter of chip edge, a substantial improvement over existing solutions. - While co-packaged optics offer numerous advantages, they also present new challenges for maintenance and reliability. Unlike pluggable modules that can be easily replaced in the field, a failure in a co-packaged optics component could necessitate the replacement of the entire switch, a much more complex and costly procedure.
