Datacenter power and optics shift
- AI racks are hitting power densities above 100 kW, creating a new datacenter 'power wall' for deployments. (x.com/JAXXIAO1/status/2046821856670630294) - Co‑packaged optics can cut interconnect energy by roughly 80%, while GaN and SiC hardware improve power delivery efficiency. (x.com/JAXXIAO1/status/2046821856670630294) - These shifts force changes in cooling, rack design, and supplier choices across power, optics and thermal stacks. (x.com/JAXXIAO1/status/2046821856670630294)
AI server racks are crossing 100 kilowatts per rack, creating a new datacenter "power wall" that many facilities cannot support with existing power and cooling infrastructure. (ramboll.com) Rack power density has jumped from historical norms of roughly 10–15 kW to air‑cooled peaks near 30 kW and now to liquid‑cooled deployments topping 100 kW. (dcpulse.com) One hardware response is co‑packaged optics (CPO): IBM’s December 2024 prototype used polymer optical waveguides and claims more than an 80% cut in interconnect energy and up to 5× faster model training in lab tests. (research.ibm.com) On the power side, vendors and white papers say wide‑bandgap semiconductors — gallium nitride (GaN) and silicon carbide (SiC) — plus redesigned PSU architectures can push conversion efficiencies higher and shrink PSU volume for AI racks. (infineon.com) Those component shifts force practical changes: data centers are evaluating direct liquid cooling, 48‑volt distribution architectures, and new rack PDUs to move hundreds of amps safely and limit losses. (vertiv.com) Manufacturers from Infineon to IBM and power‑supply specialists are rolling prototype GaN/SiC PSUs and CPO modules in 2024–2026, and hyperscalers are reported to be running pilot systems. (infineon.com) Not everyone agrees the transition is ready: proponents point to the >80% interconnect energy savings in demonstrations, while thermal‑management research and packaging complexity remain cited hurdles for volume deployment. (semiengineering.com) Expect the next six to 18 months to decide whether CPO plus GaN/SiC power stacks become standard for 100 kW+ racks or remain niche — vendors and operators will pick winners through pilot rollouts and supply‑chain choices. (dcpulse.com)
