Vision Pro to Get 'Foveated Streaming'
Apple's Vision Pro headset is set to receive an advanced “foveated streaming” feature, a technology that renders only the area where a user is looking in full resolution to save processing power. The update is expected to enable more immersive and high-performance experiences for streamed content and games without overburdening the hardware.
- Foveated rendering mimics the human eye by using eye-tracking to render only the center of a user's gaze in high resolution, which can reduce the GPU processing requirement by 30-60%. - The feature arrived in the visionOS 26.4 beta and utilizes NVIDIA's CloudXR technology to enable apps to stream high-resolution, low-latency content from a remote computer or server. - Apple's framework allows for a hybrid rendering approach; for example, a flight simulator app could render the cockpit locally using RealityKit while streaming the processor-intensive landscape from a remote computer. - Valve announced a similar "foveated streaming" feature in November 2025 for its Steam Frame headset, a technique designed to reduce wireless bandwidth requirements for PC VR games. - While foveated *rendering* reduces the workload on a local GPU, foveated *streaming* specifically cuts down on the amount of data transmitted over a network, which is critical for wireless experiences. - Other commercially available headsets that support dynamic foveated rendering include the Meta Quest Pro, HTC Vive Pro Eye, and PlayStation VR2. - The new Foveated Streaming framework provides developers with a first-party API to access gaze-directed foveation data, a capability that Apple had previously blocked.
