Apple Frames Vision Pro as 'Creative Medium'
Apple's design team has detailed the philosophy behind its visionOS Environments, describing them not as backgrounds but as a "creative medium" to support focus. The development process blended architectural site visits with photographic fieldwork. A recent industry report card notes the platform's growing role for creative professionals depends on API maturity and interoperability with tools like Figma and code assistants.
- To create the new "Amalthea" environment in visionOS 26, which depicts a view from Jupiter's moon, Apple's design team collaborated with NASA's Jet Propulsion Laboratory (JPL) to accurately theorize the moon's icy surface, which is composed of rocks held together by Jupiter's gravity. The design process for these virtual spaces was conducted by designers wearing the Vision Pro itself to ensure the scale and composition, including the placement of individual rocks, felt correct. - The design philosophy for visionOS Environments, as articulated by Human Interface Designer Matt Dessero, is to create "calibrated emotional instruments" rather than just backgrounds. The team, including Yuri Imoto from visionOS Product Marketing, starts with nature as a base and questions what mood an environment will create, such as calmness, focus, or wonder. - Spatial computing, the underlying technology of visionOS, is viewed as a new paradigm that merges physical and virtual objects, enabling new forms of human-computer interaction beyond screens. This allows for the creation of immersive experiences where users can interact with digital content in a three-dimensional space. - The concept of human-AI collaboration is shifting towards a co-creation model, where AI acts as a creative partner that augments human intuition, rather than just a tool for automation. This approach emphasizes that while AI can handle repetitive tasks and generate initial concepts, human oversight is crucial for strategic direction, emotional resonance, and ethical judgment. - For developers and designers, the emergence of AI-native IDEs and code assistants like Cursor, Windsurf, and TRAE is changing creative workflows. These tools go beyond simple code completion, offering features like autonomous code generation, debugging, and seamless integration with design tools like Figma. - In creative fields, effective human-AI collaboration involves breaking down tasks into sub-activities with varying degrees of human and AI participation. For instance, AI can be used for initial idea generation and creating variations, while humans focus on evaluation, selection, and refining the final output to align with strategic goals. - The development of visionOS leverages existing Apple frameworks like SwiftUI, UIKit, RealityKit, and ARKit, allowing developers to build spatial experiences with a degree of familiarity. Reality Composer Pro is a key tool for preparing and optimizing 3D content for visionOS apps. - A core principle of visionOS design is user comfort and ergonomics; content is placed within a 30- to 60-degree visual arc to avoid excessive head and eye movement. The system is designed to bring content to the user, rather than making the user move to the content, supporting interaction while sitting, standing, or even lying down.