The Spatial Scene mode in iOS 26 creates 3D Photos using advanced generative AI technology that analyzes a standard 2D photo and constructs a dynamic three-dimensional representation. This feature is a significant evolution in photo visualization that goes beyond traditional depth-of-field effects by intelligently separating subjects from background elements and synthesizing depth information that was never originally captured by the camera.
At a technical level, the Spatial Scenes feature leverages generative AI algorithms to generate depth maps from flat RGB images. It enhances depth perception by combining sparse lidar data (where available, such as on newer iPhone models) and RGB input to better understand spatial relationships within the photo. The AI models used perform multimodal scene understanding, simultaneously handling depth completion (filling in the depth information gaps), semantic segmentation (differentiating objects within the photo), and 3D object detection. This allows the software to create believable 3D layers and even generate new viewpoints around the subject, effectively "imagining" perspectives the original camera did not capture. This process happens rapidly, often in near real time, even on devices as old as the iPhone 12.
Users can activate the Spatial Scene effect in the Photos app by selecting a compatible photo and tapping a hexagon icon that appears on the image thumbnail. Photos that work best have a clear subject distinctly separated from the background, such as portraits, pet pictures, or images with obvious foreground and background layers like landscapes. The effect creates a parallax shift based on the user's device movements, simulating how human eyes perceive depth through subtle right-to-left or tilting motions of the phone. This interactive 3D parallax brings photos to life with immersive spatial depth that can be viewed directly on the iPhone's 2D display. The feature does not alter the original photo permanently but activates the 3D effect dynamically when enabled, allowing users to toggle the effect on or off at will.
Further enhancing the experience, the Spatial Scenes mode integrates into the iPhone's Lock Screen, where photos can become spatial wallpapers. These wallpapers respond to phone movements with layered 3D illusions, adding a sense of depth and presence to images viewed at a glance. The lock screen selects photos compatible with the depth effect automatically and provides toggles to enable or disable the spatial effect on chosen wallpapers. This creates a cohesive experience where users see the same spatial depth applied both in their photo galleries and personalized lock screens.
Overall, the underlying technology represents a leap forward in spatial computing on mobile devices, merging AI-powered scene understanding with hardware capabilities such as lidar sensing. It also aligns closely with Apple's broader vision for spatial computing, dovetailing with technologies in visionOS for Apple Vision Pro, which likewise employs spatial scenes for an immersive 3D experience. By making it possible to convert everyday photos into engaging spatial scenes, iOS 26 encourages user interaction with 3D content, helping people become comfortable with dimensional interactions on their personal devices.
The key components contributing to iOS 26's Spatial Scene mode include:
- AI-powered depth map generation from 2D photos
- Combining RGB data with sparse lidar points (on compatible devices)
- Multimodal scene understanding models that include depth completion, semantic segmentation, and 3D object detection
- Dynamic view synthesis generating new perspectives not originally captured
- Parallax effects that respond to device movement with foreground stability and background shifts
- Easy user interface with a simple toggle icon and compatibility with a broad range of photos
- Lock screen integration for spatial wallpapers with depth illusion effects