Apple’s spatial computing device, explained

On Monday, Apple unveiled the Vision Pro—its long awaited augmented reality headset. Rather than selling it as a virtual reality headset or even as AR goggles, the company is calling the new device its “first spatial computer.” Apple CEO Tim Cook even tweeted: “Welcome to the era of spatial computing.” So let’s dig in and look at what on earth (or in the metaverse) spatial computing is. 

First, a few specs so you can understand what the Vision Pro is capable of doing. The new high-tech device resembles a pair of ski goggles and is packed with 12 cameras, five sensors, and two 4K displays. While it is capable of immersive VR experiences like gaming, it is mostly designed to be used for augmented or mixed reality. To achieve this, the cameras on the outside of the device will capture footage that’s displayed in real-time on the screens inside it. That’s how digital elements, like email apps, FaceTime video calls, and everything else can appear as if they’re floating in the physical environment surrounding you. Apps can be controlled with your gaze, hand gestures, and your voice—or with a keyboard and mouse. All this tech doesn’t come cheap: The Vision Pro will go on sale next year for $3,499. Now, on to what this all means for the future of computers. 

Although “spatial computing” has had a few different definitions, it is essentially an extension of virtual and augmented reality. A spatial computer is a device that enables the physical and digital to co-exist and, in some cases, interact. So, instead of only being able to use apps on your smartphone or laptop, spatial computers—like the Vision Pro—allow you to check your email anywhere you want in the world around you. Your email app can appear to be projected on a wall, floating off to your left, or attached to your wrist. Similarly, instead of having to rely on a keyboard or mouse, you can typically interact with a spatial computer using voice commands, your gaze, and physical movements, as if the objects you can see are real.

In announcing the Vision Pro, Apple’s marketing materials show how the company thinks spatial computing could fit into modern life. The examples the…