Apple’s AR iPhone Tools Lets You See Your Room Without Furniture


Protect Your Access to the Internet

Redecorating a room is a big commitment, but one of the more intriguing uses for augmented reality is letting users preview new furniture pieces in a space. Thanks to a new feature Apple introduced to developers last month, you won’t have to move a single item before dropping a new virtual couch or coffee table into your real world space.

The feature is a new Swift API called RoomPlan that leverages Apple’s ARKit as well an iPhone or an iPad with a camera and LiDAR (short for Light Detection and Ranging). The scanner can easily generate detailed and accurate 3D floor plans, including features like windows, doors, and even various types of furniture that are automatically recognized and accurately measured. Then, it can edit the furniture out of your shot while keeping the room intact. When it was revealed At WWDC 2022 last month, Apple introduced the new API with a video that demonstrates what the RoomPlan API can do and how it can potentially be used in mobile apps.

Apple RoomPlan API — WWDC 2022

Using augmented reality to try out a new piece of furniture in a room before you buy it isn’t an entirely new idea. Ikea’s been doing it for years through its mobile apps, and last month the Swedish furniture maker revealed a new design tool that can generate a static image of a room with all of the existing furniture digitally erased, allowing virtual furniture to be added and moved around. It was an interesting upgrade, but one that lacked the interactivity of being able to move around the emptied virtual space and see the added furniture from different angles.

Using the new RoomPlan API and a few other AR tools, digitally erasing existing furniture in an interactive 3D room is apparently something that’s quite feasible, as Russ Maschmeyer, who currently develops AR and VR experiences for Shopify, recently demonstrated on Twitter.

The video shows off a new augmented reality tool that Maschmeyer describes as a reset button for a room. After a LiDAR equipped Apple device is used to scan and capture imagery of the space, everything from furniture, to rugs on the floor, to even vents and AC units on the walls, can be instantly erased, leaving behind…