At long last, Meta has unveiled the long-anticipated Passthrough Camera API for the Quest, a move that is poised to revolutionize mixed reality experiences on the device by providing developers direct access to its RGB cameras. With this new capability, developers gain the tools needed to create more immersive scenes, ushering in a fresh wave of mixed reality innovations on Quest.
Before this release, the passthrough cameras on Quest were largely restricted, allowing developers to only utilize the features integrated by Meta. The company had hinted at the eventual release of this API during the Connect event in September, but the exact timing remained up in the air.
Presently, with the rollout of Meta XR Core SDK v74, the Passthrough Camera API debuts as a Public Experimental API, unlocking capabilities of the front-facing RGB cameras on both Quest 3 and Quest 3S.
The potential for deeper scene understanding is significant. By leveraging the passthrough cameras, developers can enhance lighting and effects in their mixed reality applications. Moreover, these advancements allow for the integration of machine learning and computer vision directly with the camera feed, facilitating more precise object recognition and reducing the uncertainty of environmental content.
Reflecting on last year’s announcement of this feature, former Meta VP of VR/AR, Mark Rabkin, highlighted that the API would open doors to groundbreaking MR experiences. These include functionalities like object tracking, AI-driven applications, sophisticated overlays, and refined scene comprehension.
This launch represents the first time that the API is available to the broader public. While Meta had previously shared early builds with select partners, such as Niantic Labs, Creature, and Resolution Games, this release brings wider accessibility. Notably, these early partners are sharing their expertise at GDC 2025 through a Meta presentation titled ‘Merge Realities, Multiply Wonder: Expert Guidance on Mixed Reality Development.’
Even though it remains an experimental feature, meaning developers can’t publish apps that utilize the Passthrough Camera API just yet, it’s clear that Meta is meticulously advancing toward a complete rollout, as evidenced by their iterative development strategy.
The update also brings additional enhancements like Microgestures, allowing intuitive thumb-based actions like taps and swipes. Moreover, an Immersive Debugger is included, enabling developers to scrutinize Scene Hierarchy directly within the headset, along with new components such as friends matchmaking and local matchmaking, further enriching the development toolkit.
