Oculus Unveils Tool Kit That Makes It Easier To Create Mixed Reality App

Oculus has unveiled a tool kit, Passthrough API Experimental, that will make it relatively easy to "seamlessly" merge VR with the real-world view from the Quest 2's cameras.

Gamers can project images on flat surfaces, create composite layers that float in space, and even apply visual styles (akin to social media filters) to real scenes. Users could enjoy a virtual monitor to use with their real-world keyboard, for instance, or turn their home into a psychedelic dreamscape by flicking a virtual switch.

Oculus claimed that privacy shouldn’t be an issue since the API only processes raw camera footage on-device, and apps can't access, store, or view imagery of the world around you. To put it another way, a rogue app shouldn't transmit video of your home.

Oculus expects to deliver the framework to Unity engine developers with its next software development kit release. It will take a while for finished apps to surface, but don't be surprised if mixed reality games and productivity tools become relatively commonplace as a result of Oculus' new tools.