Facebook wants to put your eyes on VR headsets and it’s truly frightening

Facebook wants to put an image of your eyes on the outside of VR headsets, if its latest research is anything to go by. A prototype has been unveiled from Facebook Reality Labs that would allow users to ‘connect’ to people in the outside world with their real-time gaze.

If it sounds a bit weird, it is – but it marks a smart reversal of the ‘passthrough’ technology used in the Oculus Quest 2’s cameras, which records the wearer’s surroundings and displays them on the headset’s screen, effectively allowing you to look through the headset and see what’s around you.

This new application of passthrough tech would instead utilise an internal camera that projects “a three-dimensional view of the wearer’s eyes […] in a perspective correct manner” onto a screen located on the outside of the headset, allowing someone to make eye contact with others in their vicinity.

Called ‘reverse pass-through VR’, the prototype tech is ostensibly designed to aid “more seamless interactions between people with and without headsets in social or professional contexts” – especially “natural eye contact”.

So whether you’re screaming at the VR arcade or wandering around a virtual building at a real estate agency, this kind of technology could help reduce the sense of awkwardness and isolation that still comes from being siloed in a VR headset – allowing nearby users to view each other in real life, albeit through several layers of screen.

The announcement comes just a week after Oculus announced its passthrough tech could be used for augmented reality (AR) applications, projecting virtual images onto video feeds of the space around you.

While the technology displayed by Facebook Reality Labs is at the prototype stage, there’s certainly a case to be made for its commercial use.

The isolating nature of VR can be off-putting for some, and the big challenge for VR headset manufacturers like the Facebook-owned Oculus will be in widening the audience of VR beyond die-hard technology geeks and gamers such as ourselves. 

Helping the technology to feel social, and more grounded in our actual surroundings, can only help make VR more accessible to the everyday user.

However, if we’re talking about a whole second screen on the outside of a headset – as well as internal cameras – there will be costs involved. 

The great strength of the Quest 2 is that it’s a relatively affordable standalone headset, and seeing that price jump up for secondary screen many won’t use doesn’t seem like a smart move either.

We could see a dedicated ‘social’ iteration of the headset, possibly one with generally lower specifications compared to flagship Oculus models – for younger, older, or more casual users. 

However, it’s also just as likely for this reverse pass-through tech to never make it to market at all. The study states that “Improved facial reconstruction […] remains a challenge”, which suggests that launching this technology early could result in some quite unnatural eye contact, which we imagine nobody wants.

Given the prototype stage that this technology appears to be at, we don’t expect it to appear in the Oculus Quest 3, at least, and we can see its application being far more useful when VR headsets finally slim down to something more approaching ‘normal’ spectacles.

Via RoadtoVR