The front display of Apple’s mixed-reality headset will accurately depict the wearer’s eyes in perspective to passersby, according to one of the “a-ha” moments at the Apple Vision Pro presentation. A software hacker aims to create a similar effect by attaching an iPhone to the front of a Meta Quest Pro.
The smartphone functions as a front screen in the “Adam Quision Pro” idea, displaying the motions of the ocular region behind it. These are caught by the Meta Quest Pro’s eye and facial tracking, which wirelessly transfers motion data to the iPhone over WLAN. The iPhone then produces the right 3D perspective of the user, appropriate to a spectator’s line of sight.
Quest Pro gets eyes of Apple Vision Pro
Reddit user “West_Palpitation7066” aka Adam is presently developing the requisite iPhone and Quest Pro applications. He intends to make the application available for testing soon, as well as the source code. However, some fine-tuning is required first, according to the developer on Reddit. He has already provided early moving impressions on YouTube, which make even more possible than the purposely basic implementation on the Apple Vision Pro.
The implementation for Quest Pro and the iPhone is far more entertaining than the Apple headset, which just shows the slightly darker, animated region around the eyes on the front.
Sometimes the turquoise Quest Pro avatar’s eyes show, sometimes cartoon eyes in the Simpsons manner, and occasionally what looks to be a direct glimpse into the brain with eyeballs floating in front of it. Small dogs may also be seen roaming the virtual space between the VR headgear and the iPhone display.
Although the phone obscures part of the Quest Pro’s cameras, tracking is still remarkably excellent, according to West_Palpitation7066. He also attached a 3D-printed folding mechanism to the VR headgear to use the Quest Pro’s passthrough mode between tests.
