There have been several rumors about VR headsets, AR headsets, and AR glasses throughout the years, but what exactly does Apple have planned for its augmented reality future? Apple’s slew of rumors, leaks, acquisitions, and new personnel hint that it might be a hybrid of all three, with a release date spread out over several years.
According to reports, the corporation is working on numerous headgear prototypes, not just for augmented reality but also for virtual reality.
Apple’s AR/VR development team is said to be made up of around 1,000 Apple personnel who are all devoted to incorporating developing technology into forthcoming products. This is supported by particular AR/VR-inspired Apple hiring in recent years, as well as the company’s acquisition of a few startups that specialize in either AR/VR tech or content geared to those platforms.
In some ways, it makes sense – Apple has always stated that AR is an interesting technology, and it effectively already has the largest AR app offering in the world via ARKit-integrated apps on the App Store, so transferring AR-focused apps to a headset platform that would provide a more immersive, enjoyable experience than holding up a smartphone in front of you wouldn’t be a huge step.
Apple’s ultimate goal is supposed to be a full-fledged pair of augmented reality glasses, which we’ve covered previously, however internet rumors suggest that the actual AR glasses have been postponed indefinitely in favor of a cheaper AR/VR headset.
According to several reports, the answer might be an AR/VR hybrid headgear similar to the Meta Quest 2, which is slated to be released in the near future. Here’s everything you need to know about Apple’s entrance into AR/VR headsets, including the latest rumors and a likely release date.
What will the AR/VR headset be called?
While most rumors regarding Apple’s impending hybrid headset have focused on its function – an AR/VR headset – a new wave of trademark filings implies Apple may have finally settled on a moniker.
A swath of trademark applications with the topic ‘Reality’ have been submitted in a variety of countries, including the US, UK, EU, Canada, Australia, New Zealand, Saudi Arabia, Costa Rica, and Uruguay, as first discovered by Bloomberg writer Mark Gurman. Reality One, Reality Pro, and Reality Processor are all mentioned in applications. Gurman has dubbed the headgear Reality Pro, which implies that this is the most likely name.
Of course, this has yet to be confirmed – Apple isn’t directly linked with the trademark registrations – but it’s not uncommon for the tech behemoth to utilize legal firms and shell organizations to cover some of the necessary pre-launch work.
When will the Apple AR/VR headset be released?
Apple’s headgear was undoubtedly supposed to be available by now, but it has been postponed several times. Bloomberg says that while Apple had initially expected to introduce the headgear at WWDC 2022, “development issues relating to overheating, cameras and software have made it harder to stay on pace”.
The headgear was purportedly in the manufacturing validation phase as of November 2022, with mass production anticipated for March 2023, according to a DigiTimes article. According to the newspaper, an announcement might come a month later in April, with a very limited number of headsets first available.
Gurman has subsequently revealed for Bloomberg that it will debut at WWDC 2023, which will most likely be in June, following Apple’s cancellation of a dedicated headset launch event in April this year.
Analyst Ming-Chi Kuo projected a similar event, with Apple announcing the AR/VR headset either in the spring or at WWDC 2023, but he hasn’t officially confirmed Gurman’s word that the spring event has been canceled. In any case, Kuo believes that major shipments of the headset will not commence until the end of 2Q23 or the beginning of 3Q23, i.e. June or July.
According to reports, Apple has also accelerated the development of realityOS, the software that will operate on the headset. A further finding of a realityOS trademark in early June 2022, which comes under the categories of peripherals, software, and wearable computer gear, supported this.
With that stated, a reveal and subsequent distribution of Apple’s AR/VR headset in early 2023 appears most plausible, but we’ll update if we hear otherwise.
How much will the Apple AR/VR headset cost?
According to Bloomberg, Apple’s first AR/VR product will be a “pricey, niche” alternative, with the company expecting to sell only 180,000 copies (similar to the Mac Pro) when it is introduced.
Bloomberg reports that the headgear will be substantially more costly than existing standalone VR headsets, which presently range from the £399/$399 Meta Quest 2 to the more sophisticated $1,499/£1,499 Meta Quest Pro, but no precise pricing was given.
According to JPMorgan Chase industry expert Yang Weilun, it might be substantially more expensive, costing Apple roughly $500 each unit to create, while a massive article from The Information indicates it could be as high as $3,000. In a second story in January 2023, the journal confirmed the rumored pricing, implying that it may be a high-end headset.
DSCC also predicts that the headset will be a luxury product, anticipating “the Apple headgear will cost several thousand dollars,” in an early 2022 projection, adding that it’ll be targeted mostly at “professionals and developers to extend Apple’s ecosystem in AR/VR”.
The redeeming grace is that Apple may be working on a considerably less expensive headset for delivery in 2024. According to The Information, Apple plans to offer a more inexpensive headset, however ‘affordable’ in Apple’s view means a price comparable to the Meta Quest Pro. This is supposed to be accomplished by employing lower-tier components than the top-tier headset expected out this year, such as a lower-resolution display, less processing power, and maybe the deletion of the H2 low-latency audio chipset.
Bloomberg has also weighed in, claiming that Apple is now preparing to offer two AR/VR headsets, with a cheaper variant arriving in 2024.
What to expect from Apple’s AR/VR headset
Apple’s first dedicated headgear would focus not just on augmented reality but also on virtual reality, according to a Bloomberg report from early 2021 and a subsequent one from January 2023.
Design
The headset is believed to appear similar to the Meta Quest 2, but with a slimmer design (it is, after all, an Apple product) and lightweight fabrics and materials that assist maintain a comfortable fit during extended periods.
“The gadget will include a curved screen on the front that can display a wearer’s eyes outwards, speakers on the sides, and a headband that helps fit the device around a user’s head,” Gurman says. “This will be in contrast to competing devices, which normally strap the gadget to the wearer with numerous bands.”
Ming-Chi Kuo estimates that current prototypes weigh 200-300g, but the business is aiming for 100-200g as long as a few major technical issues are resolved.
One area where it hopes to save weight is in the lens, with Kuo describing a ‘pancake’ lens technology. According to a memo received by Cult of Mac, the future headset would employ “3P pancake” lenses supplied by Genius and Young Optics.
The lenses have numerous sheets of glass packed firmly together to minimize the overall form factor, allowing for a lighter and more compact design. Those who use big lenses on their DSLR or mirrorless cameras will be familiar with the notion.
Despite Apple’s commitment to fanless technology, even if it means sacrificing speed, like with the MacBook Air M1, Kuo believes Apple will incorporate a fan to keep the headset cool.
While Apple has considered utilizing its virtual assistant, Siri, to manage the headgear, the firm is also considering including a real controller. Though Bloomberg was unable to disclose specifics on the remote, MacRumours discovered a snapshot from iOS 14 exhibiting a controller comparable to that used with the Vive Focus, which might give us a fair sense of what to anticipate.
Most of it was supported by a massive story from The Information, which cited people “with intimate knowledge” of the headset and suggested a form factor comparable to the Quest 2, but in a much smaller shell. According to the illustrations in the article, it may have the same thickness as a pair of ski goggles. If true, that’s quite an accomplishment.
It also provides further information about the proposed remote, describing it as a “thimble-like gadget” that would be used in conjunction with hand tracking to interact with virtual and augmented things in real time.
Nevertheless, according to a January 2023 article from The Information, things haven’t gone as planned, with Apple supposedly discarding the controller in favor of hand tracking and voice instructions.
The January 2023 story also gives much more insight on the design; according to The Information’s sources, while Apple originally incorporated the battery within the headset itself, it has subsequently shifted to a waist-worn battery pack. This should make the headset lighter and simpler to wear for longer periods of time, albeit a wire will stretch from the headset to your waist.
According to Gurman, the external battery pack will be “approximately the size of two iPhone 14 Pro Maxes placed on top of each other.” He did mention that Apple tried prototypes with internal batteries, but it appears that the external approach won out over cooling concerns for the headset.
The headgear is reported to be made of aluminum, glass, and carbon fiber to help minimize size and weight, with cameras hidden within the ski goggle-like design for a cleaner look. This will be flanked by an Apple Watch-like digital crown on the side of the headset to allow users to easily move between the virtual and real worlds, and alternative headbands for different use cases are also possible.
What’s most intriguing is the mention of a unique outward-facing display on the front of the headset, meant to reveal the headset wearer’s facial expressions to people in the real world. This is supposed to lessen the sensation of isolation that users may have when using the headset in a room with other people. According to the rumor, the display has an ultra-low refresh rate and minimal power usage, comparable to the iPhone 14 Pro’s always-on display technology.
It’s an intriguing feature that we haven’t seen from any VR headsets up until now, but it should be taken with a grain of salt at this point.
Performance
Per Bloomberg, the headset allegedly features an Apple-designed chip that’s a variant of the M2 chip found in the latest Macs, allowing the company to include a high-resolution display and cameras that allow users to “read small type” and allow the user to “see other people standing in front of and behind virtual objects” according to the reports.
In reality, the M2 will be accompanied by a less powerful specialized ‘Reality’ chipset to handle sensor operations and some image processing.
The Information’s sources believe that the primary chipset will comprise a CPU, GPU, and RAM, while the second is a specialised picture signal processor, according to a January 2023 report. Both are claimed to be manufactured using a 5nm technology, losing out on the rumored enhancements expected with the 3nm A17 chipset coming later this year.
In a follow-up note in early 2022, Kuo stated that the headset will require the same 96W charger as the 14in MacBook Pro which “proves that Apple AR/MR requires the same amount of computational power as the MacBook Pro and is substantially higher than the iPhone”.
The chipset is reportedly claimed to employ an unique streaming codec developed by Apple after intolerable latency issues were discovered during product development. The headset also incorporates an H2 chip enabling an ultra-low latency connection with the second-generation AirPods Pro, however Gurman claims that while the headset supports Spatial Audio, it only works with compatible AirPods and not with the built-in speakers.
The disadvantage of combining MacBook-level power with a lightweight design is that something has to be sacrificed, and it appears that this may be battery life. According to WCCFTech, Apple is not planning the headgear to be used for extended amounts of time, but rather for short, intentional spurts. Gurman thinks that it will be able to run for around two hours on a single charge.
CEO Tim Cook has already expressed reservations about how Apple’s gadgets are being used for endless scrolling, so this might be a means to compel people to dip their toes into the augmented world rather than live in it.
Ming-Chi Kuo also speculated that Apple’s forthcoming HMD will ship with Wi-Fi 6/6E to “enhance the wireless experience,” with “much better” transmission speed and battery consumption than Wi-Fi 5, citing Oculus Air Link as an example.
Display technology
The Information reported that the headgear might have not one, but two 8K monitors, putting it far ahead of the competition. Even most Televisions do not currently support 8K resolution.
Ming-Chi Kuo, on the other hand, offers something a little more practical: two 4K screens. More precisely, the headgear is said to employ two Sony 4K Micro OLED panels for a high-end AR/VR experience. Later, The Information acknowledged that two 8K displays are unlikely, instead pointing to the utilization of two 4K Micro OLED panels, as Kuo proposed.
Display Supply Chain Consultants adds to the excitement with an early 2022 projection for a triple-display system. It, too, says that Apple would employ two 4K Micro OLED panels to produce graphics, but it also cites a third very low-res AMOLED screen, which would be a first for a VR/AR headset if accurate.
According to the description, the third display might be “for low-resolution peripheral vision, so enabling a foveated display system,” thereby eliminating the tunnel vision prevalent in all existing VR headsets.
According to a subsequent rumor released in January 2023 by The Information, the headset will have a 120-degree field of vision, the same as the Valve Index and far greater than the 106-degree FOV of the high-end Meta Quest Pro. It’s also supposed to contain small motors that automatically change its internal lenses to fit the wearer’s inter-pupillary distance, which is certainly convenient, but it’s not the first to do so – the functionality is also included in the Meta Quest Pro.
Tracking technology
In addition to the incredibly high-resolution displays, The Information reports that Apple is planning to include eye-tracking technology that will “fully render only parts of the display where the user is looking,” allowing the headset to render lower-quality graphics along the user’s peripheral vision and reduce overall computing needs without a noticeable visual downgrade.
The Information expands on the eye-tracking technology in a follow-up story in October 2022, claiming that it will also be capable of scanning your iris. The idea is that customers would be able to put on the headset and automatically be signed into their account, while the article also indicates it will be used for payment authentication, similar to Touch and Face ID.
Bloomberg claims it will be able to map surfaces, edges, and settings with “higher precision than existing technologies on the market” to give genuine 1:1 tracking in virtual and augmented reality situations. The cameras embedded into the device may also monitor hand gestures and even display a virtual keyboard onto actual surfaces for typing.
The Information goes a step further, stating that the headset would “be outfitted with more than a dozen cameras for hand tracking motions and relaying footage of the actual world to anyone wearing it”. According to a further source, two of these cameras would be dedicated to leg tracking in order to better replicate the postures of your legs via virtual avatars. Meta is exploring towards leg tracking for their avatar system, which is now made up of floating torsos, heads, and arms with no legs, however it isn’t accessible on the Quest 2 or the more recent Quest Pro.
Software
Apple is rumored to seek to build a special App Store for the headset, with a focus on gaming, streaming video content, and virtual chat – similar to Meta’s latest standalone headsets. Bloomberg reports that the headgear would provide “an all-encompassing 3-D digital world” for gaming, streaming video, and checking up with friends or coworkers.
Not much further was stated on that front until 2022, when iOS developers started detecting allusions to a new operating system named ‘realityOS’. It was discovered in a number of sources, including Apple’s own open-source repository on GitHub and App Store upload records. According to Bloomberg, the headgear will most likely have its own App Store where developers can create and distribute programs for the new headset.
On Twitter, prominent iOS developer Steve Troughton-Smith provided pictures of references to realityOS – as well as a realityOS simulator for developers.
Nevertheless, according to Bloomberg’s Mark Gurman, Apple may have abandoned the realityOS name in favor of the more elegant xrOS.
Gurman adds that the headset will be able to act as an external monitor for your Mac and may include “a specialized video-viewing capability that may make users feel like they’re watching a movie on a huge screen in another setting, such as a desert or outer space.”
He further claims that the UI will be “essentially identical to that of the iPhone and iPad, having a home screen with a grid of reorganizable icons.”
