Apple has announced an exciting development for iPhone 15 Pro users at the WWDC 2024, where various updates and advancements in AI and spatial computing were unveiled. A significant highlight of the event was the integration of spatial audio capture capabilities into third-party applications with the forthcoming iOS 18.
The new operating system aims to revolutionize the use of spatial computing technology by offering an option to transform standard 2D images into spatial photos. The depth and dimension incorporated into these images are courtesy of sophisticated machine learning algorithms. Additionally, Apple’s recent collaborations are shaping up the way spatial content is created, particularly through a notable partnership aimed at facilitating the creation of spatial content using mirrorless cameras.
With the launch of iOS 18, developers will now be able to tap into a new API designed to enable spatial video recording within their camera apps. This is a marked change from the current situation where the spatial video feature was exclusive to Apple’s proprietary software. Available initially with the stock camera app on the iPhone 15 Pro and iPhone 15 Pro Max on iOS 17.2 and later versions, the recording of spatial audio had previously been a limitation for third-party applications seeking to capture comprehensive auditory details.
The vertical alignment of the iPhone 15 Pro’s cameras, specifically the main and ultra-wide lenses, are critical for capturing spatial videos. This technology will remain a unique offering of the ‘Pro’ models for those seeking to produce videos with in-depth dimensions. However, this exclusivity is set to be redefined with the upcoming iPhone 16 lineup, which is expected to support spatial video capabilities, thanks to vertically arranged cameras.
This inclusion of third-party apps in spatial video projects signals a substantial boost in the market reach of Apple’s Vision Pro. The company is poised to capitalize on an extended user base across regions, including China, Japan, Singapore, and beyond. Beyond the mere expansion, users can also anticipate the addition of creative elements such as filters and edits through these apps in the foreseeable future.
For users who are eager for a firsthand look at iOS 18’s new features, the beta preview is currently available for testing. The public release is scheduled for later this year in the fall. While Apple’s plans indicate a temporary hold on Vision Pro 2 development, attention is being directed towards a more budget-friendly version of the Apple Vision Pro headset, slated for release in the near term.
The integration of spatial audio capture in third-party apps not only exemplifies Apple’s commitment to pushing technological boundaries but also presents users with more diversity in creating immersive content. The iOS 18 update promises to be a groundbreaking step towards enhancing the sophistication and accessibility of spatial computing for iPhone users.
