Today marks the launch of the initial beta for visionOS 2.4, potentially the most significant update to date for Apple Vision Pro users. This update introduces support for Apple Intelligence, substantial enhancements to Guest Mode, a new Spatial Gallery application, an Apple Vision Pro application for iPhone, and much more. Here’s a comprehensive overview of what you should know…
“Apple Vision Pro enables users to connect, collaborate, and enjoy entertainment like never before — and we are committed to exploring the possibilities of spatial computing with visionOS 2.4,” commented Mike Rockwell, Apple’s vice president of the Vision Products Group. “With the addition of Apple Intelligence, Vision Pro users can elevate their productivity and creativity through innovative features such as Writing Tools, Image Playground, and Genmoji. We eagerly await users discovering and sharing remarkable new experiences via Spatial Gallery.”
Support for Apple Intelligence
With the rollout of visionOS 2.4, Apple Vision Pro introduces support for Apple Intelligence, encompassing Apple’s array of AI features. Initially unveiled during last year’s WWDC, Apple Intelligence highlighted features across the iPhone, iPad, and Mac, while Apple Vision Pro did not initially participate. However, that scenario is shifting now.
The Genmoji feature on Apple Vision Pro allows users to create customized emojis based on text inputs or individuals from their Photos library. Genmoji can be conveniently accessed directly from the keyboard within various Apple applications such as Messages.
The Image Playground feature enables users to generate images from concepts, textual descriptions, and subjects found in their Photos library. Users can access Image Playground through a dedicated application built specifically to leverage the spatial computing capabilities of Vision Pro. Similar to other platforms, it’s integrated within Messages as well.
Additionally, visionOS 2.4 incorporates the intuitive Writing Tools feature into Vision Pro. Writing Tools simplifies the proofreading and rewriting process, providing integrated options for adjusting your text to be friendlier, more professional, or concise. Users can also generate summaries, key points, lists, and tables based on their content. Moreover, Writing Tools on Apple Vision Pro can utilize ChatGPT to generate new text based on user prompts.
The Smart Reply feature analyzes email or messaging threads to suggest relevant responses. The update also includes the memory movie functionality within the Photos application, enabling users to create custom memory movies based on their descriptions. Apple Intelligence then curates the best photos and videos to weave together a narrative. Additionally, natural language search in the Photos app is now accessible.
A few additional insights regarding Apple Intelligence in visionOS 2.4:
The update also brings support for Priority Messages in Mail, Mail Summaries, Image Wand in Notes, Priority Notifications in Notification Center, and Notification Summaries. Apple Intelligence leverages on-device processing to ensure user privacy wherever feasible. For tasks requiring larger models, Private Cloud Compute enhances the privacy and security framework of Apple products in the cloud, enabling even more intelligence. When using Private Cloud Compute, user data is neither stored nor shared with Apple; it is strictly utilized to fulfill requests. Independent experts can continuously evaluate the code running on Apple silicon servers to uphold this privacy commitment, and they are already actively doing so.
As it stands, Vision Pro continues to operate with the existing Siri functionality without any further enhancements. For instance, unlike other Apple Intelligence platforms, ChatGPT cannot currently be accessed via Siri on visionOS 2.4. Apple indicates that more features and language options for Siri on Apple Vision Pro will be introduced throughout the remainder of the year.
Introduction of the Spatial Gallery app
In addition to Apple Intelligence support, Apple has unveiled several new features for Vision Pro in visionOS 2.4, including a brand-new Spatial Gallery app. This application serves as a hub for spatial photos, videos, and panoramas, all compiled in one place. The content, meticulously curated by Apple for Vision Pro users, will be available for free and will be updated regularly.
The Spatial Gallery app offers a wide range of content categories, including sports, travel, entertainment, and others.
Here’s how Apple describes it:
visionOS 2.4 introduces Spatial Gallery, a novel application presenting a curated selection of spatial photos, videos, and panoramas designed for Apple Vision Pro. Through Spatial Gallery, users can relish extraordinary and intimate experiences encompassing art, culture, entertainment, lifestyle, nature, sports, and travel, with fresh content rolling out regularly. At launch, users can explore exceptional perspectives from photographers such as Jonpaul Douglass and Samba Diop; discover fresh stories and experiences from iconic brands like Cirque du Soleil, Red Bull, and Porsche; enjoy behind-the-scenes glimpses from Apple Originals like Disclaimer, Severance, and Shrinking; and relive significant moments captured by leading artists.
The Spatial Gallery app will be included when visionOS 2.4 launches in April.
Apple Vision Pro application for iPhone
As part of the iOS 18.4 release, visionOS 2.4 will introduce a new “Apple Vision Pro” app for iPhone users. This application allows Vision Pro users to explore content and spatial experiences, discover helpful tips about their devices, and much more.
The app features a comprehensive Discover page that highlights immersive videos from the TV app, enticing content from Spatial Gallery, and information on new applications and updates. This will also serve as the primary venue for Apple to showcase new features for Vision Pro. Furthermore, a “My Vision Pro” section will provide users with information regarding serial numbers, optical inserts, AppleCare coverage, and other relevant details.
The app will automatically appear on your iPhone following the update to iOS 18.4 and the upgrade of Apple Vision Pro to visionOS 2.4. Even those without an Apple Vision Pro can download this app from the App Store to explore the Discover page and learn about the spatial computing platform.
This application is set to launch alongside visionOS 2.4 in April.
Enhancements for Guest Users
Guest User functionality allows Apple Vision Pro users to share their headset with friends, family, and coworkers. The initial implementation required the Vision Pro owner to don the device and select which apps to share with the guest user. Subsequently, the guest would wear the Vision Pro and perform hand and eye tracking calibration.
With visionOS 2 released last fall, Apple improved the feature so that the guest user could retain their hand and eye data for 30 days, eliminating the need for continual calibration.
visionOS 2.4 introduces another significant enhancement. Now, the Vision Pro owner doesn’t need to wear the headset to grant access to a guest. The guest can simply put the headset on and then request permission from the owner. The owner will receive a notification on their iPhone, allowing them to approve the request and select which apps to share.
During this process, the Vision Pro owner can also activate AirPlay, allowing them to monitor the guest’s actions and provide guidance as needed.
Conclusion
In addition to these features, Apple has introduced a few minor updates with visionOS 2.4 for Apple Vision Pro. The Dictation feature now offers voice commands for text editing. Additionally, inline math equations can be solved within the Notes app, mirroring the functionality integrated into iOS 18 last year.
The first developer beta of visionOS 2.4 is available today, with the public release scheduled for April.
Follow Chance: Threads, Bluesky, Instagram, and Mastodon.
