NVIDIA and Apple Revolutionize Spatial Computing with CloudXR Integration

Spatial computing is rapidly evolving, seamlessly blending digital content with the physical world. A recent integration between NVIDIA CloudXR 6.0 and Apple’s visionOS is poised to accelerate this evolution, offering professionals, developers, and enthusiasts unprecedented capabilities in visualization, collaboration, and immersive experiences. This collaboration, detailed at NVIDIA’s GTC global AI conference, unlocks high-fidelity, low-latency streaming for applications on Apple Vision Pro.

Unlocking Immersive Experiences with CloudXR 6.0

NVIDIA CloudXR 6.0 now natively integrates with Apple Vision Pro, leveraging foveated streaming to optimize rendering resolution based on the user’s gaze. This intelligent optimization delivers high-resolution content where it matters most while protecting user privacy by never exposing gaze data to applications. As Jeff Norris, senior director of the vision products group at Apple, stated, “Apple Vision Pro is redefining what professionals can do with spatial computing…With NVIDIA, we’ve brought together the powerful capabilities of visionOS with CloudXR streaming technology to deliver high-fidelity experiences.”^[1]

Key Requirements for Spatial Computing

Demanding XR and spatial computing workloads require three critical elements: uncompromised high-fidelity visuals at 4K resolution, real-time response rates, and full immersion. CloudXR for visionOS delivers on all three fronts, enabling users to seamlessly augment their workflows with applications like Immersive for Autodesk VRED, powered by NVIDIA RTX technologies – from NVIDIA RTX PRO workstations to GeForce RTX GPUs – on PCs or in the cloud.

Industry Adoption and Real-World Applications

A growing ecosystem of partners is already harnessing CloudXR for visionOS to transform their workflows. Leading software providers, including Autodesk, Innoactive, Synopsys, Trifork, X-Plane, and iRacing, are integrating the technology to deliver high-fidelity applications natively to Apple Vision Pro. This benefits enterprises like Roche, Foxconn, and Switch, as well as automotive leaders such as Come on, BMW Group, Rivian, and Volvo Group, allowing them to visualize massive 3D assets and complex simulations with photorealistic quality.

Transforming Automotive Design with Immersive Collaboration

Volvo Group designers are utilizing XR to refine vehicle designs, perfecting details like the windscreen-to-front transition before physical prototyping.^[1] Immersive for Autodesk VRED, enabled by Innoactive, is transforming the design review process for automotive giants. Designers can now visualize massive models with RTX-powered ray tracing at a 1:1 scale within Apple Vision Pro. Thomas Heermann, vice president of automotive design at Autodesk, noted, “Automotive design reviews are high-stakes moments…By making the review process more seamless, companies can spend less time on infrastructure and more time on bringing products to life.”

Digital Twins and Factory Planning

Roche, in collaboration with Innoactive, is using Autodesk Revit software, NVIDIA Omniverse libraries, and CloudXR for visionOS to simulate layouts for its biofluid analysis labs before physical construction. ^[4] Foxconn is leveraging CloudXR for visionOS to visualize factory-floor walkthroughs, enabling designers to optimize facilities without physically being on-site.

Optimizing Data Centers and Simulating Aerodynamics

Switch is demoing an Omniverse digital twin of its EVO AI Factories, utilizing CloudXR for visionOS to optimize infrastructure within a fully immersive spatial environment. MHP, an IT consultancy, is using Synopsys Ansys Discovery 3D product simulation software, Omniverse, and Innoactive Spatial, powered by CloudXR for visionOS, to simulate real-time aerodynamics airflow.

Expanding Beyond Enterprise: Gaming and Simulation

CloudXR for visionOS extends beyond enterprise applications, allowing simulation enthusiasts to connect high-fidelity, RTX-powered titles like iRacing and X-Plane to Apple Vision Pro, creating an ultimate simulation experience with uncompromised 4K resolution.

Developer Access and Future Availability

CloudXR 6.0 is now available to developers as a native streaming framework for Swift, Apple’s programming language. This allows developers to build high-fidelity consumer and enterprise apps directly within Xcode. VisionOS 26.4 and these applications will be available to users this spring.