Vision Pro

Joshua Olexa, Annie Trang, Jonathan Cohen, Kevin Kim, Maureen Rakovec, Jordan R. Saadon, Charles Sansur, Graeme F Woodworth, Gary Schwartzbauer, Jacob Cherian

With its recent release, the Apple Vision Pro (Apple Inc., Cupertino, CA) represents a promising technological advancement of mixed reality in the field of neurosurgery and medicine more broadly. With all new technologies, it is critical to facilitate early use and assessment of the technology to facilitate adoption by the larger medical community. A 44-year-old female with a history of ruptured intracranial aneurysm status post anterior communicating artery aneurysm clipping presented with worsened confusion and intermittent headache. CT imaging revealed evidence of hydrocephalus due to the malfunction of a previous right parietal ventriculoperitoneal (VP) shunt. Prior to the case, the Apple Vision Pro was used in the operating room to visualize and interact with a 3D model of the patient's anatomy for the patient undergoing a VP shunt placement. A visualization of the 3D model through the headset was used to plan the approach and entry point. At the conclusion of the procedure, all clinicians and operating staff who used the technology for planning completed a survey about their initial impressions of the headset. Overall, users felt the 3D models felt realistic (4.5/5), that the display of the user's real-world view felt natural (4.3/5), and that the headset did not cause eye strain or fatigue (4.5/5). The majority of users responded that they would continue to use the headset for cases (4/5). This represents one of the first known clinical uses of the Apple Vision Pro. It is a cutting-edge technology that will likely provide immense value for healthcare providers as it becomes more integrated into clinical care.

Tao Lan, Sichun Liu, Yihe Dai, Jia Luo, Jiang Han, Yun Jin

Laparoscopic ultrasound-guided liver microwave ablation requires precise navigation and spatial accuracy. We developed an image fusion navigation system that integrates laparoscopic, ultrasound, and 3D liver model images into a unified real-time visualization. The Apple Vision Pro mixed reality device projects all essential image information into the surgeon’s field of view in real-time. This system reduces cognitive load and enhances surgical precision and efficiency. Comparative experiments showed a significant improvement in puncture accuracy under AVP guidance (success rate of 90%) compared to traditional methods (42.5%), benefiting both novice and experienced surgeons. According to the NASA Task Load Index evaluation, the system also reduced the workload of surgeons. In eight patients, ablation was successful with minimal blood loss, no major complications, and rapid recovery. Despite challenges such as cost and fatigue, these results highlight the potential of mixed reality technology to improve spatial navigation, reduce cognitive demands, and optimize complex surgical procedures.

Carolin Wienrich, David Obremski

Spatial computing is set to change the way we work. It will enable both focused work through a higher degree of immersion and collaborative work through enhanced integration of shared interaction spaces or interaction partners. With the Apple Vision Pro, the level of immersion can be adjusted seamlessly. So far, there have been no systematic studies on how this adjustability affects work performance when working alone or together. The present empirical study fills this research gap by varying the level of immersion across three stages (high, medium, low) while solving various tasks with the Apple Vision Pro. The results show that selective attention improves significantly with increasing immersion levels. In contrast, social presence decreases with increasing immersion. In general, participants performed better in the individual task than in the collaborative task. However, the degree of immersion did not influence the collaborative performance. In addition, we could not determine any adverse effects on depth perception or user experience after use. The present study provides initial contributions to the future of spatial computing in professional settings and highlights the importance of balancing immersion and social interaction in a world where digital and physical spaces seamlessly coexist.

Guodong Chen, Sizhe Wang, Jacob Chakareski, Dimitrios Koutsonikolas, Mallesham Dasari

Apple recently unveiled capturing spatial video experiences on an iPhone and their extended reality (XR) headset Vision Pro. Spatial videos can be viewed on immersive near-eye displays like the Apple Vision Pro for a more realistic experience with depth perception. However, streaming spatial videos encounters several challenges, such as bandwidth limitations, latency, and synchronization issues between multiple camera views. This position paper presents a comprehensive research agenda to address these issues and make spatial video streaming as ubiquitous as traditional online video for mobile systems and applications. We outline several research threads for exploration and discuss a series of novel ideas, including view-adaptive streaming strategies, multipath support, and QoE modeling, which we believe will become the fundamental components for future video experiences on mobile and wearable devices.

Rangga Rizky Pratama, Ryan Randy Suryono

With the development of spatial computing devices, there arises a need to analyze consumer opinions about products such as the Apple Vision Pro (AVP), a technology that combines augmented reality (AR) and virtual reality (VR). This study aims to analyze consumer opinions on the Apple Vision Pro by utilizing data from the social media platform X. Three algorithms—Random Forest, Support Vector Machine (SVM), and Naïve Bayes—are used in text categorization to identify sentiment trends. Data was collected through a crawling process, resulting in 3,753 entries. After preprocessing and labeling, 2,609 clean data points were obtained, with 1,618 classified as negative and 991 as positive. In sentiment analysis, Random Forest delivered the best performance with an accuracy of 83%, followed by SVM at 80%, and Naïve Bayes at 75%. These results indicate that the Random Forest algorithm is more effective in sentiment categorization related to Apple Vision Pro. This study provides significant contributions to companies in understanding public perceptions and crafting more precise data-driven marketing strategies.