The Apple Vision Pro, which went on sale in the US on 2024/2/2, went on sale in Japan on 2024/6/28 with a delay of about 5 months, and it arrived at our company today 2024/7/8. I tried using it for an hour and was impressed, so I wanted to write this essay.

About virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR)

Until now, we have been shooting virtual productions using a combination of the RedSpy camera tracking system and the Sony FX6 cinema camera. In the case of shooting with multiple cameras, it has been possible to create images in different patterns with a virtual camera within the UE or a fixed camera without tracking, but now we have verified the operation of the SONY FR7 swivel camera with interchangeable lenses.

Since InCameraVFX displays images rendered in real time on an LED according to the camera's angle of view, one camera is operated, but technology that enables simultaneous shooting with 2 or more cameras has begun to appear, and it is beginning to be used for shooting and distribution.

The HP Reverb G2 Omnicept Edition, which is a VR head-mounted display that can detect pupils, gaze, heart rate, and mouth movements, has arrived at us, so we first checked the operation of the characteristic features. I felt that the acquisition of this biological information could be effectively used for future user analysis in VR applications, medical applications, etc.

This is a memo I tried using Pixotope, a real-time compositing software used for virtual production.

The 3D interactive display zSpace Inspire will be available

I was able to borrow 360Anywhere, which is a panoramic camera, and I was able to shoot various things in a short period of time, so I'd like to write down the results.

I made a sample application for Spatial Reality Display using Unity