Generally, since InCameraVFX displays images rendered in real time on an LED according to the camera's angle of view, one camera is operated, but technology that enables simultaneous shooting with 2 or more cameras has begun to appear, and it is beginning to be used for shooting and distribution.

　Kadinche Co., Ltd. (Headquarters: Shibuya-ku, Tokyo; Representative Director: Takayuki Aoki) received cooperation from Mitomo Co., Ltd. (Headquarters: Shinagawa-ku, Tokyo; President: Fujimori Motonari) and Ark Ventures Co., Ltd. (Headquarters: Koto-ku, Tokyo; COO: Shinya Tanigawa) to verify the operation of PixoTop in the case of InCameraVFX using multiple cameras.

◆About operating multiple cameras with InCameraVFX

　By aligning the timing of releasing the camera shutter with the timing of the image displayed on the LED, it is possible to shoot with multiple cameras even with one LED by adjusting the timing so that only LED images that match that camera are displayed on each camera's images.

　　　　　　　　　　　　The basic idea of multiple InCameraVFX

　This time, as hardware, operation was confirmed with Ghost Frame, which is realized by combining an ROE Visual LED panel and a Megapixel VR HELIOS® LED processor (HELIOS8K).

GhostFrame can be rendered to an LED in 1 frame according to the timing of the camera shutter, and it is compatible with shooting with up to 4 cameras, but this time we tested with 2 cameras.
The equipment configuration is as follows.

　Other than the equipment required for GhostFrame, I used 2 cameras compatible with global shutters, and RedSpy and HTC VIVE Tracker for tracking.

　In this verification, due to location relationships, a simple map was created by attaching a reflective sticker to a large sheet to the RedSpy map and tracking was performed.
It was the first operation outside of the studio, and tracking was possible without any major issues.

◆ Test shot content

As for operation verification, there were no particular problems unique to Pixotope, and we were able to confirm the operation of the two units simply by setting the Helios 8K and adjusting the timing of the Sync Generator.
Three types of shooting tests were performed to confirm operation.

① As the most common method of use, I changed the angle of view of one scene and shot it with 2 cameras. By shooting with 2 cameras, you can edit freely.
Since this is a simple shooting, CG timing etc. have not been adjusted, but in actual shooting, detailed adjustments are necessary, such as synchronizing the Server-Client settings with Pixotope settings and creating scenes by synchronizing the animation.

② Since it is also possible to display completely different background assets with 2 cameras, we conducted a test where two different backgrounds were photographed by the actor's performance once. It was possible to switch between cameras seamlessly in one shot.

③ Even with one camera, if the shutter timing was adjusted, different images can be switched for each frame, so the LED background was switched between CG and green background for shooting. It is possible to simultaneously shoot InCameraVFX images and green background images in one cut.

　In order to verify the fast movement, I shot it as a scene of waving hands, but during shooting, I shot at 59.94p, exported every frame from the captured image, and then rendered it as a 29.97p image. There is a difference of 1 frame in parts that move quickly, such as hands, but if the cut is calm, it seems that almost the same image can be shot.

　This time, we verified the operation of Ghost Frame using Pixotope.
The system stability of GhostFrame itself was high, and I was able to shoot without problems even with Pixotope. In addition to shooting with multiple cameras, I also learned that there is a possibility that it can also be used with one device.
Kadinche Co., Ltd. will continue to sell Pixotope and provide consulting.　

Verification cooperation:
Sanyu Co., Ltd. (Headquarters: Shinagawa-ku, Tokyo; President and CEO: Fujimori Motonari)
https://www.mitomo.co.jp/
‍Ark Ventures Co., Ltd. (Headquarters: Koto-ku, Tokyo; COO: Shinya Tanigawa)
https://www.ark.ventures/