Pixotope

What is Pixotope?

Pixotope
Virtual production solutions

Pixotope (Pixotope) from Norwegian Pixotope Technologies is a software-based solution that provides virtual production. Virtual production studios using Pixotope include all necessary functions, from assembling virtual sets compatible with virtual studios and in-camera VFX shooting, to rendering, keying, and linking with camera tracking systems.

We provide license sales and equipment consulting

Kadinche sells “Pixotope” as an authorized domestic distributor to companies such as photography studios and educational institutions that are considering introducing studios using “virtual production.” In addition to selling licenses, we also provide equipment consulting.

What can you do with Pixotope

By synthesizing virtual scenes created with CG and performers shot in real time on a virtual studio set, composite images with free camera work as if they were shot in an actual studio can be rendered in real time.

Various shooting methods are possible

With the introduction of Pixotope, in-camera VFX shooting using an LED wall as a background linked to a camera tracking system, virtual studio shooting with CG using a green background, and composite shooting of CG objects using AR will be possible.

Flexible support for equipment and studio environments

The shooting and compositing environment is built on Unreal Engine (UE4/UE5), and realizes real-time, high-quality rendering compatible with UHD/4k formats and 32-bit HDR. It can be flexibly adapted to various shooting equipment and studio environments.

“Daikanyama Metaverse Studio”

Together with Shochiku Co., Ltd. and Miecru Co., Ltd., this virtual production studio was the first to start operation in Japan in January 2022. It is operated by combining “Pixotope (Pixotope)” with a large LED wall, green background, and camera tracking system (RedSpy).
Starting with the live streaming of the Kabuki performance “META Kabuki Genji Memories” on January 25, 2022, virtual production has been used in many shooting cases.

Pixotope Key Features and Examples

A virtual production studio using Pixotope, a fully equipped virtual production studio, includes all necessary functions, from assembling virtual sets compatible with virtual studios and in-camera VFX shooting, to linking with rendering, keying, and camera tracking systems.

VS (Virtual Studio Virtual Studio)

By synthesizing virtual scenes created with CG and performers shot in real time on a virtual studio set, composite images with free camera work as if they were shot in an actual studio can be rendered in real time.
Pixotope is linked to various camera tracking systems, and collaboration is possible simply by selecting a linked camera tracking system and making various settings.
‍
　Also, a chroma key function is included, and real-time keying is possible simply by selecting the green part of the camera image. Since averaging is also performed, high-precision keying is possible even if there is a slight difference in color.
　Virtual studio adjustments are also possible on the UE, but it is also possible to adjust objects, adjust effects, color correction, etc. on Pixotope, and operate with an intuitive UI.
　A color grading function is also included, and post-processing can be performed for each camera image and CG, and since color adjustments can also be made for images after synthesis, it is possible to improve overall image quality.

AR (augmented reality)

　Characters and objects created with CG are arranged on three-dimensional coordinates in relation to the actual shooting site and combined into images. It also makes it possible to synthesize natural CG for live streaming of sports and news programs, and to co-star avatars with people seen in virtual live shows, etc.

　Pixotope has an external synthesis pipeline equipped with individual outputs for reflection, shadow, and alpha to match AR synthesis, so by adjusting shadows according to ambient light, images with a sense of reality can be taken, and even when the reflective material is within the camera's field of view, the reflection of the AR synthesized CG can be adjusted according to how the material is viewed.
　Also, even when CG with a translucent material is placed, translucent processing can be added not only to the CG but also to the camera image, so it is possible to produce images with a sense of reality.
　In AR, simple camera tracking can also be used by using a smartphone without using an expensive camera tracking system. (Since it is easy to use, it is not compatible with high-precision synthesis.)

XR (cross reality extended reality)

Through the camera lens, a virtual scene of the actor and CG rendered on a large LED wall in the background was captured. It is a method also called in-camera VFX, and in addition to being easy to reduce location costs in commercial/movie/drama shooting, adoption is increasing because it is easier to shoot seamless images rather than synthesis due to shooting through a lens or emitting light from an LED wall. In the case of InCameraVFX, since LEDs can only be used as a background, it is difficult to express depth, but it is also possible to create a sense of depth by using small items.

In Pixotope, as an XR function, it is possible to intuitively adjust the part to be projected onto the LED with a function called an XR wall actor.
　Also, with the extension function, which can synthesize CG on the outside of the LED, it is possible to shoot not limited to the size of the LED. The extension function requires adjustments that reduce the difference between images inside and outside the LED as much as possible, but by using the color matching calibration function, it is possible to automatically adjust the color.
　Extend requires 2 PCs, one for XR and one for AR, but it is also possible to connect the 2 PCs, and it is also possible to reduce the operational load.

Overseas case studies

VS (Virtual Studio Virtual Studio)

Performers shot in live-action are synthesized on virtual scenes and virtual studio sets created with CG. Composite images can be rendered in real time using free camera work as if they were being shot in an actual studio.

AR (augmented reality)

Characters and objects created with CG are arranged on three-dimensional coordinates in relation to the actual shooting site and combined into images. It also makes it possible to synthesize natural CG for live streaming of sports and news programs, and to co-star avatars with people seen in virtual live shows, etc.

XR (cross reality extended reality)

Through the camera lens, a virtual scene of the actor and CG rendered on a large LED wall in the background was captured. It is a method also called in-camera VFX, and in addition to being easy to reduce location costs in commercial/movie/drama shooting, it is increasingly being introduced because it is easier to shoot seamless images than synthesis due to shooting through a lens or the emission of light from an LED wall.

Next-generation video with Pixotope

As an authorized distributor of Pixotope in Japan, Kadinche Co., Ltd. not only sells products, but also accepts content production support and demonstrations.
Be sure to use pixotope to create cutting-edge virtual production content.

For an overview of Pixotope's features and pamphlets in Japanese,Mitomo's pageSee also.