ELF-SR1 set

In this article, we will build an environment and even build sample scenes for ELF-SR1 development in Unity.

table of contents

1. At the beginning

The author is an amateur who has never written an article in my life, so I think there are bad parts, but I would be happy if you could watch over me with warm eyes.

2. Introduction to the operating environment

Recommended PC specs

・OS: Windows 10 (64-bit)

・CPU: AMD Ryzen 5 3600X or higher (6 cores or higher)

・GPU: GeForce RTX 2060 or higher

・Memory: 8GB or more

・Storage: SSD is recommended

Compatible environments

・Unity 2018.4, 2019.4, 2020.1

・Unreal Engine 4.24, 4.25

This time, the build was performed with the following PC specs and environment.

PC specs

・OS: Windows 10 (64-bit)

・CPU: Intel Core-i7 10750H

・GPU: GeForce RTX 2070 Super

・Memory: 16GB

・Storage: SSD

operating environment

・Unity2019.4.15F1

・Visual Studio 2019

By the way, it only works on Windows (crying) It's still unclear whether it works on Macs using Bootcamp. I'll do it soon. It depends on the specs, but there is little hope.

3. Setup on PC

What is a very rough explanation of what you do

1. Screen settings
2. Download and install what you need
3. Check if the ELF-SR1 is working properly

That's it.

Below are detailed instructions and images.

image 1

image 2

① Set the display while the ELF-SR1 is connected to a Windows PC. As shown in image 2, change the screen size of the ELF-SR1 to 100%, the resolution to 3840 x 2160, and the orientation of the screen to horizontal. Then change the multi-display settings to “expand the display screen”.

※ In this case, the ELF-SR1 will be used horizontally, but it is also possible to create content vertically. If you want to display vertically, change the orientation of the screen to vertical.

Picture 3

② https://www.sony.net/Products/Developer-Spatial-Reality-display/jp/develop/Setup/DownloadInfo.html Download the plug-ins and drivers required for development from

The following is an explanation of the contents. You don't need to read it.

The SR Display Runtime Installer includes the following two pieces of software.

・SR Display Runtime Libraries & Device Drivers

・SR Display Settings application

SR Display Runtime libraries & device drivers are libraries required when building on Unity and drivers for ELF-SR1. Once installed, development can be carried out with the ELF-SR1.

The SR Display Settings Application is an application that can adjust SR Display settings and check whether the high-speed vision sensor can recognize the user's face.

SR Display Plugin for Unity is like a zip file packed with everything necessary for development in Unity. 4. I use it for operations on Unity

Image 4: ELF-SR1 Vision Sensor Status Bar

Image 5 Camera capture image window

③ Start SR Display Settings from the Windows button and check the operation. A red frame is displayed on your face, and once you enter, the confirmation is complete.

Below is an explanation of each button, etc.

You can adjust the amount of camera light with the Camera Gain setting on the status bar. Let's adjust the amount of light so you can see your face properly. If you check Auto Exposure, it will adjust automatically.

Crosstalk Correction is a system that corrects noise, etc. When Application Cotrolled is selected, the settings on the Unity side are reflected in CrossTalk Correction. OFF means there is no CrossTalk Correction.

4. Operations on Unity

Create a new project → set up the project → do the sample scene in 3 steps.

Step 1: Create a new project

Picture 6

The project name can be anything. Full-width characters and spaces are often bad, so use single-byte characters as much as possible. You can also freely decide where to save it. Once you've decided, click the Create button.

Picture 7

Once the project has been successfully created and the scene is unfolded, let's start with F on the toolbarile→SAveLet's save it with

Step 2 Set up a project

Picture 8

SaveOnce done, 3. Import the SR Display Plugin for Unity that you downloaded during setup on the PC into the scene you created.

Picture 9

SR Display UnityPluginWindows x86_64Since only the architecture is supported, if the settings are different, a warning will appear during import as shown in image 9.OKIf you press it, the settings will be changed automatically.

Picture 10

I need to change the project settings for ELF-SR1, so E on the toolbarDit→PROJECT SETTINGLet's open it.

Picture 11

qualitySelect, then at the bottom of the screenvSync CountI think Every V Blank is now, so let's change it to Don't Sync like the red frame.

The Unity project is now set up. Next, let's actually build the scene and see it moving on the display.

Step 3 Build a sample scene

Picture 12

As shown in image 11Projectfrom a windowAssetLet's open the column and open srDisplayUnityPlugin → samplesy → 0_srdsampleHome → scenes → srdisplaySampleHome.

Picture 13

On the toolbarFile→Build settingsLet's open it. I've confirmed that 6 different scenes have been added to Scenes In Build, and that the platform is PC Mac & Linux StandaloneBuild and Go Let's click.

Image 14 is adapted to the human eye, so there is a high probability that it will be distorted when pointing at the camera (crying). I will work hard to take good pictures.

When you build, a screen like image 14 will appear. You can experience various samples by pressing the numbers 1 to 5.

5. Introducing self-made projects

Image 15 A planetarium where only the Earth can be seen using ELF-SR1

Image 16 Hierarchy and Inspector

The background can be created as shown in image 16 by arranging the quad on the inside according to the SRDisplayBox wall and changing the texture of the quad. Also, by combining it with gadgets such as leap motion, the range of uses will expand, so be sure to try out various things.

6. At the end

Thank you for your hard work!
Thank you for reading to the end. This time, I created it while looking at the official documentation. I would be happy if it was even a little helpful.

Sony Global - SPATIAL REALITY DISPLAY | Overview

From building the Sony ELF-SR1 environment to running the sample on the actual machine Was published recently in Kadinche Engineering on medium, where people are discussing the conversation by discussing and discussing to this story.