summary

VISION

Realizing a world where people living in various different realities can interact safely, securely, and happily, and understand each other

MISSION

　Information technology has expanded our reality (reality = place where we place our values in life) from physical space to cyber virtual space. In recent years, advanced virtual reality (VR) technologies that are more directly connected to the five human senses have appeared one after another, and the creation of new industries is also expected. Meanwhile, in exchange for this high immersive experience, there are concerns about security and privacy risks related to biological and environmental information through VR devices that are worn all the time, and the emergence of invasive physical and mental attack methods. The purpose of this research is to construct various forms of reality composed of various materials and virtual spaces and entities present therein, and to establish information infrastructure technology that realizes their safe and secure integration. In this research, we will first clarify requirements for a new trust infrastructure that takes into account the nature of space in expanded Reality, attributes of users, etc. through research and development of reality construction/connection technology in various modalities. At that time, we will not only expand the viewpoint of information security, such as identity assurance of space and user entities, authentication, cryptographic methods that dynamically change target granularity, etc., but also medically verify the effects and threats due to physical and mental invasiveness through wearable devices (Note 2), etc., and design an information infrastructure equipped with human-centered usable security technology (Note 3) that assumes actual usage/operation forms. The infrastructure that integrates each research item is named the “Trusted Inter-Reality Platform,” and we aim to evaluate its convenience, safety, and usability through domestic and international demonstration tests.

Note 1) Trust principle: CCA (Consistency, Availability), which extends the three conventional security elements CIA (Integrity, Availability), is placed as the principle of trust in inter-reality.

Note 2) Wearable device: A device that is worn on the human body and stimulates the five senses. It includes VR goggles that enhance audiovisual immersion, and haptic devices that give skin sensory feedback.

Note 3) Usable security technology: Security technology with high usability that is familiar and easy to use for users, such as reducing the burden on users.

Project Research Outline

project name

JST CREST “Creation of basic software for Society 5.0 through fusion of basic theory and system infrastructure technology”

Research project name

A trusted inter-reality foundation that safely and securely creates and connects diverse forms of reality

Research system

Project Leader: Yonezawa Takuro (Nagoya University)
Main collaborators: Akira Kanaoka (Toho University), Takayuki Aoki (Kadinche Co., Ltd.), Tsukada Manabu (The University of Tokyo)

Research period

5.5 years from 2022 to 2028

Research and development items and responsibilities

Nagoya University Group

• Research Supervisor
• Multimodal Reality Connector technology for safe and secure reality connections
• Inter-reality infrastructure integration

The University of Tokyo Group

• Secure and hierarchical real space construction technology that takes into account the diversity of space managers and users
• Building a scalable Reality Twin server infrastructure that takes user protection into account

Toho University Group

• Integrity confirmation technology using user assurance technology
• Dynamic spatial encryption preserves confidentiality

Kadinche Group

• Development of inter-reality feedback technology considering medical safety
• Inter-Reality service development and demonstration experiment

Kadincheʼs Research Topics

In the “development of inter-reality feedback technology that takes medical safety into consideration,” we use computer science in combination with knowledge from medicine and cognitive science, and aim to make head-mounted displays, wearable devices, etc. that will develop more and more in the future safe for humans and have a positive impact. The problem of VR sickness has already been reported on some VR head-mounted displays, and we are working scientifically and medically to address such issues.

In the “Inter-Reality Service Development and Demonstration Experiment,” service development and demonstration experiments are being carried out in a wide variety of realities, such as Extended Realities (XR), which starts from devices such as VR, AR, and MR, and a new reality society where personalities and roles are properly used in multiple spaces such as reality and the metaverse. We are also aiming for a demonstration experiment with Kenya, and we are also considering and preparing a project connecting local indigenous communities and wild animals with Japanese society.

Main external announcements

■ Soko Aoki, Naoki Itabashi and Ripandy Adha, “System for the Synchronization of Position, Motion and Audio Between MR and VR” The 1st International Workshop on Internet of Realities (IOr- WS 2023)

https://iorws2023.klab.is.sci.toho-u.ac.jp/program.html

■Takashi Yuki, Nguyen Tiep Viet, Uchida Keisuke, Inada Akinori “Development of Energy-Saving Cloud-Compatible Cameras for Non-Electrified and Non-WiFi Regions” Measurement and Auto Control Accounting Division Smart Sensing Systems Group Research Presentation

https://rcl-aoyama.jp/sice-sss/20240718_program.html

related

project site

https://www.internet-of-realities.org/

Related Laboratories

• Takuro Yonezawa (Nagoya University)　https://takuroyonezawa.info/
• Akira Kanaoka (Toho University)　https://www.toho-u.ac.jp/sci/lab/Sci-Inf-lab-17.html
• Tsukada Manabu (The University of Tokyo)　https://tlab.hongo.wide.ad.jp/ja/