About virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR)

＜VR, AR, MR, and XR worlds: latest technology and future possibility＞

In recent years, the terms virtual reality (VR), augmented reality (AR), mixed reality (MR), and extended reality (XR) have come to be seen frequently in the media. These innovative technologies are drastically changing our daily lives and the way we do business. In this article, we will explain in detail the features of each technology, the latest trends, and future possibilities.

table of contents

1. VR (Virtual Reality)
2. AR (Augmented Reality: Augmented Reality)
3. MR (mixed reality)
4. XR (Extended Reality: Augmented Reality)
5. VR, AR, and MR market trends and future potential
6. The latest trends: metaverses and AR clouds
7. summary

1. What is VR (Virtual Reality: Virtual Reality)

VR is a technology that creates an artificial environment on a computer and allows users to immerse themselves in it. It is called “virtual reality” or “artificial reality” in Japanese.
In order to realize VR, VR head-mounted displays (HMD) are often used, and the difference between AR and MR is that the real world cannot be seen when wearing an HMD. The word virtual (virtual) is reminiscent of CG and “fictional worlds,” but creating and experiencing an imaginary world is not just “virtual reality.” We see the term “virtual reality” as a general term for technology and initiatives to experience all kinds of spatial expressions, including “virtual (virtual),” “as if they were reality (reality).” The essence of “virtual reality” is that no matter what “virtual reality” has been created, users can experience and act as if it were a “real world.”

VR features

• Provides a completely artificial environment
• Use a dedicated head-mounted display (HMD)
• An experience completely cut off from the real world

Types of VR HMD

1. 3DoF (3 Degrees of Freedom)
   • Only rotation on the spot is possible
   • Example: Google Cardboard
2. 6DoF (6 Degrees of Freedom)
   • In addition to rotation, movement within space is also possible
   • Examples: Oculus Quest 2, HTC Vive Pro 2

Examples of VR applications

• Gaming and entertainment
• Education and training
• Medical care (surgery simulation, rehabilitation)
• Construction/Real Estate (virtual tour)
• Product design/prototyping

‍

Examples from our company:“VR Devilman Exhibition” basic function development,Peer support for cancer patients using VR technology
Examples of commercial products:Oculus Quest 2,HTC Vive,Playstation VR

2. What is AR (Augmented Reality: Augmented Reality)

AR is a technology that superimposes digital information on the real world. You can experience it through a smartphone, tablet, or special AR glasses. VR enters a virtual world separated from the real world, but AR is mainly about the real world. It is a concept that also includes MR described later, but by utilizing both the real world and the virtual world, it is possible to add new value to the real world. Unlike MR, AR does not recognize real-world shape information, three-dimensional information, etc., and displays digital content by superimposing it on a camera image has become mainstream.

AR features

• Based on the real world and adding digital information
• Real world interaction with virtual objects is limited
• You can also experience it on a smartphone or tablet

Types of AR technology

1. Marker AR
   • Recognize specific images or objects and display content
2. Markerless AR
   • Uses environmental recognition technology to detect planes and spaces and display content

Examples of AR applications

• Navigation (AR function of Google Maps)
• Education (interactive learning materials)
• Retail (virtual fitting, product visualization)
• Sightseeing (display information on tourist spots)
• Manufacturing (assembly/maintenance support)

‍

Examples from our company:Development of Kabuki AR/MR application Reverse Reality,zSpace Distributors
Examples of commercial products:Google “Glass Enterprise Edition 2”

3. What is MR (mixed reality)

MR is a technology that combines the real world with the virtual world at a high level. It can be said to be an advanced form of AR, but it is characterized by more advanced spatial recognition and interaction. The major difference from AR is that MR recognizes space by recognizing three-dimensional shapes in real space, such as placing a digital object on the ground or desk in a real space. Also, instead of a physical controller, it is sometimes possible to operate with hand gestures.

Characteristics of MR

• Advanced interaction between the real world and virtual objects
• Use spatial recognition technology to display content according to the actual environment
• Special MR headsets are often used

Examples of MR devices

• Microsoft HoloLens 2
• Magic Leap 1
• Nreal light

Examples of MR applications

• Industrial design and simulation
• Medical care (surgical support, anatomy learning)
• Education (interactive 3D learning)
• Remote collaboration
• Entertainment (immersive gaming experience)

‍

MR is called mixed reality, and it is a technology that incorporates artificial virtual world information created with CG etc. into the real world and creates a world that combines the real world and the virtual world. Within the MR world, things in the virtual world interact with things in the real world.

Examples of commercial products:Microsoft Hololens2andMagic Leap OneHead-mounted displays such as these are typical commercially available MR devices, but recently smartphones are also equipped with depth detection sensors such as LiDAR, and MR-like functions are being realized in smartphones as well.

‍

‍

4. What is XR (Extended Reality: Augmented Reality)

XR is a general term that encompasses VR, AR, and MR. It refers to any technology that combines the real world and the virtual world.

XR features

• Integrate VR, AR, and MR technologies
• Includes all experiences on a real and virtual continuum
• The right technology can be selected according to the device and application

5. VR, AR, and MR market trends and future potential

The XR market is growing rapidly, bringing innovation to various industries. According to Goldman Sachs's VR use case forecast for 2025, the VR application market spans a wide range, and it seems that we will see it in various industries such as the medical healthcare field, industrial field, retail market, etc., starting with the game market/entertainment field, which is currently booming.

market forecast

• Goldman Sachs predicts that the VR/AR market is expected to grow to $80 billion by 2025
• Areas where growth is particularly expected:
  1. Gaming and entertainment
  2. Health care/medical
  3. Engineering/Manufacturing
  4. Education and training
  5. Retail/e-commerce

Psychological effects of XR technology

”How will VR change the brain? The psychology of virtual realityThe following things were described in the book”. Not only is the market growing significantly, but new technologies and new tools are being developed for humanity, and we are also developing various systems.

• The brain treats experiences in VR as real events
• Even if you develop a third arm in VR or “transfer” it to an animal's body, the brain quickly adapts to the changes and masters the new body
• After the Iraq War, over 2000 former soldiers who had suffered from PTSD recovered due to VR therapy to experience “virtual Iraq”
• When you play a violent game from a first-person perspective in VR, you feel a vivid sense of guilt even if you know your opponent is a virtual human
• If you spend a day in a virtual world, you don't understand the difference between real and unreal
• Detailed movements of a VR user's body and gaze can be accurately converted into data
• From there, you can directly read that person's mental state, emotions, and self-awareness

6. The latest trends: metaverses and AR clouds

“metaverse”

A persistent and immersive online environment built on virtual space.

• Development of social VR and virtual economy
• Communication through virtual avatars
• Organizing events and concerts in virtual spaces

“AR cloud”

A technology that superimposes digital information on a 3D map of the real world.

• Providing AR experiences linked to location information
• Sharing AR experiences with multiple users
• Realizing city-scale AR experiences

‍

7. summary

VR, AR, MR, and XR have the potential to revolutionize our lives and businesses. These technologies are being used in a wide range of fields, from entertainment to education, medical care, and manufacturing.
In the future, advances in hardware and software technology will enable even more immersive experiences and seamless integration with the real world. New concepts such as the metaverse and AR cloud are also further expanding the possibilities of these technologies.
XR technology has the potential to have a major impact on human perception and cognition, so along with its development, ethical and social discussions will also become important.
We need to focus on the possibilities brought about by these innovative technologies and keep in mind responsible development and use. The world of XR offers us a new dimension that truly transcends the boundary between reality and the virtual.