The relationship between the metaverse and the universe corresponds to the one between the virtual environment and the real environment in MAR (Mixed and Augmented reality). The concept of fusing multiple metaverses with the universe is sometimes referred to as the interverse, although this is not yet generally recognized. This presentation will provide an overview of the standards related to interverse developed by SC 24/WG9 (MAR Continuum Concepts and Reference Model) and the ongoing projects. In addition, VRM, an open 3D humanoid avatar format for the metaverse, will be presented, although it is not yet a de jure standard. ISO/IEC Workshop on Standards for the Metaverse Session 1: ISO/IEC JTC 1 Standards and Projects for the Metaverse, June 26, 2023, at 21:00-22:50 UTC

1. Standards and projects of
SC 24/WG 9 on
Metaverse and Interverse
Takeshi Kurata
Convenor, ISO/IEC JTC 1/SC 24 WG 9
(Human Augmentation Research Center, AIST, Japan)
ISO/IEC Workshop on Standards for the Metaverse
Session 1: ISO/IEC JTC 1 Standards and Projects for the Metaverse,
June 26, 2023, at 21:00-22:50 UTC

2. Presentation Summary
• The relationship between the metaverse and the
universe corresponds to the one between the virtual
environment and the real environment in MAR (Mixed
and Augmented reality).
• The concept of fusing multiple metaverses with the
universe is sometimes referred to as the interverse,
although this is not yet generally recognized.
• This presentation will provide an overview of the
standards related to the metaverse and the interverse
developed by SC 24/WG 9 (MAR Continuum Concepts
and Reference Model) and the ongoing projects.
• In addition, VRM, an open 3D humanoid avatar format
for the metaverse, will be presented, although it is not
yet a de jure standard.
2

3. Metaverse, (Digital) Multiverse,
Omniverse, Interverse, etc.
• Interverse
• The concept of fusing digital multiverse with the universe
• Virtual economy forms and related technologies that return value in cyberspace to
physical space (by Cabinet Office, Government of Japan)
3
https://www.techtarget.com/searchcio/tip/Metaverse-vs-multiverse-vs-omniverse-Key-differences
https://ivrc.net/2023/en/toppage/
https://www.w3.org/2008/WebVideo/Annotations/wiki/images/1/19/MetaverseRoadmapOverview.pdf
Source: Metaverse Roadmap 2008
Source: SIP, Cabinet Office, Government of Japan

4. Standards and projects by SC 24/WG9
• ISO/IEC 18039:2019 MAR reference model
• ISO/IEC 18038:2020 Sensor representation in MAR
• ISO/IEC 18040:2019 Live actor and entity representation in MAR
• ISO/IEC 23488:2022 Object/environmental representation for image-
based rendering in VR/MAR
• ISO/IEC TS 23884:2021 Material property and parameter representation
for model-based haptic simulation of objects in VR/MAR
• ISO/IEC PRF 3721 (Formerly 3721-1) Information model for MAR content
— Core objects and attributes
• ISO/IEC PRF 21145 (Formerly 3721-2) Style representation for MAR
• ISO/IEC AWI TR 16088 Constructs for Visual Positioning Systems in MAR
• ISO/IEC 18520:2019 Benchmarking of vision-based spatial registration
and tracking methods for MAR
• ISO/IEC AWI 21134 Benchmarking of integrated indoor localization and
tracking methods using dead reckoning
4
PRF: Proof of a new International Standard
AWI: Approved new Work Item

5. MAR Reference Architecture (in ISO/IEC 18039)
5

6. Table of contents (ISO/IEC 18039)
6
•Scope
•Motivation
•Terms and Definitions / Symbols
•MAR Domain and Concepts
•MAR RM Usage Example
•Reference System Architecture
–Viewpoints
–Enterprise
–Computational
–Informational
•MAR Classification Framework
•MAR System Classes
•Conformance
•Performance
•Safety
•Security
•Privacy
•Annex (Informative)
–A: Patent Statements
–B: Use Cases and Coverage by
MAR RM
–C: Existent AR Solutions
(Research)
–D: Existent AR Solutions
(Commercial)

7. Sensor representation in MAR (ISO/IEC 18038)
7
a) Representation of physical sensors in a 3D scene;
b) Definition of physical sensors in a 3D scene;
c) Representation of functionalities of each physical sensor in a 3D scene;
d) Representation of physical properties of each physical sensor in a 3D scene;
e) Management of physical sensors in a 3D scene;
f) Interface with physical sensor information in a 3D scene.
System architecture for physical sensor
representation
Sensor scene graph for a 3D MAR scene

8. Live actor and entity representation in MAR
(ISO/IEC 18040)
8
Live Actor and Entity (LAE): Representation of a living physical or real object,
such as a human being, animal or bird, in the MAR content or system
a) Definitions for an LAE in MAR;
b) Representation of an LAE;
c) Representation of properties of an LAE;
d) Sensing of an LAE in a physical world;
e) Integration of an LAE into a 2D/3D virtual
scene;
f) Interaction between an LAE and objects in
a 2D/3D virtual scene;
g) Transmission of information related to an
LAE in an MAR scene.
System framework for an LAE in an MAR scene

9. Benchmarking of vision-based spatial registration
and tracking methods for MAR (ISO/IEC 18520)
9
• Main Body
• Terms and Definitions
• Benchmarking processes
• Benchmark indicators
• Trial set for benchmarking
• Conformance
• Annex A: Benchmarking activities
• Annex B: Usage examples of conformation checklists
• Annex C: Conceptual relationship between this document and other
standards

10. Benchmarking of vision-based spatial registration
and tracking methods for MAR (ISO/IEC 18520)
10
vSRT: Vision-based spatial registration and tracking
Benchmarking Process Flow, Example of stakeholders and their roles

11. 11
https://unit.aist.go.jp/harc/xDR-Challenge-2023/
Standardization on
MAR related sensing
benchmarking through
grassroot competition
activities
Call for participation
NOW!
(Good for summer
projects)
ISO/IEC 18520:2019 Benchmarking of vision-based spatial registration and tracking methods for MAR
ISO/IEC AWI 21134 Benchmarking of integrated indoor localization and tracking methods using dead reckoning

12. Standards and projects by SC 24/WG9
ISO/IEC 18039:2019
MAR reference model
ISO/IEC 18038:2020 Sensor
representation in MAR
ISO/IEC PRF 3721
Information model for
MAR content — Core
objects and attributes
ISO/IEC PRF 21145
Style representation for MAR
ISO/IEC TS 23884:2021
Material property and parameter
representation for model-based
haptic simulation of objects in
VR/MAR
ISO/IEC 23488:2022
Object/environmental
representation for image-
based rendering in VR/MAR
ISO/IEC 18040:2019
Live actor and entity
representation in MAR
ISO/IEC AWI TR 16088 Constructs for
Visual Positioning Systems in MAR
ISO/IEC AWI 21134 Benchmarking of integrated indoor
localization and tracking methods using dead reckoning
ISO/IEC 18520:2019 Benchmarking of vision-based
spatial registration and tracking methods for MAR

13. Standards and projects by SC 24/WG9
ISO/IEC 18039:2019
MAR reference model
ISO/IEC 18038:2020 Sensor
representation in MAR
ISO/IEC PRF 3721
Information model for
MAR content — Core
objects and attributes
ISO/IEC PRF 21145
Style representation for MAR
ISO/IEC TS 23884:2021
Material property and parameter
representation for model-based
haptic simulation of objects in
VR/MAR
ISO/IEC 23488:2022
Object/environmental
representation for image-
based rendering in VR/MAR
ISO/IEC 18040:2019
Live actor and entity
representation in MAR
ISO/IEC AWI TR 16088 Constructs for
Visual Positioning Systems in MAR
ISO/IEC AWI 21134 Benchmarking of integrated indoor
localization and tracking methods using dead reckoning
ISO/IEC 18520:2019 Benchmarking of vision-based
spatial registration and tracking methods for MAR

14. VRM: Platform-independent handling of humanoid
character 3D model data
14
https://www.youtube.com/live/TI17Ql
dPX60?feature=share&t=2851
The Metaverse in Japan and its
Unique Quirks / XR Kaigi mini
One of the most popular avatar
formats in Japan.

15. VRM: Platform-independent handling of humanoid
character 3D model data
15
https://vrm-consortium.org/en/
• Based on the 3D standard format glTF2.0, with additional constraints and
extensions for handling humanoid models which make it easy to implement.
• All data, including textures and materials, can be handled in a single file.
• There are standard configurations for elements such as scale (1.00 = 1m),
coordinate system and orientation (Y-up, -Z), bone structure (Unity Humanoid
compliant configuration, T-stance, no local rotation for each bone), etc., which are
all unaffected by differences in modeling tools.
• Techniques for handling "character expressions" such as Blend Shape and material
transparency are absorbed by the VRM side so as to be operated with a unified API.
• Support for "information for reproducing the first-person perspective" for avatars
• A standard, customizable implementation for "shaking objects" independent of
the physics engine, such as character hair.
• Materials (shaders) available as standard implementations. In addition to the
standard PBR, toon shading and Unlit rendering can also be configured.
• Meta-information such as title and author name, as well as avatar-specific license
information, can be included.
• A standard implementation (UniVRM) in c# that can import and export VRM file in
Unity is released as open source.

16. VRM: Platform-independent handling of humanoid
character 3D model data
16
VRChat (via VRM Converter for VRChat)
Popular metaverse services in Japan that can import and/or export avatar data in VRM formats.
MY VKET
VirtualCast
cluster

17. VRM: 3D humanoid avatar format for the metaverse
• VRM Consortium
• Established in 2019 to develop and disseminate the "VRM" file
format for 3D avatars.
• Joined MetaverseStandardsForum in June, 2022.
• WG 9 will discuss the benefits of making VRM a de jure
standard and the coordination necessary for it
• Potential collaboration between VRM consortium and HAnim
practitioners in X3D (SC 24/WG 6).
17
https://vrm-consortium.org/en/
https://vrm.dev/en/vrm1/index.html