1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

The ensemble of Real-time Data from the Real and Virtual Environment converted to the internal XRV formats.

2. Functional Requirements

2.1 Real Environment

2.1 .1      RE Performance Data

Data collected from performers and scene including the stage:

  1. PerformerID
  2. Semantics per Venue Specification and Associations of the following:
    1. Lighting fixture status
    2. Special effect status
    3. Musical instrument Data
    4. Other data
  3. Live audio and video streams
  4. Volumetric performers and objects.
  5. Motion captured performers and objects.
  6. LiDAR captured performers and objects.
  7. Biometric sensor data.

2.1.2       RE Participants Data

Data collected from participants, including:

  1. PsrtivcipantID
  2. Audio and video sources
  3. Volumetric of participants
  4. LiDAR of participants
  5. Biometric sensors.
  6. Miscellaneous sensors – Semantics per Venue Specification and Associations.

2.1.3       RE Operator Data

Data collected from operator consoles:

  1. Semantics of the following per Venue Specification and Associations.
    1. Lighting
    2. Special effects
    3. Audio and video consoles
    4. DJ and VJ consoles
    5. Show control consoles
    6. Other data

2.1 Virtual Environment

Data provided via metaverse API.

2.2.1    VE Performance Data

Performance Data includes data describing all elements of the entire Virtual Environment Scene (including terrain, foliage, architectural structures, performers’ avatars, autonomous avatars) and their properties (Spatial Attitudes, animations, lighting, textures/materials, and effects).

2.2.2       VE Participants Data

Participants Data includes data describing participants’ avatars and their properties (Spatial Attitudes, animations, lighting, textures/materials, and effects).

2.2.3       VE Operator Data

Operator Data includes data from remote show operators acting within the metaverse.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/ShowData.json

4. Semantics

Label Size Description
Header N1 Bytes Show Data Header
– Standard-ShowSata 9 Bytes The characters “XRV-SHD-V”
– Version N2 Bytes Major version – 1 or 2 characters
– Dot-separator 1 Byte The character “.”
– Subversion N3 Bytes Minor version – 1 or 2 characters
MInstanceID N4 Bytes Identifier of M-Instance.
ShowDataID N5 Bytes Identifier of VE Performance Descriptors
ShowDataSpaceTime N6 Bytes Space-Time info of VE Performance Descriptors.
ShowDataDescriptors N7 Bytes Set of VE Performance Descriptors
– Real Environment N8 Bytes Show data from RE
  – RE Performance Data Performance Data from RE
    – Lighting fixture status Semantics per Venue Spec. and Associations
    – Special effect status Semantics per Venue Spec. and Associations
    – Musical instrument Data Semantics per Venue Spec. and Associations
    – Other data Semantics per Venue Spec. and Associations
    – Performer Data
      – Audio
      – Visual
      – Motion
      – Biometric sensor data.
    – Object Data
      – Audio
      – Visual
      – Motion
  – RE Participants Data
    – Audio Data
    – Visual Data
    – Biometric sensors
    – Miscellaneous sensors Semantics per Venue Spec. and Associations.
  – RE Operator Data
    – Lighting Semantics per Venue Spec. and Associations.
    – Special effects Semantics per Venue Spec. and Associations.
    – Audio & video consoles Semantics per Venue Spec. and Associations.
    – DJ and VJ consoles Semantics per Venue Spec. and Associations.
    – Show control consoles Semantics per Venue Spec. and Associations.
    – Other data Semantics per Venue Spec. and Associations.
– Virtual Environment Data provided via metaverse API.
  – VE Performance Data Data provided via metaverse API.
  – VE Participants Data Data provided via metaverse API.
  – VE Operator Data Data provided via metaverse API.