1. Definition | 2. Functional Requirements | 3. Syntax | 4. Semantics |
1. Definition
The ensemble of Real-time Data from the Real and Virtual Environment converted to the internal XRV formats.
2. Functional Requirements
2.1 Real Environment
2.1 .1 RE Performance Data
Data collected from performers and scene including the stage:
- Semantics per Venue Specification and Associations of the following:
- Lighting fixture status
- Special effect status
- Musical instrument Data
- Other data
- Live audio and video streams
- Volumetric performers and objects.
- Motion captured performers and objects.
- LiDAR captured performers and objects.
- Biometric sensor data.
2.1.2 RE Participants Data
Data collected from participants, including:
- Audio and video sources
- Volumetric of participants
- LiDAR of participants
- Biometric sensors.
- Miscellaneous sensors – Semantics per Venue Specification and Associations.
2.1.3 RE Operator Data
Data collected from operator consoles:
- Semantics of the following per Venue Specification and Associations.
- Lighting
- Special effects
- Audio and video consoles
- DJ and VJ consoles
- Show control consoles
- Other data
2.1 Virtual Environment
Data provided via metaverse API.
2.2.1 VE Performance Data
Performance Data includes data describing all elements of the entire Virtual Environment Scene (including terrain, foliage, architectural structures, performers’ avatars, autonomous avatars) and their properties (Spatial Attitudes, animations, lighting, textures/materials, and effects).
2.2.2 VE Participants Data
Participants Data includes data describing participants’ avatars and their properties (Spatial Attitudes, animations, lighting, textures/materials, and effects).
2.2.3 VE Operator Data
Operator Data includes data from remote show operators acting within the metaverse.
3. Syntax
https://schemas.mpai.community/XRV1/V1.0/data/ShowData.json
4. Semantics
Label | Size | Description |
Header | N1 Bytes | Show Data Header |
– Standard-ShowSata | 9 Bytes | The characters “XRV-SHD-V” |
– Version | N2 Bytes | Major version – 1 or 2 characters |
– Dot-separator | 1 Byte | The character “.” |
– Subversion | N3 Bytes | Minor version – 1 or 2 characters |
MInstanceID | N4 Bytes | Identifier of M-Instance. |
ShowDataID | N5 Bytes | Identifier of VE Performance Descriptors |
ShowDataSpaceTime | N6 Bytes | Space-Time info of VE Performance Descriptors. |
ShowDataDescriptors | N7 Bytes | Set of VE Performance Descriptors |
– Real Environment | N8 Bytes | Show data from RE |
– RE Performance Data | Performance Data from RE | |
– Lighting fixture status | Semantics per Venue Spec. and Associations | |
– Special effect status | Semantics per Venue Spec. and Associations | |
– Musical instrument Data | Semantics per Venue Spec. and Associations | |
– Other data | Semantics per Venue Spec. and Associations | |
– Performer Data | ||
– Audio | ||
– Visual | ||
– Motion | ||
– Biometric sensor data. | ||
– Object Data | ||
– Audio | ||
– Visual | ||
– Motion | ||
– RE Participants Data | ||
– Audio Data | ||
– Visual Data | ||
– Biometric sensors | ||
– Miscellaneous sensors | Semantics per Venue Spec. and Associations. | |
– RE Operator Data | ||
– Lighting | Semantics per Venue Spec. and Associations. | |
– Special effects | Semantics per Venue Spec. and Associations. | |
– Audio & video consoles | Semantics per Venue Spec. and Associations. | |
– DJ and VJ consoles | Semantics per Venue Spec. and Associations. | |
– Show control consoles | Semantics per Venue Spec. and Associations. | |
– Other data | Semantics per Venue Spec. and Associations. | |
– Virtual Environment | Data provided via metaverse API. | |
– VE Performance Data | Data provided via metaverse API. | |
– VE Participants Data | Data provided via metaverse API. | |
– VE Operator Data | Data provided via metaverse API. |