Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment
Definition
Real Environment Data In (RE Data In) consists of a wide variety of Data Types extracted from the Real Environment (as specified by Qualifiers) including the Performance (Performers and associated objects including stage or performance set), Participants, and Operators and any Control Data issued by them.
Functional Requirements
RE Data In includes data describing three elements of the Real Environment:
- Performance Data includes data describing all elements of the entire Real Environment scene (e.g., stage, props and set pieces, lighting, FX), and performer data (e.g., MoCap, Volumetric, Biometric).
- Participants Data includes data describing Participants’ individual and group behaviour (e.g., video, audio, app responses).
- Operator Data includes data from show operator consoles (Audio, Video, Lighting, and Control).
Data entering the XRV-LTP includes the following categories:
- Control Data includes data from apps, lighting fixtures, special effects, DJ and VJ consoles, rigging, elevator stages, prop motions, pyro, performer and participant devices, and miscellaneous sensors whose form is referenced in Control Qualifier.
- Audio Data includes audio from microphones, audio players, and all other audio sources.
- Visual Data includes visual data from 2D/3D cameras, video servers, and all other video sources.
- Motion Capture Data includes performer motion and object motion tracking data.
- LiDAR Data includes scans of performance and participant areas.
- Biometric Data includes biometric measures of performers and participants.
- Time Code Data as required for show synchronisation.
Syntax
https://schemas.mpai.community/XRV1/V1.0/data/REDataIn.json
Semantics
| Label | Description |
|---|---|
| Header | RE Data In Header. Shall have constant value “XRV-RDI-V1.0”. |
| MInstanceID | Identifier of the M-Instance (Virtual Space) associated with this RE Data In instance. |
| UEnvironmentID | Identifier of the User Environment. |
| REDataInID | Identifier of RE Data In. |
| REDataInTime | Time information of RE Data In expressed using SimpleTime. |
| REDataIn | Container of Real Environment data from performance, participants, and operators. |
| – AudioObjects[] | Array of Audio Objects. |
| – AudioObjectTime | Time associated with the AudioObject. |
| – AudioObject | Audio Object as defined in OSD V1.5. |
| – 3DModelObjects[] | Array of 3D Model Objects. |
| – 3DModelObjectTime | Time associated with the 3DModelObject. |
| – 3DModelObject | 3D Model Object as defined in OSD V1.5. |
| – VisualObjects[] | Array of Visual Objects. |
| – VisualObjectTime | Time associated with the VisualObject. |
| – VisualObject | Visual Object as defined in OSD V1.5. |
| – MoCapObjects[] | Array of MoCap Objects. |
| – MoCapObjectTime | Time associated with the MoCapObject. |
| – MoCapObject | MoCap Object as defined in PAF V1.6. |
| – LiDARObjects[] | Array of LiDAR Objects. |
| – LiDARObjectTime | Time associated with the LiDARObject. |
| – LiDARObject | LiDAR Object as defined in OSD V1.5. |
| – BiometricDataSets[] | Array of Biometric Data sets. |
| – BiometricData | Biometric Data as defined in AIH-HSP V1.1. |
| – AppDataSets[] | Array of App Data sets. |
| – AppData | Application data expressed as string according to venue specifications. |
| – ControlObjects[] | Array of Control Objects. |
| – ControlObject | Control Object as defined in XRV1 V1.0. |
| – TimeCodes[] | Time Code Data as required for show synchronisation. |
| – TimeCodeTime | Time associated with the Time Code, expressed using SimpleTime. |
| – TimeCode | Time Code value (e.g., SMPTE hh:mm:ss:ff). |
| DataXMData | MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this RE Data In instance in a trusted data exchange context. |
| DescrMetadata | Descriptive metadata. |
