Go to PGM-AUA V1.0 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

Definition

Real Environment Data In (RE Data In) consists of a wide variety of Data Types extracted from the Real Environment including the Scene (Performers and Stage or Performance Set), Participants, and Operators and any Control Data issued by them.

Functional Requirements

RE Data In includes data describing three elements of the Real Environment:

  • Performance Data includes data describing all elements of the entire Real Environment Scene (e.g., stage, props and set pieces, lighting, FX), and performer data (e.g., MoCap, Volumetric, Biometric).
  • Participants Data includes data describing participants individual and group behaviour (e.g., video, audio, app responses).
  • Operator Data includes data from show operator consoles.

Data entering the XRV-LTP belong to the following categories:

  • Control Data includes data from Lighting fixtures, Special effects, DJ and VJ consoles, rigging, elevator stages, prop motions, pyro, performer and participant devices, and miscellaneous sensors whose form is referenced in Control Qualifier.
  • Audio Data includes audio from microphones and all audio sources.
  • Visual Data includes visual data from 2D/3D cameras, video servers, and all other video sources.
  • Motion Capture Data includes performer motion and object motion tracking data.
  • LiDAR Data includes scans of performance and participant areas.
  • Biometric Data includes biometric measures of performers and participants.
  • Time Code Data as required for show synchronisation.
  • App Data from performer and participant devices.

Syntax

https://schemas.mpai.community/XRV1/V1.0/data/REDataIn.json

Semantics

Label Description
Header RE Data In Header. Shall have constant value “XRV-RDI-V1.0”.
UEnvironmentID Identifier of the User Environment.
REDataInID Identifier of RE Data In.
REDataInTime Time information of RE Data In expressed using SimpleTime.
REDataIn Container of Real Environment data from performance, participants, and operators.
  AudioObjects Array of Audio Objects.
    AudioObjectTime Time associated with the AudioObject.
    AudioObject Audio Object as defined in OSD V1.4.
  3DModelObjects Array of 3D Model Objects.
    3DModelObjectTime Time associated with the 3DModelObject.
    3DModelObject 3D Model Object as defined in OSD V1.4.
  VisualObjects Array of Visual Objects.
    VisualObjectTime Time associated with the VisualObject.
    VisualObject Visual Object as defined in OSD V1.4.
  MoCapObjects Array of MoCap Objects.
    MoCapObjectTime Time associated with the MoCapObject.
    MoCapObject MoCap Object as defined in PAF V1.5.
  LiDARObjects Array of LiDAR Objects.
    LiDARObjectTime Time associated with the LiDARObject.
    LiDARObject LiDAR Object as defined in OSD V1.4.
  BiometricDataSets Array of Biometric Data sets.
    BiometricData Biometric Data as defined in AIH1 V1.0.
  AppDataSets Array of App Data sets.
    AppData Application data expressed as string according to venue specifications.
  ControlObjects Array of Control Objects.
    ControlObject Control Object as defined in XRV1 V1.0.
DescrMetadata Descriptive metadata.

Conformance Testing

Performance Assessment