Go to XRV-LTP Data Types

1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are based on RE Data In from Performers, Objects, and Controllers in the Real Environment and have a form that is suitable for Interpretation (e.g., Position and Orientation, Face and Gestures, Controller Data). Performers may be captured by MoCap, one or more video cameras, and one or more microphones.

2. Functional Requirements

Performance Description AIM generates descriptors conveying information on:

  1. AV Scene Descriptors
  2.  Performers
    1. Performer ID
    2. Visual Performer object
    3. Visual attributes
      1. Position and Orientation
      2. Face and Gestures
    4. Performer Audio
    5. Performer Biometrics:
      1. Heart rate and Heart rate variability (HRV).
      2. Brain state from EEG data (delta, theta, alpha, beta, gamma).
      3. Galvanic Skin Response (Electrodermal Activity).
      4. Myoelectric intensity per electrode site.
      5. Skin temperature.
  3. Objects:
    1. ObjectID
    2. Visual Object Data
    3. Position and Orientation (Spatial Attitude) of set pieces.
    4. Other data (encoders, triggers, measuring devices, motion/proximity sensors, etc.).

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/REPerformanceDescriptors.json

4. Semantics

Label Description
Header RE Performance Descriptors Header. Shall have constant value “XRV-RFD-V1.0”.
MInstanceID Identifier of the M-Instance (Virtual Space) associated with this RE Performance Descriptors instance.
UEnvironmentID ID of U-Environment connect to M-Instance.
REPerformanceDescriptorsID Identifier of RE Performance Descriptors
REPerformanceDescriptorsTime Space-Time info of RE Performance Descriptors
AVSceneDescriptors Descriptors of the AV Scene.
REPerformanceDescriptorsData[] Collection of Performance Descriptions.
– REPerformerID ID of Performer.
– FaceDescriptorsObject Face Descriptors Object as defined in PAF V1.6.
– BodyDescriptorsObject Body Descriptors Object as defined in PAF V1.6.
– SpatialAttitude Spatial Attitude of Performer.
– UtteredSpeech Uttered Speech of Performer.
– BiometricData Biometric data of Performer
– Brainwaves Frequency, in Hz, of each EEG band, per Brainwaves (AIH-BRW).
REObjectDescriptors[] Array of RE Object Descriptors.
– REObjectID oneOf: knob, slider, button.
– SpatialAttitude Spatial Attitude of Object.
– ControlObject Variable Types in RE Venue Specification; signalled by DMX/Midi.
RECameraData[] Array of RE Camera Data.
– REVisualObject Visual Object as defined in OSD V1.5.
– FieldOfView Field of view, in degrees.
– REAudioObject Audio Object as defined in OSD V1.5.
– SpatialAttitude Spatial Attitude of the camera.
DataXMData MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this RE Performance Descriptors instance in a trusted data exchange context.
DescrMetadata Descriptive Metadata

Go to XRV-LTP Data Types