Go to XRV-LTP Data Types

1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are based on RE Data In from Participants and Controllers in the Real Environment and have a form that is suitable for Interpretation (e.g., Position and Orientation, Face and Gestures, Controller Data). The theatre may be split into two or more sections. Participants may be captured by one or more video cameras and one or more microphones per the RE Venue Specification.

2. Functional Requirements

  1. Audio-Visual Scene Descriptors
  2. Seat Arrangement
  3. Participant Description
    1. Participant ID
    2. Spatial Attitude
    3. Descriptors (Speech, Face, Body)
  4. Choice per seat (mobile app, web interface, controller)
    1. Voting
    2. Controller
      1. Spatial Attitude
      2. Actuator type (knob, slider, button)
      3. Values of actuator
      4. Text
  5. Biometric descriptors of the Real Environment participant.
    1. Heart rate and Heart rate variability (HRV).
    2. Brain state from EEG data (delta, theta, alpha, beta, gamma).
    3. Galvanic Skin Response (Electrodermal Activity).
    4. Myoelectric intensity per electrode site.
    5. Skin temperature.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/REParticipantDescriptors.json

4. Semantics

Label Description
Header RE Participant Descriptors Header. Shall have constant value “XRV-RTD-V1.0”.
MInstanceID Identifier of the M-Instance (Virtual Space) associated with this RE Participant Descriptors instance.
UEnvironmentID Identifier of the U-Environment (Real Space) associated with this RE Participant Descriptors instance.
REParticipantDescriptorsID Identifier of RE Participant Descriptors.
REParticipantDescriptorsTime Time info of RE Participant Descriptors
AVSceneDescriptors Descriptors of the portion of the theatre that includes Participants.
SeatOccupation Seat occupation per the Seat Occupation Data Type.
REParticipantDescriptorsData[] Collection of Participant Descriptors
– REParticipantID ID of Participant.
– SeatID Identifier of Seat.
– SpatialAttitude Spatial Attitude of Participant.
– FaceDescriptorsObject Face Descriptors of Participant.
– BodyDescriptorsObject Body Descriptors of Participant.
– ControlObject Control Object of the Participant Controller being described.
– BiometricData BiometricData of Participant.
– Brainwaves Frequency, in Hz, of each EEG band, per Brainwaves (AIH-BRW).
DataXMData MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this RE Participant Descriptors instance in a trusted data exchange context.
DescrMetadata Descriptive Metadata

Go to XRV-LTP Data Types