Go to XRV-LTP Data Types

1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are:

  1. Based on performance data (objects and avatars) extracted from the Virtual Environment as received through the metaverse API.
  2. Have a Data Type that is suitable for the Performance Status AIM to extract interpretations and determine Cue Points.

2. Functional Requirements

Data acquired via the metaverse API:

  1. Avatar Descriptors (may be driven by performers or be NPCs)
    1. Avatar ID
    2. Descriptors of Avatar motion
      1. Position and Orientation (Spatial Attitude)
      2. Face and Gestures
      3. Eye tracking (Face Descriptors)
  2. Object Descriptors – all non-avatar objects and associated parameters including:
    1. Object instance
    2. Position and Orientation (Spatial Attitude)
    3. Additional Descriptors if accessible via Metaverse API.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/VEPerformanceDescriptors.json

4. Semantics

Label Description
Header VE Performance Descriptors Header. Shall have constant value “XRV-VFD-V1.0”.
MInstanceID Identifier of M-Instance.
UEnvironmentID ID of U-Environment connected with M-Instance.
VEPerformanceDescriptorsID Identifier of VE Performance Descriptors
VEPerformanceDescriptorsTime Time as defined in OSD V1.5.
AVSceneDescriptors Descriptors of the Virtual Scene.
VEPerformanceDescriptorsData[] Set of VE Performance Descriptors
– VEPerformerID Identifier of VE Performer.
– SpatialAttitude Avatar’s Spatial Attitude
– AvatarOrAvatarID Array of Portable Avatars or Portable Avatar IDs, as defined in PAF V1.6.
– UtteredSpeech Uttered Speech of Performer, as Speech Object defined in OSD V1.5.
– BiometricData Biometric Data as defined in AIH-HSP V1.1.
– Brainwaves Frequency, in Hz, of each EEG band, per Brainwaves (AIH-BRW).
VEObjectDescriptors[] Set of Object Descriptors
– VEObjectID Object instance ID
– VEObject 3D Model Object as defined in OSD V1.5.
– SpatialAttitude Object’s Spatial Attitude
– ControlObject Control Object as defined in XRV1 V1.0.
VECameraData[] Array of VE Camera Data.
– VEVisualObject 3D Model Object as defined in OSD V1.5.
– FieldOfView Field of view, in degrees.
– VEAudioObject Audio Object as defined in OSD V1.5.
– SpatialAttitude Spatial Attitude as defined in OSD V1.5.
DataXMData MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this VE Performance Descriptors instance in a trusted data exchange context.
DescrMetadata Descriptive Metadata

Go to XRV-LTP Data Types