1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are based on performance data from the Virtual Environment (objects and avatars) as received through the metaverse API and have a form that is suitable for the Performance Status AIM to extract interpretations to determine Cue Points.

2. Functional Requirements

Data acquired via the metaverse API:

  1. Avatar Descriptors (may be driven by performers or be NPCs)
    1. Avatar ID
    2. Descriptors of Avatar motion
      1. Position and Orientation (Spatial Attitude)
      2. Face and Gestures
      3. Eye tracking (Face Descriptors)
  2. Object Descriptors – all non-avatar objects and associated parameters including:
    1. Object instance
    2. Position and Orientation (Spatial Attitude)
    3. Additional Descriptors if accessible via Metaverse API.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/VEPerformanceDescriptors.json

4. Semantics

Label Description
Header VE Performance Descriptors Header
– Standard-VEPerformanceDescriptors The characters “XRV-VFD-V”
– Version Major version – 1 or 2 characters
– Dot-separator The character “.”
– Subversion Minor version – 1 or 2 characters
MInstanceID Identifier of M-Instance.
UEnvironmentID
 ID of U-Environment connected with M-Instance.
VEPerformanceDescriptorsID Identifier of VE Performance Descriptors
VEPerformanceDescriptorsTime Space-Time info of VE Performance Descriptors.
AudioVisualSceneDescriptors Descriptors of the Virtual Scene.
VEPerformanceDescriptors Set of VE Performance Descriptors
– AvatarDescriptors[] Set od Avatar Descriptors
  – AvatarID Avatar ID
  – AvatarSpatialAttitude Avatar’s Spatial Attitude
  – Avatar Avatar of one Performer
  – SpeechObject Avatar’s Speech
– ObjectDescriptors[] Set of Object Descriptors
  – ObjectID Object instance ID
  – ObjectSpatialAttitude Object’s Spatial Attitude
  – Other Descriptors If accessible via Metaverse API per Metaverse Qualifier semantics.
DescrMetaData Descriptive Metadata