1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are:

  1. Based on performance data (objects and avatars) extracted from the Virtual Environment as received through the metaverse API.
  2. Have a Data Type that is suitable for the Performance Status AIM to extract interpretations and determine Cue Points.

2. Functional Requirements

Data acquired via the metaverse API:

  1. Avatar Descriptors (may be driven by performers or be NPCs)
    1. Avatar ID
    2. Descriptors of Avatar motion
      1. Position and Orientation (Spatial Attitude)
      2. Face and Gestures
      3. Eye tracking (Face Descriptors)
  2. Object Descriptors – all non-avatar objects and associated parameters including:
    1. Object instance
    2. Position and Orientation (Spatial Attitude)
    3. Additional Descriptors if accessible via Metaverse API.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/VEPerformanceDescriptors.json

4. Semantics

Label Description
Header VE Performance Descriptors Header
– Standard-VEPerformanceDescriptors The characters “XRV-VFD-V”
– Version Major version – 1 or 2 characters
– Dot-separator The character “.”
– Subversion Minor version – 1 or 2 characters
MInstanceID Identifier of M-Instance.
UEnvironmentID
 ID of U-Environment connected with M-Instance.
VEPerformanceDescriptorsID Identifier of VE Performance Descriptors
VEPerformanceDescriptorsTime Space-Time info of VE Performance Descriptors.
AudioVisualSceneDescriptors Descriptors of the Virtual Scene.
VEPerformanceDescriptors Set of VE Performance Descriptors
– AvatarDescriptors[] Set of Avatar Descriptors
  – AvatarID Avatar ID
  – AvatarSpatialAttitude Avatar’s Spatial Attitude
  – SpeakingAvatar Speaking Avatar of one Performer
– ObjectDescriptors[] Set of Object Descriptors
  – ObjectID Object instance ID
  – ObjectSpatialAttitude Object’s Spatial Attitude
  – Other Descriptors If accessible via Metaverse API per Metaverse Qualifier semantics.
DescrMetaData Descriptive Metadata