1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

Descriptors that are based on performance data form the Virtual Environment (objects and avatars) and have a form that is suitable for interpretation (e.g., Face and Gestures) in addition to providing Descriptors to determine cue points.

 

2. Functional Requirements

  1. Avatar Descriptors (may be driven by performers or algorithms)
    1. Spatial position of Avatar
      1. Per area/zone
      2. Ground/air
    2. Descriptors of Avatar motion (driven by Script determining which Avatars are of inter)
      1. Position and Orientation (Spatial Attitude, see MPAI-OSD)
      2. Face and Gestures (See MPAI-PAF)
      3. Dancing/stationary
      4. Social clustering
      5. Gaze direction (head and eye tracking).
    3. Avatar audio activity
        1. Text uttered by Avatar.
        2. Avatar’s audio activity:
          1. Speaking
          2. Laughing
          3. Clapping
          4. Booing
          5. Shouting
          6. Singing
  2. Object Descriptors – all non-avatar objects and associated parameters including:
    1. Meshes with materials (terrain, foliage, etc.).
    2. Light sources and their parameters.
    3. Particles and their parameters.
    4. Effects such as fog, volumetric rays, fire, etc.
    5. Position and Orientation (Spatial Attitude) of all meshes, lights, particles, and effects.
    6. Other data (events, triggers, scene changes, etc.)
  3. Biometric descriptors of the performer represented in the Virtual Environment.
    1. Heart rate and Heart rate variability (HRV).
    2. Brain state from EEG data (delta, theta, alpha, beta, gamma).
    3. Galvanic Skin Response (Electrodermal Activity).
    4. Myoelectric intensity per electrode site.
    5. Skin temperature.

3. Syntax

4. Semantics