1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

The focused status data obtained by observing the individual and collective behaviour of Performers and Objects in the Virtual Environment by interpreting the descriptors, per the current Cue Point. including object and performer Behaviours and Personal Status (Emotion, Cognitive State, and Social Attitude), as needed by .he Action Generation AIM to service the current cue point.

2. Functional Requirements

Components from the virtual environment: (data describing any and all “objects” and avatars from the Virtual Environment)

  1. Avatar Descriptors (may be driven by performers or algorithms)
    1. Spatial Attitude of Avatar
      1. Per area/zone
      2. Ground/air
    2. Descriptors of Avatar motion (driven by Script determining which Avatars are of inter)
      1. Spatial Attitude
      2. Face and Gestures
      3. Dancing/stationary
      4. Social clustering
      5. Gaze direction
    3. Avatar audio activity
      1. Performer doing a certain activity, e.g., Laughing, Clapping, Booing, Shouting, Singing
      2. Intensity of the Performer’s activity
      3. Particular phrase/text uttered
  1. Object Descriptors – all non-avatar objects and associated parameters including:
    1. Meshes with materials (terrain, foliage, etc.).
    2. Light sources and their parameters.
    3. Particles and their parameters.
    4. Effects such as fog, volumetric rays, fire, etc.
    5. Position and Orientation (Spatial Attitude) of all meshes, lights, particles, and effects.
    6. Other data (events, triggers, scene changes, etc.)

3. Syntax

4. Semantics

Label Description
Header RE Performance Status Header
– Standard-REPerformanceStatus The characters “XRV-RFS”
– Version Major version – 1 or 2 characters
– Dot-separator The character “.”
– Subversion Minor version – 1 or 2 characters
MInstanceID ID of M-Instance.
UEnvironmentID ID of U-Environment connect to M-Instance.
VEPerformanceStatusID Identifier of RE Performance Status.
VEPerformanceStatusTime Time of RE Performance Status.
VEAudioVisualSceneDescriptors Descriptors of AV Scene (VE).
VEPerformanceStatusData Data of RE Performance Status.
– IndividualStatus[] Collection of Statuses of individual Performers.
  – VEPerformerID ID of one Performer.
  – AvatarIDOr Avatar Performer’s Avatar.
  – AudioBehaviour Performer’s behaviour in terms of Audio.
  – VisualBehaviour Performer’s behaviour in terms of Visual.
  – Personal Status Performer’ Personal Status.
  – BrainwaveFrequencies Value of Alpha, Theta, Delta, Beta, Gamma frequencies.
  – BiometricData Per Biometric Data specificarion.
– CollectiveStatus[] Collection of Statuses of groups of Performers.
  – PerfomerGroupID ID of the group of Performers.
  – CentroidPosition Position of Group Centroid.
  – PrincipalAxes Principal Axes of Group.
  – PrincipalAxesVariances Variances along Principal Axes
  – PerformerPercentage Number of Performers in the Group by total number of Performers.
  – BrainwaveFrequencies Average value of Alpha, Theta, Delta, Beta, Gamma frequencies.
  – AudioBehaviour Group of Performers’ behaviour in terms of Audio.
  – VisualBehaviour Group of Performers’ behaviour in terms of Visual.
  – GazingPerformers[] Configuration of Gazing Performers.
    – Performer1ID ID of Gazing Performer.
    – Performer2ID ID of Gazed Performer.
  – PerformerDistances[] Configuration of inter-Performers’ distances.
    – PerformerID ID of one Performer.
      – PerformerID ID of all other Performers.
– Objects[] Set Pieces of Stage.
  – ObjectID ID of Set Piece.
  – Object Actual Object.
  – SpatialAttitude Set Piece’s Spatial Attitude.
  – ControlData[] Set of Data Generated by Set Pieces.
  – ControlDataID Data meaning anyOf: encoder, trigger, measuring device, motion sensor proximity sensor.
– VECameraData
  – VEVisualObject
  – VEAudioObject
  – Spatial Attitude
DescrMetadata Descriptive Metadata