1. Definition 2. Functional Requirements 3. Syntax 4. Semantics

1. Definition

The focused status data obtained by interpreting the individual and collective behaviour of Participants in the Real Environment by interpreting the Descriptors, per the current Cue Point as needed by the Action Generation AIM to service the current cue point.

2. Functional Requirements

  1. Collective clustering:
    1. Spatial info
      1. Coordinates of cluster centroids.
      2. Variances along the three principal axes.
      3. Percentage of total Participants in each cluster.
    2. Cluster property
      1. Visual Behaviour
        1. Visual Activity: AnyOf Clapping, Dancing, Gazing at a direction, Hand waving, Jumping, Pointing to a direction, Raising arms, Stadium wave, Stand/Sit
        2. Supplementary data:
          1. Hands waving left to right/right to left
          2. Standing or Sitting
          3. Relevant objects in gaze direction.
      2. Audio Behaviour
        1. Audio Activity: anyOf Booing, Clapping, Laughing, Shouting, Singing, Speaking.
        2. Supplementary data: Intensity.
  2. Individual Status
    1. Participant ID
    2. Distance of individual Participant from the centroid.
    3. Visual Behaviour
      1. Visual Activity: AnyOf Clapping, Dancing, Gazing at a direction, Hand waving, Jumping, Pointing to a direction, Raising arms, Stadium wave, Stand/Sit
      2. Supplementary data:
        1. Hands waving left to right/right to left
        2. Standing or Sitting
        3. Relevant objects in gaze direction.
    4. Audio Behaviour
      1. Audio Activity: anyOf Booing, Clapping, Laughing, Shouting, Singing, Speaking.
      2. Supplementary data: Intensity.

3. Syntax

https://schemas.mpai.community/XRV1/V1.0/data/REParticipantStatus.json

4. Semantics

Label Description
Header RE Participant Status Header
– Standard-REParticipantStatus The characters “XRV-RTS-V”
– Version Major version – 1 or 2 characters
– Dot-separator The character “.”
– Subversion Minor version – 1 or 2 characters
UEnvironmentID ID of U-Environment.
REParticipantStatusID Identifier of RE Participant Status
REParticipantStatusTime Time of RE Participant Status.
AudioVisualSceneDescriptors Descriptors of AV Scene.
REParticipantStatusData Data of RE Participant Status
– IndividualStatus[] Collection of Statuses of individual Participants.
  – ParticipantID ID of one Participant.
  – AudioBehaviour Participant’s behaviour in terms of Audio.
  – VisualBehaviour Participant’s behaviour in terms of Visual.
  – Personal Status Of Participant.
– ParticipantClusters[] Social Clustering related data.
  – ClusterID ID of Cluster.
    – CentroidPosition Position of Centroid.
    – PrincipalAxes Principal axes of Cluster.
    – PrincipalAxesVariances Variances of Participant coordinates along Cluster axes.
    – ParticipantPercentage Percentage of total participant in Cluster.
  – Participants[] Data of Participants in Cluster
    – ParticipantID ID of Participant
    – DistanceFromCentroid Position of Participant
    – AudioBehaviour Cluster’s Audio Behaviour
    – VisualBehaviour Cluster’s Visual Behaviour
  DescrMetadata Descriptive Metadata