1. Definition | 2. Functional Requirements | 3. Syntax | 4. Semantics |
1. Definition
The focused status data obtained by interpreting the individual and collective behaviour of Participants in the Real Environment by interpreting the Descriptors, per the current Cue Point as needed by the Action Generation AIM to service the current cue point.
2. Functional Requirements
- Collective clustering:
- Spatial info
- Coordinates of cluster centroids.
- Variances along the three principal axes.
- Percentage of total Participants in each cluster.
- Cluster property
- Visual Behaviour
- Visual Activity: AnyOf Clapping, Dancing, Gazing at a direction, Hand waving, Jumping, Pointing to a direction, Raising arms, Stadium wave, Stand/Sit
- Supplementary data:
- Hands waving left to right/right to left
- Standing or Sitting
- Relevant objects in gaze direction.
- Audio Behaviour
- Audio Activity: anyOf Booing, Clapping, Laughing, Shouting, Singing, Speaking.
- Supplementary data: Intensity.
- Visual Behaviour
- Spatial info
- Individual Status
- Participant ID
- Distance of individual Participant from the centroid.
- Visual Behaviour
- Visual Activity: AnyOf Clapping, Dancing, Gazing at a direction, Hand waving, Jumping, Pointing to a direction, Raising arms, Stadium wave, Stand/Sit
- Supplementary data:
- Hands waving left to right/right to left
- Standing or Sitting
- Relevant objects in gaze direction.
- Audio Behaviour
- Audio Activity: anyOf Booing, Clapping, Laughing, Shouting, Singing, Speaking.
- Supplementary data: Intensity.
3. Syntax
https://schemas.mpai.community/XRV1/V1.0/data/REParticipantStatus.json
4. Semantics
Label | Description |
Header | RE Participant Status Header |
– Standard-REParticipantStatus | The characters “XRV-RTS-V” |
– Version | Major version – 1 or 2 characters |
– Dot-separator | The character “.” |
– Subversion | Minor version – 1 or 2 characters |
UEnvironmentID | ID of U-Environment. |
REParticipantStatusID | Identifier of RE Participant Status |
REParticipantStatusTime | Time of RE Participant Status. |
AudioVisualSceneDescriptors | Descriptors of AV Scene. |
REParticipantStatusData | Data of RE Participant Status |
– IndividualStatus[] | Collection of Statuses of individual Participants. |
– ParticipantID | ID of one Participant. |
– AudioBehaviour | Participant’s behaviour in terms of Audio. |
– VisualBehaviour | Participant’s behaviour in terms of Visual. |
– Personal Status | Of Participant. |
– ParticipantClusters[] | Social Clustering related data. |
– ClusterID | ID of Cluster. |
– CentroidPosition | Position of Centroid. |
– PrincipalAxes | Principal axes of Cluster. |
– PrincipalAxesVariances | Variances of Participant coordinates along Cluster axes. |
– ParticipantPercentage | Percentage of total participant in Cluster. |
– Participants[] | Data of Participants in Cluster |
– ParticipantID | ID of Participant |
– DistanceFromCentroid | Position of Participant |
– AudioBehaviour | Cluster’s Audio Behaviour |
– VisualBehaviour | Cluster’s Visual Behaviour |
DescrMetadata | Descriptive Metadata |