Definition

Personal Status is a Data Type composed of three Factors:

  1. Emotion (such as “angry” or “sad”).
  2. Cognitive State (such as “surprised” or “interested”).
  3. Social Attitude (such as “polite” or “arrogant”).

Factors can be expressed via several Modalities: Text, Speech, Face, and Gestures. (Other Modalities, such as body posture, may be handled in future MPAI Versions.)

Within a given Modality, the Factors can be analysed and interpreted via various Descriptors. For example, when expressed via Speech, the elements may be expressed through combinations of such features as prosody (pitch, rhythm, and volume variations); separable speech effects (such as degrees of voice tension, breathiness, etc.); and vocal gestures (laughs, sobs, etc.).

Each of Emotion, Cognitive State, and Social Attitude Factors is represented by a standard set of labels and associated semantics. For each of these Factors, two tables are provided:

  • A Label Set Table containing descriptive labels relevant to the Factor in a three-level format:
    • The CATEGORIES column specifies the relevant categories using nouns (e.g., “AN-GER”).
    • The GENERAL ADJECTIVAL column gives adjectival labels for general or basic la-bels within a category (e.g., “angry”).
    • The SPECIFIC ADJECTIVAL column gives more specific (sub-categorised) labels in the relevant category (e.g., “furious”).
  • A Label Semantics Table providing the semantics for each label in the GENERAL AD-JECTIVAL and SPECIFIC ADJECTIVAL columns of the Label Set Table. For example, for “angry” the semantic gloss is “emotion due to perception of physical or emotional damage or threat.”

These sets have been compiled in the interests of basic cooperation and coordination among AIM submitters and vendors complemented by a procedure whereby AIM submitters may propose extended or alternate sets for their purposes.

An Implementer wishing to extend or replace a Label Set Table for one of the three Factors is requested to do the following:

  1. Create a new Label Set Table where:
    1. Proposed additions are clearly marked (in case of extension).
    2. b. All the elements of the target Factor and levels (up to 3) are listed (in case of replacement).
  2. Create a new Label Semantics Table where the semantics of elements of the target Factor is:
    1. Added to the semantics of the existing target Factor (in case of extension).
    2. Provided (in case of replacement).
      The submitted semantics should have a level of detail comparable to the semantics given in the current Label Semantics Table.
  3. Submit both tables to the MPAI Secretariat (secretariat@mpai.community).

The appropriate MPAI Development Committee will examine the proposed extension or replac­ement. Only the adequacy of the proposed new tables in terms of clarity and completeness will be considered. In case the new tables are not clear or complete, a revision of the tables will be requested.

The accepted External Factor Set will be identified as proposed by the submitter and reviewed by the appropriate MPAI Committee and posted to the MPAI web site.

The versioning system is based on a name – MPAI for MPAI-generated versions or “organisation name” for the proposing organisation – with a suffix m.n where m indicates the version and n indicated the subversion.

Syntax

https://schemas.mpai.community/MMC/V2.1/data/PersonalStatus.json

Semantics

  1. Timestamp type can either be:
    • Absolute time (A)
    • Relative time, i.e., time from the start of operation (R)
  2. Timestamp value is as in CAE V1.
    • 18 values of Personal Status that include (see Table 17)
      • 6 cells for Emotion.
      • 6 cells for Cognitive State.
      • 6 cells for Social Attitude.

Table 1 – The table of (Factor, Modality) cells

Modality
Version Fused value Text Speech Face Gesture
Factor Emotion V.Emotion
Cognitive State V.Cognitive
Social Attitude V.Attitude
  1. The 18 values in the cells are represented as a vector of 18 values, 6 for each Factor:
    • The first value is the Version of Emotion/Cognitive State/Social Attitude (VE/VC/VA) represented as two fields:
      • Field 1: 2 digits of the Version of the MMC standard (e.g., “12”, meaning version 1.2, is expressed as 2 bytes).
      • Field 2: The sequential number of the Factor dataset. Currently, there is one dataset, given the number 1. New submissions will receive sequential numbers starting from 2, where the sequential number of the dataset is expressed with 1 byte).
    • The second value is the current default fused value of the Modality.
    • Followed by the 4 values of the Modality.
      • The value of Text
      • The value of Speech
      • The value of Face
      • The value of Gesture
    • The list of possible values of a Modality are (values are in bytes):
      • Value 0: unable to compute for any reason; error; or no discernible value.
      • Value 1 up to the largest number of Factor values in the relevant Label Semantics Table.

Therefore, a value of Personal Status is represented by the following table. Timestamp, Emotion, Cognitive State, Social Attitude. Their Descriptors are also present if the information is available.

Table 2 – The variables composing the Personal Status

Variable name Code
Timestamp Timestamp type
Timestamp value
Emotion Emotion version
Fused Emotion value
Text Emotion value
Speech Emotion value
Face Emotion value
Gesture Emotion value
Cognitive State Cognitive State version
Fused Cognitive State value
Text Cognitive State value
Speech Cognitive State value
Face Cognitive State value
Gesture Cognitive State value
Social Attitude Social Attitude version
Fused Social Attitude value
Text Social Attitude value
Speech Social Attitude value
Face Social Attitude value
Gesture Social Attitude value