Go To MPAI-MMC AI Modules

1 Function 2 Reference Model 3 Input/Output Data
4 SubAIMs 5 JSON Metadata 6 Profiles
7 Reference Software 8 Conformance Texting 9 Performance Assessment

1 Functions

Personal Status Extraction (MMC-PSE):

Receives Text Object or Text Descriptors
Text Selector indicating whether Text or Text Descriptors should be used.
Speech Object or Speech Descriptors
Speech Selector indicating whether Speech or Speech Descriptors should be used.
Face or Face Descriptors
Face Selector indicating whether Face or Face Descriptors should be used.
Body or Gesture Descriptors
Body Selector indicating whether Body or Gesture Descriptors should be used.
Computes and then Interprets depending on reception of the Descriptors of a Modality (Text, Speech, or Face).
Text Descriptors alternatively, Interprets the received Descriptors and produces Personal Status of the Text Object (PS-Text).
Speech Descriptors; alternatively, Interprets the received Descriptors and produces Personal Status of the Speech Object (PS-Speech).
Face Descriptors alternatively, Interprets the received Descriptors and produces Personal Status of the Face (PS-Face).
Gesture Descriptors alternatively, Interprets the received Gesture Descriptors of the Body.
Multiplexes The results of the interpretations.
Produces Entity’s Personal Status

2 Reference Model

Figure 1 depicts the Reference Model of the Personal Status Extraction (MMC-PSE) AIM.

Figure 1 – The Personal Status Extraction Composite (MMC-PSE) AIM Reference Model

3 Input/Output Data

Table 1 specifies the Input and Output Data of the Personal Status Extraction (MMC-PSE) AIM.

Table 1 – I/O Data of the Personal Status Extraction (MMC-PSE) AIM

Input data From Description
Input Selector An external signal Media or Descriptors Selector
Text Object Keyboard or AIM Text or Recognised Text.
Text Descriptors An upstream AIM Functionally equivalent to Text Description.
Speech Object Microphone/upstream AIM Speech of Entity.
Speech Descriptors An upstream AIM Functionally equivalent to Speech Description.
Face Visual Object Visual Scene Description The face of the Entity.
Face Descriptors An upstream AIM Functionally equivalent to Face Description.
Body Visual Object Visual Scene Description The body of the Entity.
Gesture Descriptors An upstream AIM Functionally equivalent to Body Description.
Output data To Description
Personal Status A downstream AIM For further processing

4 SubAIMs

A Personal Status Extraction AIM instance can be implemented as a Composite AIM with different degrees of composition. The most extended composition if depicted by Figure 2

Figure 2 – The version of Personal Status Extraction AIM with the highest level of composition.

Table 2 gives the AIMs and their JSON Metadata of MMC-PSE.

Table 2 – AIMs and JSON Metadata

AIMs AIMs AIM Names JSON
MMC-PSE Personal Status Extraction X
MMC-ETD Entity Text Description X
MMC-ESD Entity Speech Description X
PAF-EFD Entity Face Description X
PAF-EBD Entity Body Description X
MMC-PTI PS-Text Interpretation X
MMC-PSI PS-Speech Interpretation X
PAF-PFI PS-Face Interpretation X
PAF-PGI PS-Gesture Interpretation X
MMC-PMX Personal Status Multiplexing X

5 JSON Metadata

https://schemas.mpai.community/MMC/V2.3/AIMs/PersonalStatusExtraction.json

6 Profiles

The Profiles of Personal Status Extraction are specified.

7. Reference Software

8. Conformance Testing

Table 3 provides the Conformance Testing Method for MMC-PSE AIM as a Basic AIM. Conformance Testing of the individual AIMs of the MMC-PSE Composite AIM are given by the individual AIM Specification.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data that refers to a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.

Table 3 – Conformance Testing Method for MMC-PSE AIM

Input Text Object or Shall validate against Text Object schema.
Text Data shall conform with Text Qualifier.
Text Descriptors Shall validate against Text Descriptors schema.
Text Selector Shall validate against Text Selector schema.
Speech Object or Shall validate against Speech Object schema.
Speech Data shall conform with Speech Qualifier.
Speech Descriptors Shall validate against Speech Descriptors schema.
Speech Selector Shall validate against Speech Selector schema.
Face Visual Object or Shall validate against Visual Object schema.
Visual Data shall conform with Visual Qualifier.
Face Descriptors Shall validate against Face Descriptors schema.
Face Selector Shall validate against Face Selector schema.
Body Visual Object Shall validate against Visual Object schema.
Visual Data shall conform with Visual Qualifier.
Gesture Descriptors Shall validate against Gesture Descriptors schema.
Body Selector Shall validate against Body Selector schema.
Output Entity Personal Status Shall validate against Personal Status schema.

9. Performance Assessment

Go To MPAI-MMC AI Modules