<-References Go to ToC AI Modules ->

1. Technical Specification 2. Reference Software 3. Conformance Testing 4. Performance Assessment

1. Technical Specification

Technical Specification: Multimodal Conversation (MPAI-MMC) V2.3 assumes that Workflow implementations will be based on Technical Specification: AI Framework (MPAI-AIF) V2.1. specifying an AI Framework (AIF) where AI Workflows (AIW) composed of interconnected AI Modules (AIM) are executed.

Table 1 provides the full list of AIWs specified by MPAI-MMC V2.3 with links to the pages dedicated to each AI Workflow which includes its function, reference model, Input/Output Data, Functions of AIMs, Input/Output Data of AIMs, and links to the AIW-related AIW, AIMs, and JSON metadata.

All MPAI-MMC V2.3 specified AI-Workflows are superseded by those specified by previous MPAI-MMC specifications which can still be used if their version is explicitly indicated.

Table 1 – AIWs of MPAI-MMC V2.3

Acronym Title JSON Acronym Title JSON
MMC-AMQ Answer to Multimodal Question X MMC-HCI Human-CAV Interaction X
MMC-CAS Conversation About a Scene X MMC-MQA Multimodal Question Answering X
MMC-CPS Conversation with Personal Status X MMC-TST Text and Speech Translation X
MMC-CWE Conversation with Emotion X MMC-VMS Virtual Meeting Secretary X

2. Reference Software

As a rule, MPAI provides Reference Software implementing the AI Modules released with the BSD-3-Clause licence and the following disclaimers:

  1. The purpose of the Reference Software is to demonstrate a working Implementation of an AIW, not to provide a ready-to-use product.
  2. MPAI disclaims the suitability of the Software for any other purposes than those of the MPAI-OSD Standard, and does not guarantee that it offers the best performance and that it is secure.
  3. Users shall verify that they have the right to use any third-party software required by this Reference Software, e.g., by accepting the  licences from third-party repositories.

Note that at this stage the MPAI-MMC AIWs implement only a part of the AIMs.

3. Conformance Testing

An implementation of an AI Workflow conforms with MPAI-MMC if it accepts as input and produces as output Data and/or Data Objects (the combination of Data of a Data Type and its Qualifier) conforming with those specified by MPAI-MMC.

The Conformance of an instance of a Data is to be expressed by a sentence like “Data validates against the Data Type Schema”. This means that:

  • Any Data Sub-Type is as indicated in the Qualifier.
  • The Data Format is indicated by the Qualifier.
  • Any File and/or Stream have the Formats indicated by the Qualifier.
  • Any Attribute of the Data is of the type or validates against the Schema specified in the Qualifier.

The method to Test the Conformance of a Data or Data Object instance is specified in the Data Types chapter.

4. Performance Assessment

Performance is a multidimensional entity because it can have various connotations, and the Performance Assessment Specification should provide methods to measure how well an AIW performs its function, using a metric that depends on the nature of the function, such as:

  1. Quality: the Performance of an Answer to Question Module AIW can measure how well the AIW answers a question related to an image.
  2. Bias: Performance of an Answer to Question Module AIW can measure the quality of responses in dependence of the type of images.
  3. Legal compliance: the Performance of an AIW can measure the compliance of the AIW to a regulation, e.g., the European AI Act.
  4. Ethical compliance: the Performance Assessment of an AIW can measure the compliance of an AIW to a target ethical standard.

The current MPAI-MMC V2.3 Standard does not provide AIW Performance Assessment methods.

<-References Go to ToC AI Modules ->