Technical Specification: Multimodal Conversation (MPAI-MMC) V2.2 assumes that implementations will be based on Technical Specification: AI Framework (MPAI-AIF) V2.0. specifying an AI Framework (AIF) where AI Workflows (AIW) composed of interconnected AI Modules (AIM) are executed.

Table 1 displays the full list of AIWs specified by MPAI-MMC V2. Click a listed AIW to access its dedicated page, which includes a its functions, reference model, I/O Data, Functions of AIMs, I/O Data of AIMs, and s table providing links to the AIW, AIMs, and JSON metadata.

NOTE: Conversation with Personal Status (MMC-CWP) is an enhanced or more complete version of Conversation with Emotion (MMC-CWE) specified in earlier version of the AIW. In MPAI’s terminology, Personal Status includes not only Emotion (e.g., angry, sad, etc.) but Cognitive Status (surprised, confused, etc.) and Social Attitude (sarcastic, polite, etc.).

Table 1 – AIWs of MPAI-MMC V2.2

Acronym Title JSON
MMC-CAS Conversation About a Scene X
MMC-CPS Conversation with Personal Status X
MMC-CWE Conversation with Emotion X
MMC-HCI Human-CAV Interaction X
MMC-MQA Multimodal Question Answering X
MMC-TST Text and Speech Translation X
MMC-VMS Virtual Meeting Secretary X