<- Avatar-Based Videoconference   Go to ToC     Data Types->

AI Modules (AIM) are interconnected processing units composing an AI Workflow (AW). There are two types of AIM:

  1. Composite AIMs are AI Modules composed of multiple AI Modules.
  2. Basic AIMs do not include (or do not expose) AIMs inside.

This Chapter specifies the Composite AIMs of Table 1 .

Table 1 – Composite AIMs of MPAI-PAF

Acronym AIM Name Versions
PAF-PSD Personal Status Display V1.0

This Chapter also specifies the Basic AIMs of Table 2.

Table 2 – Basic AIMs of MPAI PAF- Note that V1.1 is currently not approved.

Acronym AIM Name
PAF-AVR Audio-Visual Scene Rendering
PAF-FIR Face Identity Recognition
PAF-IBD Input Body Description
PAF-IFD Input Face Description
PAF-PFI PS-Face Interpretation
PAF-PGI PS-Gesture Interpretation
PAF-PMX Portable Avatar Multiplexing
PAF-PSD Personal Status Display

 


This Chapter also provides the full set of AIWs, Composite AIMs, and AIMs used by the four Avatar-Based Videoconference subsystems.

Videoconference Client Transmitter

AIW and AIMs Name JSON
PA-CTX Videoconference Client Transmitter X
OSD-AVS Audio-Visual Scene Description X
CAE-ASD Audio Scene Description X
CAE-AAT Audio Analysis Transform X
CAE-ASL Audio Source Localisation X
CAE-ASE Audio Separation and Enhancement X
CAE-AST Audio Synthesis Transform X
CAE-AMX Audio Descriptor Multiplexing X
OSD-VSD Visual Scene Description X
OSD-AVA Audio-Visual Alignment X
MMC-ASR Automatic Speech Recognition X
MMC-NLU Natural Language Understanding X
MMC-PSE Personal Status Extraction X
MMC-ITD Input Text Description X
MMC-ISD Input Speech Description X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
MMC-PTI PS-Text Interpretation X
MMC-PSI PS-Speech Interpretation X
PAF-PFI PS-Face Interpretation X
PAF-PGI PS-Gesture Interpretation X
MMC-PMX Personal Status Multiplexing X

Avatar Videoconference Server

AIW and AIMs Name JSON
PAF-AVS Avatar Videoconference Server X
PAF-PDX Portable Avatar Demultiplexing X
MMC-TST Text and Speech Translation X
PAF-SPA Service Participant Authentication X
PAF-PMX Portable Avatar Multiplexing X

Virtual Meeting Secretary

AIW and AIMs Name and AIW/AIM Specification JSON
MMC-VMS Virtual Meeting Secretary X
PAF-PDX Portable Avatar Demultiplexing X
MMC-ASR Automatic Speech Recognition X
MMC-NLU Natural Language Understanding X
MMC-PSE Personal Status Extraction X
MMC-ITD Input Text Description X
MMC-ISD Input Speech Description X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
MMC-PTI PS-Text Interpretation X
MMC-PSI PS-Speech Interpretation X
PAF-PFI PS-Face Interpretation X
PAF-PGI PS-Gesture Interpretation X
MMC-PMX Personal Status Multiplexing X
MMC-SCM Summary Creation Module X
MMC-EDP Entity Dialogue Processing X
PAF-PSD Personal Status Display X
MMC-TTS Text-to-Speech X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
PAF-PMX Portable Avatar Multiplexing X

Videoconference Client Receiver

AIW and AIMs Name and AIW/AIM Specification JSON
PAF-CRX Videoconference Client Receiver X
PAF-PDX Portable Avatar Demultiplexing X
PAF-VSC Visual Scene Creation X
PAF-ASC Audio Scene Creation X
PAF-AVR Audio-Visual Scene Rendering X

 

<- Avatar-Based Videoconference   Go to ToC     Data Types->