<- Avatar-Based Videoconference   Go to ToC     Data Types->

Composite AIMs are AI Modules composed of multiple AI Modules. Several MPAI Use Cases  use Composite AIMs. This Chapter specifies Portable Avatar Format (MPAI-PAF) Composite AIM using a format aligned with the one adopted for Uses Cases. Other Technical Specifications, such as the Audio Scene Description (MPAI-CAE), Multimodal Conversation (MPAI-MMC), Object and Scene Description (MPAI-OSD), and specify other Composite AIMs that are used in this Technical Specification.

This Chapter provides links to the specifications of Composite and Basic AIM and JSON Metadata used by the four AIWs.

Personal Status Display (PAF-PSD)


This Chapter also provides the full set of AIWs, Composite AIMs, and AIMs used by the four Avatar-Based Videoconference subsystems.

Videoconference Client Transmitters

AIW and AIMs Name JSON
PA-CTX Videoconference Client Transmitter X
OSD-AVS Audio-Visual Scene Description X
CAE-ASD Audio Scene Description X
CAE-AAT Audio Analysis Transform X
CAE-ASL Audio Source Localisation X
CAE-ASE Audio Separation and Enhancement X
CAE-AST Audio Synthesis Transform X
CAE-AMX Audio Descriptor Multiplexing X
OSD-VSD Visual Scene Description X
OSD-AVA Audio-Visual Alignment X
MMC-ASR Automatic Speech Recognition X
MMC-NLU Natural Language Understanding X
MMC-PSE Personal Status Extraction X
MMC-ITD Input Text Description X
MMC-ISD Input Speech Description X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
MMC-PTI PS-Text Interpretation X
MMC-PSI PS-Speech Interpretation X
PAF-PFI PS-Face Interpretation X
PAF-PGI PS-Gesture Interpretation X
MMC-PMX Personal Status Multiplexing X

Avatar Videoconference Server

AIW and AIMs Name JSON
PAF-AVS Avatar Videoconference Server X
PAF-PDX Portable Avatar Demultiplexing X
MMC-TST Text and Speech Translation X
PAF-SPA Service Participant Authentication X
PAF-PMX Portable Avatar Multiplexing X

Virtual Meeting Secretary

AIW and AIMs Name and AIW/AIM Specification JSON
MMC-VMS Virtual Meeting Secretary X
PAF-PDX Portable Avatar Demultiplexing X
MMC-ASR Automatic Speech Recognition X
MMC-NLU Natural Language Understanding X
MMC-PSE Personal Status Extraction X
MMC-ITD Input Text Description X
MMC-ISD Input Speech Description X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
MMC-PTI PS-Text Interpretation X
MMC-PSI PS-Speech Interpretation X
PAF-PFI PS-Face Interpretation X
PAF-PGI PS-Gesture Interpretation X
MMC-PMX Personal Status Multiplexing X
MMC-SCM Summary Creation Module X
MMC-EDP Entity Dialogue Processing X
PAF-PSD Personal Status Display X
MMC-TTS Text-to-Speech X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
PAF-PMX Portable Avatar Multiplexing X

Videoconference Client Receivers

AIW and AIMs Name and AIW/AIM Specification JSON
PAF-CRX Videoconference Client Receiver X
PAF-PDX Portable Avatar Demultiplexing X
PAF-VSC Visual Scene Creation X
PAF-ASC Audio Scene Creation X
PAF-AVR Audio-Visual Scene Rendering X

 

<- Avatar-Based Videoconference   Go to ToC     Data Types->