Go to MPAI-PAF V1.6 AI Modules
Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance
1 Functions
The Avatar Videoconference Server (PAF‑AVS) AIM is used in the Avatar-Based Videoconference Use Case.
The Server:
- At the start:
- Receives Speech Object and Speech Objects of each participant.
- Authenticates participant’s Avatar.
- Receives Portable Avatars each containing Language Preference and Avatar Model.
- Selects an Audio-Visual Scene.
- Selects the Spatial Attitudes of the Avatar Models in the Audio-Visual Scene.
- Selects the common meeting Language.
- Distributes all Portable Avatars each containing: Audio-Visual Scene, Language Preference, Avatar Model, and Spatial Attitude.
- During the videoconference:
- Receives participant Avatars’ and Virtual Meeting Secretary’s Avatar Descriptors.
- Translates participants’ Speech Objects according to their Language Preferences.
- Sends Portable Avatars containing Avatar ID, Text, Speech translated to the common meeting Language, Face Descriptors and Gesture Descriptors to Virtual Meeting Secretary.
- Receives Virtual Meeting Secretary’s Portable Avatar containing Avatar ID, Text, Speech in the common meeting Language, Face Descriptors and Gesture Descriptors.
- Translates Virtual Meeting Secretary’s Speech according to each participant’s Language Preferences.
- Sends participant Avatars and Virtual Meeting Secretary’s Portable Avatars containing Avatar ID, Text, Translated Speech, Face Descriptors and Gesture Descriptors to Client Receivers.
2 Reference Model
Figure 1 depicts the Reference Model of the Avatar Videoconference Server (PAF‑AVS) AIM.
Figure 1 – Reference Model of the Avatar Videoconference Server (PAF‑AVS) AIM
3 I/O Data
Table 1 gives the Input and Output Data of the Avatar Videoconference Server (PAF‑AVS) AIM.
| Input | Description |
| Summary | From Virtual Meeting Secretary |
| AV Scene Descriptors | Initial AV Scene Descriptors set by Server |
| Spatial Attitudes | Initial Spatial Attitudes set by Server |
| Input and VMS Portable Avatars | From Transmitting Clients and Virtual Meeting Secretary |
| Speech Objects | Participants’ Speech Object for Authentication |
| Face Objects | Participants’ Face Object for Authentication |
| Outputs | Description |
| Summary | As above |
| Portable Avatars | As re-multiplexed by Server |
4 SubAIMs
4.1 Reference Model
Figure 2 depicts the Reference Model of the Avatar Videoconference Server (PAF‑AVS) Composite AIM. Red text refers to Data sent at the start of the meeting.
Figure 2 – Reference Model of the Avatar Videoconference Server (PAF‑AVS) Composite AIM
4.2 Functions of SubAIMs
Table 2 gives the functions of the Avatar Videoconference Server (PAF‑AVS) SubAIMs.
| SubAIM | Functions |
| Portable Avatar Demultiplexing | Makes available Input Text, Input Speech, Language Preferences and participant ID from Input and VS Portable Avatars. |
| Text and Speech Translation | Translates active Speech and Text of all Participants to the Selected Languages. |
| Service Participant Authentication | – Authenticates participants using Speech and Face Objects. – Connects participant ID to Avatar ID. |
| Portable Avatar Multiplexing | Multiplexes components of Portable Avatars for transmission to Receiving Clients. |
4.3 I/O Data of SubAIMs
Table 3 gives the Input and Output Data of the Avatar Videoconference Server (PAF‑AVS) SubAIMs.
| SubAIM | Input | Output |
| Portable Avatar Demultiplexing | Input and VMS Portable Avatars | 1. Text Object 2. Speech Object 3. Language Selector 4. Participant ID |
| Text and Speech Translation | 1. Language Selector 2. Text Object 3. Speech Object |
1. Translated Text Object 2. Translated Speech |
| Service Participant Authentication | 1. Participant ID 2. Speech Object 3. Face Object |
Avatar Identifier |
| Portable Avatar Multiplexing | 1. Audio-Visual Scene Descriptors 2. Spatial Attitudes 3. Portable Avatars 4. Translated Text Object 5. Translated Speech 6. Avatar Identifier |
Portable Avatars |
4.4 AIMs and JSON Metadata
Table 4 provides the links to the AIM specifications and JSON schemas. AIM1 indicates the Composite AIM and the other columns its SubAIMs.
| AIM1 | AIM2 | Name | JSON |
| PAF-AVS | Avatar Videoconference Server | X | |
| PAF-PDX | Portable Avatar Demultiplexing | X | |
| MMC-TST | Text and Speech Translation | X | |
| PAF-SPA | Service Participant Authentication | X | |
| PAF-PMX | Portable Avatar Multiplexing | X |
5 JSON Metadata
https://schemas.mpai.community/PAF/V1.5/AIWs/AvatarVideoconferenceServer.json
6 Profiles
No Profiles.
7 Reference Software
Not part of this specification.
8 Conformance Testing
Table 5 provides the Conformance Testing Method for the Avatar Videoconference Server (PAF‑AVS) AIM. Conformance Testing of the individual SubAIMs is given by the individual AIM specifications.
If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present, and conform with the Qualifier, if present.
| Receives | Summary | Shall validate against Summary schema. |
| AV Scene Descriptors | Shall validate against AV Scene Descriptors Schema. | |
| Spatial Attitudes | Shall validate against Spatial Attitude Schema. | |
| Portable Avatars | Shall validate against Portable Avatar Schema. Portable Avatar Data shall conform with respective Qualifiers. |
|
| Speech Objects | Shall validate against Speech Object Schema. Speech Data shall conform with Speech Qualifier. |
|
| Face Objects | Shall validate against Visual Schema. Speech Data shall conform with Visual Qualifier. |
|
| Produces | Summary | Shall validate against Summary Schema. |
| Portable Avatars | Shall validate against Portable Avatar Schema. Portable Avatar Data shall conform with respective Qualifiers. |
9 Performance Assessment
Not part of this specification.
