1 Functions of Avatar Videoconference Server
2 Reference Model of Avatar Videoconference Server
3 I/O Data of Avatar Videoconference Server
4 Functions of Avatar Videoconference Server AI Modules
5 I/O Data of Avatar Videoconference Server AI Modules
6 AIW, AIM, and JSON Metadata of Avatar Videoconference Server
1 Functions of Avatar Videoconference Server
The Server:
- At the start:
- Receives Speech Object and Speech Objects of each participant.
- Authenticates participant’s Avatar.
- Receives Portable Avatars each containing Language Preference and Avatar Model.
- Selects an Audio-Visual Scene.
- Selects the Spatial Attitudes of the Avatar Models in the Audio-Visual Scene.
- Selects the common meeting Language.
- Distributes all Portable Avatars each containing: Audio-Visual Scene, Language Preference, Avatar Model, and Spatial Attitude.
- During the videoconference:
- Receives participant Avatars’ and Virtual Meeting Secretary’s Avatar Descriptors.
- Translates participants’ Speech Objects according to their Language Preferences.
- Sends Portable Avatars containing Avatar ID, Text, Speech translated to the common meeting Language, Face Descriptors and Gesture Descriptors to Virtual Meeting Secretary.
- Receives Virtual Meeting Secretary’s Portable Avatar containing Avatar ID, Text, Speech in the common meeting Language, Face Descriptors and Gesture Descriptors.
- Translates Virtual Meeting Secretary’s Speech according to each participant’s Language Preferences.
- Sends participant Avatars and Virtual Meeting Secretary’s Portable Avatars containing Avatar ID, Text, Translated Speech, Face Descriptors and Gesture Descriptors to Client Receivers.
2 Reference Model of Avatar Videoconference Server
Figure 4 gives the Reference Model of Avatar Videoconference Server AIW. Red text refers to Data sent at meeting start.
Figure 4 – Reference Model of Avatar Videoconference Server
3 I/O Data of Avatar Videoconference Server
Table 8 gives the input and output data of Avatar Videoconference Server AIW.
Table 8 – Input and output data of Avatar Videoconference Server AIW
| Input | Description |
| Summary | From Virtual Meeting Secretary |
| AV Scene Descriptors | Set by Server |
| Spatial Attitudes | Set by Server |
| Input Avatars and VMS Portable Avatars | From Transmitting Clients and Virtual Meeting Secretary |
| Speech Objects | participants’ Speech Object for Authentication |
| Face Objects | participants’ Face Object for Authentication |
| Outputs | Description |
| Summary | As above |
| Portable Avatars | As re-multiplexed by Server |
4 Functions of Avatar Videoconference Server AI Modules
Table 9 gives the functions of the AI Modules of the Avatar Videoconference Server AIW.
Table 9 – AI Modules of Avatar Videoconference Server AIW
| AIM | Functions |
| Portable Avatar Demultiplexing | Makes available Input Text, Input Speech, Language Preferences and participant ID from Input and VS Portable Avatars. |
| Text and Speech Translation | Translates active Speech and Text of all Participants to the Selected Languages. |
| Service Participant Authentication | Authenticates participants using Speech and Face Objects.
Connects participant ID to Avatar ID. |
| Portable Avatar Multiplexing | Multiplexes components of Portable Avatars for transmission to Receiving Clients. |
5 I/O Data of Avatar Videoconference Server AI Modules
Table 10 gives the Input/Output Data of the AI Modules of the Avatar Videoconference Server AIW.
Table 10 – AI Modules of Avatar Videoconference Server AIW
| AIM | Input | Output |
| Portable Avatar Demultiplexing | Input and VMS Portable Avatars | 1. Input Text
2. Input Speech 3. Language Preferences 4. Participant ID |
| Text and Speech Translation | 1. Language Preferences
2. Text 3. Speech |
1. Translates Text
2. Translated Speech |
| Service Participant Authentication | 1. Speech Descriptors
2. Face Descriptors |
Avatar ID |
| Portable Avatar Multiplexing | 1. Audio-Visual Descriptors
2. Spatial Attitudes 3. Avatar Descriptors 4. Translated Text 5. Translated Speech 6. Avatar ID |
Portable Avatars |
6 AIW, AIM, and JSON Metadata of Avatar Videoconference Server
Table 11 – AIW and AIMs Specification and JSON Metadata
| AIW | AIMs | Name | JSON |
| PAF-AVS | Avatar Videoconference Server | X | |
| – | PAF-PDX | Portable Avatar Demultiplexing | X |
| – | MMC-TST | Text and Speech Translation | X |
| – | PAF-SPA | Service Participant Authentication | X |
| – | PAF-PMX | Portable Avatar Multiplexing | X |
