1     Functions 2     Reference Model 3     I/O Data 
4     Functions of AI Modules 5     I/O Data of AI Modules 6     AIW, AIM, and JSON Metadata

1      Functions

The Server:

  1. At the start:
    • Receives Speech Object and Speech Objects of each participant.
    • Authenticates participant’s Avatar.
    • Receives Portable Avatars each containing Language Preference and Avatar Model.
    • Selects an Audio-Visual Scene.
    • Selects the Spatial Attitudes of the Avatar Models in the Audio-Visual Scene.
    • Selects the common meeting Language.
    • Distributes all Portable Avatars each containing: Audio-Visual Scene, Language Preference, Avatar Model, and Spatial Attitude.
  1. During the videoconference:
    • Receives participant Avatars’ and Virtual Meeting Secretary’s Avatar Descriptors.
    • Translates participants’ Speech Objects according to their Language Preferences.
    • Sends Portable Avatars containing Avatar ID, Text, Speech translated to the common meeting Language, Face Descriptors and Gesture Descriptors to Virtual Meeting Secretary.
    • Receives Virtual Meeting Secretary’s Portable Avatar containing Avatar ID, Text, Speech in the common meeting Language, Face Descriptors and Gesture Descriptors.
    • Translates Virtual Meeting Secretary’s Speech according to each participant’s Language Preferences.
    • Sends participant Avatars and Virtual Meeting Secretary’s Portable Avatars containing Avatar ID, Text, Translated Speech, Face Descriptors and Gesture Descriptors to Client Receivers.

2      Reference Model

Figure 4 gives the Reference Model of Avatar Videoconference Server AIW. Red text refers to Data sent at meeting start.

Figure 4 – Reference Model of Avatar Videoconference Server

3      I/O Data

Table 8 gives the input and output data of Avatar Videoconference Server AIW.

Table 8 – Input and output data of Avatar Videoconference Server AIW

Input Description
Summary From Virtual Meeting Secretary
AV Scene Descriptors Initial AV Scene Descriptors set by Server
Spatial Attitudes Initial Spatial Attitudes set by Server
Input and VMS Portable Avatars From Transmitting Clients and Virtual Meeting Secretary
Speech Objects Participants’ Speech Object for Authentication
Face Objects Participants’ Face Object for Authentication
Outputs Description
Summary As above
Portable Avatars As re-multiplexed by Server

4      Functions of AI Modules

Table 9 gives the functions of the AI Modules of the Avatar Videoconference Server AIW.

Table 9 – AI Modules of Avatar Videoconference Server AIW

AIM Functions
Portable Avatar Demultiplexing Makes available Input Text, Input Speech, Language Preferences and participant ID from Input and VS Portable Avatars.
Text and Speech Translation Translates active Speech and Text of all Participants to the Selected Languages.
Service Participant Authentication – Authenticates participants using Speech and Face Objects.
– Connects participant ID to Avatar ID.
Portable Avatar Multiplexing Multiplexes components of Portable Avatars for transmission to Receiving Clients.

5      I/O Data of AI Modules

Table 10 gives the Input/Output Data of the AI Modules of the Avatar Videoconference Server AIW.

Table 10 – AI Modules of Avatar Videoconference Server AIW

AIM Input Output
Portable Avatar Demultiplexing Input and VMS Portable Avatars 1.     Input Text
2.     Input Speech
3.     Language Preferences
4.     Participant ID
Text and Speech Translation 1.     Language Preferences
2.     Text
3.     Speech		 1.     Translates Text
2.     Translated Speech
Service Participant Authentication 1.     Speech Descriptors
2.     Face Descriptors		 Avatar ID
Portable Avatar Multiplexing 1.     Audio-Visual Descriptors
2.     Spatial Attitudes
3.     Avatar Descriptors
4.     Translated Text
5.     Translated Speech
6.     Avatar ID		 Portable Avatars

6      AIW, AIM, and JSON Metadata

Table 11 – AIW, AIMs and JSON Metadata

AIW AIMs Name JSON
PAF-AVS Avatar Videoconference Server X
– PAF-PDX Portable Avatar Demultiplexing X
– MMC-TST Text and Speech Translation X
– PAF-SPA Service Participant Authentication X
– PAF-PMX Portable Avatar Multiplexing X