4.1     Functions of Avatar Videoconference Server

4.2     Reference Model of Avatar Videoconference Server

4.3     I/O Data of Avatar Videoconference Server

4.4     Functions of Avatar Videoconference Server AI Modules

4.5     I/O Data of Avatar Videoconference Server AI Modules

4.6     JSON Metadata of Avatar Videoconference Server AIW and AIMs

1      Functions of Avatar Videoconference Server

The Server:

  1. At the start:
    • Receives Speech Object and Speech Objects of each Participant.
    • Authenticates Participants.
    • Receives Portable Avatars each containing Language Preference and Avatar Model.
    • Selects an Audio-Visual Scene.
    • Selects the Spatial Attitudes of the Avatar Models in the Audio-Visual Scene.
    • Selects the common meeting language.
    • Distributes all Portable Avatars each containing: Audio-Visual Scene, Language Preference, Avatar Model, and Spatial Attitude.
  2. During the videoconference:
    • Receives Participants’ and Virtual Meeting Secretary’s Avatar Descriptors.
    • Translates participants’ Speech according to their Language Preferences.
    • Sends Portable Avatars containing Avatar ID, Text, Speech translated to the common meeting language, Face Descriptors and Gesture Descriptors to Virtual Meeting Secretary.
    • Receives Virtual Meeting Secretary’s Portable Avatar containing Avatar ID, Text, Speech in the common meeting language, Face Descriptors and Gesture Descriptors.
    • Translates Virtual Meeting Secretary’s Speech according to each participant’s Language Preferences.
    • Sends Participants’ and Virtual Meeting Secretary’s Portable Avatars containing Avatar ID, Text, Translated Speech, Face Descriptors and Gesture Descriptors to Client Receivers.

2      Reference Model of Avatar Videoconference Server

Figure 1 gives the Reference Model of Avatar Videoconference Server AIW. Red text refers to data sent at meeting start.

Figure 1 – Reference Model of Avatar Videoconference Server

3      I/O Data of Avatar Videoconference Server

Table 1 gives the input and output data of Avatar Videoconference Server AIW.

 Table 1 – Input and output data of Avatar Videoconference Server AIW

Input Description
Summary From Virtual Meeting Secretary
Audio-Visual Scene Descriptors Set by Server
Spatial Attitude Set by Server
Input+Virtual Secretary Portable Avatar From Transmitting Clients and Virtual Meeting Secretary
Speech Objects Participants’ Speech Object for Authentication
Face Object Participants’ Face Object for Authentication
Outputs Description
Summary As above
Portable Avatar As re-multiplexed by Server

4      Functions of Avatar Videoconference Server AI Modules

Table 2 gives the functions of the AI Modules of the Avatar Videoconference Server AIW.

Table 2 – AI Modules of Avatar Videoconference Server AIW

AIM Functions
Portable Avatar Demultiplexing Makes available Input Text, Input Speech, Language Preferences and Participant ID from Input and VS Portable Avatars.
Text and Speech Translation Translates active Speech and Text of all Participants to the Selected Languages.
Service Participant Authentication Authenticates Participants using Speech and Face Objects.

Connects Participant ID to Avatar ID.
Portable Avatar Multiplexing Multiplexes components of Portable Avatars for transmission to Receiving Clients.

5      I/O Data of Avatar Videoconference Server AI Modules

Table 3 gives the Input/Output Data of the AI Modules of the Avatar Videoconference Server AIW.

Table 3 – AI Modules of Avatar Videoconference Server AIW

AIM Input Output
Portable Avatar Demultiplexing Input and VS Portable Avatars Input TextI
nput Speech
Language Preferences
Participant ID
Text and Speech Translation Language Preferences
Text
Speech		 Translates Text
Translated Speech
Service Participant Authentication Speech Descriptors
Face Descriptors		 Avatar ID
Portable Avatar Multiplexing Audio-Visual Scene Descriptors
Spatial Attitudes
Face Descriptors
Body Descriptors
Translated Text
Translated Speech
Avatar ID		 Portable Avatars

6      Specification of Avatar Videoconference Server AIMs and JSON Metadata

Table 4 – AIMs and JSON Metadata

AIMs Name JSON
PAF-AVS Avatar Videoconference Server X
– PAF-PDX Portable Avatar Demultiplexing X
– MMC-TST Text and Speech Translation X
– PAF-SPA Service Participant Authentication X
– PAF-PMX Portable Avatar Multiplexing X