1     Version

V1.1

2    Functions

Videoconference Client Transmitter (PAF-CTX)

  1. Receives Portable Avatar conveying
    1. Participants’ Avatar Models and Language Preference
    2. Visual Scene Descriptors
    3. Avatars’ Spatial Attitudes
    4. Avatars’ Face and Body Descriptors and Speech Objects.
    5. Participant’s Point of View.
  2. Performs the following:
    1. Instantiates the Audio-Visual Scene.
    2. Place and animate the Avatar Models with their Spatial Attitudes.
    3. Add Speech to Avatars’ mouths.
  3. Renders the Audio-Visual Scene as seen from the Participant-selected Point of View.

3      Reference Architecture

The Reference Architecture is depicted in Figure 1.

Figure 1 – The Videoconference Client Receiverer AIW

4      I/O Data

Table 1 specifies the Input and Output Data of the Visual Scene Description AIM.

Table 1 – I/O Data of the Videoconference Client Receiver AIW

Input Description
Point of View Participant-selected point of view to see the Audio-Visual Scene.
Portable Avatars Portable Avatars from Server.
Output Description
Output Audio Presented using loudspeaker (array)/earphones.
Output Visual Presented using 2D or 3D display.

5     SubAIMs

Portable Avatar Demultiplexing
Visual Scene Creation
Audio Scene Creation
Audio-Visual Scene Rendering

 6     JSON Metadata

https://schemas.mpai.community/PAF/V1.1/AIWs/VideoconferenceClientReceiver.json