Go to MPAI-PAF V1.6 AI Modules

Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance

1 Functions

The Videoconference Client Receiver (PAF‑VCR) AIM is used in the Avatar-Based Videoconference Use Case.

The Function of the Videoconference Client Receiver is to:

Create Local Visual Scene by placing and animating the Avatar Models with their Spatial Attitudes.
Local Audio-Visual Scene by adding Speech to Avatars’ Mouths.
Render Audio-Visual Scene as seen from the Participant-selected Point of View.

2 Reference Model

Figure 1 depicts the Reference Model of the Videoconference Client Receiver (PAF‑VCR) AIM.

Reference Model of the Videoconference Client Receiver (PAF-VCR) AIM

Figure 1 – Reference Model of the Videoconference Client Receiver (PAF‑VCR) AIM

3 I/O Data

Table 1 gives the Input and Output Data of the Videoconference Client Receiver (PAF‑VCR) AIM.

Table 1 – I/O Data of the Videoconference Client Receiver (PAF‑VCR) AIM

Input Description
Point of View Avatar-selected Position to see the Audio-Visual Scene.
Portable Avatars Portable Avatars from Videoconference Avatar Server.
Output Description
Output Speech Rendered by Audio-Visual Scene Rendering.
Output Visual Rendered by Audio-Visual Scene Rendering.

4 SubAIMs

4.1 Reference Model

Figure 2 depicts the Reference Model of the Videoconference Client Receiver (PAF‑VCR) Composite AIM.

Reference Model of the Videoconference Client Receiver (PAF-VCR) Composite AIM

Figure 2 – Reference Model of the Videoconference Client Receiver (PAF‑VCR) Composite AIM

4.2 Functions of SubAIMs

Table 2 gives the functions of the Videoconference Client Receiver (PAF‑VCR) SubAIMs.

Table 2 – Functions of the Videoconference Client Receiver (PAF‑VCR) SubAIMs

SubAIM Input
Portable Avatar Demultiplexing Extracts Avatar ID, Audio-Visual Scene Descriptors, Avatar Model, Spatial Attitude, Body Descriptors, Face Descriptors, and Input Speech from Portable Avatars.
Visual Scene Creation Creates the Visual Scene and provides the Spatial Attitudes of the Mouths of all Avatars.
Audio-Visual Scene Creation Creates the Audio Scene.
Audio-Visual Scene Rendering Provides a ready-to-rendered Audio-Visual Scene.

4.3 I/O Data of SubAIMs

Table 3 gives the Input and Output Data of the Videoconference Client Receiver (PAF‑VCR) SubAIMs.

Table 3 – I/O Data of the Videoconference Client Receiver (PAF‑VCR) SubAIMs

SubAIM Input Output
Portable Avatar Demultiplexing Portable Avatars 1. Avatar IDs
2. Audio-Visual Scene Descriptors
3. Avatars
4. Spatial Attitudes
5. Input Speech Objects
6. Output Text Objects
Visual Scene Creation 1. Avatar IDs
2. Audio-Visual Scene Descriptors
3. Avatars
4. Spatial Attitude
5. Input Speech Objects		 1. Visual Scene Descriptors
2. Mouth Spatial Attitudes
Audio-Visual Scene Creation 1. Avatar ID
2. Input Speech Objects
3. Mouth Spatial Attitudes		 1. Audio Scene Descriptors
Audio-Visual Scene Rendering 1. Audio Scene Descriptors
2. Visual Scene Descriptors
3. Point of View		 1. Output Speech
2. Output Visual

4.4 AIMs and JSON Metadata

Table 4 provides the links to the AIM specifications and JSON schemas. AIM1 indicates the Composite AIM and the other columns its SubAIMs.

Table 4 – AIMs and JSON Metadata of the Videoconference Client Receiver (PAF‑VCR)

AIM1 AIM2 Name JSON
PAF-VCR Videoconference Client Receiver X
– PAF-PDX Portable Avatar Demultiplexing X
– PAF-VSC Visual Scene Creation X
– PAF-AVC Audio-Visual Scene Creation X
– PAF-AVR Audio-Visual Scene Rendering X

5 JSON Metadata

https://schemas.mpai.community/PAF/V1.5/AIWs/VideoconferenceClientReceiver.json

6 Profiles

No Profiles.

7 Reference Software

Not part of this specification.

8 Conformance Testing

Table 5 provides the Conformance Testing Method for the Videoconference Client Receiver (PAF‑VCR) AIM. Conformance Testing of the individual SubAIMs is given by the individual AIM specifications.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present, and conform with the Qualifier, if present.

Table 5 – Conformance Testing Method for the Videoconference Client Receiver (PAF‑VCR) AIM

Receives Point of View Shall validate against Point of View Schema.
Portable Avatars Shall validate against Portable Avatar Schema.
Portable Avatar Data shall conform with respective Qualifiers.
Produces Output Speech Shall validate against Speech Object Schema.
Speech Data shall conform with Speech Qualifier.
Output Visual Shall validate against Visual Object Schema.
Visual Data shall conform with Visual Qualifier.

9 Performance Assessment

Not part of this specification.

Go to MPAI-PAF V1.6 AI Modules