Go To MPAI-PAF AI Modules

1     Function 2     Reference Model 3     Input/Output Data
4     SubAIMs 5     JSON Metadata 6     Profiles
7     Reference Software 8     Conformance Texting 9     Performance Assessment

1     Functions

Audio-Visual Scene Rendering (PAF-AVR):

Receives Point of View
Audio-Visual Scene Descriptors, and/or
Portable Avatar
Transforms Portable Avatar into generic Audio-Visual Scene Descriptors if input is Portable Avatar.
Produces Output Text.
Output Speech – of the Portable Avatar is always integrated in the Audio-Visual Scene. Output Speech results from the rendering of Audio Scene Descriptors from human-selected Point of View.
Output Audio – resulting from the rendering of Audio Scene Descriptors from human-selected Point of View.
Output Visual – resulting from the rendering of Audio Scene Descriptors from human-selected Point of View. View Selector tells the OSD-AVR AIM where the visual components of the Portable Avatar should also be integrated.

2     Reference Model

Figure 1 specifies the Reference Model of the Audio-Visual Scene Rendering (PAF-AVR) AIM.

Figure 1 – The Audio-Visual Scene Rendering (PAF-AVR) AIM

3    Input/Output Data

Table 1 specifies the Input and Output Data of the Audio-Visual Scene Rendering (PAF-AVR) AIM.

Table 1 – I/O Data of the Audio-Visual Scene Rendering (PAF-AVR) AIM

Input Description
Portable Avatar Data produced, e.g., by Personal Status Display.
AV Scene Descriptors Audio-Visual Scene Descriptors.
Point of View Point from where an Entity perceives the Audio-Visual Scene
Output Description
Output Text The Text included in the Portable Avatar.
Output Speech The Speech components of the Audio-Visual Scene.
Output Audio The Audio components of the Audio-Visual Scene.
Output Visual The Visual components of the Audio-Visual Scene.

4     SubAIMs

No SubAIMs.

5     JSON Metadata

https://schemas.mpai.community/PAF/V1.2/AIMs/AudioVisualSceneRendering.json

6     Profiles

The Profiles of Audio-Visual Scene Rendering are specified.

7     Reference Software

8     Conformance Testing

9     Performance Assessment

Go To MPAI-PAF AI Modules