Go To MPAI-PAF AI Modules

1     Function 2     Reference Model 3     Input/Output Data
4     SubAIMs 5     JSON Metadata 6     Profiles
7     Reference Software 8     Conformance Texting 9     Performance Assessment

1     Functions

Audio-Visual Scene Rendering (PAF-AVR):

Receives Point of View To be used in rendering the scene and its objects.
Audio-Visual Scene Descriptors jointly with or alternatively with Portable Avatar.
Portable Avatar Jointly with or alternatively with AV Scene Descriptors.
Transforms Portable Avatar Into generic Audio-Visual Scene Descriptors if input is Portable Avatar.
Produces Portable Avatar’s Output Speech Always integrated in the Audio-Visual Scene. Output Speech results from the rendering of Audio Scene Descriptors from human-selected Point of View.
Output Audio  Resulting from the rendering of Audio Scene Descriptors from human-selected Point of View.
Output Visual  Resulting from the rendering of Audio Scene Descriptors from human-selected Point of View. View Selector tells the OSD-AVR AIM where the visual components of the Portable Avatar should also be integrated.

2     Reference Model

Figure 1 specifies the Reference Model of the Audio-Visual Scene Rendering (PAF-AVR) AIM.

Figure 1 – The Audio-Visual Scene Rendering (PAF-AVR) AIM

3    Input/Output Data

Table 1 specifies the Input and Output Data of the Audio-Visual Scene Rendering (PAF-AVR) AIM.

Table 1 – I/O Data of the Audio-Visual Scene Rendering (PAF-AVR) AIM

Input Description
Portable Avatar Data produced, e.g., by Personal Status Display.
AV Scene Descriptors Audio-Visual Scene Descriptors.
Point of View Point from where an Entity perceives the Audio-Visual Scene
Output Description
Output Speech The Speech components of the Audio-Visual Scene.
Output Audio The Audio components of the Audio-Visual Scene.
Output Visual The Visual components of the Audio-Visual Scene.

4     SubAIMs

No SubAIMs.

5     JSON Metadata

https://schemas.mpai.community/PAF/V1.3/AIMs/AudioVisualSceneRendering.json

6     Profiles

The Profiles of Audio-Visual Scene Rendering are specified.

7     Reference Software

8     Conformance Testing

Table 2 provides the Conformance Testing Method for PAF-AVR AIM.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.

Table 2 – Conformance Testing Method for PAF-AVR AIM

Receives Portable Avatar Shall validate against Point of View Schema.
AV Scene Descriptors Shall validate against AV Scene Descriptors Schema.
Point of View Shall validate against Portable Avatar Schema.
Portable Avatar Data shall conform with respective Qualifiers.
Produces Output Speech Shall validate against Speech Object Schema.
Speech Data shall conform with Speech Qualifier.
Output Audio Shall validate against Audio Object Schema.
Audio Data shall conform with Audio Qualifier.
Output Visual Shall validate against Visual Object or 3D Model Schema.
Visual Data shall conform with Visual Object.

9     Performance Assessment

Go To MPAI-PAF AI Modules