Go To MPAI-PAF AI Modules

1 Function 2 Reference Model 3 Input/Output Data
4 SubAIMs 5 JSON Metadata 6 Profiles
7 Reference Software 8 Conformance Texting 9 Performance Assessment

1 Functions

The Scene and Avatar  Rendering (PAF-SAR) AIM produces Speech-Audio-Visual outputs from Avatar in an Audio-Visual Scene from AV Scene, Point of View, Speech or Text and Personal Status:

Receives Point of View Selected by viewer to see/hear the scene.
AV Scene Descriptors Describing the Audio-Visual Scene.
Avatar PoV The Point of View of the Avatar in the AV Scene.
 Speech Speech alternative to Speech synthesised from Text Object.
Avatar Model When a specific Avatar Model is externally provided.
Face Descriptors Descriptors of Avatar’s Face.
Body Descriptors Descriptors of Avatar’s Body.
Produces Output Speech The output Speech Object .
Audio Speech The Audio of the Audio-Visual Scene Descriptors.
Output Visual The rendering of the animated avatar and the visual scene.

2 Reference Model

Figure 1depicts the Reference Model of the Scene and Avatar  Rendering (PAF-SAR) AIM .

Figure 1– The Scene and Avatar  Rendering (PAF-SAR) AIM AIM

3 Input/Output Data

Table 1 specifies the Input and Output Data of the Scene and Avatar  Rendering (PAF-SAR) AIM.

Table 1– I/O Data of the Scene and Avatar  Rendering (PAF-SAR) AIM

Input Description
Point of View Selected by viewer to see/hear the scene.
Audio-Visual Scene Descriptors Describing the Audio-Visual Scene.
Avatar PoV The Point of View of the Avatar in the AV Scene.
Input Speech Speech alternative to Speech synthesised from Text Object.
Avatar Model When a specific Avatar Model is externally provided.
Face Descriptors Descriptors of Avatar’s Face.
Body Descriptors Descriptors of Avatar’s Body.
Output Description
Output Speech The output Speech Object .
Audio Speech The Audio of the Audio-Visual Scene Descriptors.
Output Visual The rendering of the animated avatar and the visual scene.

4 SubAIMs

No SubAIMs.

5 JSON Metadata

https://schemas.mpai.community/PAF/V1.5/AIMs/SceneAndAvatarRendering.json

6 Profiles

No Profiles

7 Reference Software

8 Conformance Testing

Table 2 provides the Conformance Testing Method for PAF-PSRAIM.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.

Table 2 – Conformance Testing Method for PAF-AAS AIM

Receives Point of View Shall validate against the Point of View Schema
Audio-Visual Scene Descriptors Shall validate against the AV Scene Descriptors Schema
Avatar PoV Shall validate against the Point of View Schema Schema
Input Speech Shall validate against the  Speech Object Schema
Avatar Model Shall validate against the 3D Model Model Schema
Face Descriptors Shall validate against the Face Descriptors Schema
Body Descriptors Shall validate against the Body Descriptors Schema
Produces Output Speech Shall validate against the Speech Object Schema
Audio Speech Shall validate against the Speech Object Schema
Output Visual Shall validate against the Visual Object Schema

9 Performance Assessment

Go To MPAI-PAF AI Modules