1 Function | 2 Reference Model | 3 Input/Output Data |
4 SubAIMs | 5 JSON Metadata | 6 Profiles |
7 Reference Software | 8 Conformance Texting | 9 Performance Assessment |
1 Functions
The Scene and Avatar Rendering (PAF-SAR) AIM produces Speech-Audio-Visual outputs from Avatar in an Audio-Visual Scene from AV Scene, Point of View, Speech or Text and Personal Status:
Receives | Point of View | Selected by viewer to see/hear the scene. |
AV Scene Descriptors | Describing the Audio-Visual Scene. | |
Avatar PoV | The Point of View of the Avatar in the AV Scene. | |
Speech | Speech alternative to Speech synthesised from Text Object. | |
Avatar Model | When a specific Avatar Model is externally provided. | |
Face Descriptors | Descriptors of Avatar’s Face. | |
Body Descriptors | Descriptors of Avatar’s Body. | |
Produces | Output Speech | The output Speech Object . |
Audio Speech | The Audio of the Audio-Visual Scene Descriptors. | |
Output Visual | The rendering of the animated avatar and the visual scene. |
2 Reference Model
Figure 1depicts the Reference Model of the Scene and Avatar Rendering (PAF-SAR) AIM .
Figure 1– The Scene and Avatar Rendering (PAF-SAR) AIM AIM
3 Input/Output Data
Table 1 specifies the Input and Output Data of the Scene and Avatar Rendering (PAF-SAR) AIM.
Table 1– I/O Data of the Scene and Avatar Rendering (PAF-SAR) AIM
Input | Description |
Point of View | Selected by viewer to see/hear the scene. |
Audio-Visual Scene Descriptors | Describing the Audio-Visual Scene. |
Avatar PoV | The Point of View of the Avatar in the AV Scene. |
Input Speech | Speech alternative to Speech synthesised from Text Object. |
Avatar Model | When a specific Avatar Model is externally provided. |
Face Descriptors | Descriptors of Avatar’s Face. |
Body Descriptors | Descriptors of Avatar’s Body. |
Output | Description |
Output Speech | The output Speech Object . |
Audio Speech | The Audio of the Audio-Visual Scene Descriptors. |
Output Visual | The rendering of the animated avatar and the visual scene. |
4 SubAIMs
No SubAIMs.
5 JSON Metadata
https://schemas.mpai.community/PAF/V1.5/AIMs/SceneAndAvatarRendering.json
6 Profiles
No Profiles
7 Reference Software
8 Conformance Testing
Table 2 provides the Conformance Testing Method for PAF-PSRAIM.
If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.
Table 2 – Conformance Testing Method for PAF-AAS AIM
Receives | Point of View | Shall validate against the Point of View Schema |
Audio-Visual Scene Descriptors | Shall validate against the AV Scene Descriptors Schema | |
Avatar PoV | Shall validate against the Point of View Schema Schema | |
Input Speech | Shall validate against the Speech Object Schema | |
Avatar Model | Shall validate against the 3D Model Model Schema | |
Face Descriptors | Shall validate against the Face Descriptors Schema | |
Body Descriptors | Shall validate against the Body Descriptors Schema | |
Produces | Output Speech | Shall validate against the Speech Object Schema |
Audio Speech | Shall validate against the Speech Object Schema | |
Output Visual | Shall validate against the Visual Object Schema |