Go to MPAI-PAF V1.6 AI Modules
Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance
1 Functions
The Response and Scene Rendering (PAF‑RSR) AIM renders the response of a machine – a Text – as a Speaking Avatar of the input Avatar Model, ready to play. Whoever requested the Speaking Avatar places it in a Scene and renders it, e.g., with Scene and Avatar Rendering:
| Receives | Input Speech | The Speech the Avatar utters instead of the Machine Speech (optional). |
| Speech Model | The Model with which the Machine Speech is made (optional). | |
| Text Object | The Text of the response. | |
| Personal Status | The Personal Status the Avatar expresses (optional). | |
| Avatar Model | The Avatar whose Model is animated. | |
| Produces | Speaking Avatar | The Avatar, the Speech and the Face and Body Descriptors, ready to play. |
2 Reference Model
Figure 1 depicts the Reference Model of the Response and Scene Rendering (PAF‑RSR) AIM.
Figure 1 – The Response and Scene Rendering (PAF‑RSR) AIM
3 I/O Data
Table 1 specifies the Input and Output Data of the Response and Scene Rendering (PAF‑RSR) AIM.
| Input | Description |
|---|---|
| Input Speech | The Speech the Avatar utters instead of the Machine Speech (optional). |
| Speech Model | The Model with which the Machine Speech is made (optional). |
| Text Object | The Text of the response. |
| Personal Status | The Personal Status the Avatar expresses (optional). |
| Avatar Model | The Avatar whose Model is animated. |
| Output | Description |
| Speaking Avatar | The Avatar, the Speech and the Face and Body Descriptors, ready to play. |
4 SubAIMs
4.1 Reference Model
The Response and Scene Rendering (PAF‑RSR) AIM is a Composite AIM depicted in Figure 2.
Figure 2 – The Response and Scene Rendering (PAF‑RSR) Composite AIM
4.2 Operation
Personal Status Demultiplexing splits the Personal Status into the Speech, Face and Gesture Personal Statuses that make the Avatar expressive. Text-To-Speech makes the Machine Speech from the Text, expressive of the Speech Personal Status, with the Speech Model when one is supplied. Speaking Avatar Formation forms the Speaking Avatar of the Avatar Model from the Machine Speech – or from the Input Speech, when one is supplied – the Text and the Face and Gesture Personal Statuses.
4.3 Functions of AI Modules
Table 2 specifies the Function of the AI Modules.
| Personal Status Demultiplexing | Splits the Personal Status into the Speech, Face and Gesture Personal Statuses. |
| Text-To-Speech | Makes the Machine Speech from the Text, expressive of the Speech Personal Status. |
| Speaking Avatar Formation | Forms the Speaking Avatar of the Avatar Model. |
4.4 I/O Data of AI Modules
Table 3 provides the links to the AIM specifications and JSON schemas. AIM1 indicates the Composite AIM and AIM2 its SubAIMs.
| AIM1 | AIM2 | Name | JSON |
|---|---|---|---|
| PAF‑RSR | Response and Scene Rendering | X | |
| MMC‑PDX | Personal Status Demultiplexing | X | |
| MMC‑TTS | Text-To-Speech | X | |
| PAF‑SAF | Speaking Avatar Formation | X |
5 JSON Metadata
https://schemas.mpai.community/PAF/V1.6/AIMs/ResponseAndSceneRendering.json
6 Profiles
No Profiles.
7 Reference Software
Not part of this specification.
8 Conformance Testing
Table 4 provides the Conformance Testing Method for the PAF‑RSR AIM.
If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present, and conform with the Qualifier, if present.
| Receives | Input Speech | Shall validate against Basic Speech Object schema. |
| Speech Model | Shall validate against ML Model Object schema. | |
| Text Object | Shall validate against Basic Text Object schema. | |
| Personal Status | Shall validate against Personal Status schema. | |
| Avatar Model | Shall validate against Avatar schema. | |
| Produces | Speaking Avatar | Shall validate against Speaking Avatar schema. |
9 Performance Assessment
Not part of this specification.
