Go to MPAI-PAF V1.6 AI Modules

Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance

1 Functions

The Response and Scene Rendering (PAF‑RSR) AIM renders the response of a machine – a Text, and the Personal Status that goes with it – as a Portable Avatar of the input Avatar Model, ready to play. Whoever requested the Portable Avatar places it in a Scene and renders it:

Receives Input Speech The Speech the Avatar utters instead of the Machine Speech (optional).
Speech Model The Model with which the Machine Speech is made (optional).
Text for Speech The Text from which the Machine Speech is made (Port 1).
Text for Formation The Text carried by the Portable Avatar, from which its Face and Body behaviour is made (Port 2).
Personal Status The Personal Status the Avatar expresses (optional).
Avatar Model The Avatar Model, represented by a Basic 3D Model Object, that is animated.
Machine ID The identifier of the machine the Portable Avatar represents.
Point of View The Point of View of the Scene in which the Portable Avatar will be placed (optional). It goes through to the Output Point of View.
Avatar Spatial Attitude The position and orientation of the Avatar in the Scene (optional).
AV Scene Descriptors The Descriptors of the Audio-Visual Scene in which the Avatar is placed (optional).
Produces Portable Avatar The Avatar, the Speech and the Face and Body Descriptors, ready to play.
Output Point of View The Point of View received, passed through (optional).

2 Reference Model

Figure 1 depicts the Reference Model of the Response and Scene Rendering (PAF‑RSR) AIM.

Response and Scene Rendering PAF-RSR AIM

Figure 1 – The Response and Scene Rendering (PAF‑RSR) AIM

3 I/O Data

Table 1 specifies the Input and Output Data of the Response and Scene Rendering (PAF‑RSR) AIM.

Table 1 – I/O Data of the Response and Scene Rendering (PAF‑RSR) AIM

Input Description
Input Speech or Input Speech The Speech the Avatar utters instead of the Machine Speech (optional).
Speech Model The Model with which the Machine Speech is made (optional).
Text for Speech or Text for Speech The Text from which the Machine Speech is made (Port 1).
Text for Formation or Text for Formation The Text carried by the Portable Avatar, from which its Face and Body behaviour is made (Port 2).
Personal Status The Personal Status the Avatar expresses (optional).
Avatar Model The Avatar Model, represented by a Basic 3D Model Object, that is animated.
Machine ID The identifier of the machine the Portable Avatar represents.
Point of View The Point of View of the Scene in which the Portable Avatar will be placed (optional). It goes through to the Output Point of View.
Avatar Spatial Attitude The position and orientation of the Avatar in the Scene (optional).
AV Scene Descriptors The Descriptors of the Audio-Visual Scene in which the Avatar is placed (optional).
Output Description
Portable Avatar The Avatar, the Speech and the Face and Body Descriptors, ready to play.
Output Point of View The Point of View received, passed through (optional).

4 SubAIMs

4.1 Reference Model

The Response and Scene Rendering (PAF‑RSR) AIM is a Composite AIM depicted in Figure 2.

Response and Scene Rendering PAF-RSR Composite AIM

Figure 2 – The Response and Scene Rendering (PAF‑RSR) Composite AIM

4.2 Operation

Personal Status Demultiplexing splits the Personal Status into the Speech, Face and Body Personal Statuses that make the Avatar expressive. Text-To-Speech makes the Machine Speech from the Text, expressive of the Speech Personal Status, with the Speech Model when one is supplied. Portable Avatar Formation forms the Portable Avatar of the Avatar Model from the Machine Speech – or from the Input Speech, when one is supplied – the Text and the Face and Body Personal Statuses.

The Face Animation Object and the Body Animation Object, if present, go through to Portable Avatar Formation, which gives them to Generative Face Description and Generative Body Description. These animate the face and the body of the Portable Avatar with the animations that the Animation Objects carry, in addition to what they derive from the Text and the Machine Speech.