MPAI-PAF V1.6 AIMs Portable Avatar Formation

Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance

1 Functions

The Portable Avatar Formation (PAF‑SAF) AIM forms the Portable Avatar of an input Avatar Model, animated as it utters the input Speech. Face and Body Descriptors are generated from the Speech and the Text, expressive when a Face or Body Personal Status is supplied, and packaged with the Avatar Model and the Speech, time-aligned and ready to play, as the Portable Avatar of the machine identified by the Machine ID, placed in a Scene when an Avatar Spatial Attitude and Scene Descriptors are supplied:

Receives	Speech	The Speech the Avatar utters.
	Text	The Text of the Speech, used to generate Face and Body Descriptors.
	Face Personal Status	The Personal Status the Face expresses (optional).
	Body Personal Status	The Personal Status the Body expresses (optional).
	Avatar Model	The Avatar Model, represented by a Basic 3D Model Object, that is animated.
	Machine ID	The identifier of the machine the Portable Avatar represents.
	Avatar Spatial Attitude	The position and orientation of the Avatar in the Scene (optional).
	AV Scene Descriptors	The Descriptors of the Audio-Visual Scene the Avatar is placed in (optional).
Produces	Portable Avatar	The Avatar, the Speech and the Face and Body Descriptors, ready to play.

2 Reference Model

Figure 1 depicts the Reference Model of the Portable Avatar Formation (PAF‑SAF) AIM.

Figure 1 – The Portable Avatar Formation (PAF‑SAF) AIM

3 I/O Data

Table 1 specifies the Input and Output Data of the Portable Avatar Formation (PAF‑SAF) AIM.

Table 1 – I/O Data of the Portable Avatar Formation (PAF‑SAF) AIM

Input	Description
Speech	The Speech the Avatar utters.
Text	The Text of the Speech, used to generate Face and Body Descriptors.
Face Personal Status	The Personal Status the Face expresses (optional).
Body Personal Status	The Personal Status the Body expresses (optional).
Avatar Model	The Avatar Model, represented by a Basic 3D Model Object, that is animated.
Machine ID	The identifier of the machine the Portable Avatar represents.
Avatar Spatial Attitude	The position and orientation of the Avatar in the Scene (optional).
AV Scene Descriptors	The Descriptors of the Audio-Visual Scene the Avatar is placed in (optional).
Output	Description
Portable Avatar	The Avatar, the Speech and the Face and Body Descriptors, ready to play.

4 SubAIMs

4.1 Reference Model

A Portable Avatar Formation (PAF‑SAF) AIM may be implemented as a Composite AIM depicted in Figure 2.

Figure 2 – The Portable Avatar Formation (PAF‑SAF) Composite AIM

4.2 Operation

Generative Face Description produces the Face Descriptors from the Speech and the Text, expressive of the Face Personal Status when one is supplied. Generative Body Description produces the Body Descriptors from the Text, expressive of the Body Personal Status when one is supplied. Portable Avatar Multiplexing packages the Avatar Model, the Speech and the Face and Body Descriptors, with the Machine ID and, when supplied, the Avatar Spatial Attitude and the AV Scene Descriptors, into the Portable Avatar, time-aligned and ready to play.

4.3 Functions of AI Modules

Table 2 specifies the Function of the AI Modules.

Table 2 – Functions of End AI Modules

Generative Face Description	Generates the Face Descriptors of the Avatar from Speech and Text.
Generative Body Description	Generates the Body Descriptors of the Avatar from Text.
Portable Avatar Multiplexing	Packages Avatar, Speech, and Face and Body Descriptors into the Portable Avatar.

4.4 I/O Data of AI Modules

Table 3 provides the links to the AIM specifications and JSON schemas. AIM1 indicates the Composite AIM and AIM2 its SubAIMs.

Table 3 – AIMs and JSON Metadata of the Portable Avatar Formation (PAF‑SAF)

AIM1	AIM2	Name	JSON
PAF‑SAF		Portable Avatar Formation	X
	PAF‑GFD	Generative Face Description	X
	PAF‑GBD	Generative Body Description	X
	PAF‑PMX	Portable Avatar Multiplexing	X

5 JSON Metadata

https://schemas.mpai.community/PAF/V1.6/AIMs/PortableAvatarFormation.json

6 Profiles

No Profiles.

7 Reference Software

Not part of this specification.

8 Conformance Testing

Table 4 provides the Conformance Testing Method for the PAF‑SAF AIM.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present, and conform with the Qualifier, if present.

Table 4 – Conformance Testing Method for the PAF‑SAF AIM

Receives	Speech	Shall validate against Speech Object schema.
	Text	Shall validate against Text Object schema.
	Face Personal Status	Shall validate against Personal Status schema.
	Body Personal Status	Shall validate against Personal Status schema.
	Avatar Model	Shall validate against Basic 3D Model Object schema.
	Machine ID	Shall be a string identifying the machine.
	Avatar Spatial Attitude	Shall validate against Spatial Attitude schema.
	AV Scene Descriptors	Shall validate against the Scene Descriptors schema.
Produces	Portable Avatar	Shall validate against Portable Avatar schema.

9 Performance Assessment