PGM-AUA V1.0 AIMs - Entity Face Description

Go to PGM-AUA V1.0 AI Modules

Function

Ref. Model

1. Function

The Entity Face Description (PGM‑EFD) AIM is a Sub-AIM of A‑User Formation (PGM‑AUF). It produces the description of the face of the Portable Avatar that utters the response. It produces the Face Descriptors mainly from the speech, with the text and the Face Personal Status. It also uses the Face Motion Objects produced by Motion Object Generation, if any, for the facial actions that the speech does not carry.

PGM‑EFD:

Receives the AUC-AUF Request, the Final Response, the Machine Speech, the Face Motion Objects and the Face Personal Status.
Describes the facial behaviour (expression, lip movements synchronised with the speech, gaze) that accompanies the response, in accordance with the Face Personal Status.
Produces the Face Descriptors.
Reports its processing with an AUC-AUF Response.

2. Reference Model

Figure 1 depicts the Reference Model of the Entity Face Description (PGM‑EFD) AIM.

Figure 1 – The Entity Face Description (PGM‑EFD) AIM

3. Input/Output Data

Table 1 specifies the Input and Output Data of the Entity Face Description (PGM‑EFD) AIM.

Table 1 – I/O Data of the Entity Face Description (PGM‑EFD) AIM

Input	Description
AUC-AUF Request	Guidance from A‑User Control on the delivery of the response.
Final Response	The deliberated content produced by Basic Knowledge: the text to be uttered and the Action Objects that carry the actions of the face that accompany it.
Machine Speech	The synthesised speech of the response, from Text-To-Speech (MMC-TTS).
Face Motion Object	A motion of the face of the Persona of the A-User (e.g., a nod, a gaze) as a mini-Process Action, produced by Motion Object Generation (PGM-MOG), if any.
Face Personal Status	Personal Status component for the face, from PGM-PSD.
Output	Description
Face Descriptors	Description of the face of the Portable Avatar, sent to Portable Avatar Multiplexing (PAF-PMX).
AUC-AUF Response	Report to the AUF Status Multiplexing (PGM-FSM) AIM.

4. Sub-AIMs

No Sub-AIMs.

5. JSON Metadata

https://schemas.mpai.community/PGM1/V1.0/AIMs/EntityFaceDescription.json

6. Profiles

No Profiles.

7. Reference Software

Not part of this specification.

8. Conformance Testing

Table 2 provides the Conformance Testing Method for the Entity Face Description (PGM‑EFD) AIM.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present, and conform with the Qualifier, if present.

Table 2 – Conformance Testing Method for the Entity Face Description (PGM‑EFD) AIM

Receives	AUC-AUF Request	Shall validate against the AUF‑Request schema.
	Final Response	Shall validate against the Basic Final Response schema.
	Machine Speech	Shall validate against the Machine Speech schema.
	Face Motion Object	Shall validate against Face Motion Object schema.
	Face Personal Status	Shall validate against the Face Personal Status schema.
Produces	Face Descriptors	Shall validate against the Face Descriptors schema.
	AUC-AUF Response	Shall validate against the AUC-AUF Response schema.

9. Performance Assessment