1     Functions of Composite AIM

2     Reference Model

3     I/O Data of Personal Status Display

4     Functions of AI Modules of Personal Status Display

5     I/O Data of AI Modules of Personal Status Display

6     AIMs and JSON Metadata of Personal Status Display

7     Profiles

1      Functions

Receives
  1. Text Object
  2. Personal Status
  3. Avatar Model
  4. Speech Model
  5. NN Format
Uses
  1. Text and PS-Speech to produce Machine Speech.
  2. Machine Speech, Avatar Model, and PS-Face to produce Machine Face Descriptors.
  3. Machine Text, Avatar Model, and PS-Gesture to produce Machine Body Descriptors
Produces Portable Avatar
Enables PAF-AVR to render the Portable Avatar produced by PAF-PSD.

2      Reference Model

Figure 1 depicts the AIMs implementing the Personal Status Display.

Figure 1 – Reference Model of Personal Status Display

The Personal Status Display operates as follows:

  1. Avatar ID is the ID of the Portable Avatar.
  2. Machine Text is synthesised as Speech using a Speech Model in a format specified by NN Format and the Personal Status provided by PS-Speech.
  3. Machine Speech and PS-Face are used to produce the Machine Face Descriptors.
  4. PS-Gesture and Text are used for Machine Body Descriptors using the Avatar Model.
  5. Portable Avatar Multiplexing produces the Portable Avatar.

3      I/O Data of Personal Status Display

Table 2 gives the Input/Output Data of Personal Status Display.

Table 2 – I/O Data of Personal Status Display

Input data From Description
Avatar ID Upstream AIM Portable Avatar’s ID
Avatar Model Upstream AIM or embedded in PSD Part of Portable Avatar
Text Object Keyboard or upstream AIM Texts of Portable Avatar
PS-Speech Personal Status Extraction or Machine To synthesise Speech
NN Format The Format of the NN-based Speech Model 0=NNEX [11]; 1=ONNX [12]
Speech Model Upstream AIM or embedded in PSD Neural Network
PS-Face Personal Status Extractor or Machine To describe Face
PS-Gesture Personal Status Extractor or Machine To describe Body
Output data To Description
Portable Avatar Downstream AIM or renderer As Portable Avatar

4      Functions of AI Modules of Personal Status Display

Table 19 gives the functions of the AIMs.

Table 19 – Functions of Personal Status Display AI Modules

AIM Functions
Text To Speech Synthesises Text with Personal Status.
Input Face Description Produces Machine Face Descriptors with Personal Status.
Input Body Description Produces Machine Body Descriptors with Personal Status.
Portable Avatar Multiplexing Multiplexes Data into Portable Avatar with Personal Status.

5      I/O Data of AI Modules of Personal Status Display

Table 3 gives the list of PSD AIMs with their input and output Data.

Table 3 – AI Modules of Personal Status Display

AIM Receives Produces
Text To Speech 1.     Text
2.     NN Format
3.     NN-based Speech Model
4.     PS-Speech
Machine Speech
Input Face Description 1.     Avatar Model
2.     Machine Speech
3.     PS-Face
Machine Face Descriptors
Gesture Description 1.     Avatar Model
2.     Text
3.     Machine PS-Gesture
Machine Body Descriptors
Portable Avatar Multiplexing 1.     Avatar ID
2.     Machine Text
3.     NN Format
4.     NN-based Speech Model
5.     Machine Speech
6.     Machine Body Descriptors
7.     Machine Face Descriptors
8.     Machine Avatar
9.     Avatar Model
Portable Avatar

6      AIMs, and JSON Metadata of Personal Status Display

Table 4 gives the list of PSD AIMs with their input and output Data.

Table 4 –AIMs and JSON Metadata

AIMs Name and Specification JSON
PAF-PSD Personal Status Display X
MMC-TTS Text-to-Speech X
PAF-IFD Input Face Description X
PAF-IBD Input Body Description X
PAF-PMX Portable Avatar Multiplexing X

7. Profiles

The Profiles of Personal Status Display are specified.