Go To MPAI-MMC AI Modules

1     Function 2     Reference Model 3     Input/Output Data
4     SubAIMs 5     JSON Metadata 6     Profiles
7     Reference Software 8     Conformance Texting 9     Performance Assessment

1     Functions

Video Lip Animation (MMC-VLA):

Receives Machine Speech
Machine Emotion
Video from Video of Faces KB
Produces Face Object displaying lips animated by Speech on a face Emotion

2     Reference Model

Figure 1 depicts the Reference Model of the Video Lip Animation (MMC-VLA) AIM.

Figure 1 – The Video Lip Animation (MMC-VLA) AIM Reference Model

3    Input/Output Data

Table 1 specifies the Input and Output Data of the Video Lip Animation (MMC-VLA) AIM.

Table 1 – I/O Data of the Video Lip Animation (MMC-VLA) AIM

Input data Description
Speech The vocal response of a Machine.
Emotion Emotion in Speech.
Video From KB Faces.
Output data Description
Emotion Of Video in Video of KB Faces.
Face Object Synthetic speaking Face Object displaying Emotion.

4     SubAIMs

No SubAIMs.

5     JSON Metadata

https://schemas.mpai.community/MMC/V2.2/AIMs/VideoLipAnimation.json

6     Profiles

No Profiles.

7     Reference Software

8     Conformance Testing

Input Data Data Type Input Conformance Testing Data
Machine Speech .wav All input Text files to be drawn from Text files.
Machine Emotion JSON All input JSON Emotion files to be drawn from Emotion JSON Files
Video of Face AVC All input Video files to be drawn from Video files.
Output Data Data Type Output Conformance Testing Criteria
Machine Face AVC All Video files produced shall conform with Video.

9     Performance Assessment

Go To MPAI-MMC AI Modules