1 Function | 2 Reference Model | 3 Input/Output Data |
4 SubAIMs | 5 JSON Metadata | 6 Profiles |
7 Reference Software | 8 Conformance Texting | 9 Performance Assessment |
1 Functions
Video Lip Animation (MMC-VLA):
Receives | Machine Speech |
Machine Emotion | |
Video from Video of Faces KB | |
Produces | Face Object displaying lips animated by Speech on a face Emotion |
2 Reference Model
Figure 1 depicts the Reference Model of the Video Lip Animation (MMC-VLA) AIM.
Figure 1 – The Video Lip Animation (MMC-VLA) AIM Reference Model
3 Input/Output Data
Table 1 specifies the Input and Output Data of the Video Lip Animation (MMC-VLA) AIM.
Table 1 – I/O Data of the Video Lip Animation (MMC-VLA) AIM
Input data | Description |
Speech | The vocal response of a Machine. |
Emotion | Emotion in Speech. |
Video | From KB Faces. |
Output data | Description |
Emotion | Of Video in Video of KB Faces. |
Face Object | Synthetic speaking Face Object displaying Emotion. |
4 SubAIMs
No SubAIMs.
5 JSON Metadata
https://schemas.mpai.community/MMC/V2.2/AIMs/VideoLipAnimation.json
6 Profiles
No Profiles.
7 Reference Software
8 Conformance Testing
Input Data | Data Type | Input Conformance Testing Data |
Machine Speech | .wav | All input Text files to be drawn from Text files. |
Machine Emotion | JSON | All input JSON Emotion files to be drawn from Emotion JSON Files |
Video of Face | AVC | All input Video files to be drawn from Video files. |
Output Data | Data Type | Output Conformance Testing Criteria |
Machine Face | AVC | All Video files produced shall conform with Video. |