The MMC-CPS AI Workflow:
- Audio Input and Visual Input of a human wishing to have a conversation with a Machine
- Input Text, complementing or replacing the Audio Input and Visual Input.
- Understands the information and the Personal Status of the human.
- Produces and emits multimodal responses to the humans in the form of a speaking Avatar that displays Personal Status.
3 Reference Model
Figure 1 depicts the MMC-CPS Reference Architecture.
Figure 1 – The Conversation with Personal Status AIW
4 I/O Data
The Input and Output Data of the Human and Machine Communication AIW is specified in Table 1.
Table 1 – I/O Data of Conversation with Personal Status
|Text typed by the human as additional information stream or as a replacement of the Speech.
|Speech of the human having a conversation with the machine.
|Visual information of the Face and Body of the human having a conversation with the machine.
|Data determining the use of Speech vs Text.
|Machine Portable Avatar
|The representation of the Machine response.