| 1 Function | 2 Reference Model | 3 Input/Output Data |
| 4 SubAIMs | 5 JSON Metadata | 6 Profiles |
| 7 Reference Software | 8 Conformance Texting | 9 Performance Assessment |
1 Functions
The Multimodal Event Description (OSD-MED) AIM produces the Descriptors of an Multimodal Event from a sequence of Multimodal Scene Descriptors:
| Receives | Basic Multimodal Scene Descriptors (OSD-BMS) or Multimodal Scene Descriptors (OSD-MSD) | A sequence. |
| Produces | Multimodal Event Descriptors (OSD-MEV) |
2 Reference Model
The Multimodal Event Description (OSD-MED) AIM Reference Model is depicted in Figure 1.
Figure 1 – The Multimodal Event Description (OSD-MED) AIM Reference Model
3 Input/Output Data
Table 1 specifies the Input and Output Data of the Multimodal Event Description AIM. Links are to the Data Type specifications.
Table 1 – I/O Data of the Multimodal Event Description (OSD-MED) AIM
| Input | Description |
| Basic Multimodal Scene Descriptors (OSD-BMS) or Multimodal Scene Descriptors (OSD-MSD) | A sequence of Multimodal Scene Descriptors. |
| Output | Description |
| Multimodal Event Descriptors (OSD-MEV) | The Multimodal Event Descriptors of the Multimodal Scene. |
4 SubAIMs
No SubAIMs
5 JSON Metadata
https://schemas.mpai.community/OSD/V1.5/AIMs/MultimodalEventDescription.json
6 Profiles
No Profiles
7 Reference Software
- This OSD-MED Reference Software Implementation is released with the BSD-3-Clause licence.
- The purpose of this Reference Software is to show a working Implementation of OSD-MED, not to provide a ready-to-use product.
- MPAI disclaims the suitability of the Software for any other purposes and does not guarantee that it is secure.
- Use of this Reference Software may require acceptance of licences from the respective repositories. Users shall verify that they have the right to use any third-party software required by this Reference Software.
7.2 Guide to the OSD-AVE code
OSD-MED arranges the audio-visual scene descriptors from OSD-AVS into Multimodal Event Descriptors.
Use of this Reference Software for the OSD-MED AI Module is for developers who are familiar with Python, Docker, and RabbitMQ.
The OSD-MED Reference Software is found at the MPAI gitlab site. It contains:
- src: a folder with the Python code implementing the AIM
- Dockerfile: a Docker file containing only the libraries required to build the Docker image and run the container
- requirements.txt: dependencies installed in the Docker image.
7.3 Acknowledgements
This version of the OSD-MED Reference Software has been developed by the MPAI AI Framework Development Committee (AIF-DC).
8 Conformance Testing
Table 2 provides the Conformance Testing Method for OSD-MED AIM.
If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.
Table 2 – Conformance Testing Method for OSD-MED AIM
| Receives | Basic Multimodal Scene Descriptors (OSD-BMS) or Multimodal Scene Descriptors (OSD-MSD) | Shall validate against the schema of the Data Type. |
| Produces | Multimodal Event Descriptors (OSD-MEV) | Shall validate against the schema of the Data Type. |
9 Performance Assessment
