Go To MPAI-OSD AI Modules

1     Function 2     Reference Model 3     Input/Output Data
4     SubAIMs 5     JSON Metadata 6     Profiles
7     Reference Software 8     Conformance Texting 9     Performance Assessment

1     Functions

Audio-Visual Event Description (OSD-AVE).

Receives A sequence of  Audio-Visual Scene Descriptors.
Creates A file containing the input Audio-Visual Scene Descriptors.
Produces Audio-Visual Event Descriptors

2     Reference Model

The Audio-Visual Event Description (OSD-AVE) AIM Reference Model is depicted in Figure 1.

Figure 1 – The Audio-Visual Event Description AIM Reference Model

3    Input/Output Data

Table 1 specifies the Input and Output Data of the Audio-Visual Event Description AIM. Links are to the Data Type specifications.

Table 1 – I/O Data of the Audio-Visual Event Description AIM

Input Description
Audio-Visual Scene Descriptors Sequence of Audio-Visual Scene Descriptors.
Output Description
Audio-Visual Event Descriptors The Audio-Visual Event Descriptors of the Audio-Visual Scene.

4     SubAIMs

No SubAIMs

5     JSON Metadata

https://schemas.mpai.community/OSD/V1.1/AIMs/AudioVisualEventDescription.json

6     Profiles

No Profiles

7     Reference Software

  1. This OSD-AVE Reference Software Implementation is released with the BSD-3-Clause licence.
  2. The purpose of this Reference Software is to show a working Implementation of OSD-AVE, not to provide a ready-to-use product.
  3. MPAI disclaims the suitability of the Software for any other purposes and does not guarantee that it is secure.
  4. Use of this Reference Software may require acceptance of licences from the respective repositories. Users shall verify that they have the right to use any third-party software required by this Reference Software.

7.2    Guide to the OSD-AVE code

OSD-AVE arranges the audio-visual scene descriptors from OSD-AVS into Audio-Visual Event Descriptors.

Use of this Reference Software for the OSD-AVE AI Module is for developers who are familiar with Python, Docker, and RabbitMQ.

The OSD-AVE Reference Software is found at the MPAI gitlab site. It contains:

  1. src: a folder with the Python code implementing the AIM
  2. Dockerfile: a Docker file containing only the libraries required to build the Docker image and run the container
  3. requirements.txt: dependencies installed in the Docker image.

7.3 Acknowledgements

This version of the OSD-AVE Reference Software has been developed by the MPAI AI Framework Development Committee (AIF-DC).

8     Conformance Testing

9     Performance Assessment

 

Go To MPAI-OSD AI Modules