Go To MPAI-OSD AI Modules

1     Function 2     Reference Model 3     Input/Output Data
4     SubAIMs 5     JSON Metadata 6     Profiles
7     Reference Software 8     Conformance Texting 9     Performance Assessment

1     Functions

Audio-Visual Basic Scene Description (OSD-AVB):

Receives Space-Time. of the Audio Visual Basic Scene.
Audio Objects. In input.
Speech Objects. In input.
Visual Objects. In input.
Audio-Visual Objects. In input.
Processes All Objects.
Creates Audio, Speech, Visual, and Audio-Visual Scene Descriptors From the Objects, if possible
Combines The Scene Descriptors Of all Objects.
Produces Audio-Visual Scene Descriptors

2     Reference Model

Figure 1 specifies the Reference Model of the Audio-Visual Basic Scene Description (OSD-AVB) AIM.

Figure 1 – The Audio-Visual Basic Scene Description (OSD-AVB) AIM

3    Input/Output Data

Table 1 specifies the Input and Output Data of the Audio-Visual Basic Scene Description (OSD-AVB).

Table 1 – I/O Data of the Audio-Visual Basic Scene Description (OSD-AVB) AIM

Input Description
SpaceTime Space-Time information of Objects.
Audio Objects Input Audio Objects.
Speech Objects Input Speech Objects.
Visual Objects Input Visual Objects.
Output Description
Audio-Visual Scene Descriptors The Audio-Visual Descriptors of the Scene.

4     SubAIMs

Audio-Visual Basic Scene Description (OSD-AVB) is a Composite AIM whose reference Model is depicted in Figure 2.

Figure 2 – Reference Model of Audio-Visual Basic Scene Description Composite (OSD-AVB) AIM

Table 2 provides the AI Modules composing the AIM.

Table 2 – AI Modules of the Audio-Visual Basic Scene Description (OSD-AVB) AIM

AIM Acron. AIMs JSON
OSD-AVS Audio-Visual Basic Scene Description X
CAE-ABS Audio Basic Scene Description X
MMC-SBS Speech Basic Scene Description X
OSD-VBS Visual Basic Scene Description X
OSD-AV Audio-Visual Alignment X

5     JSON Metadata

https://schemas.mpai.community/OSD/V1.2/AIMs/AudioVisualBasicSceneDescription.json

6     Profiles

No Profiles.

7     Reference Software

8     Conformance Testing

Table 3 provides the Conformance Testing Method for OSD-AVB AIM. Conformance Testing of the individual AIMs of the OSD-AVB Composite AIM are given by the individual AIM Specification.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.

Table 3 – Conformance Testing Method for OSD-AVB AIM

Receives Space-Time Shall validate against Space-Time schema
Speech Objects Shall validate against Speech Objects schema
Speech Data shall conform with Qualifier
Audio Objects Shall validate against Audio Objects schema
Audio Data shall conform with Qualifier
Visual Objects Shall validate against Visual Objects schema
Visual Data shall conform with Qualifier
Audio-Visual Objects Shall validate against Audio-Visual Objects schema
Audio-Visual Data shall conform with Qualifier
Produces Audio-Visual Scene Descriptors Shall validate against AV Scene Descriptors schema

9     Performance Assessment

 

Go To MPAI-OSD AI Modules