Go To MPAI-OSD AI Modules

1 Function 2 Reference Model 3 Input/Output Data
4 SubAIMs 5 JSON Metadata 6 Profiles
7 Reference Software 8 Conformance Texting 9 Performance Assessment

1 Functions

Speech Scene Description (OSD-SSD) V1.3 produces the Descriptors of a Scene composed by Speech Objects and Scenes:

Receives Space-Time of the input Objects having the same time base.
Speech Objects Individual Speech Objects.
Scene Descriptors Scene the Objects belong to.
Integrates Space-Time and Speech Object with Scene Descriptors.
Produces Speech Scene Descriptors Output#1 of AIM
Alert Output#2 of AIM signalling potential anomalies in Object.

2 Reference Model

The Reference Architecture is depicted in Figure 1.

Figure 1 – The Speech Scene Description (OSD-SSD) AIM

3 Input/Output Data

Table 1 specifies the Input and Output Data of the Speech Scene Description (OSD-SSD) AIM. .

Table 1 – I/O Data of the Speech Scene Description (OSD-SSD) AIM

Input Description
Space-Time Space-Time of input Objects.
Speech Objects Input Speech Objects.
Scene Descriptors Input Scene Descriptors.
Output Description
Speech Scene Descriptors The output Speech Scene Descriptors.
Alert Data signalling potential anomalies in Object.

4 SubAIMs

No SubAIMs.

5 JSON Metadata

https://schemas.mpai.community/OSD/V1.3/AIMs/SpeechSceneDescription.json

6 Profiles

No profiles.

7 Reference Software

8 Conformance Testing

Table 2 provides the Conformance Testing Method for OSD-SSD AIM.

If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema, if present and conform with the Qualifier, if present.

Table 2 – Conformance Testing Method for OSD-SSD AIM

Receives Space-Time Shall validate against Space-Time schema.
Speech Objects Shall validate against Speech Object schema.
Media-specific Data shall conform with their Qualifiers.
Scene Descriptors Shall validate against Scene Descriptors schema.
Produces Speech Scene Descriptors Shall validate against Speech Scene Descriptors schema.
Alert Shall validate against Alert schema.

9 Performance Assessment

Go To MPAI-OSD AI Modules