1     Definition 2     Functional Requirements 3     Syntax
4     Semantics 5    Conformance Testing 6     Performance Assessment

1      Definition

A Data Type including the Audio-Visual Scene’s Objects and Sub-Scenes and their arrangement in the Scene.

2      Functional Requirements

Audio-Visual Scene Descriptors includes Scenes in addition to Objects.

3      Syntax

https://schemas.mpai.community/OSD/V1.5/data/AudioVisualSceneDescriptors.json

4      Semantics

Label Description
Header Audio-Visual Scene Descriptors Header – Standard “OSD-AVS-Vx.y”
MInstanceID Identifier of M-Instance.
AVSceneDescriptorsID Identifier of the AV Object.
AVSceneDescriptorsSpaceTime
 Space Time of the AV Object.
ObjectCount Number of Objects in Scene.
AVSceneSpaceTime Data about Space and Time.
SpeechObjects[] Set of Speech Objects.
– SpeechObject Speech Object.
– SpeechObjectSpaceTime Space-Time of Speech Object.
AudioObjects[] Set of Audio Objects.
– AudioObject ID of Audio Object.
– AudioObjectSpaceTime Space-Time of Audio Object.
VisualObjects[] Set of Visual Objects.
– VisualObjectID ID of Visual Object.
– VisualObjectSpaceTime Space-Time of Visual Object.
3DModelObjects[] Set of 3D Model Objects.
– 3D ModelObjectID ID of 3D Model Object.
– 3DModelObjectSpaceTime Space-Time of 3D Model Object.
AudioVisualObjects[] Set of Audio-Visual Objects.
– AudioVisualObjectID ID of Audio-Visual Object.
– AudioObjectSpaceTime Space-Time of Audio-Visual Object.
SubSceneCount Number of Sub-Scenes in Scene.
SpeechSubScenes[] Set of Speech Objects.
– SpeechSubScene Speech SubScene.
– SpeechSubSceneSpaceTime Space-Time of Speech SubScene.
AudioSubScenes[] Set of Audio SubScenes.
– AudioSubScene ID of Audio SubScene.
– AudioSubSceneSpaceTime Space-Time of Audio SubScene.
VisualSubScenes[] Set of Visual SubScenes.
– VisualSubSceneID ID of Visual SubScene.
– VisualSubSceneSpaceTime Space-Time of Visual SubScene.
3DModelSubScenes[] Set of 3D Model SubScenes.
– 3DModelSubSceneID ID of 3D Model SubScene.
– 3DModelSubSceneSpaceTime Space-Time of 3D Model SubScene.
AudioVisualSubScenes[] Set of Audio-Visual SubScenes.
– AudioVisualSubSceneID ID of Audio-Visual SubScene.
– AudioSubSceneSpaceTime Space-Time of Audio-Visual SubScene.
DataXMData Information about this Audio-Visual Scene Descriptors Instance.
DescrMetadata Descriptive Metadata.

5     Conformance Testing

A Data instance Conforms with Audio-Visual Scene Descriptors (OSD-AVS) if:

  1. The Data validates against the Audio-Visual Scene Descriptors’ JSON Schema.
  2. All Data in the  Audio-Visual Scene Descriptors’ JSON Schema
    1. Have the specified type
    2. Validate against their JSON Schemas
    3. Conform with their Data Qualifiers if present.

6     Performance Assessment