Go to MPAI-OSD V1.5 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

1      Definition

An Audio-Visual Object is a Data Type whose rendering has both Audio and Visual perceptibility attributes. Audio-Visual Objects may have a hierarchical structure where Audio-Visual Objects contain Basic Audio-Visual Objects and Audio-Visual Objects.

2      Functional Requirements

An Audio-Visual Object must include:

  1. The Audio-Visual Object Header.
  2. The ID of a Virtual Space (M-Instance) where it is or is intended to be located.
  3. The ID of the Audio-Visual Object.
  4. The Space/Time of the Audio-Visual Object.

An Audio-Visual Object may include:

  1. The ID of a U-Environment (Real Space) where it is or is intended to be located.
  2. Time when this Audio-Visual Object was produced.
  3. Acoustic properties of the Audio-Visual Object.
  4. Basic Audio-Visual Objects and child Audio-Visual Objects, each with their Space/Time.
  5. A mixed array of Basic Audio-Visual Objects and child Audio-Visual Objects.
  6. MPAI-PTF Data Exchange Metadata.
  7. Descriptive Metadata.

3      Syntax

https://schemas.mpai.community/OSD/V1.5/data/AudioVisualObject.json

4      Semantics

Table 1 – Semantics of the Audio-Visual Object Data Type

Label
Description
Header Audio-Visual Object Header – Standard “OSD‑AVO‑Vx.y”.
MInstanceID Identifier of the M-Instance (Virtual Space) where this Audio-Visual Object is or is intended to be located.
UEnvironmentID Identifier of the U-Environment (Real Space) where this Audio-Visual Object is or is intended to be located.
AVObjectID Unique identifier of this Audio-Visual Object.
AVObjectTime Time this Audio-Visual Object was produced.
AVObjectSpaceTime Space/Time where/when this Audio-Visual Object is located.
AVObjectProperties Acoustic properties of this Audio-Visual Object.
BasicAVObjectCount Number of Basic Audio-Visual Objects contained in this Audio-Visual Object.
BasicAVObjects[] Set of Basic Audio-Visual Objects contained in this Audio-Visual Object.
    – BasicAVObjectSpaceTime Space/Time where/when this Basic Audio-Visual Object is located within the containing Audio-Visual Object. If absent, the Space/Time of the containing object applies.
    – BasicAVObjectIDOrBasicAVObject Either the ID of a Basic Audio-Visual Object or the Basic Audio-Visual Object itself.
SubAVObjectCount Number of child Audio-Visual Objects contained in this Audio-Visual Object.
SubAVObjects[] Set of child Audio-Visual Objects contained in this Audio-Visual Object.
    – SubAVObjectSpaceTime Space/Time where/when this child Audio-Visual Object is located within the containing Audio-Visual Object. If absent, the Space/Time of the containing object applies.
    – SubAVObjectIDOrSubAVObject Either the ID of a child Audio-Visual Object or the child Audio-Visual Object itself.
BasicAVObjectOrAVObject A mixed array of Basic Audio-Visual Objects and child Audio-Visual Objects contained in this Audio-Visual Object.
DataXMData MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this Audio-Visual Object in a trusted data exchange context.
DescrMetadata Human-readable descriptive metadata of the Audio-Visual Object (plain text, max 2048 characters).

5      Conformance Testing

A Data instance conforms with Audio-Visual Object (OSD‑AVO) if:

  1. The Data validates against the Audio-Visual Object’s JSON Schema.
  2. All Data in the Audio-Visual Object’s JSON Schema:
    1. Have the specified type.
    2. Validate against their JSON Schemas.
    3. Conform with their Data Qualifiers.

6      Performance Assessment

Not part of this specification.

Go to MPAI-OSD V1.5 Data Types