1     Definition 2     Functional Requirements 3     Syntax
4     Semantics 5    Conformance Testing 6     Performance Assessment

1      Definition

A Data Type including:

  1. Audio Data whose rendering is perceived by a hearing device or audible to a human with attached Qualifier.
  2. Descriptive Data regarding Sub-Types, Formats and Attributes of the Audio Data (optionally).
  3. Space-Time information.

2      Functional Requirements

An Audio Object includes:

  1. The ID of a Virtual Space (M-Instance) where it is or will be located.
  2. The ID of the Audio Object.
  3. The ID(s) of the Parent Object(s) supporting two cases:
    1. The Parent Object has spawned two (or more) Objects.
    2. Two (or more) Parent Objects have merged into one.
  4. The Space-Time information of all Parent Objects in the M-Instance.
  5. The Space-Time information of the Visual Data in an M-Instance.
  6. The Visual Data Qualifier.
  7. The Audio Data Annotations, including:
    1. Annotation
    2. Annotation Space-Time
    3. Process Action IDs
  8. The Audio Object-specific Data:
    1. Visual Data Qualifier.
    2. Visual Data Annotation.
    3. Visual Data length in Bytes.
    4. Visual Data URI.

3      Syntax

https://schemas.mpai.community/CAE1/V2.3/data/AudioObject.json

4      Semantics

Label Size Description
Header N1 Bytes Audio Object Header
– Standard-AudioObject 9 Bytes The characters “CAE-AUO-V”
– Version N2 Bytes Major version – 1 or 2 characters
– Dot-separator 1 Byte The character “.”
– Subversion N3 Bytes Minor version – 1 or 2 characters
MInstanceID N4 Bytes Identifier of M-Instance.
AudioObjectID N5 Bytes Identifier of the Audio Object.
ParentAudioObjects[] N6 Bytes Identifier(s) of Parent Audio Objects.
– ParentAudioObjectID N7 Bytes ID of a Parent Audio Object
– ParentAudioDataSpaceTime N8 Bytes Space Time info of Parent Audio  Data
AudioDataSpaceTime N9 Bytes Space-Time info of Audio Data.
AudioDataQualifier N10 Bytes Audio Data Qualifier.
SpeechDataAnnotations[] N11 Bytes Annotations of Speech Data
– Annotation N12 Bytes ID of Annotation
– AnnotationSpaceTime N13 Bytes Where/when Annotation is attached.
– ProcessActionIDs N14 Bytes What is possible to do with the Annotation
AudioDataLength N15 Bytes Number of Bytes of Audio Data
AudioDataURI N16 Bytes URI of Data of Audio Data
DescrMetadata N17 Bytes Descriptive Metadata

5     Conformance Testing

A Data instance Conforms with CAE-USC V2.3 Audio Object (CAE-AUO) if:

  1. JSON Data validate against the Audio Object’s JSON Schema.
  2. All Data in the Audio Object’s JSON Schema
    1. Have the specified types.
    2. Validate against their JSON Schemas.
    3. Conform with their Data Qualifiers if present.

6     Performance Assessment