Go to PGM-AUA V1.0 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

Definition

Ranked Audio Objects (PGM-RAO): The Audio Objects of the scene ordered by the salience score computed by Audio Salience Mapping.

Functional Requirements

  1. Header: The Data shall have Header “PGM-RAO-V1.0”.
  2. Identification: The Data shall carry the identifiers of the M‑Instance, of the U‑Environment and of the session, and a unique identifier and a time (RankedAudioObjectsID, RankedAudioObjectsTime).
  3. Ranking: The Data shall include the ranking, in order of rank.
  4. Metadata: The Data shall include DataXMData and may include DescrMetadata.

Syntax

https://schemas.mpai.community/PGM1/V1.0/data/RankedAudioObjects.json

Semantics

Table 1 – Semantics of Ranked Audio Objects

Label Description
Header Header of the Data Type, with the version. (required)
MInstance Identifier of the M-Instance. (required)
UEnvironment Identifier of the U-Environment. (required)
SessionID Identifier of the A-User session. (required)
RankedAudioObjectsID Identifier of this instance. (required)
RankedAudioObjectsTime Time at which the Data was produced. (required)
Ranking The ranking, in order of rank. (required)
– AudioObjectID Audio Object ID. (required)
– Rank Position in the ranking, starting from 1. (required)
– SalienceScore Salience score, 0 to 1. (required)
– Components The dimensions that contributed to the score.
–– Physical Motion, proximity, acoustic prominence and clarity.
–– Semantic Audio object type.
–– Contextual Directive and domain.
DataXMData Data Exchange Metadata of MPAI-PTF: provenance, authorisation, security and confidence of the Data.
DescrMetadata Descriptive metadata (plain text, at most 2048 characters).

Conformance Testing

Data conforms with Ranked Audio Objects if it validates against the schema of Section 3. If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema.

Performance Assessment

Not part of this specification.

Go to PGM-AUA V1.0 Data Types