Go to PGM-AUA V1.0 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

Definition

Context Descriptors (PGM-CXD): The aggregated result of Context Description, delivered to Prompt Creation: the Enhanced Audio Scene Descriptors, the Enhanced Visual Scene Descriptors and the User State.

Functional Requirements

  1. Header: The Data shall have Header “PGM-CXD-V1.0”.
  2. Identification: The Data shall carry the identifiers of the M‑Instance, of the U‑Environment and of the session, and a unique identifier and a time (ContextDescriptorsID, ContextDescriptorsTime).
  3. EnhancedAudioSceneDescriptors: The Data shall include the audio scene with all derived and semantic attributes.
  4. EnhancedVisualSceneDescriptors: The Data shall include the visual scene with all derived and semantic attributes.
  5. AudioVisualSceneDescriptors: The Data may include optional. The Audio-Visual Scene Descriptors, with the Joint Salience attached to the AV Entities, when Audio-Visual Alignment was required.
  6. UserState: The Data shall include the interpreted description of the User State.
  7. Metadata: The Data shall include DataXMData and may include DescrMetadata.

Syntax

https://schemas.mpai.community/PGM1/V1.0/data/ContextDescriptors.json

Semantics

Table 1 – Semantics of Context Descriptors

Label Description
Header Header of the Data Type, with the version. (required)
MInstance Identifier of the M-Instance. (required)
UEnvironment Identifier of the U-Environment. (required)
SessionID Identifier of the A-User session. (required)
ContextDescriptorsID Identifier of this instance. (required)
ContextDescriptorsTime Time at which the Data was produced. (required)
EnhancedAudioSceneDescriptors The audio scene with all derived and semantic attributes. (required)
EnhancedVisualSceneDescriptors The visual scene with all derived and semantic attributes. (required)
AudioVisualSceneDescriptors Optional. The Audio-Visual Scene Descriptors, with the Joint Salience attached to the AV Entities, when Audio-Visual Alignment was required.
UserState The interpreted description of the User State. (required)
DataXMData Data Exchange Metadata of MPAI-PTF: provenance, authorisation, security and confidence of the Data.
DescrMetadata Descriptive metadata (plain text, at most 2048 characters).

Conformance Testing

Data conforms with Context Descriptors if it validates against the schema of Section 3. If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema.

Performance Assessment

Not part of this specification.

Go to PGM-AUA V1.0 Data Types