Function
Ref. Model
I/O Data
SubAIMs
JSON MData
Profiles
Ref. Software
Conformance
Performance
1 Functions
The Audio Scene Enhancement (PGM‑ASE) AIM interacts with three external entities through two distinct patterns. A‑User Control issues the Audio CXT Request and receives the Audio CXT Response reporting the goal understood and the outcome reached. Domain Access and Private Storage are queried: the Audio Domain Request and the Audio Interaction History Request are issued by the AIM, and the Audio Domain Response and the Audio Interaction History Response are received in reply, in general during a subsequent processing cycle
Audio Scene Enhancement
- Operates on the Audio Object, under the Audio CXT Request received from A‑User Control, using the Audio Domain Response received from Domain Access and the Audio Interaction History Response received from Private Storage.
- Produces the Enhanced Audio Scene Descriptors and the Audio CXT Response, sent to Context Description Multiplexing, together with the Audio Domain Request sent to Domain Access and the Audio Interaction History Request sent to Private Storage.
The Enhanced Audio Scene Descriptors carry the perceptual semantics of the scene, augmented with derived and semantic information under the control of AUC-CXT Request.
2 Reference Model
Figure 1 gives the Reference Model of the Audio Scene Enhancement (PGM‑ASE) AIM.
Figure 1 – Reference Model of the Audio Scene Enhancement (PGM‑ASE) AIM
3 I/O Data
Table 1 gives the Input and Output Data of the Audio Scene Enhancement (PGM‑ASE) AIM.
| Input | Description |
|---|---|
| Audio Interaction History Response | Response obtained from Private Storage through the Controller. |
| Audio Object | Audio of the scene captured according to the Audio CXT Request. |
| Audio CXT Request | Control directive specifying scope, depth, or policy constraints for audio description. |
| Audio Domain Response | Domain‑specific knowledge supporting audio interpretation and semantic classification. |
| Output | Description |
| Audio Interaction History Request | Request made to Private Storage through the Controller. |
| Enhanced Audio Scene Descriptors | Description of the audio scene, carrying perceptual semantics augmented with derived and semantic audio properties. |
| Audio CXT Response | Response describing the execution and outcome of Audio Scene Enhancement processing. |
| Audio Domain Request | Query to Domain Access requesting domain‑specific knowledge. |
4 Sub-AIMs (informative)
This section is informative. The decomposition of Audio Scene Enhancement into Sub-AIMs described below specifies one conformant architecture that produces the normative outputs of Audio Scene Enhancement (PGM‑ASE). Implementers may adopt alternative internal structures, provided they satisfy the conformance requirements of Section 8. An implementer may develop a Composite PGM-ASE AIM as specified below and claim conformance to it, provided the individual Sub-AIMs conform with the respective specifications.
4.1 Reference Model
An implementation of the Audio Scene Enhancement (PGM‑ASE) AIM may be based on the architecture of Figure 2.
Figure 2 – Reference Model of the Audio Scene Enhancement (PGM‑ASE) Composite AIM
4.2 Operation
The Audio Scene Enhancement operation extracts the Audio Scene Descriptors from the captured Audio Object, providing audio objects and their spatial attitudes; analyses their motion, proximity, and acoustic environment; identifies object types with optional domain knowledge; maps salience with respect to the AUC-CXT Requests, Domain Response and Interaction History Response; and constructs the Enhanced Audio Scene Descriptors, together with the execution status (Audio CXT Response), Audio Interaction History Request, and Domain Request.
4.3 Functions of Sub-AIMs
Table 2 specifies the functions performed by the Audio Scene Enhancement (PGM‑ASE) AIM Sub-AIMs in the current example.
| SubAIM | Function |
|---|---|
| Audio Scene Description | Produces an initial Audio Scene Description. |
| Acoustic Environment Analysis | Characterises the acoustic conditions affecting the audio scene, using signal‑derived measures producing the Acoustic Profile. |
| Audio Instance Identification | Assigns semantic object‑type labels to audio objects, using classification models and optional domain knowledge. |
| Audio Salience Mapping | Determines the relevance of audio objects with respect to user interaction and context. |
| Enhanced Audio Multiplexing | Aggregates perceptual and enriched evidence into the Enhanced Audio Scene Descriptors and issues the execution status. |
4.4 I/O Data of SubAIMs
Table 3 specifies the Input and Output Data of the Audio Scene Enhancement (PGM‑ASE) AIM SubAIMs.
4.5 AIMs and JSON Metadata
Table 4 provides the links to the AIM specifications and JSON schemas. AIM1 indicates the Composite AIM and AIM2 its SubAIMs.
| AIM1 | AIM2 | Name | JSON |
|---|---|---|---|
| PGM‑ASE | Audio Scene Enhancement | X | |
| PGM-ASD | Audio Scene Description | X | |
| PGM-AEA | Acoustic Environment Analysis | X | |
| PGM-AII | Audio Instance Identification | X | |
| PGM-ASM | Audio Salience Mapping | X | |
| PGM-EAM | Enhanced Audio Multiplexing | X |
5 JSON Metadata
https://schemas.mpai.community/PGM1/V1.0/AIMs/AudioSceneEnhancement.json
6 Profiles
No Profiles.
7 Reference Software
Not part of this specification.
8 Conformance Testing
Not part of this specification.
9 Performance Assessment
Not part of this specification.
