(Tentative)
| Function | Reference Model | Input/Output Data |
| SubAIMs | JSON Metadata | Profiles |
1. Function
The Audio Spatial Reasoning AIM (PGM‑ASR) AIM acts as a bridge between raw Audio Scene Descriptors and higher-level reasoning modules by interpreting and refining spatial audio context to support reasoning and action execution:
| Receives | Audio Action Directive (PGM‑AAD) | from A-User Control. |
| Context | from Context Capture that includes Entity State, Visual Scene Descriptors, and Audio Scene Descriptors (ASD0). | |
| Refines and aligns | Audio Scene Descriptors | through a possibly iterative loop with Doman Access (PGM‑DAC) with the following steps: |
| ASR sends ASD0 to Domain Access. | ||
| DAC sends ASD1, an enhanced version of ASD0 to ASR. | ||
| Produces | ASD2 | an enhanced version of ASD1 to Prompt Creation (PGM-PRC), sent to Prompt Creation. |
| Audio Action Status | sent to A-User Control. |
2. Reference Model
Figure 1 gives the of Audio Spatial Reasoning (PGM-ASR) AIM Reference Model.
Figure 1 – The Reference Model of the Audio Spatial Reasoning (PGM-ASR) AIM
3. Input/Output Data
Table 1 gives the Input/Output Data of the Audio Spatial Reasoning AIM.
Table 1 – Input/Output Data of the Audio Spatial Reasoning AIM
| Input | Description |
| Context | A structured and time-stamped snapshot representing the initial understanding of the environment and the User posture achieved by Context Capture. |
| Audio Spatial Directive | A dynamic modifier provided by the Domain Access AIM to help the interpretation of the Audio Scene by injecting directional constraints, source focus hints, salience maps, and refinement logic. |
| Audio Action Directive | Instructions issued by the A-User Control AIM to guide the Audio Spatial Reasoning AIM (PGM-ASR) in interpreting and acting upon the audio scene. |
| Output | Description |
| Audio Scene Descriptors | The enriched ASD1 enriched with the results of the reasoning made on the input ASD0, such as motion flags, proximity classification, and acoustic characteristics (e.g. reverb, echo, ambient noise). |
| Audio Action Status | A a report on the execution state and outcome of an Audio Action Directive. |
4. SubAIMs (informative)
Figure 2 gives the Reference Model of the Audio Spatial Reasoning Composite AIM including an initial set of SubAIMs.
Figure 2 -Reference Model of the Composite Audio Spatial Reasoning (PGM-ASR) AIM.
Table 2 specifies the Functions performed by PGM-ASP AIM’s SubAIMs in the current example.
Table 2 – Functions performed by PGM-ASP AIM’s SubAIMs (example)
| SubAIM | Specification |
| Object Motion & Proximity | Purpose: Detects movement and proximity of audio objects with the following steps: – Track object trajectories over time. – Classify proximity zones (near, mid, far). – Extracts Spatial Attitude. Output: Motion and proximity metadata for each object. |
| Acoustic Profile Extraction | Purpose: Characterises objects’ Acoustic Profiles with the following steps: – Estimate reverberation (RT60), loudness, timbre, and frequency characteristics. – Identify environmental conditions (e.g., noisy, reverberant). Output: Acoustic Profile for each object |
| Audio Object Identification | Purpose: Adds preliminary semantic meaning to audio objects with the following steps: – Classify objects into broad categories (speech, music, noise, alarm). – Attach confidence scores. Output: Instance Identifier. |
| Object Salience Ranking | Purpose: Prioritises audio objects based on relevance with the following step: – Rank objects using proximity, semantic importance, and A-User Control Directives. Output: Ranked Audio Objects list. |
| Audio Scene Description | Purpose: Aggregates all enriched data into ASD₁ with the following steps: – Combine spatial, acoustic, semantic, and salience metadata. – Add PointOfView, EnrichmentTime, AIM ID. Output: ASD₁ is passed to DAC for domain-specific enrichment (and will be received as ASD₂). |
Table 3 gives the AIMs composing the Audio Spatial Reasoning (PGM-ASR) Composite AIM:
Table 3 – AIMs of the Audio Spatial Reasoning (PGM-ASR) Composite AIM
| # | SubAIM | Input | Output | To |
| OMP | Object Motion & Proximity | Audio Scene Descriptors | Spatial Attitudes, Proximity Class | ASD |
| Spatial Attitudes | APE | |||
| APE | Acoustic Profile Extraction | Audio Scene Descriptors | Audio Objects, Acoustic Profile | AOI |
| AOI | Audio Object Identification | Audio Objects, Acoustic Profiles, Motion Flags | Audio Object IDs | OSR |
| OSR | Object Salience Ranking | Audio Object IDs, Proximity Class | Ranked Audio Objects | ASD |
| ASD | Audio Scene Description | Spatial Attitudes, ProximityClass, AcousticProfile, Audio Objects,
Audio Object IDs, RankedAudio Objects |
ASD₁ | DAC |
| VSD | Visual Scene Description | Object Audio Characteristics | VDS₁ | DAC |
https://schemas.mpai.community/PGM1/V1.0/AIMs/AudioSpatialReasoning.json
6. Profiles
No Profiles
