<-AI Workflows Go to ToC Data Types->
1. Technical Specification | 2. Conformance Testing | 3. Performance Assessment |
1. Technical Specifications
Table 1 provides the links to the specifications and the JSON syntax of all AIMs specified by Technical Specification: Context-based Audio Enhancement (MPAI-MMC) – Use Cases (CAE-USC) V2.3. The AI Modules specified by CAE-USC V2.3 supersede those specified by previous versions. These may be used if their Version is explicitly signaled. AIMs in bold are Composite.
Table 1 – Specifications and JSON syntax of AIMs used by CAE-USC V2.3
2. Conformance Testing
An implementation of an AI Module conforms with CAE-USC V2.3 if it accepts as input and produces as output Data and/or Data Objects conforming with those specified by CAE-USC V2.3. Note that a Data Object is defined as the combination of Data of a Data Type and its Qualifier.
The Conformance of an instance of Data of a Data Type is to be expressed by a sentence like “Data validates against the Data Type Schema”. This means that:
- Any Data Sub-Type is as signaled in the Qualifier.
- The Data, File, and/or Stream have the Format signaled by the Qualifier.
- The Attributes of the Data have the type or validate against the Schemas specified in the Qualifier.
The method to Test the Conformance of a Data or Data Object instance is specified in the Data Types chapter.
3. Performance Assessment
AIM Performance Assessment provides methods of assessing the performance of an AIM. Performance may have various connotations, such as:
- Quality: Performance Assessment measures how well an AIM performs its function, using a metric that depends on the nature of the function, e.g., the perceived quality of a stereo audio.
- Bias: Performance Assessment measures how well an AIM performs its function, using a metric that depends on a bias related to certain attributes of the AIM. For instance, an Audio Source Localisation AIM tends to be more accurate in localising certain types of Audio Objects that with Objects of another type.
- Legal compliance: Performance Assessment measures how well an AIM performs its function, using a metric that assesses its accordance with a certain legal standard.
Assessing the Performance of an AIM may be complex because of the multiple dimensions involved with the input and output data of an AIM.