(Informative)
Technical Specification: Object and Scene Description (MPAI-OSD) Version 1.1 (V1.1) – in the following also called MPAI-OSD V1.1 or MPAI-OSD – has been developed by MPAI – Moving Picture, Audio, and Data Coding by Artificial Intelligence, the international, unaffiliated, non-profit organisation developing standards for Artificial Intelligence (AI)-based data coding with clear Intellectual Property Rights licensing frameworks in compliance with the rigorous MPAI Process in pursuit of the following policies:
- Be friendly to the AI context but, to the extent possible, agnostic to the technology – AI or Data Processing – used in an implementation.
- Be attractive to different industries, end users, and regulators.
- Address five standardisation areas:
- Data Type, a particular type of MPAI-specified Data, e.g., Audio, Visual, Object, Scenes, and Descriptors with as clear semantics as possible.
- Qualifier, specialised Metadata conveying information on a Data Type’s Sub-Type, Format, and Attributes of a Data Type.
- AI Module (AIM), MPAI-specified processing elements with identified functions and input/output Data.
- AI Workflow (AIW), MPAI-specified configurations of AIMs with identified functions and input/output Data.
- AI Framework (AIF), an environment enabling dynamic configuration, initialisation, and control of AIWs.
- Provide appropriate Governance of the ecosystem created by MPAI Technical Specifications enabling users to:
-
- Operate Reference Software Implementations of MPAI Technical Specifications attached to Reference Software Specifications
- Test the conformance of an implementation with a Technical Specification based on the Conformance Testing Specification.
- Assess the performance of an implementation of a Technical Specification based on the Performance Assessment Specification.
- Get conforming implementations possibly with a performance assessment report from a trusted source through the MPAI Store.
Many MPAI Technical Specifications need data types that refer to Objects and Scenes. These can be uni- and multimodal and possibly refer to locations that may be in a virtual space.
MPAI-OSD has been developed to be the reference point for the consistent use of Data Types across MPAI standards in pursuit of a consistent use of data types across its Technical Specifications. When consistency is not possible because different usages are consolidated, such usages are clearly identified, and individual specific usages recorded.
MPAI-OSD will be accompanied by the Reference Software, Conformance Testing, and Performance Assessment Specifications. Reference Software offers users the opportunity to access Implementations that are Conforming with the Technical Specification. Conformance Testing specifies methods enabling users to ascertain whether a data type generated by an AIM, an AIM, or an AIW conform with this Technical Specification. Performance Assessment specifies methods to assess the performance of an implementation.