(Informative)

Technical Specification: Object and Scene Description (MPAI-OSD) Version 1.1 (V1.1) – in the following also called MPAI-OSD V1.1 or MPAI-OSD– has been developed by MPAI – Moving Picture, Audio, and Data Coding by Artificial Intelligence, the international, unaffiliated, non-profit organisation developing standards for Artificial Intelligence (AI)-based data coding with clear Intellectual Property Rights licensing frameworks in compliance with the rigorous MPAI Process [9,10] in pursuit of the following policies:

  1. Be friendly to the AI context but, to the extent possible, agnostic to the technology – AI or Data Processing – used in an implementation.
  2. Be attractive to different industries, end users, and regulators.
  3. Address three levels of standardisation all exposing standard interfaces with an aggregation level decided by the implementer:
    • data types.
    • Components called AI Modules (AIM).
    • Configurations of AIMs called AI Workflows (AIW).
  4. Specify the data exchanged by AIMs with as clear a semantic as possible.

As manager of the MPAI Ecosystem specified by Governance of MPAI Ecosystem (MPAI-GME) [1] and ensures that a user can:

  1. Operate a reference implementation of the Technical Specification, by providing a Reference Software Specification with annexed software.
  2. Test the conformance of an implementation with the Technical Specification, by providing the Conformance Testing Specification.
  3. Assess the performance of an implementation of a Technical Specification, by providing the Performance Assessment Specification.
  4. Get conforming implementations possibly with a performance assessment report from a trusted source through the MPAI Store.

In many MPAI Technical Specifications there are data types that refer to Objects and Scenes that can be uni- and multimodal and possibly refer to locations that may be in a physical or virtual space.

MPAI values the consistent use of data types across its Technical Specifications and MPAI-OSD has been developed to be the reference point for the consistent use of Data Types across MPAI standards. When consistency is not possible because different usages are consolidated, such usages are clearly identified, and individual specific usages recorded.

MPAI-OSD will be accompanied by the Reference Software, Conformance Testing, and Performance Assessment Specifications. Conformance Testing specifies methods enabling users to ascertain whether a data type generated by an AIM, an AIM, or an AIW conform with this Technical Specification.