1 Definition
A Data Type whose instance represents analogue signals – or is rendered to be perceived – in the human-visible range (380 to 700 nanometres).
2 Functional Requirements
A Visual Qualifier must allow the expression of the following Elements:
- Sub-Types
- Colour
- Transparency
- Brightmess
- Formats
- Content
- Sampling
- Time
- Space
- SD
- Static
- Dynamic
- 3D
- Static
- Dynamic
- Sampling
- Transport
- Content
- Attributes
- Source
- Real
- Synthetic
- Metadata
- VisualMetadataFormats
- Object Identity
- Content Description
- Device
- Device ID
- Device Location
- Sensor Characteristics
- Source
3 Syntax
https://schemas.mpai.community/TFA/V1.0/data/VisualQualifier.json
4 Semantics
-
Sub-Types
-
Colour
- Definition: the parameters that characterise the digital representation of the colour information of a Visual instance.
- Parameters
- Colour Formats
- Definition: the specific mapping of the colour space
- Methods
- Rec. ITU-R BT. 709 (https://www.itu.int/rec/R-REC-BT.709)
- Rec. ITU-R BT. 2020 (https://www.itu.int/rec/R-REC-BT.2020)
- SMPTE ST 2036-1 (https://www.intertekinform.com/en-gb/standards/smpte-st-2036-1-2014-1037963_saig_smpte_smpte_2422024/)
- Alpha-channel
- Definition: a component that represents the degree of transparency of a colour of a Visual instance.
- Methods
- A number between 0 and 1.
- Brightness
- Definition: Method to express maximum value of intensity than a Visual instance can take
- Units of measure
- Nit (candelas/sqm)
- YUV
- Definition; The specific types of YUV transformation of the three colour axes.
- YUV Formats
- Y’UV
- Y’PbPr
- Y’CbCr
- YDbDr
- Y’IQ
- Colour Subsampling
- Definition: The specific methods of subsampling the colour information
- Methods
- 4:4:4
- 4:2:2
- 4:1:1
- YMCK
- Definition: the specific colour axis rotation used by the printing industry with the addition of the Black channel.
- Colour Formats
-
-
Formats
-
Content
-
- Sampling
- Definitions: The characteristics of the transformation from a Visual instance in a real space to a Visual entity in the Virtual Space.
- Characteristics
- Time
- Definition: method to define the period between digital representations of snapshots of a Visual instance.
- Methods
- Time between snapshots.
- Space
- Definitions: method to represent the density of visual samples in the Virtual Space.
- Methods
- Dots per inch (dpi)
- SamplePrecision:
- Definition: Integer representing the number of bits/pixel
- Time
- Characteristics
- Definitions: The characteristics of the transformation from a Visual instance in a real space to a Visual entity in the Virtual Space.
- 2D
- Definition: the method to represent a time-independent or time-dependent Visual instance as 2D information
- Methods
- Static
- BMP (https://docs.fileformat.com/image/bmp/)
- Bounding Box (https://mpai.community/standards/mpai-osd/v1-1/data-types/bounding-box/)
- JPEG (ISO/IEC 10918-1:1994)
- JPEG 2000 (ISO/IEC 15444-1:2019)
- JPEG XS (ISO/IEC 21122-1:2024)
- PNG (https://www.w3.org/TR/2003/REC-PNG-20031110/)
- RAW (https://docs.fileformat.com/image/raw/)
- SVG (https://www.w3.org/TR/SVG2/)
- TIFF (https://www.itu.int/itudoc/itu-t/com16/tiff-fx/docs/tiff6.pdf)
- Dynamic
- AVC (ISO/IEC 14496-10:2022)
- AV1 (https://aomediacodec.github.io/av1-spec/av1-spec.pdf)
- EVC (ISO/IEC 23094-1:2020)
- HEVC (ISO/IEC 23008-2:2023)
- LCEVC (ISO/IEC 23094-2:2021)
- VVC (ISO/IEC 23090-2:2023)
- Static
- 3D
- Definition: the method to represent a time-independent or time-dependent Visual instance as 3D information
- Methods
- Static
- 3DS (https://docs.fileformat.com/3d/3ds/)
- Bounding Box (https://mpai.community/standards/mpai-osd/v1-1/data-types/bounding-box/)
- glTF (https://registry.khronos.org/glTF/specs/2.0/glTF-2.0.html)
- G-PCC (ISO/IEC 23090-9:2023)
- OBJ (https://docs.fileformat.com/3d/obj/)
- USD (https://openusd.org/release/index.html)
- V-PCC (ISO/IEC 23090-5:20230)
- Dynamic
- FBX (https://docs.fileformat.com/3d/fbx/)
- glTF (https://registry.khronos.org/glTF/specs/2.0/glTF-2.0.html)
- G-PCC (ISO/IEC 23090-9:2023)
- USD (https://openusd.org/release/index.html)
- V-PCC (ISO/IEC 23090-5:20230)
- Static
- Sampling
-
-
Transport
- Definition: the method used to transport a Visual instance
- Methods
- File
- AVI (https://docs.fileformat.com/video/avi/)
- EXIF (https://home.jeita.or.jp/tsc/std-pdf/CP3451C.pdf)
- JPEG XS (ISO/IEC 21122-3:2022)
- MP4 (ISO/IEC 14496-12:2022)
- Stream
- DASH (ISO/EC 23009-1:2022)
- HTTP Live Streaming (https://datatracker.ietf.org/doc/html/rfc8216)
- WebRTC (https://www.w3.org/TR/webrtc/)
- MPEG-2 TS (ISO/IEC 13818-1:2023)
- File
-
-
Attributes
-
Source Type
- Definition: the types of a Visual instance
- Types:
- Real
- Raster
- Synthetic
- Raster
- Vector
- Real
-
Metadata
- Definition: the method used to attach information to a Visual instance.
- Methods
- Visual Metadata Formats
- Dublin Core (ISO 15836-1:2017)
- IPTC Photo Metadata (https://www.iptc.org/std/photometadata/specification/IPTC-PhotoMetadata)
- XMP (https://docs.fileformat.com/misc/xmp/)
- Object IDs
- Instance Identifier (https://mpai.community/standards/mpai-osd/v1-1/data-types/instance-identifier/)
- EntityInternalStatus
- Personal Status (https://mpai.community/standards/mpai-mmc/v2-2/data-types/personal-status/)
- Visual Metadata Formats
-
Device
- Definition: elements of the device that captured the Visualinstance.
- Elements
- Device ID
- Definition: an identifier of the device that captured the Speech instance
- Types
- A string.
- Device Location
- Definition: the method to define the position and orientation of the device that captured a Visual instance in a real or virtual space.
- Methods
- Point of View (https://mpai.community/standards/mpai-osd/v1-1/data-types/point-of-view/)
- Methods
- Definition: the method to define the position and orientation of the device that captured a Visual instance in a real or virtual space.
- Sensor characteristics
- Definition: sensor features having an impact on the captured Visual instance
- Features
- Device ID
-