1 Function | 2 Reference Model | 3 Input/Output Data |
4 SubAIMs | 5 JSON Metadata | 6 Profiles |
7 Reference Software | 8 Conformance Texting | 9 Performance Assessment |
1 Functions
Visual Object Identification (OSD-VOI):
Receives | Visual Scene Geometry | The arrangement of the objects in the Scene. |
Visual Objects | The Objects in the Scene. | |
Body Descriptors | Descriptors of the Body indicating the object. | |
Produces | Visual Instance ID | Identifying a Visual Object in the Scene that belongs to some level in a taxonomy. |
2 Reference Model
Figure 1 specifies the Reference Model of Visual Object Identification (OSD-VOI) AIM.
Figure – The Visual Object Identification (OSD-VOI) AIM Reference Model
3 Input/Output Data
Table 1 specifies the Input and Output Data of the Visual Object Identification (OSD-VOI) AIM.
Table 1 – I/O Data of the Visual Object Identification (OSD-VOI) AIM
Input | Description |
Body Descriptors | The Descriptors of the Body Objects of Entities in the Visual Scene. |
Visual Scene Geometry | The digital representation of the spatial arrangement of the Visual Objects of the Scene. |
Visual Object | The Visual Objects in the Visual Scene that are not Entities. |
Output | Description |
Visual Instance Identifier | The Identifier of the specific Visual Object belonging to a level in the taxonomy. |
4 SubAIMs
Visual Object Identification (OSD-VOI) is a Composite AIM specified by Figure 2.
Figure 2 – The Visual Object Identification (OSD-VOI) Composite AIM
Note that the Visual Direction Identification AIM can parse either an AV Scene Geometry or its Visual Scene Geometry subset.
The AIMs composing the Visual Object Identification (OSD-VOI) Composite AIM are:
AIM | AIMs | Names |
OSD-VOI | Visual Object Identification | |
OSD-VDI | Visual Direction Identification | |
OSD-VOE | Visual Object Extraction | |
OSD-VII | Visual Instance Identification |
5 JSON Metadata
https://schemas.mpai.community/OSD/V1.2/AIMs/VisualObjectIdentification.json
6 Profiles
No Profiles.
7 Reference Software
8 Conformance Testing
Table 2 provides the Conformance Testing Method for OSD-VOI AIM. Conformance Testing of the individual AIMs of the OSD-VOI Composite AIM are given by the individual AIM Specification.
Note that a schema may contain references to other schemas. In this case, validation of data for the primary schema implies that any data that refers to a secondary schema shall also validate.
Table 2 – Conformance Testing Method for OSD-VOI AIM
Receives | Visual Scene Geometry | Shall validate against Visual Scene Geometry schema. |
Visual Objects | Shall validate against Visual Objects schema. Visual Data shall conform with Qualifier. |
|
Body Descriptors | Shall validate against Body Descriptors XML schema. | |
Produces | Visual Instance ID | Shall validate against Instance ID schema. |
9 Performance Assessment
Performance Assessment of an OSD-VOI AIM Implementation shall be performed using a dataset of static 3D Visual Scenes each containing an Entity described by Body Descriptors, Visual Scene Geometry, and associated Visual Objects annotated with the ID of the Visual Object in the Visual Scene the index finger of the Entity is pointing to.
The Performance Assessment Report of a OSD-VDI AIM Implementation shall include:
- The identifier of the dataset.
- The Accuracy of Visual Object identification.