Go to MPAI-OSD Data Types

Definition Functional Requirements Syntax Semantics Conformance Testing Performance Assessment

1      Definition

An Item including a series of Multimodal Scene Descriptors for a duration.

2      Functional Requirements

An Multimodal Event Descriptors instance must include:

  1. The Multimodal Event Descriptors Header
  2. The ID of the Multimodal Event Descriptors.
  3. The IDs or the Multimodal Scene Descriptors of the Multimodal Scene Descriptors included in the Multimodal Event instance.

An Multimodal Event Descriptors instance may include:

  1. The ID of a Virtual Space (M-Instance) to which it refers.
  2. The ID of a U-Environment to which it refers.
  3. The Space-Time information of the Multimodal Event instance.
  4. Information about this Multimodal Event instance.
  5. Descriptive Metadata.

3      Syntax

https://schemas.mpai.community/OSD/V1.5/data/MultimodalEventDescriptors.json

4      Semantics

Label

Description

Header

Multimodal Event Descriptors Header – Standard “OSD-mED-Vx.y”

MInstanceID

Identifier of the M-Instance.

UEnvironment

Identifier of the U-Environment.

MultimodalEventDescriptorsID

ID of this Multimodal Event Descriptors instance.

MultimodalEventDescriptorsTime

Space and Time of Multimodal Event Descriptors.

MultimodalEventDescriptorsSpaceTime

Space and Time of Multimodal Event Descriptors.

MultimodalSceneDescriptors[]

Set of Multimodal Scene Descriptors in the Multimodal Event.

– MultimodalSceneObjectSpaceTime

A set of Multimodal Scene Descriptors of the Multimodal Event.

DataXMData

Information on this Multimodal Event Descriptors instance.

DescrMetadata

Descriptive Metadata

5     Conformance Testing

A Data instance Conforms with MPAI-OSD Multimodal Event Descriptors (OSD-LED) if:

  1. The Data validates against the Multimodal Event Descriptors’ JSON Schema.
  2. All Data in the Multimodal Event Descriptors’ JSON Schema
    1. Have the specified type
    2. Validate against their JSON Schemas
    3. Conform with their Data Qualifiers if present.

6     Performance Assessment