1 Definition 2 Functional Requirements 3 Syntax 4 Semantics

1 Definition

A Behavioural Signal Qualifier specifies metadata describing a Behavioural Signal Data instance. It does not contain signal samples; instead, it provides information about:

  • the Sub‑Type of the behavioural signal (e.g., gait trajectory, hand gesture sequence, facial action units, touchscreen interaction trace),
  • the Format used to encode the signal (e.g., JSON event stream, CSV time‑series, motion‑capture binary format, interaction log format), and

The Behavioural Signal Qualifier is used in conjunction with Behavioural Signal Data and is aggregated by the Behavioural Signal Object defined in MPAI‑AIH/HSP.

The combination of Behavioural Signal Data and Behavioural Signal Qualifier is called Behavioural Signal Object, specified by AIH-HSP V1.0.

2 Functional Requirements

  • Behavioural Signal Sub‑Type Identification The Behavioural Signal Qualifier shall specify the Sub‑Type of the Behavioural Signal Data.
  • Behavioural Signal Format Identification The Behavioural Signal Qualifier shall specify the Format used to encode the Behavioural Signal Data.
  • Separation from Data The Behavioural Signal Qualifier shall not contain intrinsic behavioural signal samples; it shall only describe the Behavioural Signal Data.
  • Interpretability of Data The Behavioural Signal Qualifier shall provide sufficient information to interpret the Behavioural Signal Data.

Users needing additional entries in the Physiological Signal Qualifier or support of new Qualifiers should make a documented request to the MPAI Secretariat. Requests will be considered by the appropriate MPAI committee.

3 Syntax

https://schemas.mpai.community/TFA/V1.5/data/BehaviouralSignalQualifier.json

4 Semantics

  1. Sub‑Types
    • Motor Behaviour
      • Gait
      • Upper‑limb movement
      • Whole‑body movement
      • Fine motor actions
    • Gesture Behaviour
      • Hand gestures
      • Arm gestures
      • Body gestures
    • Facial Behaviour
      • Facial action units
      • Facial expressions
      • Eye region movements (non‑EOG)
    • Interaction Behaviour
      • Touchscreen interactions
      • Keyboard interactions
      • Mouse interactions
      • Controller interactions
    • Speech‑Related Behaviour
      • Speech activity (voice activity detection)
      • Prosodic behaviour (pitch, intensity, rhythm)
      • Articulatory movement traces (non‑audio)
  1. Formats
    • Motor Behaviour Formats
      • CSV / TSV (motion time‑series)
      • JSON (motion event stream)
      • BVH (Biovision Hierarchy)
      • C3D (3D motion capture format)
      • HDF5 (structured motion datasets)
    • Gesture Behaviour Formats
      • CSV / TSV
      • JSON
      • BVH
      • C3D
      • HDF5
    • Facial Behaviour Formats
      • CSV / TSV (facial landmark time‑series)
      • JSON (facial action event stream)
      • HDF5
      • C3D (3D facial motion capture)
      • BVH (hierarchical facial motion)
    • Interaction Behaviour Formats
      • CSV / TSV (interaction logs)
      • JSON (event‑based interaction logs)
      • XML (interaction trace format)
      • HDF5
    • Speech‑Related Behaviour Formats
      • CSV / TSV (prosodic features)
      • JSON (speech activity events)
      • HDF5
      • RTTM (Rich Transcription Time Marked – activity only)
      • TextGrid (timing annotations)

 

5 References