Go to PGM-AUA V1.0 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

Definition

Linguistic-Paralinguistic Evidence (PGM-LPE): The evidence borne by the content of the utterances of an Entity and by the manner of their delivery, with the agreement between the two, produced by Linguistic-Paralinguistic Analysis. Evidence that cannot be attributed to an Entity is reported but not asserted of any Entity.

Functional Requirements

  1. Header: The Data shall have Header “PGM-LPE-V1.0”.
  2. Identification: The Data shall carry the identifiers of the M‑Instance, of the U‑Environment and of the session, and a unique identifier and a time (LinguisticParalinguisticEvidenceID, LinguisticParalinguisticEvidenceTime).
  3. Utterances: The Data shall include the utterances.
  4. Metadata: The Data shall include DataXMData and may include DescrMetadata.

Syntax

https://schemas.mpai.community/PGM1/V1.0/data/LinguisticParalinguisticEvidence.json

Semantics

Table 1 – Semantics of Linguistic-Paralinguistic Evidence

Label Description
Header Header of the Data Type, with the version. (required)
MInstance Identifier of the M-Instance. (required)
UEnvironment Identifier of the U-Environment. (required)
SessionID Identifier of the A-User session. (required)
LinguisticParalinguisticEvidenceID Identifier of this instance. (required)
LinguisticParalinguisticEvidenceTime Time at which the Data was produced. (required)
Utterances The utterances. (required)
– UtteranceID Utterance ID. (required)
– EntityID Entity to which the Harmonised Multimodal Context attributed the utterance; absent if unattributed.
– Interval Time interval, on the time base of the capture. (required)
–– StartTime Time at which the Data was produced.
–– EndTime Time at which the Data was produced.
– Linguistic Evidence borne by the words of the utterance.
–– Content Propositional content.
–– SpeechAct The speech act the utterance performs. One of: asserting, asking, requesting, promising, declining, acknowledging, other.
–– ReferringExpressions The referring expressions of the utterance and the Entities they denote.
––– Text Text of the referring expression. (required)
––– EntityIDs Identifiers of the Entities.
–– DiscourseRole Role of the utterance in the exchange. One of: opening, responding, continuing, closing, interrupting.
–– Sentiment Sentiment expressed by the words.
–– Stance Stance expressed by the words.
–– Language Language of the utterance.
–– Register Register of the utterance.
–– Formality Formality of the utterance.
– Paralinguistic Evidence borne by the manner of delivery of the utterance.
–– Prosody Prosody of the delivery.
––– PitchContour Pitch contour.
––– Stress Stress.
––– Intonation Intonation.
–– Timing Timing of the delivery.
––– SpeechRate Speech rate.
––– Pausing Pausing.
––– Hesitation Hesitation.
–– VoiceQuality Voice quality.
––– Intensity Intensity.
––– Breathiness Breathiness.
––– Tension Tension.
––– Tremor Tremor.
–– Disfluency Disfluencies found in the utterance. Each one of: repetition, repair, filled_pause.
–– NonVerbal Non-verbal vocalisations found in the utterance. Each one of: laughter, sigh, throat_clearing, other.
– Agreement Whether the delivery reinforces the content, is at variance with it, or one of the two is absent or unusable. One of: reinforcing, at_variance, one_absent.
– Confidence Confidence, 0 to 1.
DataXMData Data Exchange Metadata of MPAI-PTF: provenance, authorisation, security and confidence of the Data.
DescrMetadata Descriptive metadata (plain text, at most 2048 characters).

Conformance Testing

Data conforms with Linguistic-Paralinguistic Evidence if it validates against the schema of Section 3. If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema.

Performance Assessment

Not part of this specification.

Go to PGM-AUA V1.0 Data Types