Go to PGM-AUA V1.0 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

Definition

AUC-CXT (PGM-UCC) is the Data Type that A‑User Control and Context Description exchange. It has two modes: the Request (RQ), sent by A‑User Control to Context Description, and the Response (RS), sent by Context Description to A‑User Control. The Request sets a goal that Context Description attempts: it is binding as to the goal and the constraints it imposes and advisory as to the conclusion. Every Request is answered by a Response that reports the goal Context Description understood, the outcome reached and, if the goal was not achieved as requested, the reason.

Functional Requirements

  1. Header and Mode: The Data shall have Header “PGM-UCC-V1.0” and Mode equal to RQ for a Request and to RS for a Response; the properties that belong to the other mode shall not be present.
  2. Identification: The Data shall carry the identifiers of the M‑Instance, of the U‑Environment and of the session, and a unique identifier and a time (AUCCXTID, AUCCXTTime).
  3. Correlation: A Response shall carry the identifier (RequestID) of the Request that it answers; a Request that continues an exchange shall carry, in Exchange, the identifier of the Response to which it follows.
  4. Instruction: A Request shall state the Instruction (PED, GLA, PKQ, GII, PRF, PCE, CME or AFR) under which A‑User Control issues it.
  5. Storage: A Request may state what Context Description may write to and read from the Private Storage of the Module, under the rules set by A‑User Control; the Response reports the outcome of the writes in StorageOutcome.
  6. Process Action outcome: A Request may convey the outcome of a Process Action performed by A‑User Control, so that Context Description operates knowing the current state of the M‑Instance.
  7. Outcome and Reason: A Response shall state the goal as it was understood (GoalUnderstood, where the type has it) and the Outcome (achieved, achieved_differently or not_achieved); when the Outcome is not achieved, the Response shall carry a Reason.
  8. Control by medium: A Request may control the capture and the processing of each of Audio, Visual, Text, Speech and User, at property level, with a Requirement (required, optional or not_requested) for each property; the Response reports, for each medium, the outcome and the fulfilment of each property.
  9. Domain policy: A Request may state whether Context Description may obtain Domain information from Domain Access.
  10. Metadata: The Data shall include DataXMData and may include DescrMetadata.

Syntax

https://schemas.mpai.community/PGM1/V1.0/data/AUCCXT.json

Semantics

Table 1 gives the properties common to the two modes, Table 2 those of the Request and Table 3 those of the Response.

Table 1 – Properties common to the Request and the Response of AUC-CXT

Label Description
Header Header of the Data Type, with the version. (required)
Mode RQ for a Request (A-User Control to the AIM), RS for a Response (the AIM to A-User Control). One of: RQ, RS. (required)
MInstance Identifier of the M-Instance. (required)
UEnvironment Identifier of the U-Environment. (required)
SessionID Identifier of the A-User session. (required)
AUCCXTID Identifier of this Request or Response. (required)
AUCCXTTime Time at which the Request or the Response was produced. (required)
CaptureIndex Spatial position of the capture within the current session. CaptureIndex of the Request.
DataXMData Data Exchange Metadata of MPAI-PTF: provenance, authorisation, security and confidence of the Data.
DescrMetadata Descriptive metadata (plain text, at most 2048 characters).
AVA The alignment of audio and visual Entities: what is required, the tolerance on positions and the criteria for the Joint Salience (produced only when required).
– Properties Properties.
–– CandidateAssociation Candidate Association. One of: required, optional, not_requested.
–– CorrespondenceResolution Correspondence Resolution. One of: required, optional, not_requested.
–– SceneGeometry Scene Geometry. One of: required, optional, not_requested.
–– JointSalience Joint Salience. One of: required, optional, not_requested.
– PositionTolerance Tolerance on the divergence of the position estimates of the two modalities.
– SalienceCriteria Salience Criteria.
AVAOutcome Outcome for the alignment of audio and visual Entities.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– ObjectIdentifiers Request: whether the production of the identifiers of the objects is required, optional or not_requested. Response: fulfilment of the production of the identifiers of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Velocity Request: whether the production of the velocity of the objects is required, optional or not_requested. Response: fulfilment of the production of the velocity of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Distances Request: whether the production of the distances between the objects is required, optional or not_requested. Response: fulfilment of the production of the distances between the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– ProximityClass Request: whether the production of the proximity class of the objects is required, optional or not_requested. Response: fulfilment of the production of the proximity class of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– FrequencyRange Request: whether the production of the frequency range is required, optional or not_requested. Response: fulfilment of the production of the frequency range (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Timbre Request: whether the production of the timbre is required, optional or not_requested. Response: fulfilment of the production of the timbre (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Spectrogram Request: whether the production of the spectrogram is required, optional or not_requested. Response: fulfilment of the production of the spectrogram (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Loudness Request: whether the production of the loudness is required, optional or not_requested. Response: fulfilment of the production of the loudness (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Reflectivity Request: whether the production of the reflectivity is required, optional or not_requested. Response: fulfilment of the production of the reflectivity (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Reverberation Request: whether the production of the reverberation is required, optional or not_requested. Response: fulfilment of the production of the reverberation (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Diffusion Request: whether the production of the diffusion is required, optional or not_requested. Response: fulfilment of the production of the diffusion (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Absorption Request: whether the production of the absorption is required, optional or not_requested. Response: fulfilment of the production of the absorption (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Doppler Request: whether the production of the Doppler effects is required, optional or not_requested. Response: fulfilment of the production of the Doppler effects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– RankedObjects Request: whether the production of the objects ranked by relevance is required, optional or not_requested. Response: fulfilment of the production of the objects ranked by relevance (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– FilteredSalientObjects Request: whether the production of the filtered salient objects is required, optional or not_requested. Response: fulfilment of the production of the filtered salient objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.

Table 2 – Properties of the Request (Mode RQ)

Label Description
Instruction The Instruction under which AUC issues the Request. One of: PED, GLA, PKQ, GII, PRF, PCE, CME, AFR. (required)
Exchange Exchange. (required)
– Phase Whether the Request starts an exchange (new) or continues one (continuation). One of: new, continuation. (required)
– ResponseID ID of the Response to which a continuation Request follows.
Storage What the AIM may write to and read from the Private Storage of the Module, under the rules set by AUC.
– Write Data that the AIM may write, with the rules that apply.
–– Category Category of the data. (required)
–– Readers AIMs that may read the datum.
–– Time Longest time the datum is kept: module, session or persistent. One of: module, session, persistent.
– Read Categories of data that may be read.
ProcessActionOutcome Outcome of a Process Action performed by AUC in the M-Instance, conveyed so that the AIM operates knowing the current M-Instance state.
– PAStatus PA Status of the Process Action: Ack or the reason of the refusal (Clash, FaultyReq, IncID, IncDQ, InsRights, InsValue, LocOOR, PostRef, QualNS).
– Complements The Complements received with the Process Action Response.
– Constraint Resulting constraint on the Goal.
Goal Binding as to the objective and the constraints. (required)
– Objective The objective to pursue. (required)
– Constraints Constraints, as strings.
Audio Control of the capture and of the processing of the Audio (Audio Scene Descriptors).
– Capture How the medium is captured.
–– Requirement Whether it is required, optional or not requested. One of: required, optional, not_requested.
–– Priority Priority level. One of: low, normal, high.
–– Subject What the capture is directed at.
––– MLocation M-Locations the capture is directed at.
––– Scene Identifiers of the scenes.
––– Objects Identifiers of the objects.
––– Users Identifiers of the Users.
–– PointOfView Spatial attitude from which the capture is made.
–– Framing Framing strategy.
––– Region Region of the Space to frame.
––– TemporalWindow Temporal window to frame.
–– Acquisition Acquisition parameters of the capture.
––– Duration Duration of the capture, in seconds.
––– Deadline Time by which the capture shall be completed.
– Properties The properties to be produced, at property level.
–– ObjectIdentifiers Request: whether the production of the identifiers of the objects is required, optional or not_requested. Response: fulfilment of the production of the identifiers of the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Velocity Request: whether the production of the velocity of the objects is required, optional or not_requested. Response: fulfilment of the production of the velocity of the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Distances Request: whether the production of the distances between the objects is required, optional or not_requested. Response: fulfilment of the production of the distances between the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– ProximityClass Request: whether the production of the proximity class of the objects is required, optional or not_requested. Response: fulfilment of the production of the proximity class of the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– FrequencyRange Request: whether the production of the frequency range is required, optional or not_requested. Response: fulfilment of the production of the frequency range (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Timbre Request: whether the production of the timbre is required, optional or not_requested. Response: fulfilment of the production of the timbre (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Spectrogram Request: whether the production of the spectrogram is required, optional or not_requested. Response: fulfilment of the production of the spectrogram (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Loudness Request: whether the production of the loudness is required, optional or not_requested. Response: fulfilment of the production of the loudness (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Reflectivity Request: whether the production of the reflectivity is required, optional or not_requested. Response: fulfilment of the production of the reflectivity (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Reverberation Request: whether the production of the reverberation is required, optional or not_requested. Response: fulfilment of the production of the reverberation (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Diffusion Request: whether the production of the diffusion is required, optional or not_requested. Response: fulfilment of the production of the diffusion (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Absorption Request: whether the production of the absorption is required, optional or not_requested. Response: fulfilment of the production of the absorption (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Doppler Request: whether the production of the Doppler effects is required, optional or not_requested. Response: fulfilment of the production of the Doppler effects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– RankedObjects Request: whether the production of the objects ranked by relevance is required, optional or not_requested. Response: fulfilment of the production of the objects ranked by relevance (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– FilteredSalientObjects Request: whether the production of the filtered salient objects is required, optional or not_requested. Response: fulfilment of the production of the filtered salient objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
– TemporalScope Temporal scope of the processing.
–– Mode RQ for a Request (A-User Control to the AIM), RS for a Response (the AIM to A-User Control). One of: instantaneous, windowed.
–– WindowDurationMs Duration of the window, in milliseconds.
Visual Control of the capture and of the processing of the Visual (Visual Scene Descriptors).
– Capture How the medium is captured.
–– Requirement Whether it is required, optional or not requested. One of: required, optional, not_requested.
–– Priority Priority level. One of: low, normal, high.
–– Subject What the capture is directed at.
––– MLocation M-Locations the capture is directed at.
––– Scene Identifiers of the scenes.
––– Objects Identifiers of the objects.
––– Users Identifiers of the Users.
–– PointOfView Spatial attitude from which the capture is made.
–– Framing Framing strategy.
––– Region Region of the Space to frame.
––– TemporalWindow Temporal window to frame.
–– Acquisition Acquisition parameters of the capture.
––– Duration Duration of the capture, in seconds.
––– Deadline Time by which the capture shall be completed.
– Properties The properties to be produced, at property level.
–– ObjectIdentifiers Request: whether the production of the identifiers of the objects is required, optional or not_requested. Response: fulfilment of the production of the identifiers of the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– SpatialAttitudes Request: whether the production of the spatial attitudes of the objects is required, optional or not_requested. Response: fulfilment of the production of the spatial attitudes of the objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– RelativeDepths Request: whether the production of the relative depths is required, optional or not_requested. Response: fulfilment of the production of the relative depths (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– OcclusionFlags Request: whether the production of the occlusion flags is required, optional or not_requested. Response: fulfilment of the production of the occlusion flags (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– AffordanceTags Request: whether the production of the affordance tags is required, optional or not_requested. Response: fulfilment of the production of the affordance tags (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– InteractionPotential Request: whether the production of the interaction potential is required, optional or not_requested. Response: fulfilment of the production of the interaction potential (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– RankedVisualObjects Request: whether the production of the visual objects ranked by relevance is required, optional or not_requested. Response: fulfilment of the production of the visual objects ranked by relevance (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– SalientVisualObjects Request: whether the production of the salient visual objects is required, optional or not_requested. Response: fulfilment of the production of the salient visual objects (produced, partial, missing or not_requested). One of: required, optional, not_requested.
– TemporalScope Temporal scope of the processing.
–– Mode RQ for a Request (A-User Control to the AIM), RS for a Response (the AIM to A-User Control). One of: instantaneous, windowed.
–– WindowDurationMs Duration of the window, in milliseconds.
Text Control of the capture and of the processing of the Text, native or converted from the Speech.
– Capture How the medium is captured.
–– Requirement Whether it is required, optional or not requested. One of: required, optional, not_requested.
–– Priority Priority level. One of: low, normal, high.
–– Subject What the capture is directed at.
––– MLocation M-Locations the capture is directed at.
––– Scene Identifiers of the scenes.
––– Objects Identifiers of the objects.
––– Users Identifiers of the Users.
–– PointOfView Spatial attitude from which the capture is made.
–– Framing Framing strategy.
––– Region Region of the Space to frame.
––– TemporalWindow Temporal window to frame.
–– Acquisition Acquisition parameters of the capture.
––– Duration Duration of the capture, in seconds.
––– Deadline Time by which the capture shall be completed.
– Properties The properties to be produced, at property level.
–– TextObject Request: whether the production of the Text Object is required, optional or not_requested. Response: fulfilment of the production of the Text Object (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– Segmentation Request: whether the production of the segmentation of the Text is required, optional or not_requested. Response: fulfilment of the production of the segmentation of the Text (produced, partial, missing or not_requested). One of: required, optional, not_requested.
Speech Control of the capture and of the processing of the Speech.
– Capture How the medium is captured.
–– Requirement Whether it is required, optional or not requested. One of: required, optional, not_requested.
–– Priority Priority level. One of: low, normal, high.
–– Subject What the capture is directed at.
––– MLocation M-Locations the capture is directed at.
––– Scene Identifiers of the scenes.
––– Objects Identifiers of the objects.
––– Users Identifiers of the Users.
–– PointOfView Spatial attitude from which the capture is made.
–– Framing Framing strategy.
––– Region Region of the Space to frame.
––– TemporalWindow Temporal window to frame.
–– Acquisition Acquisition parameters of the capture.
––– Duration Duration of the capture, in seconds.
––– Deadline Time by which the capture shall be completed.
– Properties The properties to be produced, at property level.
–– SpeechDescriptors Request: whether the production of the Speech Descriptors is required, optional or not_requested. Response: fulfilment of the production of the Speech Descriptors (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– LinguisticParalinguisticEvidence Request: whether the production of the Linguistic-Paralinguistic Evidence is required, optional or not_requested. Response: fulfilment of the production of the Linguistic-Paralinguistic Evidence (produced, partial, missing or not_requested). One of: required, optional, not_requested.
– ASREnabled Whether Automatic Speech Recognition shall be active.
– LanguageHints ISO 639-3 codes of the expected languages.
– DomainQueryEnabled Whether the processing may issue Domain Requests.
User Control of the derivation of the first-pass User State.
– Capture How the medium is captured.
–– Requirement Whether it is required, optional or not requested. One of: required, optional, not_requested.
–– Priority Priority level. One of: low, normal, high.
–– Subject What the capture is directed at.
––– MLocation M-Locations the capture is directed at.
––– Scene Identifiers of the scenes.
––– Objects Identifiers of the objects.
––– Users Identifiers of the Users.
–– PointOfView Spatial attitude from which the capture is made.
–– Framing Framing strategy.
––– Region Region of the Space to frame.
––– TemporalWindow Temporal window to frame.
–– Acquisition Acquisition parameters of the capture.
––– Duration Duration of the capture, in seconds.
––– Deadline Time by which the capture shall be completed.
– Properties The properties to be produced, at property level.
–– HarmonisedMultimodalContext Request: whether the production of the Harmonised Multimodal Context is required, optional or not_requested. Response: fulfilment of the production of the Harmonised Multimodal Context (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– BehaviouralExpressiveIndicators Request: whether the production of the Behavioural and Expressive Indicators is required, optional or not_requested. Response: fulfilment of the production of the Behavioural and Expressive Indicators (produced, partial, missing or not_requested). One of: required, optional, not_requested.
–– CrossModalInterpretationEvidence Request: whether the production of the Cross-Modal Interpretation Evidence is required, optional or not_requested. Response: fulfilment of the production of the Cross-Modal Interpretation Evidence (produced, partial, missing or not_requested). One of: required, optional, not_requested.
– InferencePolicy Policy on inference from the evidence. One of: ObservationOnly, EvidenceBased, RestrictedInference.
– ConfidenceThreshold Minimum confidence required.
– DomainQueryEnabled Whether the processing may issue Domain Requests.
DomainPolicy Policy on the Domain information that Context Description may obtain from Domain Access.
– Query Whether Domain information may be requested. One of: required, optional, not_requested.
– Constraints Constraints, as strings.

Table 3 – Properties of the Response (Mode RS)

Label Description
RequestID ID of the Request this Response answers. (required)
Outcome The outcome reached. One of: achieved, achieved_differently, not_achieved. (required)
Reason Structured reason, required when Outcome is not ‘achieved’.
– Code Code of the reason. One of: none, occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
– Description Description of the reason.
StorageOutcome Outcome of the writes instructed by the Request.
– Category Category of the data. (required)
– Result Result of the operation. One of: written, not_authorised, not_attempted. (required)
GoalUnderstood The goal as the AIM understood it. (required)
– Objective The objective to pursue. (required)
– Constraints Constraints, as strings.
ContextDescriptorsID Identifier of the Context Descriptors produced.
UserPresence User Presence. One of: present, absent, unknown.
AudioOutcome Outcome of the capture and processing of the Audio.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– ObjectIdentifiers Request: whether the production of the identifiers of the objects is required, optional or not_requested. Response: fulfilment of the production of the identifiers of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Velocity Request: whether the production of the velocity of the objects is required, optional or not_requested. Response: fulfilment of the production of the velocity of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Distances Request: whether the production of the distances between the objects is required, optional or not_requested. Response: fulfilment of the production of the distances between the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– ProximityClass Request: whether the production of the proximity class of the objects is required, optional or not_requested. Response: fulfilment of the production of the proximity class of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– FrequencyRange Request: whether the production of the frequency range is required, optional or not_requested. Response: fulfilment of the production of the frequency range (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Timbre Request: whether the production of the timbre is required, optional or not_requested. Response: fulfilment of the production of the timbre (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Spectrogram Request: whether the production of the spectrogram is required, optional or not_requested. Response: fulfilment of the production of the spectrogram (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Loudness Request: whether the production of the loudness is required, optional or not_requested. Response: fulfilment of the production of the loudness (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Reflectivity Request: whether the production of the reflectivity is required, optional or not_requested. Response: fulfilment of the production of the reflectivity (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Reverberation Request: whether the production of the reverberation is required, optional or not_requested. Response: fulfilment of the production of the reverberation (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Diffusion Request: whether the production of the diffusion is required, optional or not_requested. Response: fulfilment of the production of the diffusion (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Absorption Request: whether the production of the absorption is required, optional or not_requested. Response: fulfilment of the production of the absorption (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Doppler Request: whether the production of the Doppler effects is required, optional or not_requested. Response: fulfilment of the production of the Doppler effects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– RankedObjects Request: whether the production of the objects ranked by relevance is required, optional or not_requested. Response: fulfilment of the production of the objects ranked by relevance (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– FilteredSalientObjects Request: whether the production of the filtered salient objects is required, optional or not_requested. Response: fulfilment of the production of the filtered salient objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
VisualOutcome Outcome of the capture and processing of the Visual.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– ObjectIdentifiers Request: whether the production of the identifiers of the objects is required, optional or not_requested. Response: fulfilment of the production of the identifiers of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– SpatialAttitudes Request: whether the production of the spatial attitudes of the objects is required, optional or not_requested. Response: fulfilment of the production of the spatial attitudes of the objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– RelativeDepths Request: whether the production of the relative depths is required, optional or not_requested. Response: fulfilment of the production of the relative depths (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– OcclusionFlags Request: whether the production of the occlusion flags is required, optional or not_requested. Response: fulfilment of the production of the occlusion flags (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– AffordanceTags Request: whether the production of the affordance tags is required, optional or not_requested. Response: fulfilment of the production of the affordance tags (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– InteractionPotential Request: whether the production of the interaction potential is required, optional or not_requested. Response: fulfilment of the production of the interaction potential (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– RankedVisualObjects Request: whether the production of the visual objects ranked by relevance is required, optional or not_requested. Response: fulfilment of the production of the visual objects ranked by relevance (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– SalientVisualObjects Request: whether the production of the salient visual objects is required, optional or not_requested. Response: fulfilment of the production of the salient visual objects (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
TextOutcome Outcome of the capture and processing of the Text.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– TextObject Request: whether the production of the Text Object is required, optional or not_requested. Response: fulfilment of the production of the Text Object (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– Segmentation Request: whether the production of the segmentation of the Text is required, optional or not_requested. Response: fulfilment of the production of the segmentation of the Text (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
SpeechOutcome Outcome of the capture and processing of the Speech.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– SpeechDescriptors Request: whether the production of the Speech Descriptors is required, optional or not_requested. Response: fulfilment of the production of the Speech Descriptors (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– LinguisticParalinguisticEvidence Request: whether the production of the Linguistic-Paralinguistic Evidence is required, optional or not_requested. Response: fulfilment of the production of the Linguistic-Paralinguistic Evidence (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
– DomainQueryStatus Whether Domain Requests were issued. One of: issued, not_issued.
UserOutcome Outcome of the derivation of the first-pass User State.
– Outcome Outcome reached. One of: produced, partial, failed, not_requested. (required)
– ChannelState State of the capture channel. One of: active, inactive, error.
– Reasons Reasons why the goal was not fully achieved.
–– Reason Reason (Response) or explanation (Correction). One of: occluded, out_of_range, target_lost, no_signal, insufficient_data, not_permitted, deadline_exceeded. (required)
–– EntityID Identifier of the Entity concerned.
– PropertyFulfilment Fulfilment of the requested properties.
–– HarmonisedMultimodalContext Request: whether the production of the Harmonised Multimodal Context is required, optional or not_requested. Response: fulfilment of the production of the Harmonised Multimodal Context (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– BehaviouralExpressiveIndicators Request: whether the production of the Behavioural and Expressive Indicators is required, optional or not_requested. Response: fulfilment of the production of the Behavioural and Expressive Indicators (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
–– CrossModalInterpretationEvidence Request: whether the production of the Cross-Modal Interpretation Evidence is required, optional or not_requested. Response: fulfilment of the production of the Cross-Modal Interpretation Evidence (produced, partial, missing or not_requested). One of: produced, partial, missing, not_requested.
– DomainQueryStatus Whether Domain Requests were issued. One of: issued, not_issued.
IdentityEvents Identity Events.
– Event Identity event: spawn, merge or promoted_to_user. One of: spawn, merge, promoted_to_user. (required)
– ParentIDs Identifiers of the entities merged or replaced.
– ChildIDs Identifiers of the entities produced.

Conformance Testing

Data conforms with AUC-CXT if it validates against the schema of Section 3 and, if the Mode is RQ, contains the properties required for a Request and none of those of a Response, and vice versa. If a schema contains references to other schemas, conformance of data for the primary schema implies that any data referencing a secondary schema shall also validate against the relevant schema.

Performance Assessment

Not part of this specification.

Go to PGM-AUA V1.0 Data Types