Go to MPAI-PAF V1.6 Data Types

Definition
Functional Requirements
Syntax
Semantics
Conformance Testing
Performance Assessment

1      Definition

A Data Type that includes:

  1. A set of avatar‑related Data: Avatar ID, Avatar Space‑Time, Avatar, Language Selector, Text, Speech Object, Animation, and Personal Status.
  2. Descriptors of the M‑Instance ID, Audio‑Visual Scene where the Avatar is embedded, and its Space‑Time information.

2      Functional Requirements

Portable Avatar provides the following set of Data characterising a speaking avatar in a virtual space (M‑Instance):

  1. The ID of the Virtual Space (M‑Instance) where the Portable Avatar is to be placed.
  2. The space and time information of the “environment” to be placed in the M‑Instance.
  3. The Audio‑Visual Scene representing the “environment”.
  4. The space and time information of the Avatar in the scene.
  5. The Avatar represented as a 3D Model, its Face Descriptors and Body Descriptors.
  6. The Language Preference of the Avatar.
  7. The Text Object the Avatar is associated with, or which will be converted into a Speech Object.
  8. The Speech Model used to synthesise the Text Object.
  9. The Speech Object alternative to the Text Object that the Avatar utters.
  10. The Personal Status of the Avatar.

3      Syntax

https://schemas.mpai.community/PAF/V1.6/data/PortableAvatar.json

4      Semantics

Table 1 – Semantics of the Portable Avatar Data Type

Label
Description
Header Portable Avatar Header – Standard “PAF‑PAV‑Vx.y”.
MInstanceID Identifier of the M-Instance (Virtual Space) where the Portable Avatar is placed.
UEnvironmentID Identifier of the U-Environment (Real Space) associated with this Portable Avatar.
PortableAvatarID Unique identifier of this Portable Avatar instance.
PortableAvatarTime Time this Portable Avatar was produced.
PortableAvatarSpaceTime Space/Time where/when this Portable Avatar applies.
AVSceneSpaceTime Space/Time where/when the Audio-Visual Scene is located in the M-Instance.
AVSceneDescriptors Descriptors of the Audio-Visual Scene where the Avatar is embedded.
AvatarSpaceTime Space/Time where/when the Avatar is located in the Audio-Visual Scene.
AvatarOrAvatarID[] Either a 3D Model Object representing the Avatar or the Avatar’s ID.
LanguageSelector Avatar’s Language Preference.
TextObject Text Object associated with the Avatar, or to be converted into a Speech Object.
MLModelOrMLModelID[] Either an ML Model for Speech Synthesis or its ID.
SPOOrSPOID[] Either a Speech Object that the Avatar utters or its ID.
EntityState Personal Status of the Avatar.
Accessories[] Set of Accessories attached to the Avatar.
    – Accessory An Accessory attached to the Avatar.
    – AccessorySpaceTime Space/Time where/when this Accessory is located on the Avatar.
DataXMData MPAI-PTF Data Exchange Metadata providing provenance, authorisation, legal, security, and confidence information associated with this Portable Avatar in a trusted data exchange context.
DescrMetadata Human-readable descriptive metadata of the Portable Avatar (plain text, max 2048 characters).

5      Conformance Testing

A Data instance conforms with Portable Avatar (PAF‑PAV) if:

  1. The Data validates against the Portable Avatar’s JSON Schema.
  2. All Data in the Portable Avatar’s JSON Schema:
    1. Have the specified type.
    2. Validate against their JSON Schemas.
    3. Conform with their Data Qualifiers.

6      Performance Assessment

Not part of this specification.

Go to MPAI-PAF V1.6 Data Types