| 1 Definition | 2 Functional Requirements | 3 Syntax |
| 4 Semantics | 5 Conformance Testing | 6 Performance Assessment |
1 Definition
Face Descriptors Object is a Data Type representing the features of the Face of an Entity resulting from the motion of the muscles of its face.
2 Functional Requirements
3 Syntax
https://schemas.mpai.community/PAF/V1.5/data/FaceDescriptorsObject.json
4 Semantics
| Label | Size | Description |
| Header | N1 Bytes | Face Descriptors Object Header. |
| – Standard-FaceDescriptorsObject | 9 Bytes | The characters “OSD-FDO-V” |
| – Version | N2 Bytes | Major version – 1 or 2 characters |
| – Dot-separator | 1 Byte | The character “.” |
| – Subversion | N3 Bytes | Minor version – 1 or 2 characters |
| M-InstanceID | N4 Bytes | ID of the Virtual Space where the Face is located. |
| FaceDescriptorsObjectID | N5 Bytes | Identifier of Face Descriptors. |
| FaceDescriptorsSpaceTime | N6 Bytes | Space-Time information of Face in the Virtual Space |
| FaceDescriptorsData | N7 Bytes | Data of Face Descriptors |
| FaceDescriptorsQualifier | N8 Bytes | Qualifier of Face Descriptors |
| DescrMetadata | N8 Bytes | Descriptive Metadata |
5 Conformance Testing
A Data instance Conforms with Face Descriptors (PAF-FCD) if
- The Data validates against the Face Descriptors’ JSON Schema.
- All Data in the Face Descriptors’ JSON Schema
- Have the specified type.
- Validate against their JSON Schemas.
6 Performance Assessment
To be specified.
7 Face Action Units (informative)
The Face Actions Units of the Facial Action Coding System (FACS) were originally developed by Carl-Herman Hjortsjö, adopted by Paul Ekman and Wallace V. Friesen (1978) and updated by Ekman, Friesen, and Joseph C. Hager (2002). Each Action Unit is represented by an Action Unit ID. The provide a set of Face Descriptors.
| AU | Description | Facial muscle generating the Action |
| 1 | Inner Brow Raiser | Frontalis, pars medialis |
| 2 | Outer Brow Raiser | Frontalis, pars lateralis |
| 4 | Brow Lowerer | Corrugator supercilii, Depressor supercilii |
| 5 | Upper Lid Raiser | Levator palpebrae superioris |
| 6 | Cheek Raiser | Orbicularis oculi, pars orbitalis |
| 7 | Lid Tightener | Orbicularis oculi, pars palpebralis |
| 9 | Nose Wrinkler | Levator labii superioris alaquae nasi |
| 10 | Upper Lip Raiser | Levator labii superioris |
| 11 | Nasolabial Deepener | Zygomaticus minor |
| 12 | Lip Corner Puller | Zygomaticus major |
| 13 | Cheek Puffer | Levator anguli oris (a.k.a. Caninus) |
| 14 | Dimpler | Buccinator |
| 15 | Lip Corner Depressor | Depressor anguli oris (a.k.a. Triangularis) |
| 16 | Lower Lip Depressor | Depressor labii inferioris |
| 17 | Chin Raiser | Mentalis |
| 18 | Lip Puckerer | Incisivii labii superioris and Incisivii labii inferioris |
| 20 | Lip stretcher | Risorius with platysma |
| 22 | Lip Funneler | Orbicularis oris |
| 23 | Lip Tightener | Orbicularis oris |
| 24 | Lip Pressor | Orbicularis oris |
| 25 | Lips part | Depressor labii inferioris or relaxation of Mentalis, or Orbicularis oris |
| 26 | Jaw Drop | Masseter, relaxed Temporalis and internal Pterygoid |
| 27 | Mouth Stretch | Pterygoids, Digastric |
| 28 | Lip Suck | Orbicularis oris |
| 41 | Lid droop | Relaxation of Levator palpebrae superioris |
| 42 | Slit | Orbicularis oculi |
| 43 | Eyes Closed | Relaxation of Levator palpebrae superioris; Orbicularis oculi, pars palpebralis |
| 44 | Squint | Orbicularis oculi, pars palpebralis |
| 45 | Blink | Relaxation of Levator palpebrae superioris; Orbicularis oculi, pars palpebralis |
| 46 | Wink | Relaxation of Levator palpebrae superioris; Orbicularis oculi, pars palpebralis |
| 61 | Eyes turn left | Lateral rectus, medial rectus |
| 62 | Eyes turn right | Lateral rectus, medial rectus |
| 63 | Eyes up | Superior rectus, Inferior oblique |
| 64 | Eyes down | Inferior rectus, Superior oblique |
The eye motion Action Units (Eyes turn left/right and Eyes up/down) have an additional parameter representing the degrees of the motion of a line perpendicular to the eye with respect to the 0° of the resting position when the eye looks horizontally and perpendicular to the body. The value of the angle is expressed with 1 Byte where 0= 0° degrees for the resting position (0°) and 255 for 90°.
8 Mapping of Face Action Units to Personal Status (Informative)
MPAI has defined a set of Cognitive States, Emotions, and Social Attitudes included in Personal Status. The Table below offers an informative mapping of some elements of Personal Status to Action Units (from 1).
| Personal Status | Cognitive State | Emotion | Prototypical (and variant AUs) |
| Happy | 17 | 12, 25 [6 (51%)] | |
| Sad | 32 | 4, 15 [1 (60%), 6 (50%), 11 (26%), 17 (67%)] | |
| Fearful | 13 | 1, 4, 20, 25 [2 (57%), 5 (63%), 26 (33%)] | |
| Angry | 2 | 4, 7, 24 [10 (26%), 17 (52%), 23 (29%)] | |
| Surprised | 18 | 1, 2, 25, 26 [5 (66%)] | |
| Disgusted | 11 | 9, 10, 17 [4 (31%), 24 (26%)] |
This Table was obtained through a series of experiments with human subjects. AUs used by a subset of the subjects are shown in brackets with the percentage of the subjects using this less common AU in parentheses.
