<– User    Go to ToC      Information search –>

Interaction

1        Introduction

This Section identifies and defines the functionalities that a human may have available to interact with a Metaverse Instance.

Interfaces
Speech
Visual
Haptic
BCI

2        Interfaces

This subsection identifies and defines the Functionalities related to Interfaces in a Metaverse Instance.

Area 7. Interaction
Subarea 7.1 Interfaces
Title 7.1.1 Metaverse Device Interface
Description The Common Metaverse Specifications  (CMS) include specifications of the Interfaces of Devices that are part of a Metaverse Instance.
Comment The CMS include Sensing and Actuation data formats.
 
Area 7. Interaction
Subarea 7.1 Interfaces
Title 7.1.2 User Device Interface
Description The Common Metaverse Specifications include specifications of the Interfaces of Devices that are attached to a User (User Devices).
Comment Comments include Sensing and Actuation data formats.
 
Area 1. Metaverse-Human Interaction
Subarea 7.1. Interfaces
Title 7.1.3 Gesture signals
Description A User requests their Device to make an action signalled with a gesture.
Comments Examples of signals are:

1.      Search

2.      Leave

3        Speech

This subsection identifies and defines the Functionalities related to Speech Interfaces with a Metaverse Instance.

Area 7. Interaction
Subarea 7.2 Speech
Title 7.2.1 Speech Interface
Description Users interact with a User using their voice.
Comment Users may use:

1.      Their voice as if they were interacting with humans.

2.      Their voice transformed to improve or distort the features of their voice or emulate the features of another voice.

3.      A synthetic version of their voice unrelated with the speech features.
 
Area 7. Interaction
Subarea 7.2 Speech
Title 7.2.2 Speech analysis
Description A Metaverse Environment Interprets a User by extracting text and Personal Status from their speech.
Comment The Metaverse Environment can have an improved conversation by understanding all aspects of the human it is interacting with.
 
Area 7. Interaction
Subarea 7.2 Speech
Title 7.2.3 Speech enhancement
Description A Metaverse Environment adds other types of information to its speech to simulate the Personal Status of a human.
Comment The Metaverse Environment or one of its Objects may improve the quality of the conversation by adapting its speech to the emotion shown by the human, the Metaverse Environment or one of its Objects.
 
Area 7. Interaction
Subarea 7.2 Speech
Title 7.2.4 Speech translation
Description A Metaverse Environment Interprets a User speaking a language by translating into the other languages.
Comment Speech Translation is a key Process that may negatively affect the User Experience if it is not implemented with a delay caused by translation not affecting the naturalness of the dialogue.
 
Area 7. Interaction
Subarea 7.2 Speech
Title 7.2.5 Spoken Dialogue System
Description A Metaverse Environment understands the speech utterances of the User and generates an appropriate response based on this interpretation and previous interactions.
Comment The Metaverse Environment is capable of producing emotional speech synthesis in any language with any chosen identity.
 
Area 7. Metaverse-Human Interaction
Subarea 7.2 Speech
Title 7.2.5 Private audio-visual message from a Metaverse Environment
Description A Metaverse Environment can send private audio-visual messages to a User.
Comments During a concert the Metaverse Environment can inform the performer of the Participants Status.

4        Visual

This subsection identifies and defines the Functionalities related to Visual Interfaces with a Metaverse Instance.

Area 7. Interaction
Subarea 7.3 Visual
Title 7.3.1 Interaction though an avatar
Description A User interacts with a Metaverse Environment using an avatar representing them.
Comment The avatar may:

1.      Faithfully reproduce the visual appearance of the human.

2.      Alter their visual appearance compared to that of the human.

3.      Have an unrelated visual appearance.
 
Area 7. Interaction
Subarea 7.3 Visual
Title 7.3.2 Personal Status from Visual
Description A Metaverse Environment Interprets a User by extracting information about the Personal Status of the User conveyed by their visual appearance.
Comment The Metaverse Environment could try and understand all aspects of the User it is interacting with for improved conversation.
 
Area 7. Interaction
Subarea 7.3 Visual
Title 7.3.3 Simulated Personal Status
Description A Virtual Human displays a simulated Personal Status.
Comment An influencer may animate the face, head, and body of their Digital Human to improve their impact.
 
Area 7. Interaction
Subarea 7.3 Visual
Title 7.3.4 Sign communication
Description A User interacts with a Metaverse Environment using signs.
Comment A vision-impaired User may use finger-alphabet to interact with a Metaverse Instance.

5        Haptic

This subsection identifies and defines the Functionalities related to Haptic Interfaces with a Metaverse Instance.

Area 7. Interaction
Subarea 7.4 Haptic
Title 7.4.1 Haptic Interaction
Description A User interacts with a Metaverse Environment using the sense of touch.
Comment A possibly impaired User:

1.      Receives a response from a Metaverse Environment expressed in the Braille alphabet.

2.      Interacts with a Metaverse Environment through bodily sensations and movements (and allow to also enjoy the Experience).

3.      Activates action commands and receive appropriate tactile images possibly accompanied by the stimulation of other visual and audio sensory modalities.

6        BCI

This subsection identifies and defines the Functionalities related to BCI Interfaces with a Metaverse Instance.

Area 7. Interaction
Subarea 7.5 BCI
Title 7.5.1 Brain-Computer Interaction
Description A User interacts with a Metaverse Environment using a Brain-Computer Interface.
Comment BCI may offer an impaired User the possibility to interact with a Metaverse Environment.

<– User    Go to ToC      Information search –>