Chat widget

The chat-screen can be used to:

  • Send messages for the robot to say

  • Send commands for the robot to execute

Overview
  1. Text and speech-options for the message or command

  2. History of sent messages

Commands will not be saved in the history.

Overview

It is highly recommended to set the options for the message before entering the message itself.

The bar at the bottom displays the options for the message to send to the robot:

MessageDetails
  1. Use the Speech-service on the tablet/smartphone to enter the message

  2. Set the output-language of the message

  3. Show or hide the speech-options for the message (e.g. volume, speech speed, …​)

  4. Message to send to the robot

  5. Toggle whether the robot should speak or respond to a voice-command

  6. Set advanced options (e.g. Animated speech)

Using the installed speech-service

  • The example listed uses the Google Assistant voice-service. On iOS devices, the layout may be slightly different.

  • The speech-recognition-app needs to be installed on the smartphone/tablet for the same user as ZBOS Control.

Save this step for last. Set the other options for the message first, especially the language.

Tap the icon md mic to open an overlay of the voice-recognition app:

TapMicrophone

When the modal is shown, state the message for the robot to repeat or the voice-command for the robot to execute:

GoogleSpeechDialogModal

Once the text has been processed by the speech-service, the content will be entered in the message-field:

MessageEntered

Tap the icon md send to send the message/command to the robot.

The speech-recognition will use the selected language for the message to interpret the speech. Additionally, make sure the requirements for the speech-recognition-app are met (i.e. access to internet, access to microphone, …​).

Set the language for the message

This setting will also be used by the speech-recognition service.

Tap the language-field in the message-bar to display the language installed on the robot:

TapLanguage

Tap the language for the message and tap the option 'Accept' to apply the changes:

LanguageOptions

The following limitations apply to the languages:

  • The language will always be displayed as 2 letters in the toolbar.

  • The list of available languages is retrieved from the currently connected robot.

Setting the options for the speech

Tap the icon md volume low to display the options for the message:

TapSpeechOptions

Drag the slider(s) for a setting(1) to change the value and tap the icon md volume low (2) again to close the options:

OutputSettings
  • Changing the volume for a message will change the overall volume set on the robot.

  • Only the options compatible with the currently connected robot will be shown.

  • Changing the options for speech speed and voice-pitch will be applied for every new sent message.

Entering the content of the message

It is highly recommended to set the type of message to send to the robot beforehand (i.e. message or command).

Tap the selected message-field at the bottom of the screen to enter a message or command into the text-field.

TapMessage

Enter the message or command to send to the robot:

EnteringMessage

Tap the (now available) icon md send to send the message/command to the robot.

  • This will change the option for setting the type of message (SendSpeech or SendCommand) to sending a message (md send)

  • Tap the icon times in the selected message-field to remove the message from the text-field.

Alternatively, a speech-to-text service can be used to enter the content of the message. See the chapter Using the installed speech-service for more information.

Sending the message to the robot

After entering the message to send (either using the keyboard or using the speech-service installed on the device), the icon md send will be shown.

Tap the icon to send the message or command to the robot.

TapSend

The sent message will now be stored in the history pane.

Changing the type of message

These options will only be shown if the message-field is empty.

Tap the option SendSpeech (or SendCommand) to display the available message-types:

TapMessageType

Select the action for the robot to take and tap the option 'Accept' to apply the changes.

TapMessageTypeModal

This will change the icon in the message-bar to match the type of message sent to the robot.

Type Icon shown Explanation

Say

SendSpeech

The robot will state the entered message using the entered speech-options

Execute

SendCommand

The robot will interpret the sent message as a voice-command

Execution options

Tap the button ellipsis v to display a list of available animations the robot can show.

Animated speech

Animated speech will only be executed if the connected robot supports this option.

Another option to animate the robot while speaking is to enable (or disable) the option 'Animated speech'.

AnimatedSpeech

Tap the option 'Animated speech' to enable or disable this option.

Tap outside the shown popup to close the modal.

History of messages

A list of recently sent messages is shown. These messages can be resent to the robot, stored as a Quick response or deleted from the history. It is not possible to edit the messages directly.

To edit the message, either send a new message with the new settings or store the message as a Quick response and edit the new quick response.

Resend a message to the robot

Tap a message in the history to resend it once more to the robot.

RepeatMessage

The robot will then play it back using the set speech-properties (voice pitch, volume, …​).

Storing a message as a Quick response

Swipe the message to the left to show the advanced options for the message.

OpenMessageOptions
The options can only be shown for one message at a time.

To close the options again, swipe the message to the right.

Tap the option Add to Quick Responses to store the message as a Quick Response.

SaveMessage

This will show a popup asking for a title and category for the Quick Response. For more information on the quick response(s), see the chapter 'Editing the quick response' in the steering page.

Removing the message

Swipe the message to the left to show the advanced options for the message.

DeleteMessage

Tap the option md trash to delete the message from the list.