Systems and methods to control an autonomous mobile robot
A method for controlling one or more operations of an autonomous mobile robot maneuverable within a home includes establishing wireless communication between an autonomous mobile robot and a remote computing system and, in response to receiving a wireless command signal from the remote computing system, initiating one or more operations of the autonomous mobile robot. The autonomous mobile robot is remote from an audio media device stationed within the home. The audio media device is capable of receiving and emitting audio. The remote computing system is configured to associate identification data of the autonomous mobile robot with identification data of the audio media device. The wireless command signal corresponds to an audible user command received by the audio media device.
1 . A method comprising:
establishing wireless communication between an autonomous cleaning robot and a stationary audio media device, the autonomous cleaning robot movable about a space, and the stationary audio media device stationed on a surface in the space and comprising a microphone in a housing of the stationary audio media device and a speaker in the housing;
receiving, at the microphone of the stationary audio media device, a voice command provided by a user;
transmitting a representation of sound of the voice command from the stationary audio media device to a cloud computing system remote from the autonomous cleaning robot and the stationary audio media device;
executing, at the cloud computing system, a sound recognition routine to parse the representation of the sound and identify a robot command corresponding to the voice command;
transmitting, based on identifying the robot command, a command signal from the cloud computing system to the autonomous cleaning robot over a transmission path that bypasses the stationary audio media device,
wherein the command signal is configured to cause the autonomous cleaning robot to initiate one or more operations indicated by the robot command upon receiving the command signal;
receiving, at the cloud computing system, from the autonomous cleaning robot, data indicative of performance of the one or more operations; and
based on the data indicative of the performance of the one or more operations, transmitting, from the cloud computing system to the stationary audio media device, a mission status update command signal configured to cause the speaker of the stationary audio media device to emit a mission status update.
2 . The method of claim 1 , wherein the one or more operations comprise:
moving the autonomous cleaning robot from a current location of the autonomous cleaning robot to a location proximate the user, or
moving the autonomous cleaning robot from the current location of the autonomous cleaning robot to perform a spot cleaning operation at the location proximate the user.
3 . The method of claim 1 , comprising:
determining, by the cloud computing system, a portion of an environment that was not traversed by the autonomous cleaning robot during a cleaning mission,
wherein the mission status update indicates the portion that was not traversed.
4 . The method of claim 1 , wherein the sound recognition routine executed by the cloud computing system is configured to recognize at least one of:
a low frequency noise from an appliance, or
a noise originating from the autonomous cleaning robot.
5 . The method of claim 4 , wherein the sound recognition routine is configured to recognize the noise originating from the autonomous cleaning robot, and
wherein the noise originating from the autonomous cleaning robot is caused by at least one of:
an air mover of the autonomous cleaning robot,
a motor of the autonomous cleaning robot, or
movement of drive wheels of the autonomous cleaning robot across a floor surface.
6 . The method of claim 1 , further comprising:
transmitting, from the cloud computing system to the stationary audio media device, a command configured to cause the stationary audio media device to provide an audible success notification in response to transmission of the command signal.
7 . The method of claim 1 , wherein the one or more operations comprises moving the autonomous cleaning robot to dock with a docking station and to cause the docking station to evacuate debris from a debris bin of the autonomous cleaning robot.
8 . The method of claim 1 , further comprising generating a map of the space, the map indicating positions of devices in wireless communication with the cloud computing system, the autonomous cleaning robot being in wireless communication with the cloud computing system.
9 . The method of claim 8 , wherein the devices comprise the stationary audio media device.
10 . The method of claim 1 , wherein the one or more operations comprises navigating the autonomous cleaning robot toward the stationary audio media device.
11 . The method of claim 1 , wherein:
the method further comprises:
identifying, through execution of the sound recognition routine, an audible identifier associated with the autonomous cleaning robot; and
transmitting the command signal to the autonomous cleaning robot comprises:
transmitting the command signal based on identifying the audible identifier.
12 . The method of claim 11 , wherein identifying the audible identifier associated with the autonomous cleaning robot comprises accessing, by the cloud computing system, a user account associated with the autonomous cleaning robot or the stationary audio media device.
13 . The method of claim 1 , wherein the one or more operations comprises initiating or pausing a cleaning operation of the autonomous cleaning robot.
14 . The method of claim 1 , wherein the voice command is indicative of a user-defined schedule, and the one or more operations comprises:
storing, in memory of the autonomous cleaning robot, the user-defined schedule to perform a subsequent operation at a future time; and
causing the autonomous cleaning robot to perform the subsequent operation at the future time.
15 . The method of claim 1 , wherein the stationary audio media device does not comprise a display.
16 . The method of claim 1 , comprising:
identifying, by the cloud computing system, a room identifier in a user utterance; and
associating the room identifier with a room in the space based on the autonomous cleaning robot being located in the room when the user utterance is received.
17 . The method of claim 1 , wherein executing the sound recognition routine comprises determining whether the voice command includes a predefined command in a command database.
18 . The method of claim 1 , wherein executing the sound recognition routine comprises:
identifying, in the voice command, first identification data corresponding to the stationary audio media device and second identification data corresponding to the autonomous cleaning robot;
determining that the first identification data and the second identification data are not associated; and
based on determining that the first identification data and the second identification data are not associated, causing the stationary audio media device to emit an error notification.
19 . The method of claim 18 , wherein determining that the first identification data and the second identification data are not associated comprises determining that the voice command includes an identifier of a robot different from the autonomous cleaning robot.
20 . One or more non-transitory, computer readable media storing instructions that, when executed by one or more processors, cause the one or more processors to:
establish wireless communication between an autonomous cleaning robot and a stationary audio media device, the autonomous cleaning robot movable about a space, and the stationary audio media device stationed on a surface in the space and comprising a microphone in a housing of the stationary audio media device and a speaker in the housing;
receiving, at the microphone of the stationary audio media device, a voice command provided by a user;
transmitting a representation of sound of the voice command from the stationary audio media device to a cloud computing system remote from the autonomous cleaning robot and the stationary audio media device;
executing, at the cloud computing system, a sound recognition routine to parse the representation of the sound and identify a robot command corresponding to the voice command;
transmitting, based on identifying the robot command, a command signal from the cloud computing system to the autonomous cleaning robot over a transmission path that bypasses the stationary audio media device,
wherein the command signal is configured to cause the autonomous cleaning robot to initiate one or more operations indicated by the robot command upon receiving the command signal;
receiving, at the cloud computing system, from the autonomous cleaning robot, data indicative of performance of the one or more operations; and
based on the data indicative of the performance of the one or more operations, transmitting, from the cloud computing system to the stationary audio media device, a mission status update command signal configured to cause the speaker of the stationary audio media device to emit a mission status update.
21 . The one or more non-transitory, computer readable media of claim 20 , wherein the instructions, when executed by the one or more processors, cause the one or more processors to:
cause the stationary audio media device to provide an audible success notification in response to transmission of the command signal to the autonomous cleaning robot to cause the autonomous cleaning robot to initiate the one or more operations.
22 . A method comprising:
receiving, at a microphone of a stationary audio media device, a first voice command, the stationary audio media device stationed on a surface in a space and comprising the microphone in a housing of the stationary audio media device and a speaker in the housing;
transmitting a representation of sound of the first voice command from the stationary audio media device to a cloud computing system;
executing, at the cloud computing system, a first sound recognition routine, comprising:
identifying, in the first voice command, first identification data corresponding to the stationary audio media device and second identification data corresponding to an autonomous cleaning robot,
determining that the first identification data and the second identification data are not associated, and
based on determining that the first identification data and the second identification data are not associated, causing the stationary audio media device to emit an error notification;
establishing wireless communication between the autonomous cleaning robot and the stationary audio media device, the autonomous cleaning robot movable about the space;
receiving, at the microphone of the stationary audio media device, a second voice command;
transmitting a representation of sound of the second voice command from the stationary audio media device to the cloud computing system, wherein the cloud computing system is remote from the autonomous cleaning robot and the stationary audio media device;
executing, at the cloud computing system, a second sound recognition routine to parse the representation of the sound of the second voice command and identify a robot command corresponding to the second voice command; and
transmitting, based on identifying the robot command, a command signal from the cloud computing system to the autonomous cleaning robot over a transmission path that bypasses the stationary audio media device,
wherein the command signal is configured to cause the autonomous cleaning robot to initiate one or more operations indicated by the robot command upon receiving the command signal.
23 . The method of claim 22 , wherein determining that the first identification data and the second identification data are not associated comprises determining that the first voice command includes an identifier of a robot different from the autonomous cleaning robot.
24 . The method of claim 22 , wherein the second sound recognition routine executed by the cloud computing system is configured to recognize at least one of:
a low frequency noise from an appliance, or
a noise originating from the autonomous cleaning robot.
25 . The method of claim 24 , wherein the second sound recognition routine is configured to recognize the noise originating from the autonomous cleaning robot, and
wherein the noise originating from the autonomous cleaning robot is caused by at least one of:
an air mover of the autonomous cleaning robot,
a motor of the autonomous cleaning robot, or
movement of drive wheels of the autonomous cleaning robot across a floor surface.
26 . The method of claim 22 , further comprising:
transmitting, from the cloud computing system to the stationary audio media device, a command configured to cause the stationary audio media device to provide an audible success notification in response to transmission of the command signal.
27 . The method of claim 22 , further comprising generating a map of the space, the map indicating positions of devices in wireless communication with the cloud computing system, the autonomous cleaning robot being in wireless communication with the cloud computing system, wherein the devices comprise the stationary audio media device.
28 . The method of claim 22 , wherein:
the method further comprises:
identifying, through execution of the second sound recognition routine, an audible identifier associated with the autonomous cleaning robot; and
transmitting the command signal to the autonomous cleaning robot comprises:
transmitting the command signal based on identifying the audible identifier.
29 . The method of claim 28 , wherein identifying the audible identifier associated with the autonomous cleaning robot comprises accessing, by the cloud computing system, a user account associated with the autonomous cleaning robot or the stationary audio media device.
30 . The method of claim 22 , wherein the stationary audio media device does not comprise a display.