IP Library › Granted Patent US 11,806,862
Granted Patent B2
US 11,806,862 · App. 16/784,583 · Granted Nov 7, 2023

Robots, methods, computer programs, computer-readable media, arrays of microphones and controllers

Inventors: Pawel Swietojanski (London, GB); Tomasz Franciszek Wierzchowski (London, GB); Pedro Antonio Martinez Mediano (London, GB)
Assignee: Emotech Ltd.
B25J13/003B25J9/1697
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,806,862
App. No.
16/784,583
Filed
Feb 7, 2020
Granted
Nov 7, 2023
Kind
B2
Art Unit
3664
USPC
700/258
Abstract

A robot obtains image data representative of an environment comprising a first region and a second region. A microphone receives sound from the environment. The robot determines, using the image data and audio data derived based on the received sound, whether the sound is received from the first region, and outputs a control signal for controlling the robot based on the audio data. Sounds received from the first region are processed as voice commands on the basis that one of the first region and the second region comprises a predetermined type of inanimate object. Sounds received from the second region are processed in a different manner.

Claims (51)

1. A robot comprising:

an input component configured to obtain image data representative of an environment comprising a first and a second region;

a microphone configured to receive sound from the environment; and

a controller configured to:

determine, using the image data and audio data derived based on the received sound, whether the sound is received from the first region; and

output, in response to the controller determining that the sound is received from the first region, a control signal for controlling the robot, the control signal being based on the audio data,

wherein the controller is arranged to process sounds received from the first region as voice commands on the basis that a predetermined type of inanimate object is located in the first region and is arranged to process sounds received from the second region in a different manner.

2. A robot according to claim 1 , wherein the controller is arranged to visually detect the inanimate object using the image data.

3. A robot according to claim 1 , comprising an output component, wherein the control signal is operable to control the output component in accordance with the voice command.

4. A robot according to claim 3 ,

wherein the output component comprises:

a loudspeaker, and wherein the control signal is operable to cause the loudspeaker to output a sound; or

a display device, and wherein the control signal is operable to cause the display device to output a visual output.

5. A robot according to claim 3 ,

wherein the output component comprises an actuator, and

wherein the control signal is operable to control the actuator to cause movement of the robot.

6. A robot according to claim 5 ,

wherein the robot comprises a user interaction part arranged to interact with a user, and

wherein the control signal is operable to control the actuator to cause rotation of the user interaction part such that the user interaction part faces towards the first region.

7. A robot according to claim 3 ,

wherein the output component comprises a network interface, and

wherein the control signal is operable to cause data to be transmitted via the network interface.

8. A robot according to claim 1 , wherein the input component comprises an image sensor arranged to detect electromagnetic radiation from the environment.

9. A robot according to claim 7 , wherein the input component is arranged to obtain the image data based on the controller causing at least part of the robot to rotate such that the image sensor obtains the image data, the image data representing a 360 degree spatial map of the environment around the robot.

10. A robot according to claim 1 , wherein the input component comprises a network interface arranged to receive the image data.

11. A robot according to claim 1 ,

wherein the robot comprises a memory, and

wherein the controller is arranged to receive the image data and/or the audio data from the memory.

12. A robot according to claim 1 , wherein the robot comprises an object recognition engine arranged to recognise the inanimate object in the first region.

13. A robot according to claim 1 , wherein the controller is arranged to process sounds received from the second region in the different manner on the basis that the second region comprises a predetermined acoustically active device.

14. A robot according to claim 1 , wherein the processing of the sounds received from the second region in the different manner comprises not interpreting the sounds received from the second region as voice commands.

15. A robot according to claim 1 , wherein the controller is arranged to determine a direction of arrival of the sound at the microphone based on the audio data.

16. A robot according to claim 1 ,

wherein the robot comprises an array of microphones, and

wherein, on the basis of the sound being received from the first region, the controller is arranged to process the sound using a beamforming function of the controller using the array of microphones.

17. A robot according to claim 1 , wherein the controller is arranged to process sounds received from the first region as voice commands without determining that the sounds are received from a user.

18. A robot according to claim 1 , wherein the input component is arranged to obtain the image data in response to the controller determining that the robot has moved.

19. A method of controlling a robot, the robot comprising an input component, a microphone and a controller, the method comprising:

obtaining, by the input component, image data representative of an environment comprising a first region and a second region;

outputting, by the input component, the image data for processing by the controller;

receiving, by the microphone, sound from the environment;

outputting, by the microphone, audio data based on the received sound for processing by the controller; and

in response to the controller determining, using the image data and the audio data, that the sound is received from the first region, outputting, by the controller, a control signal for controlling the robot, the control signal being based on the audio data,

wherein the controller is arranged to process sounds received from the first region as voice commands on the basis that a predetermined type of inanimate object is located in the first region, and is arranged to process sounds received from the second region in a different manner.

20. A non-transitory computer-readable storage medium comprising a set of computer-readable instructions stored thereon, which, when executed by a processing system, cause the processing system to perform a method of controlling a robot comprising an input component, a microphone and a controller, the method comprising:

obtaining, by the input component, image data representative of an environment comprising a first region and a second region;

outputting, by the input component, the image data for processing by the controller;

receiving, by the microphone, sound from the environment;

outputting, by the microphone, audio data based on the received sound for processing by the controller; and

in response to the controller determining, using the image data and the audio data, that the sound is received from the first region, outputting, by the controller, a control signal for controlling the robot, the control signal being based on the audio data,

wherein the controller is arranged to process sounds received from the first region as voice commands on the basis that a predetermined type of inanimate object is located in the first region, and is arranged to process sounds received from the second region in a different manner.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2023
From: SWIETOJANSKI, PAWEL; WIERZCHOWSKI, TOMASZ FRANCISZEK
To: EMOTECH LTD
Reel/Frame 065054/0487 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2023
From: MEDIANO, PEDRO ANTONIO MARTINEZ
To: EMOTECH LTD
Reel/Frame 064627/0337 →
Priority Claims (1)
GB 1712791 · Aug 9, 2017 · national
Continuity (2)
Continuation PCTGB2018052272 · Aug 9, 2018
Related Publication 20200246977A1 · Aug 6, 2020