IP Library Granted Patent US 11,014,245
Granted Patent B2
US 11,014,245 · App. 16/852,556 · Granted May 25, 2021

Robot device, method of controlling robot device, computer program, and program storage medium

Inventor: Tsutomu Sawada (Tokyo, JP)
Assignee: SONY CORPORATION
B25J9/1697B25J9/1674B25J11/0085B25J19/0058B25J19/023G05D1/00G05D1/0246G05D1/0272G06K9/00664H04N5/2171G05B2219/39053G05D2201/0217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,014,245
App. No.
16/852,556
Granted
May 25, 2021
Kind
B2
Abstract

Provided is an excellent robot device capable of preferably detecting difference between dirt and a scratch on a lens of a camera and difference between dirt and a scratch on a hand. A robot device detects a site in which there is the dirt or the scratch using an image of the hand taken by a camera as a reference image. Further, this determines whether the detected dirt or scratch is due to the lens of the camera or the hand by moving the hand. The robot device performs cleaning work assuming that the dirt is detected, and then this detects the difference between the dirt and the scratch depending on whether the dirt is removed.

Claims (36)

1. A signal processing device, comprising:

circuitry configured to

determine whether there is a foreign object of an image capturing device by comparing a first image captured by the image capturing device with a second image different from the first image; and

output information indicating there is the foreign object in response to determining that there is the foreign object of the image capturing device, the information being used to control performance of a cleaning work of the image capturing device.

2. The signal processing device according to claim 1 , wherein the second image is captured by the image capturing device.

3. The signal processing device according to claim 1 , wherein the second image is captured at a position different from a position at which the first image is captured.

4. The signal processing device according to claim 1 , wherein the image capturing device is a camera.

5. The signal processing device according to claim 4 , wherein the circuitry is configured to determine whether there is the foreign object on a lens of the camera.

6. The signal processing device according to claim 1 , wherein the first image and the second image are captured for a same object.

7. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control capturing of the first image captured by the image capturing device of a moving apparatus.

8. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control capturing of a third image captured by the image capturing device after the cleaning work of the image capturing device.

9. The signal processing device according to claim 8 , wherein the circuitry is further configured to:

determine whether there is the foreign object of the image capturing device by comparing the third image with the first image or the second image.

10. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control performance of the cleaning work of the image capturing device using the information indicating there is the foreign object.

11. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

determine whether there is the foreign object of the image capturing device based on a correlation between the first image and the second image.

12. The signal processing device according to claim 11 , wherein the circuitry is further configured to:

determine that there is the foreign object of the image capturing device in a case that a site exists in which the correlation between the first image and the second image is higher than a predetermined value.

13. The signal processing device according to claim 12 , wherein the information indicating there is the foreign object is used to control performance of the cleaning work on the site of the image capturing device.

14. The signal processing device according to claim 13 , wherein the circuitry is further configured to:

control performance of the cleaning work on the site of the image capturing device using the information indicating there is the foreign object.

15. A signal processing method, comprising:

determining, using circuitry, whether there is a foreign object of an image capturing device by comparing a first image captured by the image capturing device with a second image different from the first image; and

outputting information indicating there is the foreign object in response to determining that there is the foreign object of the image capturing device, the information being used to control performance of a cleaning work of the image capturing device.

16. The signal processing method according to claim 15 , wherein the second image is captured by the image capturing device.

17. The signal processing method according to claim 15 , wherein the second image is captured at a position different from a position at which the first image is captured.

18. The signal processing method according to claim 15 , wherein

the image capturing device is a camera, and

the determining determines whether there is the foreign object on a lens of the camera.

19. The signal processing method according to claim 15 , wherein the first image and the second image are captured for a same object.

20. A non-transitory computer readable medium including executable instructions, which when executed by a computer cause the computer to execute a signal processing method, the method comprising:

determining whether there is a foreign object of an image capturing device by comparing a first image captured by the image capturing device with a second image different from the first image; and

outputting information indicating there is the foreign object in response to determining that there is the foreign object of the image capturing device, the information being used to control performance of a cleaning work of the image capturing device.

Priority Claims (1)
JP 2011-117111 · May 25, 2011 · national
Continuity (5)
Continuation 16543617 · Aug 19, 2019
Continuation 15716022 · Sep 26, 2017
Continuation 15142611 · Apr 29, 2016
Continuation 14114333
Related Publication 20200238532A1 · Jul 30, 2020