IP Library Granted Patent US 10,675,764
Granted Patent B2
US 10,675,764 · App. 16/543,617 · Granted Jun 9, 2020

Robot device, method of controlling robot device, computer program, and program storage medium

Inventor: Tsutomu Sawada (Tokyo, JP)
Assignee: Sony Corporation
B25J9/1697B25J9/1674B25J11/0085B25J19/0058B25J19/023G05D1/00G05D1/0246G05D1/0272G06K9/00664H04N5/2171G05B2219/39053G05D2201/0217
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,675,764
App. No.
16/543,617
Granted
Jun 9, 2020
Kind
B2
Abstract

Provided is an excellent robot device capable of preferably detecting difference between dirt and a scratch on a lens of a camera and difference between dirt and a scratch on a hand. A robot device detects a site in which there is the dirt or the scratch using an image of the hand taken by a camera as a reference image. Further, this determines whether the detected dirt or scratch is due to the lens of the camera or the hand by moving the hand. The robot device performs cleaning work assuming that the dirt is detected, and then this detects the difference between the dirt and the scratch depending on whether the dirt is removed.

Claims (37)

1. A signal processing device for a moving apparatus, the signal processing device comprising:

circuitry configured to

determine whether there is a foreign object on an image capturing device by comparing a first image captured by the image capturing device with a reference image captured at a position different from a position at which the first image is captured, wherein

information indicating there is the foreign object is used to control performance of a cleaning work on the image capturing device.

2. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control capturing of a second image captured by the image capturing device after the cleaning work on the image capturing device.

3. The signal processing device according to claim 2 , wherein the circuitry is further configured to:

determine whether there is the foreign object on the image capturing device by comparing the second image with the reference image.

4. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control capturing of the first image captured by the image capturing device of the moving apparatus.

5. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

control performance of the cleaning work on the image capturing device using the information indicating there is the foreign object.

6. The signal processing device according to claim 1 , wherein the circuitry is further configured to:

determine whether there is the foreign object on the image capturing device based on a correlation between the first image and the reference image.

7. The signal processing device according to claim 6 , wherein the circuitry is further configured to:

determine that there is the foreign object on the image capturing device in a case that a site exists in which the correlation between the first image and the reference image is higher than a predetermined value.

8. The signal processing device according to claim 7 , wherein the information indicating there is the foreign object is used to control performance of the cleaning work on the site of the image capturing device.

9. The signal processing device according to claim 8 , wherein the circuitry is further configured to:

control performance of the cleaning work on the site of the image capturing device using the information indicating there is the foreign object.

10. A signal processing method for a moving apparatus, the signal processing method comprising:

determining, using circuitry, whether there is a foreign object on an image capturing device by comparing a first image captured by the image capturing device with a reference image captured at a position different from a position at which the first image is captured, wherein

information indicating there is the foreign object is used to control performance of a cleaning work on the image capturing device.

11. The signal processing method according to claim 10 , further comprising:

controlling capturing of the first image captured by the image capturing device of the moving apparatus.

12. The signal processing method according to claim 10 , further comprising:

controlling capturing of a second image captured by the image capturing device after the cleaning work on the image capturing device.

13. The signal processing method according to claim 12 , further comprising:

determining whether there is the foreign object on the image capturing device by comparing the second image with the reference image.

14. The signal processing method according to claim 10 , further comprising:

controlling performance of the cleaning work on the image capturing device using the information indicating there is the foreign object.

15. The signal processing method according to claim 10 , further comprising:

determining whether there is the foreign object on the image capturing device based on a correlation between the first image and the reference image.

16. The signal processing method according to claim 15 , further comprising:

determining that there is the foreign object on the image capturing device in a case that a site exists in which the correlation between the first image and the reference image is higher than a predetermined value.

17. The signal processing method according to claim 16 , wherein the information indicating there is the foreign object is used to control performance of the cleaning work on the site of the image capturing device.

18. The signal processing method according to claim 17 , further comprising:

controlling performance of the cleaning work on the site of the image capturing device using the information indicating there is the foreign object.

Priority Claims (1)
JP 2011-117111 · May 25, 2011 · national
Continuity (4)
Continuation 15716022 · Sep 26, 2017
Continuation 15142611 · Apr 29, 2016
Continuation 14114333
Related Publication 20190366555A1 · Dec 5, 2019