IP Library Granted Patent US 11,061,412
Granted Patent B2
US 11,061,412 · App. 16/482,640 · Granted Jul 13, 2021

Information processing device and information processing method

Inventors: Takeshi Harada (Tokyo, JP); Ryunosuke Oda (Tokyo, JP)
Assignee: SONY CORPORATION
G05D1/10G06T7/0002H04N5/95H04N17/002
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,061,412
App. No.
16/482,640
Granted
Jul 13, 2021
Kind
B2
Abstract

An information processing device that operates in an imaging device mounted on a mobile unit, and notifies the mobile unit of failed imaging, when imaging performed by the imaging device has failed.

Claims (53)

1. An information processing device in an imaging device, comprising:

a processing unit configured to:

receive an instruction from a mobile unit;

control the imaging device to perform an imaging operation on a plurality of points based on the received instruction;

compare the plurality of points with a plurality of marked points on a map;

analyze a deviation of at least one point of the plurality of points from corresponding at least one marked point of the plurality of marked points on the map, wherein the analysis of the deviation is based on the comparison; and

notify a failure of the performance of the imaging operation on the at least one point, wherein the notification of the failure is based on the analysis of the deviation.

2. The information processing device according to claim 1 , wherein the processing unit is further configured to determine the failure of the performance of the imaging operation based on at least one of an image captured by the imaging device and/or information related to the image.

3. The information processing device according to claim 2 , wherein

the processing unit is further configured to notify the failure of the performance of the imaging operation based on the image, and

the image is out of focus with respect to the imaging device.

4. The information processing device according to claim 2 , wherein the processing unit is further configured to notify the failure of the performance of the imaging operation based on exposure of the image with respect to a range.

5. The information processing device according to claim 2 , wherein the processing unit is further configured to obtain position information that indicates an imaging position of the image captured by the imaging device.

6. The information processing device according to claim 2 , wherein the processing unit is further configured to:

acquire time information that indicates imaging time of the image captured by the imaging device, and

notify the failure of the performance of the imaging operation based on the time information with respect to a specific.

7. The information processing device according to claim 2 , wherein the processing unit further configured to:

obtain position information that indicates indicating an imaging position of the image captured by the imaging device; and

identify the deviation of the at least one point from the corresponding at least one marked point based on the obtained position information.

8. The information processing device according to claim 2 , wherein the processing unit is further configured to:

obtain time information that indicates an imaging time of the image captured by the imaging device; and

notify the failure of the performance of the imaging operation based on deviation of the imaging time from a series of constant time intervals.

9. The information processing device according to claim 2 , wherein the processing unit is further configured to notify the failure of the performance of the imaging operation based on failure to perform the imaging operation at one of a specific position or a specific time.

10. The information processing device according to claim 1 , wherein the processing unit is further configured to notify the failure of the performance of the imaging operation based on acquisition of an image captured by a device other than the imaging device.

11. The information processing device according to claim 10 , wherein

the image is stored in a storage unit, and

the processing unit is further configured to notify the failure of the performance of the imaging operation based on a capacity of the storage unit is equal to or smaller than a specific storage capacity.

12. The information processing device according to claim 10 , wherein the processing unit is further configured to notify the failure of the performance of the imaging operation based on is an error in a write operation of the image into a storage unit.

13. The information processing device according to claim 10 , wherein

the processing unit is further configured to notify the failure of the performance of the imaging operation based on estimated utilization of a battery equal to or smaller than a specific estimated utilization, and

the battery powers the imaging device.

14. The information processing device according to claim 1 , wherein the processing unit is further configured to notify success of the performance of the imaging operation based on successful image capture by the imaging device.

15. An information processing method, comprising:

receiving an instruction from a mobile unit;

controlling an imaging device to perform an imaging operation on a plurality of points based on the received instruction;

comparing the plurality of points with a plurality of marked points on a map;

analyzing a deviation of at least one point of the plurality of points from corresponding at least one marked point of the plurality of marked points on the map, wherein the analysis of the deviation is based on the comparison; and

notifying a failure of the performance of the imaging operation on the at least one point, wherein the notification of the failure is based on the analysis.

16. A non-transitory computer-readable medium having stored thereon, computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising: receiving an instruction from a mobile unit;

controlling an imaging device to perform an imaging operation on a plurality of points based on the received instruction;

comparing the plurality of points with a plurality of marked points on a map;

analyzing a deviation of at least one point of the plurality of points from corresponding at least one marked point of the plurality of marked points on the map, wherein the analysis of the deviation is based on the comparison; and

notifying a failure of the performance of the imaging operation on the at least one point, wherein the notification of the failure is based on the analysis of the deviation.

17. An information processing device that operatcs in a mobile unit . , comprising:

a processing unit configured to:

receive an instruction from the mobile unit;

control an imaging device to perform an imaging operation on a plurality of points based on the received instruction;

compare the plurality of points with a plurality of marked points on a map;

analyze a deviation of at least one point of the plurality of points from corresponding at least one marked point of the plurality of marked points on the map, wherein the analysis of the deviation is based on the comparison; and

notify a failure of the performance of the imaging operation on the at least one point, wherein the notification of the failure is based on the analysis of the deviation.

18. The information processing device according to claim 17 , wherein the processing unit is further configured to issue a re-imaging instruction based on the notification.

19. The information processing device according to claim 17 , wherein the processing unit is further configured to set a moving route of the mobile unit based on the notification of the failure of the performance of imaging.

20. The information processing device according to claim 17 , wherein the processing unit is further configured to send the notification to an external device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2019
From: HARADA, TAKESHI; ODA, RYUNOSUKE
To: SONY CORPORATION
Reel/Frame 049925/0120 →
Priority Claims (1)
JP JP2017-045663 · Mar 10, 2017 · national
Continuity (1)
Related Publication 20200014913A1 · Jan 9, 2020
Cited By (1)
US 12,603,986