IP Library Granted Patent US 9,842,435
Granted Patent B2
US 9,842,435 · App. 15/384,754 · Granted Dec 12, 2017

Image processing to provide stable environment recognition

Inventors: Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Tatsuki Kashitani (Tokyo, JP)
Assignee: SONY CORPORATION
G06T19/006G06F3/011G06K9/00671G06K9/6267
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,842,435
App. No.
15/384,754
Granted
Dec 12, 2017
Kind
B2
Abstract

An information processing system that acquires image data captured by an image capturing device; identifies a density of distribution of a plurality of feature points in the acquired image data; and controls a display to display guidance information based on the density of the distribution of the plurality of feature points.

Claims (35)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire image data of a real space by an image capturing device;

detect a plurality of feature points based on the image data;

calculate a relative position of at least one feature point from the plurality of feature points with respect to the image capturing device;

generate environment information based on the calculated relative position;

determine an un-explored area and an explored area based on the generated environment information; and

generate a direction control instruction to direct the information processing apparatus to move into the un-explored area to acquire additional environment information of the un-explored area.

2. The information processing apparatus of claim 1 , wherein the circuitry is further configured to continuously update the explored area and the un-explored area based on the acquired additional environment information.

3. The information processing apparatus of claim 1 , wherein the generated environment information includes a map.

4. The information processing apparatus of claim 3 , wherein the circuitry is further configured to detect a position of the information processing apparatus on the map.

5. The information processing apparatus of claim 4 , wherein the circuitry is further configured to detect the position of the information processing apparatus based on simultaneous localization and mapping (SLAM).

6. The information processing apparatus of claim 3 , wherein the map indicates a three dimensional location and a shape of real objects within the real space.

7. The information processing apparatus of claim 3 , wherein the map is a three-dimensional map.

8. An information processing method, comprising:

in an information processing apparatus:

acquiring image data of a real space by an image capturing device;

detecting a plurality of feature points based on the image data;

calculating a relative position of at least one feature point from the plurality of feature points with respect to the image capturing device;

generating environment information based on the calculated relative position;

determining an un-explored area and an explored area based on the generated environment information; and

generating a direction control instruction to direct the information processing apparatus to move into the un-explored area to acquire additional environment information of the un-explored area.

9. The information processing method of claim 8 , wherein the explored area and the un-explored area are continuously updated based on the acquired additional environment information.

10. The information processing method of claim 8 , wherein the generated environment information includes a map.

11. The information processing method of claim 10 , wherein a position of the information processing apparatus is detected on the map.

12. The information processing method of claim 11 , wherein the position of the information processing apparatus is detected based on simultaneous localization and mapping (SLAM).

13. The information processing method of claim 10 , wherein the map indicates a three dimensional location and a shape of real objects within the real space.

14. The information processing method of claim 10 , wherein the map is a three-dimensional map.

15. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a processor, cause a computer to execute operations, the operations comprising:

acquiring image data of a real space by an image capturing device;

detecting a plurality of feature points based on the image data;

calculating a relative position of at least one feature point from the plurality of feature points with respect to the image capturing device;

generating environment information based on the calculated relative position;

determining an un-explored area and an explored area based on the generated environment information; and

generating a direction control instruction to direct an information processing apparatus to move into the un-explored area to acquire additional environment information of the un-explored area.

Priority Claims (1)
JP 2012-097714 · Apr 23, 2012 · national
Continuity (3)
Continuation 15162246 · May 23, 2016
Continuation 14391874
Related Publication 20170103578A1 · Apr 13, 2017