IP Library Granted Patent US 9,552,677
Granted Patent B2
US 9,552,677 · App. 15/162,246 · Granted Jan 24, 2017

Image processing apparatus, image processing method, and program

Inventors: Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Tatsuki Kashitani (Tokyo, JP)
Assignee: SONY CORPORATION
G06T19/006G06T7/0042H04N7/18
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,552,677
App. No.
15/162,246
Granted
Jan 24, 2017
Kind
B2
Abstract

An information processing system that acquires image data captured by an image capturing device; identifies a density of distribution of a plurality of feature points in the acquired image data; and controls a display to display guidance information based on the density of the distribution of the plurality of feature points.

Claims (40)

1. An information processing apparatus comprising:

at least one circuitry configured to:

acquire an image data of a real space by an image capturing device,

detect feature points based on the image data,

calculate a relative position of an object to the imaging capturing device within the real space based on the image data and the feature points,

generate environment information based on the calculation,

determine a stable recognition area or an un-explored area based on the environment information, and

generate a direction control instruction to direct the information processing apparatus to:

(i) explore the un-explored area containing less environment information than the stable recognition area, or

(ii) avoid activities outside the stable recognition area.

2. The information processing apparatus of claim 1 , wherein a position of the object is at least part of the feature points.

3. The information processing apparatus of claim 1 , wherein the direction control instruction is a virtual object to be displayed.

4. The information processing apparatus of claim 3 , wherein in an event of directing the information processing apparatus to avoid activities the outside the stable recognition area, the virtual object is displayed within the stable recognition area.

5. The information processing apparatus of claim 3 , wherein in an event of directing the information processing apparatus to explore the un-explored area, the virtual object is displayed outside the stable recognition area.

6. The information processing apparatus of claim 1 , wherein the direction control instruction is a virtual indication.

7. The information processing apparatus of claim 1 , wherein the direction control instruction is an audio message.

8. The information processing apparatus of claim 1 , wherein the environment information is continuously updated corresponding to the acquired image data.

9. The information processing apparatus of claim 8 , wherein the stable recognition area or the un-explored area is continuously updated corresponding to the environment information.

10. The information processing apparatus of claim 1 , wherein directing the information processing apparatus to avoid the activities outside the stable recognition area is to avoid movement in a direction unfavorable for the calculation.

11. The information processing apparatus of claim 1 , wherein the environment information is generated based on a density of the detected feature points.

12. The information processing apparatus of claim 1 , wherein the generation of the direction control instruction is based on a prediction of whether the environment information exceeds a predetermined threshold in subsequent captured images of the real space.

13. The information processing apparatus of claim 12 , wherein the stable recognition area is determined in an event the environment information exceeds the predetermined threshold.

14. An information processing method comprising:

acquiring an image data of a real space by an image capturing device,

detecting feature points based on the image data,

calculating a relative position of an object to the imaging capturing device within the real space based on the image data and the feature points,

generating environment information based on the calculation,

determining a stable recognition area or an un-explored area based on the environment information, and

generating a direction control instruction to direct the information processing apparatus to:

(i) explore the un-explored area containing less environment information than the stable recognition area or

(ii) avoid activities outside the stable recognition area.

15. A non-transitory computer-readable medium including computer program instructions, when executed by a computer causes the computer to perform an information processing method, the method comprising:

acquiring an image data of a real space by an image capturing device,

detecting feature points based on the image data,

calculating a relative position of an object to the imaging capturing device within the real space based on the image data and the feature points,

generating environment information based on the calculation,

determining a stable recognition area or an un-explored area based on the environment information, and

generating a direction control instruction to direct the information processing apparatus to:

(i) explore the un-explored area containing less environment information than the stable recognition area or

(ii) avoid activities outside the stable recognition area.

Priority Claims (1)
JP 2012-097714 · Apr 23, 2012 · national
Continuity (2)
Continuation 14391874
Related Publication 20160267718A1 · Sep 15, 2016