IP Library Granted Patent US 10,950,053
Granted Patent B2
US 10,950,053 · App. 15/816,500 · Granted Mar 16, 2021

Image processing apparatus and image processing method

Inventors: Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Tatsuki Kashitani (Tokyo, JP)
Assignee: SONY CORPORATION
G06T19/006G06F3/011G06K9/00671G06K9/6211G06K9/6267G06T7/73H04N7/18G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,950,053
App. No.
15/816,500
Granted
Mar 16, 2021
Kind
B2
Abstract

An information processing system that acquires image data captured by an image capturing device; identifies a density of distribution of a plurality of feature points in the acquired image data; and controls a display to display guidance information based on the density of the distribution of the plurality of feature points.

Claims (40)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognize environment information by Simultaneous Localization And Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determine an un-explored area in the acquired image and an explored area in the acquired image based on the environment information; and

control display of a first virtual indication related to the un-explored area superimposed on the real space.

2. The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to superimpose the first virtual indication on the un-explored area.

3. The information processing apparatus according to claim 1 ,

wherein the circuitry is further configured to update the first virtual indication based on the environment information.

4. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to display a second virtual indication that includes a boundary between the un-explored area and the explored area.

5. The information processing apparatus according to claim 1 , wherein the circuitry is further configured to:

control display of the acquired image; and

execute an augmented reality (AR) process to control display of a virtual object overlaid on the displayed image.

6. The information processing apparatus according to claim 1 , wherein the information processing apparatus operates in one of a first operation mode or a second operation mode.

7. The information processing apparatus according to claim 6 , wherein the circuitry is further configured to control the display of the first virtual indication in the second operation mode.

8. The information processing apparatus according to claim 6 , wherein, in the second operation mode, the circuitry is further configured to control the display of the first virtual indication to navigate a user to capture images of the un-explored area.

9. The information processing apparatus according to claim 6 , wherein, in the first operation mode, the circuitry is further configured to control the display of the first virtual indication to navigate a user to stabilize the recognition of the environment information.

10. The information processing apparatus according to claim 1 , further comprising a display device.

11. An information processing method, comprising:

in an information processing apparatus:

acquiring an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognizing environment information by Simultaneous Localization And Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determining an un-explored area in the acquired image and an explored area in the acquired image based on the environment information; and

controlling display of a virtual indication related to the un-explored area superimposed on the real space.

12. An information processing method, comprising:

in an information processing apparatus:

acquiring real space data by use of at least one sensor, wherein the real space data is image data of a real space;

detecting a position of an image pick-up device;

generating environment information by Simultaneous Localization And Mapping (SLAM), wherein the environment information is generated based on the acquired real space data;

determining an un-explored area of the real space and an explored area of the real space based on the environment information;

determining a first movement route of the image pick-up device and a second movement route of the image pick-up device, based on the determined un- explored area, the determined explored area, and the detected position of the image pick-up device, wherein

the first movement route includes a plurality of first feature points, and

the second movement route includes a plurality of second feature points; and

controlling a movement of the image pick-up device in the second movement route based on a count of the plurality of second feature points being greater than a count of the plurality of first feature points.

13. A non-transitory computer-readable storage medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to execute operations, the operations comprising:

acquiring an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognizing environment information by Simultaneous Localization And Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determining an un-explored area in the acquired image and an explored area in the acquired image based on the environment information; and

controlling display of a virtual indication related to the un-explored area superimposed on the real space.

Priority Claims (1)
JP 2012-097714 · Apr 23, 2012 · national
Continuity (4)
Continuation 15384754 · Dec 20, 2016
Continuation 15162246 · May 23, 2016
Continuation 14391874
Related Publication 20180137686A1 · May 17, 2018