IP Library Granted Patent US 11,468,648
Granted Patent B2
US 11,468,648 · App. 17/181,051 · Granted Oct 11, 2022

Image processing apparatus and image processing method

Inventors: Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Tatsuki Kashitani (Tokyo, JP)
Assignee: SONY CORPORATION
G06T19/006G06F3/011G06K9/6267G06T7/73G06V10/757G06V20/20H04N7/18G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,468,648
App. No.
17/181,051
Granted
Oct 11, 2022
Kind
B2
Abstract

An information processing system that acquires image data captured by an image capturing device; identifies a density of distribution of a plurality of feature points in the acquired image data; and controls a display to display guidance information based on the density of the distribution of the plurality of feature points.

Claims (35)

1. An information processing apparatus, comprising:

circuitry configured to:

acquire an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognize environment information by Simultaneous Localization and Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determine an un-explored area and an explored area in the acquired image based on the recognized environment information; and

determine a first operation mode and a second operation mode based on the determined un-explored area and the determined explored area.

2. The information processing apparatus of claim 1 , wherein the circuitry is further configured to continuously update the explored area and the un-explored area based on the recognized environment information.

3. The information processing apparatus of claim 1 , wherein the recognized environment information includes a map.

4. The information processing apparatus of claim 3 , wherein the circuitry is further configured to detect a position of the information processing apparatus on the map.

5. The information processing apparatus of claim 4 , wherein the circuitry is further configured to detect the position of the information processing apparatus based on the SLAM.

6. The information processing apparatus of claim 3 , wherein the map indicates a three dimensional location and shape of real objects within the real space.

7. The information processing apparatus of claim 3 , wherein the map is a three-dimensional map.

8. The information processing apparatus of claim 1 , wherein the circuitry is further configured to control, based on the determination of the first operation mode, a movable area of a virtual object.

9. The information processing apparatus of claim 8 , wherein the circuitry is further configured to control display of the virtual object in the explored area.

10. The information processing apparatus of claim 1 , wherein the circuitry is further configured to control, based on the determination of the second operation mode, display of a virtual object that notifies a user of the determined un-explored area.

11. The information processing apparatus of claim 10 , wherein the circuitry is further configured to execute an augmented reality (AR) application by controlling the display of the virtual object overlaid on the acquired image.

12. The information processing apparatus of claim 11 , wherein the second operation mode is selected in initialization phase of the AR application.

13. An information processing method, comprising:

in an information processing apparatus:

acquiring an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognizing environment information by Simultaneous Localization and Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determining an un-explored area and an explored area in the acquired image based on the recognized environment information; and

determining a first operation mode and a second operation mode based on the determined un-explored area and the determined explored area.

14. The information processing method of claim 13 , wherein the explored area and the un-explored area are continuously updated based on the recognized environment information.

15. The information processing method of claim 13 , wherein the recognized environment information includes a map.

16. The information processing method of claim 15 , wherein a position of the information processing apparatus is detected on the map.

17. The information processing method of claim 16 , wherein the position of the information processing apparatus is detected based on the SLAM.

18. The information processing method of claim 15 , wherein the map indicates a three dimensional location and shape of real objects within the real space.

19. The information processing method of claim 15 , wherein the map is a three-dimensional map.

20. A non-transitory computer-readable medium including computer-executable instructions, which when executed by a computer causes the computer to execute operations, the operations comprising:

in an information processing apparatus:

acquiring an image of a real space from an image pick-up device, wherein the image of the real space is captured by the image pick-up device;

recognizing environment information by Simultaneous Localization and Mapping (SLAM), wherein the environment information is recognized based on the acquired image of the real space;

determining an un-explored area and an explored area in the acquired image based on the recognized environment information; and

determining a first operation mode and a second operation mode based on the determined un-explored area and the determined explored area.

Priority Claims (1)
JP 2012-097714 · Apr 23, 2012 · national
Continuity (5)
Continuation 15816500 · Nov 17, 2017
Continuation 15384754 · Dec 20, 2016
Continuation 15162246 · May 23, 2016
Continuation 14391874
Related Publication 20210248828A1 · Aug 12, 2021