IP Library Granted Patent US 9,754,418
Granted Patent B2
US 9,754,418 · App. 14/869,063 · Granted Sep 5, 2017

Image processing device, image processing method, and program

Inventors: Yasuhiro Suto (Tokyo, JP); Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Jingjing Guo (Tokyo, JP); Kouichi Matsuda (Tokyo, JP)
Assignee: Sony Corporation
G06T19/006G02B27/0172G06T11/60G06T19/003G09G5/00G02B2027/014
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,754,418
App. No.
14/869,063
Granted
Sep 5, 2017
Kind
B2
Abstract

There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

Claims (41)

1. An image processing device comprising:

circuitry configured to

identify an object present in a real space, and

control a displaying of a series of directions comprising more than two procedures, the more than two procedures being defined by an order to be read, and at least one of which is associated with the object present in the real space and displayed at a timing defined by a progress condition corresponding to the at least one procedure,

wherein the progress condition is defined by one of a state of the object present in the real space, a passage of a given time, and an external event.

2. The image processing device according to claim 1 ,

wherein a direction of the at least one procedure is displayed in relation to the object or to a vicinity the object.

3. The image processing device according to claim 1 ,

wherein the object corresponds to a related physical object that is associated with the at least one procedure.

4. The image processing device according to claim 3 ,

wherein the related physical object is blank when associated with a procedure that is not associated with any physical object.

5. The image processing device according to claim 1 ,

wherein the series of directions are displayed to a user in a transit station.

6. The image processing device according to claim 1 ,

wherein the series of directions are displayed to a user in a commercial facility.

7. The image processing device according to claim 1 ,

wherein the series of directions are displayed to a user to instruct the user of a transaction process.

8. The image processing device according to claim 1 ,

wherein the series of directions is displayed to be superimposed upon or in the vicinity of the object in the real space or a representation of the object.

9. An image processing method comprising:

identifying an object present in a real space; and

displaying a series of directions comprising more than two procedures, the more than two procedures being defined by an order to be read, and at least one of which is associated with the object present in the real space and displayed at a timing defined by a progress condition corresponding to the at least one procedure,

wherein the progress condition is defined by one of a state of the object present in the real space, a passage of a given time, and an external event.

10. The image processing method according to claim 9 ,

wherein a direction of the at least one procedure is displayed in relation to the object or to a vicinity the object.

11. The image processing method according to claim 9 ,

wherein the object corresponds to a related physical object that is associated with the at least one procedure.

12. The image processing method according to claim 11 ,

wherein the related physical object is blank when associated with a procedure that is not associated with any physical object.

13. The image processing method according to claim 9 ,

wherein the series of directions are displayed to a user in a transit station.

14. The image processing method according to claim 9 ,

wherein the series of directions are displayed to a user in a commercial facility.

15. The image processing method according to claim 9 ,

wherein the series of directions are displayed to a user to instruct the user of a transaction process.

16. The image processing method according to claim 9 ,

wherein the series of directions is displayed to be superimposed upon the object in the real space or in the vicinity of the object in the real space, or superimposed upon a representation of the object or in the vicinity of the representation of the object.

17. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer causes the computer to execute a method, the method comprising:

identifying an object present in a real space; and

displaying a series of directions comprising more than two procedures, the more than two procedures being defined by an order to be read, and at least one of which is associated with the object present in the real space and displayed at a timing defined by a progress condition corresponding to the at least one procedure,

wherein the progress condition is defined by one of a state of the object present in the real space, a passage of a given time, and an external event.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2015
From: SUTO, YASUHIRO; FUKUCHI, MASAKI; OOI, KENICHIROU; GUO, JINGJING; MATSUDA, KOUICHI
To: SONY CORPORATION
Reel/Frame 036682/0424 →
Priority Claims (1)
JP 2010-021368 · Feb 2, 2010 · national
Continuity (3)
Continuation 14527148 · Oct 29, 2014
Continuation 12984847 · Jan 5, 2011
Related Publication 20160035141A1 · Feb 4, 2016