IP Library Granted Patent US 9,183,678
Granted Patent B2
US 9,183,678 · App. 14/527,148 · Granted Nov 10, 2015

Image processing device, image processing method, and program

Inventors: Yasuhiro Suto (Tokyo, JP); Masaki Fukuchi (Tokyo, JP); Kenichirou Ooi (Kanagawa, JP); Jingjing Guo (Tokyo, JP); Kouichi Matsuda (Tokyo, JP)
Assignee: Sony Corporation
G06T19/006G09G5/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,183,678
App. No.
14/527,148
Granted
Nov 10, 2015
Kind
B2
Abstract

There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space; a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

Claims (28)

1. An image processing device comprising:

a control unit configured to acquire procedure data for a set of procedures of operation to be performed in a real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

a superimposing unit configured to generate an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on an environment information representing a position of one or more physical objects present in the real space and the position information, using the procedure data acquired by the control unit,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction, and

wherein the control unit and the superimposing unit are each implemented via at least one processor.

2. The image processing device according to claim 1 ,

wherein the position information designates a position at which the direction is to be displayed, by specifying a physical object related to the direction for each procedure.

3. The image processing device according to claim 1 ,

wherein the condition for progressing displaying of each direction includes a condition according to a position or a posture of a physical object.

4. The image processing device according to claim 1 ,

wherein the control unit controls displaying of the direction for each procedure included in the set of procedures according to the procedure data.

5. An image processing method in an image processing device including a storage medium having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects, the method comprising the steps of:

acquiring procedure data for a set of procedures of operation to be performed in a real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

generating an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on an environment information representing a position of one or more physical objects present in the real space and the position information, using the acquired procedure data,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction.

6. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer that controls an image processing device including a storage medium having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects, causes the computer to perform a method comprising:

acquiring procedure data for a set of procedures of operation to be performed in a real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

generating an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on an environment information representing a position of one or more physical objects present in the real space and the position information, using the acquired procedure data,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction.

7. An image processing device comprising:

a control unit configured to acquire procedure data for a set of procedures of operation to be performed in a real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

a superimposing unit configured to generate an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on an environment information representing a position of one or more physical objects present in the real space and the position information, using the procedure data acquired by the control unit,

wherein the procedure data further defines a correspondence between each of a plurality of physical objects present in the real space and respective progress conditions, and

wherein the control unit and the superimposing unit are each implemented via at least one processor.

8. The image processing device according to claim 7 ,

wherein the progress conditions indicate a condition in correspondence with respective ones of the physical objects, upon which the direction for each procedure is to be displayed.

9. The image processing device according to claim 8 ,

wherein the direction for each procedure is respectively displayed when a progress condition associated with a corresponding one of the plurality of physical objects is determined to correspond to a present condition in the real space.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 27, 2015
From: SUTO, YASUHIRO; FUKUCHI, MASAKI; OOI, KENICHIROU; GUO, JINGJING; MATSUDA, KOUICHI
To: SONY CORPORATION
Reel/Frame 035055/0666 →
Priority Claims (1)
JP 2010-021368 · Feb 2, 2010 · national
Continuity (2)
Continuation 12984847 · Jan 5, 2011
Related Publication 20150049116A1 · Feb 19, 2015