Image processing device, image processing method, and program

1. An image processing device comprising:

an environment map building unit for building an environment map based on an input image obtained by imaging a real space using an imaging device and a feature data indicating a feature of appearance of one or more physical objects, the environment map representing a position of a physical object present in the real space;

a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

a superimposing unit for generating an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on the environment map and the position information, using the procedure data acquired by the control unit,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction, and

wherein at least one of the environment map building unit, the control unit, and the superimposing unit is implemented via a processor.

2. The image processing device according to claim 1 ,

wherein the position information designates a position in the environment map at which the direction is to be displayed, by specifying a physical object related to the direction for each procedure.

3. The image processing device according to claim 1 ,

wherein the condition for progressing displaying of each direction includes a condition according to a position or a posture of a physical object represented by the environment map.

4. The image processing device according to claim 1 ,

wherein the control unit controls displaying of the direction for each procedure included in the set of procedures according to the procedure data.

5. The image processing device according to claim 1 ,

wherein the image processing device further comprises a detection unit for dynamically detecting a position in the real space of the imaging device based on the input image and the feature data, and

the position in the input image at which the direction for each procedure is to be superimposed is determined according to the position in the real space of the imaging device detected by the detection unit.

6. The image processing device according to claim 1 ,

wherein the procedure data further defines a correspondence between each of a plurality of physical objects present in the real space and respective progress conditions.

7. The image processing device according to claim 6 ,

wherein the progress conditions indicate conditions in correspondence with respective ones of the physical objects, upon which the direction for each procedure is to be displayed.

8. The image processing device according to claim 7 ,

wherein the direction for each procedure is respectively displayed when a progress condition associated with a corresponding one of the plurality of physical objects is determined to correspond to a present condition in the real space.

9. The image processing device according to claim 7 ,

wherein the direction for each procedure is respectively displayed based on at least one of a state of a corresponding physical object in the environment map, a passage of a predetermined amount of time, and an externally-triggered event.

10. An image processing method in an image processing device including a storage medium having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects, the method comprising the steps of:

acquiring an input image obtained by imaging a real space using an imaging device;

building an environment map based on the input image and the feature data, the environment map representing a position of a physical object present in the real space;

acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

generating an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on the environment map and the position information, using the acquired procedure data,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction.

11. A non-transitory computer-readable medium having embodied thereon a program, which when executed by a computer that controls an image processing device including a storage medium having feature data stored therein, the feature data indicating a feature of appearance of one or more physical objects, causes the computer to perform a method comprising:

building an environment map based on an input image obtained by imaging a real space using an imaging device and the feature data, the environment map representing a position of a physical object present in the real space;

acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is to be displayed; and

generating an output image by superimposing the direction for each procedure included in the set of procedures at a position in the input image determined based on the environment map and the position information, using the acquired procedure data,

wherein the procedure data defines a further correspondence between the direction for each procedure and a condition for progressing displaying of each direction.