Image processing apparatus, image processing method, and program

1. An apparatus comprising:

a memory storing instructions; and

a control unit configured to execute the instructions to cause the apparatus to:

detect a three-dimensional position and attitude of an object of interest within an image of real space, relative to a display image plane of the apparatus; and

cause a display to display a modified image comprising an image of a modified object, corresponding to the object of interest, such that the modified object is displayed in an alignment parallel to the display image plane of the apparatus,

wherein the display is caused to display the modified image by gradually changing the image of real space into the modified image through an animation, and

wherein the modified object is a virtual object.

2. The apparatus of claim 1 , wherein causing the display to display the modified image comprises causing the display to display the modified object having an orientation different from an orientation of the object within the image of real space.

3. The apparatus of claim 1 , wherein causing the display to display the modified image comprising the image of the modified object comprises causing the display to display the modified image comprising the image of the modified object such that a shape of the modified object image is different from a shape of the real space object image.

4. The apparatus of claim 3 , wherein causing the display to display the modified image comprises applying a transformation to the real space object image.

5. The apparatus of claim 1 , wherein causing the display to display the modified image is triggered by detecting a user operation.

6. The apparatus of claim 1 , wherein causing the display to display the modified image is triggered by a detecting a condition.

7. The apparatus of claim 6 , wherein the detected condition relates to an orientation of the object within the image of real space.

8. The apparatus of claim 7 , wherein the detected condition is that an angle of orientation of the object within the image of real space exceeds a threshold.

9. The apparatus of claim 7 , wherein the detected condition is that a size of the real space object image is below a threshold.

10. The apparatus of claim 1 , wherein the instructions further comprise instructions to:

cause the display to display a virtual image superimposed on the modified image, the virtual image being associated with the object of interest; and

receive a user command to perform a specified operation on the virtual image.

11. The apparatus of claim 10 wherein the specified operation comprises providing information to the user relating to the object of interest.

12. The apparatus of claim 11 , wherein the user command comprises a drag operation that scrolls through at least two pages containing the information.

13. The apparatus of claim 10 , wherein:

the specified operation comprises accessing a document; and

the command comprises selecting a portion of the virtual image.

14. The apparatus of claim 1 , wherein:

the apparatus is remote from a user device; and

causing the display to display the modified image comprises sending signals to the user device to display the modified image on the user device.

15. The apparatus of claim 1 , wherein:

the apparatus is a user device; and

causing the display to display the modified image comprises receiving data defining the modified image from a remote server.

16. The apparatus of claim 1 wherein causing the display to display the modified image comprises causing the display to display an image generated by applying two-dimensional transformation on a partial region of the real space image, comprising the real space object.

17. A method executed by way of a processor, the method comprising:

detecting a three-dimensional position and attitude of an object of interest of real space relative to a display image plane of a displaying apparatus; and

causing a display to display, by control of the processor, a modified image comprising an image of a modified object, corresponding to the object of interest, such that the modified object is displayed in an alignment parallel to the display image plane of the displaying apparatus,

wherein the display is caused to display the modified image by gradually changing the image of real space into the modified image through an animation, and

wherein the modified object is a virtual object.

18. A tangibly embodied non-transitory computer-readable medium storing instructions which, when executed by a processor, cause the processor to execute a method, the method comprising:

detecting a three-dimensional position and attitude of an object of interest of real space relative to a display image plane of a displaying apparatus; and

causing a display to display a modified image comprising an image of a modified object, corresponding to the object of interest, such that the modified object is displayed in an alignment parallel to the display image plane of the displaying apparatus,

wherein the display is caused to display the modified image by gradually changing the image of real space into the modified image through an animation, and

wherein the modified object is a virtual object.

19. The apparatus of claim 1 , wherein the control unit executes the instructions to cause the apparatus to cause the display to display the modified image comprising the image of the modified object, corresponding to the object of interest, such that a base plane of the modified object is displayed in an alignment parallel to the display image plane of the apparatus.