Image processing device, image processing method, and computer program product

1. An image processing device comprising:

circuitry configured to

detect, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed,

detect, from the captured image, an area of an operation marker that is provided so as to correspond to the augmented reality marker, and determine that an operation of a user is performed when the operation marker is touched by a part of a body of the user for a predetermined period even when the part of the body is separated from the operation marker,

deform a virtual object corresponding to the augmented reality marker based on the operation of the user, and

draw the deformed virtual object in the captured image in a superimposed manner.

2. The image processing device according to claim 1 , wherein

the operation marker is located at a predetermined position with respect to the augmented reality marker, and

the circuitry is configured to detect the area of the operation marker in the captured image based on a position of the area of the augmented reality marker.

3. The image processing device according to claim 1 , wherein

the operation marker is detectable independently from the augmented reality marker, and

the circuitry is configured to detect, from the captured image, the area of the operation marker independently from the augmented reality marker.

4. The image processing device according to claim 1 , wherein

the circuitry is configured to detect a difference between a partial image of the area of the operation marker in the captured image and a reference image of the operation marker that is previously stored and, when the difference is greater than a predetermined threshold, determine that the operation is performed on the corresponding operation marker.

5. The image processing device according to claim 1 , further comprising a display configured to display the captured image where the virtual object is superimposed by the circuitry.

6. An image processing method comprising:

detecting, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed;

detecting, from the captured image, an area of an operation marker that is provided so as to correspond to the augmented reality marker;

determining that an operation of a user is performed when the operation marker is touched by a part of a body of the user for a predetermined period even when the part of the body is separated from the operation marker;

deforming a virtual object corresponding to the augmented reality marker based on the operation of the user; and

drawing the deformed virtual object in the captured image in a superimposed manner.

7. A computer program product comprising a non-transitory computer-readable medium having computer readable program codes, the program codes when executed causing the computer to perform:

detecting, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed;

detecting, from the captured image, an area of an operation marker that is provided so as to correspond to the augmented reality marker;

determining that an operation of a user is performed when the operation marker is touched by a part of a body of the user for a predetermined period even when the part of the body is separated from the operation marker;

deforming a virtual object corresponding to the augmented reality marker in based on the operation of the user; and

drawing the deformed virtual object in the captured image in a superimposed manner.

8. An image processing device comprising:

circuitry configured to

detect, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed,

detect, from the captured image, an area of at least one operation marker that is provided so as to correspond to the augmented reality marker, and detect, as an operation of a user, a movement of a part of a body of the user with respect to the at least one operation marker,

change a movement of the virtual object in accordance with the movement of the part of the body of the user, and

draw the changed virtual object in the captured image in a superimposed manner.

9. The image processing device according to claim 8 , wherein the circuitry is configured to detect the operation of the user when the part of the body of the user moves on the at least one operation marker.

10. An image processing method comprising:

detecting, from a captured image, an augmented reality marker indicating that a virtual object is to be displayed;

detecting, from the captured image, an area of at least one operation marker that is provided so as to correspond to the augmented reality marker;

detecting, as an operation of a user, a movement of a part of a body of the user with respect to the at least one operation marker;

changing a movement of the virtual object in accordance with the movement of the part of the body of the user; and

drawing the changed virtual object in the captured image in a superimposed manner.

11. A computer program product comprising a non-transitory computer-readable medium having computer readable program codes, the program codes when executed causing the computer to perform:

detecting, from a captured image, an augmented reality marker indicating that a virtual object is to he displayed;

detecting, from the captured image, an area of at least one operation marker that is provided so as to correspond to the augmented reality marker;

detecting, as an operation of a user, a movement of a part of a body of the user with respect to the at least one operation marker;

changing a movement of the virtual object in accordance with the movement of the part of the body of the user; and

drawing the changed virtual object in the captured image in a superimposed manner.