Video synthesis device, video synthesis method and recording medium

1. A video synthesis device configured to generate an augmented reality video image in which an avatar is synthesized with a live-action video image, the device comprising:

a rear-facing camera configured to capture a live-action video image;

a front-facing camera configured to capture an image of an operator;

one or more sensors configured to detect a position and an orientation of the rear-facing camera of the video synthesis device in a coordinate system corresponding to a real space;

a processor configured to control the avatar based on the image captured by the front-facing camera and further configured to move the avatar in the coordinate system according to a movement of the detected position of the rear-facing camera of the video synthesis device in the coordinate system, and

further configured to arrange the avatar in a predetermined position of the coordinate system and further configured to synthesize the avatar with the live-action video image captured by the rear-facing camera,

wherein the processor is configured to lock or unlock an orientation of the avatar, and further configured to orient the avatar to a direction according to the movement of the detected position while the orientation of the avatar is unlocked.

2. The video synthesis device of claim 1 , wherein

the processor is configured to control the avatar based on a gesture of the operator, text, or a design, the gesture of the operator being captured by the front-facing camera.

3. The video synthesis device of claim 1 , wherein

the processor is further configured to control an orientation of the avatar based on the movement of the video synthesis device.

4. The video synthesis device of claim 1 , further comprising

a touch panel through which an operation by the operator is input, wherein

the processor is configured to control the avatar based on the operation input through the touch panel.

5. The video synthesis device of claim 4 , wherein the processor is configured to cause the touch panel to display a button, and

wherein the processor is further configured to cause the avatar to turn around responsive to the operation input on the button.

6. The video synthesis device of claim 1 , further comprising

a microphone through which audio is input, wherein

the processor is configured to control the avatar based on the audio input through the microphone.

7. The video synthesis device of claim 1 , wherein

capturing directions of the rear-facing camera and the front-facing camera that are opposite to each other.

8. The video synthesis device of claim 1 , wherein a distance between the video synthesis device and the avatar in the coordinate system is maintained.

9. A video synthesis method for generating an augmented reality video image in which an avatar is synthesized with a live-action video image, the method, executed by a computer, comprising:

detecting a position and an orientation of a rear-facing camera configured to capture the live-action video image, in a coordinate system corresponding to a real space;

controlling the avatar based on an image captured by a front-facing camera configured to capture an image of an operator comprising:

locking or unlocking an orientation of the avatar;

orienting the avatar to a direction according to a movement of the detected position of the rear-facing camera in the coordinate system while the orientation of the avatar is unlocked;

moving the avatar in the coordinate system according to the movement of the detected position of the rear-facing camera in the coordinate system; and

arranging the avatar in a predetermined position of the coordinate system and synthesizing the avatar with the live-action video image captured by the rear-facing camera.

10. The video synthesis method of claim 9 , wherein controlling the avatar is based on a gesture of the operator, text, or a design, and

wherein the gesture of the operator is captured by the front-facing camera.

11. The video synthesis method of claim 9 , further comprising:

controlling an orientation of the avatar based on the movement of the rear-facing camera.

12. The video synthesis method of claim 9 , further comprising:

receiving an operation by a touch panel; and

controlling the avatar based on the operation.

13. The video synthesis method of claim 9 , further comprising:

collecting audio by a microphone; and

controlling the avatar based on the audio.

14. The video synthesis method of claim 9 , wherein capturing directions of the rear-facing camera and the front-facing camera are opposite to each other.

15. A non-transitory computer-readable recording medium, storing a video synthesis program for generating an augmented reality video image in which an avatar is synthesized with a live-action video image that causes a processor to execute:

detecting a position and an orientation of a rear-facing camera configured to capture the live-action video image, in a coordinate system corresponding to a real space;

controlling the avatar based on an image captured by a front-facing camera configured to capture the image of an operator, comprising:

locking or unlocking an orientation of the avatar;

orienting the avatar to a direction according to a movement of the detected position of the rear-facing camera in the coordinate system while the orientation of the avatar is unlocked;

moving the avatar in the coordinate system according to the movement of the detected position of the rear-facing camera in the coordinate system; and

arranging the avatar in a predetermined position of the coordinate system and synthesizing the avatar with the live-action video image captured by the rear-facing camera.

16. The non-transitory computer-readable recording medium of claim 15 , wherein controlling the avatar is based on a gesture of the operator, text, or a design, and wherein the gesture of the operator is captured by the front-facing camera.

17. The non-transitory computer-readable recording medium of claim 15 , further causes a processor to execute:

controlling an orientation of the avatar based on the movement of the rear-facing camera.

18. The non-transitory computer-readable recording medium of claim 15 , further causes a processor to execute:

receiving an operation by a touch panel; and

controlling the avatar based on the operation.

19. The non-transitory computer-readable recording medium of claim 15 , further causes a processor to execute:

collecting audio by a microphone; and

controlling the avatar based on the audio.

20. The non-transitory computer-readable recording medium of claim 15 , wherein capturing directions of the rear-facing camera and the front-facing camera are opposite to each other.