Image processing apparatus and image processing method

1. An image processing apparatus, comprising:

a central processing unit (CPU) configured to:

generate an additional image;

perform an image editing process to add the generated additional image to moving image data, based on depth information of a pixel in the moving image data;

generate an editing operation image to edit the additional image added to the moving image data; and

control a display of the generated editing operation image on a user interface, wherein

the displayed editing operation image includes a display area, on the user interface, having a time axis of a moving image and a depth axis of the moving image,

the time axis is perpendicular to the depth axis, and

the moving image is associated with the moving image data.

2. The image processing apparatus according to claim 1 , wherein the CPU is further configured to perform the image editing process based on:

a front-rear relationship between an object of the pixel in the moving image data and the additional image, and

the depth information of the pixel including the object in the moving image data and depth information of the additional image.

3. The image processing apparatus according to claim 1 , wherein the CPU is further configured to:

adjust a size of the additional image based on the depth information of the pixel in the moving image data, wherein the pixel is at an insertion position of the additional image in the moving image data; and

synthesize the additional image with the moving image data based on the adjusted size of the additional image.

4. The image processing apparatus according to claim 1 , wherein

the additional image is an effect image, and

the CPU is further configured to generate the effect image based on a moving object detection result in the moving image data.

5. The image processing apparatus according to claim 4 , wherein the CPU is further configured to:

set depth information of the effect image based on a moving object of the moving image data; and

perform the image editing process based on:

a front-rear relationship between the moving object and the effect image, and

the depth information of the pixel including the moving object in the moving image data and the set depth information of the effect image.

6. The image processing apparatus according to claim 4 , wherein the CPU is further configured to:

set depth information of the effect image based on a moving object of the moving image data;

adjust a size of the effect image based on the depth information of the pixel in the moving image data; and

synthesize the effect image with the moving image data based on the adjusted size of the effect image.

7. The image processing apparatus according to claim 1 , wherein the additional image is an effect image representing a locus of a moving object in the moving image data.

8. The image processing apparatus according to claim 1 , wherein the additional image is an effect image representing at least one of a motion mode or a motion type of a moving object in the moving image data.

9. The image processing apparatus according to claim 1 , wherein the CPU is further configured to generate a telop image as the additional image based on a sound detection result in the moving image data.

10. The image processing apparatus according to claim 9 , wherein the CPU is further configured to control a display of text data, as the telop image, based on sound recognition from the moving image data.

11. The image processing apparatus according to claim 9 , wherein the CPU is further configured to generate a mode of the telop image based on a volume of a sound recognized from the moving image data.

12. The image processing apparatus according to claim 9 , wherein the CPU is further configured to generate a mode of the telop image based on emotion information of a speaker in the moving image data.

13. The image processing apparatus according to claim 1 , wherein

the additional image is an information presentation image, and

the CPU is further configured to:

acquire specific information based on analysis of the moving image data; and

generate the information presentation image based on the acquired specific information.

14. The image processing apparatus according to claim 1 , wherein

the CPU is further configured to control simultaneous display of a specific image and specific information in a direction of the time axis, as the editing operation image, and

the specific image is an image at a specific point of time in the specific information displayed in the direction of the time axis.

15. The image processing apparatus according to claim 1 , wherein the CPU is further configured to control simultaneous display of a specific image and specific information in a direction of the time axis, as the editing operation image, based on specification of a specific point of time on an image indicating the specific information in the direction of the time axis.

16. The image processing apparatus according to claim 1 , wherein the CPU is further configured to control the display of the editing operation image, at a specific point of time in a direction of the time axis, as a stereoscopic image.

17. An image processing method, comprising:

generating an additional image;

performing an image editing process to add the generated additional image to moving image data, based on depth information of a pixel in the moving image data;

generating an editing operation image to edit the additional image added to the moving image data; and

controlling a display of the generated editing operation image on a user interface, wherein

the displayed editing operation image includes a display area, on the user interface, having a time axis of a moving image and a depth axis of the moving image,

the time axis is perpendicular to the depth axis, and

the moving image is associated with the moving image data.

18. A non-transitory computer-readable medium having stored thereon computer-executable instructions, which when executed by a computer, cause the computer to execute operations, the operations comprising:

generating an additional image;

performing an image editing process to add the generated additional image to moving image data, based on depth information of a pixel in the moving image data;

generating an editing operation image to edit the additional image added to the moving image data; and

controlling a display of the generated editing operation image on a user interface, wherein

the displayed editing operation image includes a display area, on the user interface, having a time axis of a moving image and a depth axis of the moving image,

the time axis is perpendicular to the depth axis, and

the moving image is associated with the moving image data.