Moving-image processing device, moving-image processing method, and information recording medium

1. A moving-image processing device for synthesizing a first moving image and a second moving image, wherein a first object is depicted in the first moving image and is accompanied by depth information of the first object, a second object is depicted in the second moving image as moving along a second object trajectory and is accompanied by depth information of the second object, the depth information of the first object comprises anterior-surface depth information of the first object and rear-surface depth of the first object, and the depth information of the second object comprises anterior-surface depth information of the second object and rear-surface depth of the second object, the moving-image processing device comprising:

at least one non-transitory memory operable to store program code;

at least one processor operable to read said program code and operate as instructed by said program code, said program code including:

moving image generating code configured to cause said at least one processor to generate a third moving image synthesizing the first moving image and the second moving image;

interference determining code configured to cause said at least one processor to determine whether or not the first object and the second object satisfy an interference condition in the third moving image, by referencing the second object trajectory, the anterior-surface depth information of the first object, the rear-surface depth of the first object, the anterior-surface depth information of the second object and the rear-surface depth of the second object; and

correcting code configured to cause said at least one processor to correct the second moving image by applying a non-deforming transformation that maintains a shape of the second object trajectory, when it is determined that the interference condition is satisfied,

wherein the second object moves within the second moving image over time.

2. The moving-image processing device according to claim 1 , wherein:

the non-deforming transformation is a time shift, translation, rotation, scaling or a combination of these, with the time length of the time shift, translation amount, rotation amount, or scaling ratio in the space, or a combination of these, as a transformation parameter; and

said program code further includes initial value setting code configured to set an initial value of the transformation parameter; and

the correcting code causes said at least one processor to apply the non-deforming transformation by the transformation parameter, and updates the transformation parameter so that the interference condition is not satisfied.

3. The moving-image processing device according to claim 2 , wherein the correcting code causes said at least one processor to repeat updating of the transformation parameter until a first time it is determined that the first object and the second object do not clash.

4. The moving-image processing device according to claim 3 , wherein the correcting code causes said at least one processor to update the transformation parameter within a prescribed correction range so that an elapsed time until the interference condition is for the first time satisfied increases.

5. The moving-image processing device according to claim 3 , wherein:

the interference determining code causes said at least one processor to calculate a clash amount indicating a degree of clash between the second object and the first object; and

the correcting code causes said at least one processor to update the transformation parameter within a prescribed range so that the clash amount declines.

6. The moving-image processing device according to claim 5 , wherein the clash amount is a sum of volumes in which a shape of the first object estimated based on the depth information of the first object in each frame and a shape of the first object estimated based on the depth information of the transformed object determined based on the depth information of the second object overlap.

7. The moving-image processing device according to claim 5 , wherein the clash amount is a sum of areas in which an area in which the first object should be depicted in each frame and an area in which the transformed object should be depicted overlap.

8. The moving-image processing device according to claim 2 , wherein the correcting code causes said at least one processor to repeat updating of the transformation parameter until the first time it is determined that the first object and the second object do not clash and it is determined that if the next update is done, the first object and the second object will clash.

9. The moving-image processing device according to claim 1 , wherein the interference condition is satisfied if the first object and the second object clash.

10. The moving-image processing device according to claim 1 , wherein the moving image generating code causes said at least one processor to obtain a three-dimensional position where a representative point of the second object is positioned, from a position within a frame where a representative point is depicted in the frame and a depth position of a representative point determined from depth information of the second object, and to obtain a transformed position by applying a congruent transformation of three-dimensional space on the three-dimensional position, and obtains a drawing position where the transformed position should be drawn within the frame, and obtains the transformed moving image by implementing a translation transformation based on a difference between the position within the frame and the drawing position obtained, and applying a scaling transformation based on a ratio of the depth position and the depth of the transformed position.

11. The moving-image processing device according to claim 1 , wherein the moving image generating code is configured to cause said at least one processor to generate the third moving image by superimposing objects other than a background of the second moving image onto the first moving image.

12. The moving-image processing device according to claim 1 , wherein a first moving image dimension of the first moving image corresponds to a second moving image dimension of the second moving image.

13. The moving-image processing device according to claim 1 , wherein the depth information of the first object comprises a first depth map and the depth information of the second object comprises a second depth map.

14. The moving-image processing device according to claim 1 , wherein the shape of the trajectory expressing movement within the space is maintained before and after the interference condition is satisfied.

15. The moving-image processing device according to claim 1 , wherein the first object moves within the first moving image over time.

16. The moving-image processing device according to claim 1 , wherein the first object is depicted in the first moving image as moving along a first object trajectory, and

the interference determining code is further configured to cause said at least one processor to determine whether or not the first object and the second object satisfy the interference condition in the third moving image, by referencing the first object trajectory, the second object trajectory, the depth information of the first object and the depth information of the second object.

17. The moving-image processing device according to claim 1 , wherein the second object trajectory indicates movement of the second object within the second moving image, and

the non-deforming transformation modifies the trajectory of the second object within the second moving image and maintains the shape of the second object trajectory.

18. The moving-image processing device according to claim 1 , wherein the interference determining code is further configured to cause said at least one processor to compare the anterior-surface depth information of the first object with the rear-surface depth of the second object, and compare the anterior-surface depth information of the second object with the rear-surface depth of the first object.

19. A moving-image processing method, executed by a moving-image processing device including at least one processor, for synthesizing a first moving image and a second moving image, wherein a first object is depicted in the first moving image and is accompanied by depth information of the first object, a second object is depicted in the second moving image as moving along a second object trajectory and is accompanied by depth information of the second object, the depth information of the first object comprises anterior-surface depth information of the first object and rear-surface depth of the first object, and the depth information of the second object comprises anterior-surface depth information of the second object and rear-surface depth of the second object, the moving-image processing method comprising:

generating, using said at least one processor, a third moving image synthesizing the first moving image and the second moving image;

determining, using said at least one processor, whether or not the first object and the second object satisfy an interference condition in the third moving image, by referencing the second object trajectory, the anterior-surface depth information of the first object, the rear-surface depth of the first object, the anterior-surface depth information of the second object and the rear-surface depth of the second object; and

correcting, using said at least one processor, the second moving image by applying a non-deforming transformation that maintains a shape of the second object trajectory, when it is determined that the interference condition is satisfied,

wherein the second object moves within the second moving image over time.

20. A non-transitory computer-readable medium on which is recorded a program for synthesizing a first moving image and a second moving image, wherein a first object is depicted in the first moving image and is accompanied by depth information of the first object, a second object is depicted in the second moving image as moving along a second object trajectory and is accompanied by depth information of the second object, the depth information of the first object comprises anterior-surface depth information of the first object and rear-surface depth of the first object, and the depth information of the second object comprises anterior-surface depth information of the second object and rear-surface depth of the second object, the program causing a computer to:

generate a third moving image synthesizing the first moving image and the second moving image;

determine whether or not the first object and the second object satisfy an interference condition in the third moving image, by referencing the second object trajectory, the anterior-surface depth information of the first object, the rear-surface depth of the first object, the anterior-surface depth information of the second object and the rear-surface depth of the second object; and

correct the second moving image by applying a non-deforming transformation that maintains a shape of the second object trajectory, when it is determined that the interference condition is satisfied,

wherein the second object moves within the second moving image over time.