Free viewpoint movement display device

1. A free viewpoint movement display device, comprising:

a camera vector (CV) video acquisition means which generates a CV video obtained by adding a CV value to a target video on which a CV calculation is performed to obtain the CV value representing three-dimensional coordinate values indicating a camera position and posture of the target video picked up by a predetermined video acquisition means;

a virtual three-dimensional space disposition means which disposes, in a virtual space which is formed of a database and data processing in practice, a plurality of CV videos obtained by adding the CV values representing the three-dimensional coordinate values of the camera position and posture, in accordance with the three-dimensional coordinates;

a viewpoint movement path selection means which selects, from among the plurality of CV videos, a plurality of image frames closest to scheduled viewpoint movement coordinates in a suitable interval according to the scheduled viewpoint movement coordinates; and

a continuous image generation means which converts a viewpoint direction, an enlargement ratio, a view angle and a viewpoint movement direction of the plurality of image frames selected so as to match a scheduled direction, and sequentially combines the image frames selected to generate a continuous image formed of a video image or a continuous still image, wherein

an image of visually smooth viewpoint movement and smooth viewpoint direction movement is displayed by using the continuous image,

the viewpoint movement path selection means specifies coordinates of a starting point and an ending point of the plurality of image frames, and a progress point of the starting point and the ending point,

the continuous image generation means comprises:

an image combination parameter setting means that sets, as a combination parameter used for combining the plurality of image frames, at least any one of a size of each image, an enlargement ratio of a zoom, a view angle, a coordinate of a viewpoint and a posture thereof for the plurality of image frames; and

a starting point/ending point continuous image display means which generates, based on setting of the combination parameter, a moving locus in a three-dimensional space, including the starting point and the ending point of the plurality of image frames, and the progress point thereof, and

each image is displayed in matching a change in a size of an important target in a plurality of continuous images, whereby a plurality of inter-images selected are continuously displayed.

2. The free viewpoint movement display device according to claim 1 , wherein,

the CV video acquisition means, based on the CV value representing 6 variables of a stationary image contained in the continuous image,

calculates three-dimensional coordinates of an arbitrary point in the continuous image from a CV value of an image in the vicinity of the point, measures a distance between arbitrary two points, measures an area of an arbitrary shape, measures a volume of the arbitrary shape, disposes predetermined tag information in an arbitrary position, recognizes an arbitrary target or determines a coordinate of the target, and embeds information in an arbitrary place, whereby respective pieces of the information are simultaneously or individually shared among all image frames which form the continuous image.

3. A free viewpoint movement display device comprising:

a camera vector (CV) video acquisition means which generates a CV video obtained by adding a CV value to a target video on which a CV calculation is performed to obtain the CV value representing three-dimensional coordinate values indicating a camera position and posture of the target video picked up by a predetermined video acquisition means;

a virtual three-dimensional space disposition means which disposes, in a virtual space which is formed of a database and data processing in practice, a plurality of CV videos obtained by adding the CV values representing the three-dimensional coordinate values of the camera position and posture, in accordance with the three-dimensional coordinates;

a viewpoint movement path selection means which selects, from among the plurality of CV videos, a plurality of image frames closest to scheduled viewpoint movement coordinates in a suitable interval according to the scheduled viewpoint movement coordinates;

a continuous image generation means which converts a viewpoint direction, an enlargement ratio, a view angle and a viewpoint movement direction of the plurality of image frames selected so as to match a scheduled direction, and sequentially combines the image frames selected to generate a continuous image formed of a video image or a continuous still image; and

a self-position posture orientation means, wherein

an image of visually smooth viewpoint movement and smooth viewpoint direction movement is displayed by using the continuous image, and

an image provided with the CV value is applied as a reference image, and the reference image is compared with an image having no CV value, whereby

a plurality of feature points and feature objects in the reference image are automatically selected, or

the reference image is deleted, and then an image consisting of the plurality of feature points and feature objects in the reference image is automatically selected, and

a common point or region is corresponded to the image having no CV value to give the CV value thereto to determine a self-position posture of the image.

4. A free viewpoint movement display device comprising:

a camera vector (CV) video acquisition means which generates a CV video obtained by adding a CV value to a target video on which a CV calculation is performed to obtain the CV value representing three-dimensional coordinate values indicating a camera position and posture of the target video picked up by a predetermined video acquisition means;

a virtual three-dimensional space disposition means which disposes, in a virtual space which is formed of a database and data processing in practice, a plurality of CV videos obtained by adding the CV values representing the three-dimensional coordinate values of the camera position and posture, in accordance with the three-dimensional coordinates;

a viewpoint movement path selection means which selects, from among the plurality of CV videos, a plurality of image frames closest to scheduled viewpoint movement coordinates in a suitable interval according to the scheduled viewpoint movement coordinates; and

a continuous image generation means which converts a viewpoint direction, an enlargement ratio, a view angle and a viewpoint movement direction of the plurality of image frames selected so as to match a scheduled direction, and sequentially combines the image frames selected to generate a continuous image formed of a video image or a continuous still image, wherein

the CV video acquisition means comprises:

a feature point extraction unit which automatically extracts, from among image data of the target video, a predetermined number of feature points;

a feature point correspondence processing unit which automatically tracks, in each frame image of the target video, the feature points extracted to determine a correspondence relationship among the frame images; and

a camera vector calculation unit which determines three-dimensional position coordinates of the feature points in which the correspondence relationship is determined to determine, from the three-dimensional position coordinates, a camera vector indicating a three-dimensional camera position and posture in corresponding to each frame image, and

an image of visually smooth viewpoint movement and smooth viewpoint direction movement is displayed by using the continuous image.