Freely selected point of view image generating apparatus, reference image data generating apparatus, freely selected point of view image generating method, and reference image data generating method

1. An image generating apparatus comprising:

a reference image data storing unit that stores data of a reference image from a plurality of reference images that represents an image when a space including an object of a display target is viewed from a predetermined reference point of view,

wherein a first subset of the plurality of reference images have a reference point of view set at a height of eyes when a user stands and a second subset of the plurality of reference images have a reference point of view set at a height of eyes when the user sits,

wherein the reference point of views of the first subset and the reference point of views of the second subset do not overlap in an X-axis direction or a Y-axis direction;

a point-of-view information acquiring unit that acquires information relating to a point of view;

a projecting unit that represents a position and a shape of an image of the object when the space is viewed from the point of view on a plane of a display image;

a pixel value deciding unit that decides a value of a pixel configuring the image of the object in the display image by using a value of a pixel that represents a same image in the reference image; and

an output unit that outputs data of the display image, wherein

the reference image data storing unit stores data of a reference image including an invalid region that does not have data of an image in a field of view from a corresponding reference point of view, and

the pixel value deciding unit selects the reference image in which a same image appears in a valid region when deciding the value of the pixel configuring the image of the object,

wherein the reference image data storing unit stores, as data of the reference image, data of a tile image obtained by dividing the reference image by predetermined sizes and index data that associates a position of the tile image on an image plane with the data of the tile image,

wherein the pixel value deciding unit acquires the value of the pixel by referring to a tile image including a pixel that represents a same image in the reference image based on the index data, and

wherein the index data is generated prior to the point-of-view information acquiring unit acquiring the information related to the point of view.

2. The image generating apparatus according to claim 1 , wherein

the invalid region is set in units of the tile image and the index data associates identification information indicating that data is invalid with a position corresponding to a tile image of the invalid region, and

the pixel value deciding unit refers to the index data and selects a reference image in which a tile image including the pixel that represents the same image is valid in the reference images.

3. The image generating apparatus according to claim 1 , wherein

the reference image data storing unit stores data of a plurality of the reference images in which the invalid region is set with ensuring of appearance of images of all objects in the space of the display target in at least one reference image.

4. The image generating apparatus according to claim 1 , wherein

the reference image data storing unit stores data of a reference image including the invalid region and a reference image that does not include the invalid region and the reference image including the invalid region is decided based on a position of the corresponding reference point of view.

5. The image generating apparatus according to claim 1 , wherein

the reference image data storing unit stores data of a reference image composed of a plurality of moving image frames and the data is composed of data of frames including the invalid region and frames that do not include the invalid region.

6. An image generating method for generating a display image that represents a space including an object of a display target, the image generating method comprising:

acquiring information relating to a point of view;

representing a position and a shape of an image of the object when the space is viewed from the point of view on a plane of the display image;

reading out data of a reference image from a plurality of reference images that represents an image when the space is viewed from a predetermined reference point of view from a memory that stores the data of the reference image, and deciding a value of a pixel configuring an image of the object in the display image by using a value of a pixel that represents a same image in the reference image,

wherein a first subset of the plurality of reference images have a reference point of view set at a height of eyes when a user stands and a second subset of the plurality of reference images have a reference point of view set at a height of eyes when the user sits, and

wherein the reference point of views of the first subset and the reference point of views of the second subset do not overlap in an X-axis direction or a Y-axis direction; and

outputting data of the display image,

wherein the memory stores data of a reference image including an invalid region that does not have data of an image in a field of view from a corresponding reference point of view, and the deciding the value of the pixel configuring the image of the object selects the reference image in which a same image appears in a valid region,

wherein memory stores, as data of the reference image, data of a tile image obtained by dividing the reference image by predetermined sizes and index data that associates a position of the tile image on an image plane with the data of the tile image, and

the pixel value deciding unit acquires the value of the pixel by referring to a tile image including a pixel that represents a same image in the reference image based on the index data,

wherein the index data is generated prior to the point-of-view information acquiring unit acquiring the information related to the point of view.

7. A non-transitory computer readable medium having stored thereon a computer program for a computer that generates a display image that represents a space including an object of a display target, comprising:

a reference image data storing unit that stores data of a reference image from a plurality of reference images that represents an image when a space including an object of a display target is viewed from a predetermined reference point of view,

wherein a first subset of the plurality of reference images have a reference point of view set at a height of eyes when a user stands and a second subset of the plurality of reference images have a reference point of view set at a height of eyes when the user sits,

wherein the reference point of views of the first subset and the reference point of views of the second subset do not overlap in an X-axis direction or a Y-axis direction;

by a point-of-view information acquiring unit, acquiring information relating to a point of view;

by a projecting unit, representing a position and a shape of an image of the object when the space is viewed from the point of view on a plane of the display image;

by a pixel value deciding unit, reading out data of a reference image from the reference image data storing unit that represents an image when the space is viewed from a predetermined reference point of view from a memory that stores the data of the reference image, and deciding a value of a pixel configuring an image of the object in the display image by using a value of a pixel that represents a same image in the reference image; and

by an output unit, outputting data of the display image; wherein

the memory stores data of a reference image including an invalid region that does not have data of an image in a field of view from a corresponding reference point of view, and the deciding the value of the pixel configuring the image of the object selects the reference image in which a same image appears in a valid region,

wherein the reference image data storing unit stores, as data of the reference image, data of a tile image obtained by dividing the reference image by predetermined sizes and index data that associates a position of the tile image on an image plane with the data of the tile image, and

the pixel value deciding unit acquires the value of the pixel by referring to a tile image including a pixel that represents a same image in the reference image based on the index data,

wherein the index data is generated prior to the point-of-view information acquiring unit acquiring the information related to the point of view.