Three-dimensional image processing apparatus and three-dimensional image processing system
A three-dimensional image processing apparatus includes: an obtainment unit that obtains range image data from each of a plurality of range image generation devices and obtains visible light image data from each of a plurality of visible light image generation devices; a model generation unit that generates three-dimensional model data expressing a target contained in a scene based on a plurality of pieces of the range image data; a setting unit that sets a point of view for the scene; and a rendering unit that selects one of the pieces of the visible light image data in accordance with the set point of view and renders a region corresponding to the surface of the target based on the selected visible light image data.
1. A three-dimensional image processing apparatus comprising:
a processor that obtains, from each of a plurality of visible light image sensors having mutually different image capture points, visible light image data of the scene as viewed from the image capture point;
the processor generating three-dimensional model data expressing a target contained in the scene;
the processor setting a point of view for the scene; and
the processor rendering display image data expressing the scene as viewed from the set point of view based on the three-dimensional model data and the plurality of pieces of visible light image data having mutually different image capture points,
wherein in the case where there are a plurality of pieces of visible light image data corresponding to a region on a surface of the target expressed by the three-dimensional model data, the processor selects one of the pieces of the visible light image data in accordance with the set point of view and renders the region corresponding to the surface of the target based on the selected visible light image data and the three-dimensional model data,
wherein the processor selects one of the pieces of the visible light image data in accordance with a positional relationship between the point of view and the image capture point, and
wherein the processor selects one of the pieces of the visible light image data in accordance with the magnitude of angles formed between an image capturing direction of each visible light image sensor and a direction of the set point of view.
2. The three-dimensional image processing apparatus according to claim 1 ,
wherein in border areas among a plurality of the stated regions, the processor renders the display image data by synthesizing a plurality of the pieces of the visible light image data corresponding to those border areas.
3. The three-dimensional image processing apparatus according to claim 1 ,
wherein the processor obtains, from each of a plurality of range image sensors having mutually different measurement points, range image data expressing a depth of a scene viewed from the measurement point.
4. The three-dimensional image processing apparatus according to claim 3 ,
wherein the processor generates the three-dimensional model data for each measurement point; and
the processor selects one of the pieces of the three-dimensional model data and one of the pieces of the visible light image data in accordance with the set point of view and renders the display image data based on the selected three-dimensional model data and the selected visible light image data.
5. A three-dimensional image processing system comprising:
a plurality of visible light image sensors having mutually different image capture points; and
a three-dimensional image processing apparatus,
wherein the three-dimensional image processing apparatus includes:
a processor that obtains visible light image data of the scene as viewed from the image capture points from the plurality of visible light image sensors;
the processor generating three-dimensional model data expressing a target contained in the scene;
the processor setting a point of view for the scene; and
the processor rendering display image data expressing the scene as viewed from the set point of view based on the three-dimensional model data and the plurality of pieces of visible light image data having mutually different image capture points, and
wherein in the case where there are a plurality of pieces of visible light image data corresponding to a region on a surface of the target expressed by the three-dimensional model data, the processor selects one of the pieces of the visible light image data in accordance with the set point of view and renders the region corresponding to the surface of the target based on the selected visible light image data and the three-dimensional model data,
wherein the processor selects one of the pieces of the visible light image data in accordance with a positional relationship between the point of view and the image capture point, and
wherein the processor selects one of the pieces of the visible light image data in accordance with the magnitude of angles formed between an image capturing direction of each visible light image sensor and a direction of the set point of view.
6. The three-dimensional image processing system according to claim 5 , further comprising:
a plurality of range image sensors having mutually different measurement points,
the processor obtaining range image data expressing a depth of a scene viewed from the measurement points of the plurality of range image sensors from the plurality of range image sensors.
7. A three-dimensional image processing method comprising:
obtaining, from each of a plurality of visible light image sensors having mutually different image capture points, visible light image data of the scene as viewed from the image capture point;
generating three-dimensional model data expressing a target contained in the scene;
setting a point of view for the scene; and
rendering display image data expressing the scene as viewed from the set point of view based on the three-dimensional model data and the plurality of pieces of visible light image data having mutually different image capture points,
wherein in the case where there are a plurality of pieces of visible light image data corresponding to a region on a surface of the target expressed by the three-dimensional model data, one of the pieces of the visible light image data is selected in accordance with the set point of view and the region corresponding to the surface of the target is rendered based on the selected visible light image data and the three-dimensional model data,
wherein one of the pieces of the visible light image data is selected in accordance with a positional relationship between the point of view and the image capture point, and
wherein one of the pieces of the visible light image data is selected in accordance with the magnitude of angles formed between an image capturing direction of each visible light image sensor and a direction of the set point of view.
8. The three-dimensional image processing method according to claim 7 , further comprising:
obtaining, from each of a plurality of range image sensors having mutually different measurement points, range image data expressing a depth of a scene viewed from the measurement point.