Three-dimensional model generation method, information processing device, and medium
A three-dimensional model generation method executed by an information processing device includes: obtaining a first three-dimensional model from a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target to thereby generate a first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target; obtaining a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions; and generating a second three-dimensional model by enhancing the definition of the first three-dimensional model using the multi-viewpoint image.
1. A three-dimensional model generation method executed by an information processing device, the three-dimensional model generation method comprising:
obtaining a first three-dimensional model generated by a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target, the first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target;
obtaining a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions; and
generating a second three-dimensional model of the measurement target based on the multi-viewpoint image and the first three-dimensional model by enhancing color definition of the first three-dimensional model using the multi-viewpoint image, the second three-dimensional model having an increased amount of color information per unit area relative to the first three-dimensional model.
2. The three-dimensional model generation method according to claim 1 , wherein
in the generating, a positional relationship between the multi-viewpoint image and the first three-dimensional model in a three-dimensional coordinate system is identified, and the second three-dimensional model is generated based on the positional relationship between the multi-viewpoint image and the first three-dimensional model.
3. The three-dimensional model generation method according to claim 1 , wherein
the first three-dimensional model includes color information indicating color of the measurement target, and
the enhancing of the color definition is enhancing definition of the color information included in the first three-dimensional model using the multi-viewpoint image.
4. The three-dimensional model generation method according to claim 1 , wherein
in the generating, the second three-dimensional model is generated by:
generating a third three-dimensional model using the multi-viewpoint image;
identifying a first positional relationship between the first three-dimensional model and the multi-viewpoint image by matching a three-dimensional coordinate axis of the first three-dimensional model and a three-dimensional coordinate axis of the third three-dimensional model; and
enhancing the color definition of the first three-dimensional model using the first positional relationship identified and the multi-viewpoint image.
5. The three-dimensional model generation method according to claim 4 , wherein
in the generating, the second three-dimensional model is generated by adding, for each of the first three-dimensional positions, second color information as color information corresponding to the first three-dimensional position, using the first positional relationship and the multi-viewpoint image, the second color information being based on a pixel of the multi-viewpoint image which corresponds to the first three-dimensional position.
6. The three-dimensional model generation method according to claim 4 , wherein
the first three-dimensional model further includes items of first color information each indicating a color of the measurement target in a different one of the first three-dimensional positions, the first color information being generated using an image of the measurement target shot by the measuring device,
each of images included in the multi-viewpoint image is an image having a resolution higher than a resolution of the image shot by the measuring device, and
in the generating, the second three-dimensional model is generated by changing, for each of the first three-dimensional positions, the item of first color information corresponding to the first three-dimensional position to an item of second color information which is based on a pixel of the multi-viewpoint image which corresponds to the first three-dimensional position, using the first positional relationship and the multi-viewpoint image.
7. The three-dimensional model generation method according to claim 4 , wherein
in the generating, the second three-dimensional model is generated by interpolating, using the first positional relationship and the multi-viewpoint image, a second three-dimensional position which is between two or more positions included in the first three-dimensional positions in the measurement target, the second three-dimensional model including the first three-dimensional positions and the second three-dimensional position interpolated.
8. The three-dimensional model generation method according to claim 4 , wherein
in the generating, the second three-dimensional model is generated by detecting a defective portion of the first position information and interpolating a third three-dimensional position in the measurement target corresponding to the defective portion interpolated, using the first positional relationship and the multi-viewpoint image, the second three-dimensional model including the first three-dimensional positions and the third three-dimensional position interpolated.
9. The three-dimensional model generation method according to claim 1 , further comprising:
obtaining (i) an identified image for which a second positional relationship with the first three-dimensional model is identified and (ii) the second positional relationship, wherein
in the generating, the second three-dimensional model is generated by:
generating a third three-dimensional model using the multi-viewpoint image and the identified image;
identifying a first positional relationship between the first three-dimensional model and the multi-viewpoint image, using the third three-dimensional model and the second positional relationship; and
enhancing the color definition of the first three-dimensional model using the first positional relationship identified and the multi-viewpoint image.
10. An information processing device comprising:
a receiver configured to receive:
a first three-dimensional model generated by a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target, the first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target; and
a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions; and
a processor configured to generate a second three-dimensional model of the measurement target based on the multi-viewpoint image and the first three-dimensional model by enhancing color definition of the first three-dimensional model using the multi-viewpoint image, the second three-dimensional model having an increased amount of color information per unit area relative to the first three-dimensional model.
11. A non-transitory computer-readable medium having recorded thereon a program for causing a computer to execute a three-dimensional model generation method, wherein
the three-dimensional model generation method includes:
obtaining a first three-dimensional model generated by a measuring device that emits an electromagnetic wave and obtains a reflected wave which is the electromagnetic wave reflected by a measurement target, the first three-dimensional model including first position information indicating first three-dimensional positions in the measurement target;
obtaining a multi-viewpoint image generated by one or more cameras shooting the measurement target from different positions; and
generating a second three-dimensional model of the measurement target based on the multi-viewpoint image and the first three-dimensional model by enhancing color definition of the first three-dimensional model using the multi-viewpoint image, the second three-dimensional model having an increased amount of color information per unit area relative to the first three-dimensional model.