Method and apparatus for recording digital holographic portrait photograph using neural network image interpolation
Provided is a method of recording a digital holographic portrait photograph, which is performed by an apparatus for recording a digital holographic portrait photograph, the method including the steps of: (a) performing a preliminary test using a plurality of cameras arranged at a specific rotation angle; (b) determining a maximum allowable angle between the cameras through the preliminary test; (c) acquiring a plurality of images using the plurality of cameras arranged at the maximum allowable angle; and (d) interpolating the plurality of images to record a holographic portrait photograph.
1 . A method of recording a digital holographic portrait photograph, which is performed by an apparatus for recording a digital holographic portrait photograph, the method comprising:
performing a preliminary test using a plurality of cameras arranged at a specific rotation angle;
determining a maximum allowable angle between the cameras through the preliminary test;
acquiring a plurality of images using the plurality of cameras arranged at the maximum allowable angle; and
interpolating the plurality of images to record a holographic portrait photograph, wherein the determining the maximum allowable angle includes:
comparing pixel colors between an acquired image and an actual image generated through the preliminary test;
converting a color of an area in which a difference in pixel colors in the acquired image and the actual image is greater than or equal to a preset reference to a specific color;
calculating an accuracy of the acquired image; and
determining the maximum allowable angle between two adjacent cameras in the plurality of cameras based on the area converted to the specific color and the accuracy.
2 . The method of claim 1 , wherein the performing the preliminary test includes performing the preliminary test using a 3D computer-generated image head model having a rotation angle in a range of 5° to 60° and a 3D computer graphics program.
3 . The method of claim 1 , where the performing the preliminary test includes:
generating interpolated images while changing a rotation angle between frames of the two adjacent cameras in the plurality of cameras; and
generating acquired images for each rotation angle using the interpolated images.
4 . The method of claim 1 , wherein the maximum allowable angle is 20°.
5 . The method of claim 1 , wherein in the acquiring the plurality of images, the plurality of cameras are separated at the maximum allowable angle in a range of a specific arc angle to be arranged in a horizontal direction or to be arranged in a vertical direction.
6 . The method of claim 5 , wherein the interpolating the plurality of images includes:
acquiring images from the plurality of cameras arranged in the horizontal direction;
interpolating the acquired images to generate horizontally interpolated images between the images; and
recording a half-parallax digital holographic portrait photograph using the horizontally interpolated images.
7 . The method of claim 6 , wherein the interpolating the plurality of images includes:
acquiring images from the plurality of cameras arranged in the vertical direction;
interpolating the acquired images to generate vertically interpolated images between the images; and
recording a full-parallax digital holographic portrait photograph using the vertically interpolated images and the horizontally interpolated images.
8 . An apparatus for recording a digital holographic portrait photograph, the apparatus comprising:
a camera array including a plurality of cameras arranged at a variable rotation angle;
at least one processor electrically connected to the camera array; and
a memory storing instructions executable by the at least one processor,
wherein the at least one processor, when executing the instructions, is configured to:
perform a preliminary test using the camera array including a plurality of cameras arranged at a specific rotation angle;
compare pixel colors between an acquired image and an actual image generated through the preliminary test;
convert a color of an area in which a difference in pixel colors in the acquired image and the actual image is greater than or equal to a preset reference to a specific color;
calculate an accuracy of the acquired image;
determining the maximum allowable angle between two adjacent cameras in the plurality of cameras based on the area converted to the specific color and the accuracy;
acquire a plurality of images using the camera array including a plurality of cameras arranged at the maximum allowable angle; and
interpolate the plurality of images to record a holographic portrait photograph.
9 . A computer program recorded in a non-transitory computer readable medium, which performs the method of claim 1 when instructions of the computer program are executed by a processor.