Method for encoding and reconstructing depth image using color image information

1. A computer-implemented method for encoding a depth image using color image information, the method comprising:

segmenting a color image and a depth image corresponding to the color image into block units;

selecting a position of a pixel sampling value from each block of the depth image using the color image information; and

encoding the pixel sampling value of the selected position as depth information, wherein

the encoding the pixel sampling value further comprises,

downsampling the depth image into units having a height of n pixels and a width of n pixels and encoding the pixel sampling value of the downsampled depth image as the depth information, wherein

the selecting of the position of the pixel sampling value from each block of the depth image using the color image information comprises converting colors of blocks of the color image corresponding to blocks of the depth image to frequencies, and

selecting a position of a pixel having a pixel value for a position of a pixel sampling value of each block, the pixel sampling value being determined based on absolute values of differences of the blocks and DC coefficients of the blocks of the frequency-converted color image are the minimum.

2. The method of claim 1 , wherein the segmenting of the color image and the depth image corresponding to the color image into block units comprises segmenting the color image and the depth image into block units having a height of n pixels and a width of n pixels, where n is a multiple of 2.

3. A computer-implemented method for reconstructing a depth image using color image information, the method comprising:

segmenting a color image and a depth image corresponding to the color image into block units;

selecting a position of a pixel sampling value from each block of the depth image using the color image information;

encoding the pixel sampling value of the selected position as depth information, wherein

the encoding the pixel sampling value further comprises,

downsampling the depth image into units having a height of n pixels and a width of n pixels and encoding the pixel sampling value of the downsampled depth image as the depth information;

decoding the encoded pixel sampling value of the selected position as depth information and reconstructing a pixel sampling value for each block as the depth information;

selecting a position of the reconstructed pixel sampling value from each block of the depth image using the color image information; and

reconstructing the depth image using the position of the reconstructed pixel sampling value for each block, wherein

the selecting of the position of the reconstructed pixel sampling value from each block of the depth image using the color image information comprises converting colors of blocks of the color image corresponding to blocks of the depth image to frequencies, and

selecting a position of a pixel having a pixel value for a position of a reconstructed pixel sampling value of each block, the pixel sampling value being determined based on absolute values of differences of the frequency-converted blocks and DC coefficients of the frequency-converted blocks of the color image are the minimum.

4. The method of claim 3 , wherein the reconstructing of the depth image using the position of the reconstructed pixel sampling value for each block comprises generating a mesh in the depth image using the position of the reconstructed pixel sampling value as a node and determining a depth value of the inside of the mesh using the color image information.

5. A device for encoding a depth image using color image information, the device comprising:

one or more computer-executable units being configured and executed by a processor using algorithms associated with at least one non-transitory storage device, the algorithms, when executed, causing the processor to execute one or more computer-executable units, the computer-executable units comprising,

a block dividing unit configured to segment a color image and the depth image corresponding to the color image into block units;

a pixel sampling position selecting unit configured to select a position of a pixel sampling value from each block of the depth image using the color image information; and

an encoding unit configured to encode the pixel sampling value of the selected position as depth information, wherein the encoding unit is further configured to

downsample the depth image into units having a height of n pixels and a width of n pixels and encode the pixel sampling value of the downsampled depth image as the depth information,

wherein the pixel sampling position selecting unit converts frequencies of blocks of the color image corresponding to blocks of the depth image and selects a position of a pixel having a pixel value for a position of the reconstructed pixel sampling value of each block, the reconstructed pixel sampling value being determined based on absolute values of differences of the frequency-converted blocks and DC coefficients of the frequency-converted blocks of the color image are the minimum.

6. The device of claim 5 , wherein the block dividing unit segments the color image and the depth image into block units having a height of n pixels and a width of n pixels, where n is a multiple of 2.

7. A device for reconstructing a depth image using color image information, the device comprising:

one or more computer-executable units being configured and executed by a processor using algorithms associated with at least one non-transitory storage device, the algorithms, when executed, causing the processor to execute one or more computer-executable units, the computer-executable units comprising,

a block dividing unit configured to segment a color image and the depth image corresponding to the color image into block units;

a pixel sampling position selecting unit configured to select a position of a pixel sampling value from each block of the depth image using the color image information;

an encoding unit configured to encode the pixel sampling value of the selected position as depth information, wherein the encoding unit is further configured to

downsample the depth image into units having a height of n pixels and a width of n pixels and encode the pixel sampling value of the downsampled depth image as the depth information;

a decoding unit configured to reconstruct a pixel sampling value for each block as depth information;

a pixel sampling position selecting unit configured to select a position of the reconstructed pixel sampling value from each block of the depth image using the color image information; and

a depth image reconstructing unit configured to reconstruct the depth image using, the position of the reconstructed pixel sampling value for each block, wherein

the pixel sampling position selecting unit is further configured to convert frequencies of blocks of the color image corresponding to blocks of the depth image and to select a position of a pixel having a pixel value for a position of the reconstructed pixel sampling value of each block, the reconstructed pixel sampling value being determined based on absolute values of differences of the frequency-converted blocks and DC coefficients of the frequency-converted blocks of the color image are the minimum.

8. The device of claim 7 , wherein the depth image reconstructing unit is further configured to generate a mesh in the depth image using the position of the reconstructed pixel sampling value as a node and to determine a depth value of the inside of the mesh using the color image information.