METHOD AND APPARATUS FOR BUILDING AN ESTIMATE OF AN ORIGINAL IMAGE FROM A LOW-QUALITY VERSION OF THE ORIGINAL IMAGE AND AN EPITOME
The present invention concerns a method and apparatus for building an estimate (Ŷ) of an original image (Y) from a low-quality version (Y l ) of the original image and an epitome (E h ) calculated from an image. The method is characterized in that it comprises: —obtaining ( 11 ) a dictionary comprising at least one pair of patches, each pair of patches comprising a patch of the epitome, called a first patch, and a patch of the low-quality version of the original image, called a second patch, a pair of patches being extracted for each patch of the epitome by inplace matching patches from the epitome and those from the low-quality image, —for each patch of the low-quality version of the original image, selecting ( 12 ) at least one pair of patches within the dictionary of pairs of patches, each pair of patches being selected according to a criterion involving the patch of the low-quality version of the original image and the second patch of said selected pair of patches, —obtaining (13) a mapping function from said at least one selected pair of patches, and —projecting ( 14 ) the patch of the low-quality version of the original image into a fmal patch ({tilde over (X)} h ) using the mapping function.
1 . Method for building an estimate (Ŷ) of an original image (Y) from a low-quality version (Y l ) of the original image and an epitome (E h ) calculated from an image, comprising:
obtaining a dictionary comprising at least one pair of patches, each pair of patches comprising a patch of the epitome, called a first patch, and a patch of the low-quality version of the original image, called a second patch, a pair of patches being extracted for each patch of the epitome by in-place matching patches from the epitome and those from the low-quality image,
for each patch of the low-quality version of the original image, selecting at least one pair of patches within the dictionary of pairs of patches, each pair of patches being selected according to a criterion involving the patch of the low-quality version of the original image and the second patch of said selected pair of patches,
obtaining a mapping function from said at least one selected pair of patches, and
projecting the patch of the low-quality version of the original image into a final patch ({tilde over (X)} h ) using the mapping function.
2 . Method according to the claim 1 , wherein when the final patches overlap one over each other in one pixel, the method further comprises a step for averaging the final patches in one pixel to give the pixel value of the estimate of the original image.
3 . Method according to the claim 1 , wherein said at least one selected pair of patches is a nearest neighbor of the patch of the low-quality version of the original image.
4 . Method according to claim 1 , wherein the mapping function is obtained by learning from said at least one selected pair of patches.
5 . Method according to the claim 4 , wherein, learning the mapping function is defined by minimizing a least squares error between the first patches and the second patches of said at least one selected pair of patches.
6 . Method according to claim 1 , wherein the low-quality version of the original image is an image which has the resolution of the original image.
7 . Method according to the claim 6 , wherein the low-quality version of the original image is obtained as follows:
generating a low-resolution version of the original image,
encoding the low-resolution version of the image,
decoding the low-resolution version of the image, and
interpolating the decoded low-resolution version of the image in order to get a low-quality version of the original image with a resolution identical to the resolution of the original image.
8 . Method according to claim 1 , wherein the epitome is obtained from the original image.
9 . Method according to claim 1 , wherein the epitome is obtained from a low-resolution version of the original image.
10 . The method according to claim 1 , wherein the estimate (Ŷ) of an original image (Y) is iteratively back-projected in a low-resolution image space, and the back-projected version ( ) of the estimate (Ŷ) at iteration t is compared with a low-resolution version (Y d ) of the original image.
11 . The method according to claim 1 , wherein the low-quality version of the original image used to obtain the dictionary and the mapping function is iteratively updated by back-projecting a current estimate of the original image (Y) in a low-resolution image space, and by adding to the current estimate an error calculated between the back-projected version of the current estimate at iteration t with a low-resolution version (Y d ) of the original image.
12 . Apparatus for building an estimate (Ŷ) of an original image (Y) from a low-quality version (11 of the original image and an epitome (E h ) calculated from an image, comprising at least one processor configured for:
obtaining a dictionary comprising at least one pair of patches, each pair of patches comprising a patch of the epitome, called a first patch, and a patch of the low-quality version of the original image, called a second patch, a pair of patches being extracted for each patch of the epitome by in-place matching patches from the epitome and those from the low-quality image,
for each patch of the low-quality version of the original image, selecting at least one pair of patches within the dictionary of pairs of patches, each pair of patches being selected according to a criterion involving the patch of the low-quality version of the original image and the second patch of said selected pair of patches,
obtaining a mapping function from said at least one selected pair of patches, and
projecting the patch of the low-quality version of the original image into a final patch ({tilde over (X)} h ) using the mapping function.