Method, apparatus, system and computer-readable recording medium for feature information
There are provided an apparatus, method, system, and recording medium for performing selective encoding/decoding on feature information. An encoding apparatus generates residual feature information. The encoding apparatus transmits the residual feature information to a decoding apparatus through a residual feature map bitstream. The residual feature information is the difference between feature information extracted from an original image and feature information extracted from a reconstructed image. Feature information of the reconstructed image is generated using the reconstructed image. Reconstructed feature information is generated using the feature information of the reconstructed image and reconstructed residual feature information.
1. An encoding method comprising:
extracting first feature information from a reconstructed image;
extracting second feature information from an original image; and
generating residual feature information using the first feature information and the second feature information, wherein
the first feature information and the second feature information are extracted using feedback information from a decoding apparatus, and
the feedback information is used to determine a specific part of the original image to be encoded.
2. An encoding method comprising:
extracting first feature information from a reconstructed image;
extracting second feature information from an original image; and
generating residual feature information using the first feature information and the second feature information, wherein
a preprocessed image is generated by performing first preprocessing on the original image,
the first feature information is extracted from the preprocessed image,
the first preprocessing comprises at least one of a resolution subsampling, a temporal subsampling and a spatial subsampling.
3. The encoding method of claim 2 , further comprising:
generating preprocessed residual feature information by performing second preprocessing on the residual feature information, wherein
the second preprocessing includes one or more of sub-sampling, domain transformation, and domain rearrangement.
4. A non-transitory computer-readable recording medium in which a program for performing the encoding method of claim 2 is recorded.
5. A decoding method, comprising:
generating reconstructed residual feature information by performing decoding on information of a residual feature information bitstream; and
generating reconstructed feature information using feature information of a reconstructed image and the reconstructed residual feature information, wherein
postprocessed reconstructed residual feature information is generated by performing postprocessing on the reconstructed residual feature information, and
the reconstructed feature information is generated using the feature information of the reconstructed image and the postprocessed reconstructed residual feature information;
the postprocessing includes one or more of inverse rearrangement, and inverse domain transformation.
6. The decoding method of claim 5 , further comprising:
generating the reconstructed image using an image bitstream; and
generating the feature information of the reconstructed image from the reconstructed image.
7. The decoding method of claim 6 , further comprising:
generating a postprocessed reconstructed image by performing postprocessing on the reconstructed image.
8. The decoding method of claim 7 , wherein the postprocessing includes one or more of inverse transformation of a color format and up-sampling.
9. The decoding method of claim 5 , wherein the feature information of the reconstructed image is a result from an intermediate layer of a neural network, among multiple layers of the neural network.
10. The decoding method of claim 5 , wherein the postprocessing includes up-sampling, and
the up-sampling is performed using a sampling phase and a sampling rate.
11. The decoding method of claim 5 , wherein the postprocessing includes up-sampling, and
the up-sampling is fixed sampling or non-fixed sampling.
12. A non-transitory computer-readable recording medium in which a program for performing the decoding method of claim 5 is recorded.