Method and apparatus for processing image, device and computer readable storage medium

1. A method for processing an image, the method comprising:

performing an image processing operation on an initial image having a noise of a mosaic pattern associated with an adversarial sample attack, to obtain an intermediate image, the image processing operation including: first reducing the resolution of the initial image to obtain an image with reduced resolution, and then performing a smoothing on the image with reduced resolution;

determining an image enhancement model matching the image processing operation, wherein the image enhancement model is obtained by training using a reference image as an input until a difference between a resolution or definition of an output of the image enhancement model and a resolution or definition of a sample image is smaller than a threshold, wherein the reference image is obtained by performing the image processing operation on the sample image, and the sample image is a noisy image comprising an object blocked by a mosaic; and

generating a target image by processing the intermediate image using the image enhancement model, the target image having an image quality higher than the intermediate image,

wherein the smoothing the image with reduced resolution includes:

processing the image with reduced resolution using a Gaussian filter, a size of a filtered window of the Gaussian filter being set to a range from 3 to 13.

2. The method according to claim 1 , wherein the generating a target image comprises:

performing a lossy compression on the intermediate image; and

applying the compressed intermediate image to the image enhancement model, to generate the target image.

3. The method according to claim 1 , wherein the method further comprises: acquiring the initial image, the initial image being associated with a surrounding environment of a vehicle; and

providing the target image to the vehicle.

4. The method according to claim 1 , wherein the image enhancement model is a super-resolution generative adversarial network.

5. An apparatus for processing an image, the apparatus comprising:

at least one processor; and

a memory storing instructions, wherein the instructions when executed by the at least one processor, cause the at least one processor to perform operations, the operations comprising:

performing an image processing operation on an initial image having a noise of a mosaic pattern associated with an adversarial sample attack, to obtain an intermediate image, the image processing operation including: first reducing the resolution of the initial image to obtain an image with reduced resolution, and then performing a smoothing on the image with reduced resolution;

determining an image enhancement model matching the image processing operation, wherein the image enhancement model is obtained by training using a reference image as an input until a difference between a resolution or definition of an output of the image enhancement model and a resolution or definition of a sample image is smaller than a threshold, wherein the reference image is obtained performing the image processing operation on the sample image, and the sample image is a noisy image comprising an object blocked by a mosaic; and

generating a target image by processing the intermediate image using the image enhancement model, the target image having an image quality higher than the intermediate image,

wherein the smoothing the image with reduced resolution includes:

processing the image with reduced resolution using a Gaussian filter, a size of a filtered window of the Gaussian filter being set to a range from 3 to 13.

6. The apparatus according to claim 5 , wherein the generating a target image comprises:

performing a lossy compression on the intermediate image; and

applying the compressed intermediate image to the image enhancement model, to generate the target image.

7. The apparatus according to claim 5 , wherein the operations further comprise:

acquiring the initial image, the initial image being associated with a surrounding environment of a vehicle; and

providing the target image to the vehicle.

8. The apparatus according to claim 5 , wherein the image enhancement model is a super-resolution generative adversarial network.

9. A non-transitory computer readable storage medium, storing a computer program, wherein the program, when executed by a processor, causes the processor to perform operations, the operations comprising:

performing an image processing operation on an initial image having a noise of a mosaic pattern associated with an adversarial sample attack, to obtain an intermediate image, the image processing operation including: first reducing the resolution of the initial image to obtain an image with reduced resolution, and then performing a smoothing on the image with reduced resolution;

determining an image enhancement model matching the image processing operation, wherein the image enhancement model is obtained by training using a reference image as an input until a difference between a resolution or definition of an output of the image enhancement model and a resolution or definition of a sample image is smaller than a threshold, wherein the reference image is obtained by performing the image processing operation on the sample image, and the sample image is a noisy image comprising an object blocked by a mosaic; and

generating a target image by processing the intermediate image using the image enhancement model, the target image having an image quality higher than the intermediate image,

wherein the smoothing the image with reduced resolution includes:

processing the image with reduced resolution using a Gaussian filter, a size of a filtered window of the Gaussian filter being set to a range from 3 to 13.

10. The method according to claim 1 , wherein the noisy image comprising the object blocked by the mosaic is an image comprising a traffic sign blocked by the mosaic.