IP Library › Granted Patent US 12,056,847
Granted Patent B2
US 12,056,847 · App. 17/366,484 · Granted Aug 6, 2024

Image processing method, means, electronic device and storage medium

Inventors: Xianhui Lin (Shenzhen, CN); Xiaoming Li (Shenzhen, CN); Chaofeng Chen (Shenzhen, CN); Xuansong Xie (Beijing, CN); Peiran Ren (Hangzhou, CN)
Assignee: Alibaba Group Holding Limited
G06T5/50G06N5/022G06T5/73G06T7/11G06T7/13G06T7/33G06T2207/20036G06T2207/20081G06T2207/20221G06T2207/30004G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,056,847
App. No.
17/366,484
Granted
Aug 6, 2024
Kind
B2
Abstract

The present application discloses a method, device, and system for processing a medical image. The method includes obtaining a first image corresponding to a to-be-processed image, obtaining a second image corresponding to the to-be-processed image, wherein the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image, and an image quality of the first image and an image quality of the second image are different. The method further includes obtaining image structural information corresponding to the to-be-processed image, and performing an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein a target image is obtained based at least in part on the image fusion processing, and the target image corresponds to the to-be-processed image.

Claims (129)

1. A method, comprising:

obtaining, by one or more processors, a first image corresponding to a to-be-processed image and a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image;

an image quality of the first image and an image quality of the second image are different; and

obtaining the first image and the second image comprises:

obtaining the to-be-processed image;

determining the image quality of the first image;

determining the image quality of the second image;

performing a first image degradation processing with respect to to-be-processed image based at least in part on the image quality of the first image to obtain the first image; and

performing a second image degradation processing with respect to the to-be-processed image based at least in part on the image quality of the second image to obtain the second image;

obtaining, by the one or more processors, image structural information corresponding to the to-be-processed image; and

performing, by the one or more processors, an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing, and

the target image corresponds to the to-be-processed image.

2. The method of claim 1 , wherein the obtaining image structural information corresponding to the to-be-processed image comprises:

partitioning the to-be-processed image into multiple target image regions; and

obtaining image structural information corresponding to the multiple target image regions.

3. The method of claim 2 , wherein the performing the image fusion processing with respect to the first image and the second image to image fusion processing based at least in part on the image structural information corresponding to said to-be-processed image comprises:

obtaining one or more target weights for characterizing the image structural information corresponding to the multiple target image regions; and

using the target weights in connection with performing the image fusion processing with respect to the first image and the second image to image; and

obtaining a target image corresponding to the to-be-processed image, the target image being obtained based at least in part on a result of the image fusion processing.

4. The method of claim 3 , wherein the obtaining the one or more target weights for characterizing the image structural information corresponding to the multiple target image regions comprises:

using image edge feature information corresponding to a plurality of target image regions and image definition feature information corresponding to the plurality of target image regions as a basis to obtain region weights for characterizing image structural information corresponding to the plurality of target image regions; and

obtaining the one or more target weights based at least in part on the region weights.

5. The method of claim 4 , wherein the region weights for characterizing image structural information is obtained for each target image region of the multiple target image regions.

6. The method of claim 4 , wherein to obtain region weights for characterizing image structural information corresponding to the plurality of target image regions comprises:

obtaining region edge feature values for characterizing image edge feature information corresponding to each target image region of the multiple target image regions;

obtaining region definition feature values for characterizing image definition feature information corresponding to each target image region of the multiple target image regions; and

determining the region weights based at least in part on the region edge feature values and the region definition feature values.

7. The method of claim 6 , wherein the obtaining the target weights based at least in part on the region weights comprises:

determining an image edge feature value image corresponding to said multiple target image regions based at least in part on one or more of the region edge feature values and the region definition feature values;

obtaining an image definition feature value image corresponding to the multiple target image regions based at least in part on one or more of the region edge feature values and the region definition feature values; and

determining the target weights based at least in part on the image edge feature value image and the image definition feature value image.

8. The method of claim 7 , wherein the determining the target weights based at least in part on the image edge feature value image and the image definition feature value image comprises:

determining an initial image structural weight image for characterizing image structural information corresponding to the multiple target image regions based at least in part on the image edge feature value image and the image definition feature value image;

performing Gaussian blur processing and image morphological processing on the initial image structural weight image and obtaining a second image structural weight image for characterizing image structural information corresponding to the multiple target image regions; and

performing a normalization processing on weights in the second image structural weight image, obtaining a target structural weight image for characterizing image structural information corresponding to the multiple target image regions, and deeming the weights in the target structural weight image as the target weights.

9. The method of claim 2 , wherein the obtaining image structural information corresponding to the multiple target image regions comprises:

performing an edge detection and a blur detection on the to-be-processed image;

obtaining image edge feature information corresponding to the multiple target image regions, the image edge feature information being obtained based at least in part on one or more of the edge detection and the blur detection;

obtaining image definition feature information corresponding to the multiple target image regions, the image definition feature information being obtained based at least in part on one or more of the edge detection and the blur detection; and

obtaining image structural information corresponding to the multiple target image regions, the image structural information being obtained based at least in part on the image edge feature information corresponding to the multiple target image regions and the image definition feature information corresponding to the multiple target image regions.

10. The method of claim 2 , wherein the performing the image fusion processing with respect to the first image and the second image to image fusion processing based at least in part on the image structural information corresponding to said to-be-processed image comprises:

using the multiple target image regions as a basis to partition the first image into multiple first image regions corresponding to the multiple target image regions and to partition the second image into multiple second image regions corresponding to the multiple target image regions;

obtaining one or more target weights for characterizing the image structural information corresponding to the multiple target image regions;

using the target weights in connection with performing the weighted average processing with respect to the image structural information corresponding to the multiple first image regions and image structural information corresponding to the multiple second image regions; and

obtaining a target image corresponding to the to-be-processed image, the target image being obtained based at least in part on a result of the weighted average processing.

11. The method of claim 1 , wherein the performing the image degradation processing with respect to the to-be-processed image based at least in part on the image quality of the first image to obtain the first image comprises: adding interference information to the to-be-processed image based at least in part on the image quality of the first image to obtain the first image.

12. The method of claim 1 , wherein the performing the image degradation processing with respect to the to-be-processed image based at least in part on the image quality of the first image to obtain the first image comprises: removing effective information from the to-be-processed image based at least in part on a degree of degradation of the first image to obtain the first image.

13. The method of claim 1 , further comprising:

obtaining a sample to-be-processed image for training an image quality enhancement model, wherein the image quality enhancement model is a model used to perform image quality enhancement processing; and

using the sample to-be-processed image and the target image as input for the image quality enhancement model in connection with training the image quality enhancement model.

14. A device, comprising:

one or more processors; and

a memory, for storing a program for image processing methods, wherein in response to execution program, the one or more processors are caused to:

obtain a first image corresponding to a to-be-processed image and a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image;

an image quality of the first image and an image quality of the second image are different; and

obtaining the first image and the second image comprises:

obtaining the to-be-processed image;

determining the image quality of the first image;

determining the image quality of the second image;

performing a first image degradation processing with respect to to-be-processed image based at least in part on the image quality of the first image to obtain the first image; and

performing a second image degradation processing with respect to the to-be-processed image based at least in part on the image quality of the second image to obtain the second image;

obtain image structural information corresponding to the to-be-processed image; and

perform an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing, and

the target image corresponds to the to-be-processed image.

15. A computer program product, the computer program product being embodied in a non-transitory computer readable storage medium and comprising computer instructions for:

obtaining, by one or more processors, a first image corresponding to a to-be-processed image and a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image;

an image quality of the first image and an image quality of the second image are different; and

obtaining the first image and the second image comprises:

obtaining the to-be-processed image;

determining the image quality of the first image;

determining the image quality of the second image;

performing a first image degradation processing with respect to to-be-processed image based at least in part on the image quality of the first image to obtain the first image; and

performing a second image degradation processing with respect to the to-be-processed image based at least in part on the image quality of the second image to obtain the second image;

obtaining, by the one or more processors, image structural information corresponding to the to-be-processed image; and

performing, by the one or more processors, an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing, and

the target image corresponds to the to-be-processed image.

16. A method, comprising:

obtaining, by one or more processors, a first image corresponding to a to-be-processed image;

obtaining a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image, and

an image quality of the first image and an image quality of the second image are different;

obtaining, by the one or more processors, image structural information corresponding to the to-be-processed image, wherein the obtaining image structural information corresponding to the to-be-processed image comprises:

partitioning the to-be-processed image into multiple target image regions; and

obtaining image structural information corresponding to the multiple target image regions; and

performing, by the one or more processors, an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing;

the target image corresponds to the to-be-processed image;

the performing the image fusion processing with respect to the first image and the second image to image fusion processing based at least in part on the image structural information corresponding to said to-be-processed image comprises:

obtaining one or more target weights for characterizing the image structural information corresponding to the multiple target image regions; and

using the target weights in connection with performing the image fusion processing with respect to the first image and the second image to image; and

obtaining a target image corresponding to the to-be-processed image, the target image being obtained based at least in part on a result of the image fusion processing

the obtaining the one or more target weights for characterizing the image structural information corresponding to the multiple target image regions comprises:

using image edge feature information corresponding to a plurality of target image regions and image definition feature information corresponding to the plurality of target image regions as a basis to obtain region weights for characterizing image structural information corresponding to the plurality of target image regions; and

obtaining the one or more target weights based at least in part on the region weights, the obtaining the one or more target weights based at least in part on the region weights comprising:

obtaining region edge feature values for characterizing image edge feature information corresponding to each target image region of the multiple target image regions;

obtaining region definition feature values for characterizing image definition feature information corresponding to each target image region of the multiple target image regions; and

determining the region weights based at least in part on the region edge feature values and the region definition feature values.

17. A method, comprising:

obtaining, by one or more processors, a first image corresponding to a to-be-processed image;

obtaining a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image, and

an image quality of the first image and an image quality of the second image are different;

obtaining, by the one or more processors, image structural information corresponding to the to-be-processed image, wherein the obtaining image structural information corresponding to the to-be-processed image comprises:

partitioning the to-be-processed image into multiple target image regions; and

performing an edge detection and a blur detection on the to-be-processed image;

obtaining image edge feature information corresponding to the multiple target image regions, the image edge feature information being obtained based at least in part on one or more of the edge detection and the blur detection;

obtaining image definition feature information corresponding to the multiple target image regions, the image definition feature information being obtained based at least in part on one or more of the edge detection and the blur detection; and

obtaining image structural information corresponding to the multiple target image regions, the image structural information being obtained based at least in part on the image edge feature information corresponding to the multiple target image regions and the image definition feature information corresponding to the multiple target image regions; and

performing, by the one or more processors, an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing, and

the target image corresponds to the to-be-processed image.

18. A method, comprising:

obtaining a sample to-be-processed image for training an image quality enhancement model, wherein the image quality enhancement model is a model used to perform image quality enhancement processing;

using the sample to-be-processed image and the target image as input for the image quality enhancement model in connection with training the image quality enhancement model;

using the image quality enhancement model to process a to-be-processed image, comprising:

obtaining, by one or more processors, a first image corresponding to the to-be-processed image;

obtaining a second image corresponding to the to-be-processed image, wherein:

the first image and the second image are obtained in response to an image degradation processing being performed with respect to the to-be-processed image, and

an image quality of the first image and an image quality of the second image are different;

obtaining, by the one or more processors, image structural information corresponding to the to-be-processed image; and

performing, by the one or more processors, an image fusion processing with respect to the first image and the second image to image fusion based at least in part on the image structural information corresponding to the to-be-processed image, wherein:

a target image is obtained based at least in part on the image fusion processing, and

the target image corresponds to the to-be-processed image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2021
From: LIN, XIANHUI; LI, XIAOMING; CHEN, CHAOFENG; XIE, XUANSONG; REN, PEIRAN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 057770/0308 →
Priority Claims (1)
CN 202010639623.9 · Jul 6, 2020 · national
Continuity (1)
Related Publication 20220020130A1 · Jan 20, 2022
Cited By (1)
US 12,524,848