IP Library › Granted Patent US 11,854,205
Granted Patent B2
US 11,854,205 · App. 17/229,707 · Granted Dec 26, 2023

Medical image segmentation method and apparatus, computer device, and storage medium

Inventors: Shilei Cao (Shenzhen, CN); Kai Ma (Shenzhen, CN); Yefeng Zheng (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06T7/11G06N3/045G06N3/08G16H30/40G06T2207/20081G06T2207/20084G06T2207/30004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,854,205
App. No.
17/229,707
Granted
Dec 26, 2023
Kind
B2
Abstract

This application relates to a medical image segmentation method, a computer device, and a storage medium. The method includes: obtaining medical image data; obtaining a target object and weakly supervised annotation information of the target object in the medical image data; determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information; and performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object. Because the medical image data is segmented based on the weakly supervised annotation information, there is no need to annotate information by using much labor during training of the preset mapping model, thereby saving labor costs. The preset mapping model is a model used for mapping the medical image data based on the pseudo segmentation mask.

Claims (62)

1. A medical image segmentation method, applicable to a computer device, the method comprising:

obtaining medical image data;

obtaining a target object and weakly supervised annotation information of the target object in the medical image data;

determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information; and

performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object, further comprising:

performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object; and

fusing the at least two intermediate segmentation results, to obtain the target segmentation result for the target object.

2. The method according to claim 1 , wherein the performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object comprises:

performing mapping on the medical image data based on the pseudo segmentation mask and by using at least two neural network models with no less than two structural types, to obtain the at least two intermediate segmentation results for the target object.

3. The method according to claim 1 , wherein in a training process of the at least two preset mapping models, the at least two preset mapping models are trained in a self-paced learning manner.

4. The method according to claim 3 , wherein the training process of the at least two preset mapping models comprises:

training at least two intermediate preset mapping models based on the pseudo segmentation mask in the training process;

performing mapping on the medical image data in the training process by using the at least two intermediate preset mapping models, to obtain at least two predicted training segmentation results;

generating an advanced pseudo segmentation mask according to the predicted training segmentation results in the at least two predicted training segmentation results that meet a confidence condition in combination with a priori knowledge; and

retraining the at least two intermediate preset mapping models based on the advanced pseudo segmentation mask until a preset stop condition is met, to obtain the preset mapping models.

5. The method according to claim 1 , wherein the performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object comprises:

mapping the medical image data by using the preset mapping model obtained based on the pseudo segmentation mask, to obtain the target segmentation result for the target object.

6. The method according to claim 1 , wherein the performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object comprises:

performing mapping on the medical image data based on the pseudo segmentation mask to obtain a predicted segmentation result for the target object; and

correcting the predicted segmentation result according to the a priori knowledge and/or the weakly supervised annotation information, to obtain the target segmentation result of the target object.

7. The method according to claim 1 , wherein the determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information comprises:

determining the pseudo segmentation mask for the target object in the medical image data based on the a priori knowledge and the weakly supervised annotation information.

8. The method according to claim 1 , wherein the weakly supervised annotation information comprises bounding box information, apostrophe annotation information, or point annotation information.

9. The method according to claim 1 , wherein the method is implemented by using a neural network model based on medical image segmentation.

10. The method according to claim 9 , wherein a training process of the neural network model based on medical image segmentation comprises:

obtaining a target training object, and obtaining training samples based on the target training object, the training samples comprising medical image training data and weakly supervised annotation training information;

determining a pseudo segmentation training mask for the target training object in the medical image training data based on the a priori knowledge and the weakly supervised annotation information; and

obtaining the neural network models through training based on the pseudo segmentation training mask and the medical image training data.

11. The method according to claim 10 , wherein the obtaining the neural network models through training based on the pseudo segmentation training mask and the medical image training data comprises:

obtaining a preset mapping model of the neural network model through training based on the pseudo segmentation training mask;

inputting the medical image training data to the preset mapping models, to obtain predicted training segmentation results;

generating an advanced pseudo segmentation training mask according to the predicted training segmentation results that meet a confidence condition in combination with a priori knowledge; and

retraining the preset mapping model according to the advanced pseudo segmentation training mask, until a preset stop condition is met.

12. A computer device, comprising a memory and a processor, the memory storing a plurality of computer programs that, when executed by the processor, cause the computer device to perform a plurality of operations including:

obtaining medical image data;

obtaining a target object and weakly supervised annotation information of the target object in the medical image data;

determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information; and

performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object, further comprising:

performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object; and

fusing the at least two intermediate segmentation results, to obtain the target segmentation result for the target object.

13. The computer device according to claim 12 , wherein the performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object comprises:

performing mapping on the medical image data based on the pseudo segmentation mask and by using at least two neural network models with no less than two structural types, to obtain the at least two intermediate segmentation results for the target object.

14. The computer device according to claim 12 , wherein the performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object comprises:

mapping the medical image data by using the preset mapping model obtained based on the pseudo segmentation mask, to obtain the target segmentation result for the target object.

15. The computer device according to claim 12 , wherein the performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object comprises:

performing mapping on the medical image data based on the pseudo segmentation mask to obtain a predicted segmentation result for the target object; and

correcting the predicted segmentation result according to the a priori knowledge and/or the weakly supervised annotation information, to obtain the target segmentation result of the target object.

16. The computer device according to claim 12 , wherein the determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information comprises:

determining the pseudo segmentation mask for the target object in the medical image data based on the a priori knowledge and the weakly supervised annotation information.

17. The computer device according to claim 12 , wherein the weakly supervised annotation information comprises bounding box information, apostrophe annotation information, or point annotation information.

18. A non-transitory computer-readable storage medium, storing a plurality of computer programs that, when executed by a processor of a computer device, cause the computer device to perform a plurality of operations including:

obtaining medical image data;

obtaining a target object and weakly supervised annotation information of the target object in the medical image data;

determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information; and

performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object;

performing mapping on the medical image data by using a preset mapping model based on the pseudo segmentation mask, to obtain a target segmentation result for the target object, further comprising:

performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object; and

fusing the at least two intermediate segmentation results, to obtain the target segmentation result for the target object.

19. The non-transitory computer-readable storage medium according to claim 18 , wherein the performing mapping on the medical image data based on the pseudo segmentation mask by using at least two preset mapping models, to obtain at least two intermediate segmentation results for the target object comprises:

performing mapping on the medical image data based on the pseudo segmentation mask and by using at least two neural network models with no less than two structural types, to obtain the at least two intermediate segmentation results for the target object.

20. The non-transitory computer-readable storage medium according to claim 18 , wherein the determining a pseudo segmentation mask for the target object in the medical image data according to the weakly supervised annotation information comprises:

determining the pseudo segmentation mask for the target object in the medical image data based on the a priori knowledge and the weakly supervised annotation information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 9, 2021
From: CAO, SHILEI; MA, KAI; ZHENG, YEFENG
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 057124/0088 →
Priority Claims (1)
CN 201910126219.9 · Feb 20, 2019 · national
Continuity (2)
Continuation PCTCN2020074631 · Feb 10, 2020
Related Publication 20210233247A1 · Jul 29, 2021
Cited By (2)
US 12,354,608 US 12,711,960