IP Library Granted Patent US 11,769,249
Granted Patent B2
US 11,769,249 · App. 16/994,733 · Granted Sep 26, 2023

Systems and methods for image processing

Inventors: Xiaolin Meng (Shanghai, CN); Xin Weng (Shanghai, CN); Libo Zhang (Shanghai, CN); Qi Duan (Shanghai, CN); Shuai Wang (Shanghai, CN)
Assignee: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
G06T7/0012G06T3/00G06T3/0037G06T7/11G06T7/187G06T2207/10072G06T2207/30028G06T2207/30172
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,769,249
App. No.
16/994,733
Granted
Sep 26, 2023
Kind
B2
Abstract

An image processing method is provided, including: obtaining image data of a cavity wall of an organ; unfolding the cavity wall; and generating an image of the unfolded cavity wall. The unfolding of the cavity wall may include: obtaining a mask and a centerline of the organ; obtaining a connected region of the mask; dividing the connected region into at least one equidistant block; determining an orientation of the equidistant block in a three-dimensional coordinate system including a first direction, a second direction and a third direction; determining an initial normal vector and an initial tangent vector of a center point of the centerline; assigning a projection of the initial normal vector to a normal vector of a light direction of the center point; assigning the third direction or an reverse direction of the third direction to a tangent vector of the light direction of the center point.

Claims (80)

1. An image processing method implemented on at least one machine each of which has at least one processor and at least one storage device, the method comprising:

obtaining an image relating to volume data of a plurality of tissues, wherein tissue labels of the plurality of tissues are organized in a tissue set;

selecting a sample point based on the volume data;

obtaining one or more neighboring points of the sample point, wherein one or more neighboring labels corresponding to the one or more neighboring points respectively are organized in a neighboring point set;

determining whether the one or more neighboring labels belong to the tissue set;

determining a color of the sample point based on the determination result, wherein the determining a color of the sample point based on the determination result comprises:

in response to determining that a target neighboring label of the one or more neighboring labels does not belong to the tissue set, obtaining a first color list based on the target neighboring label, the first color list including preset color attributes corresponding to image values respectively; and

determining the color of the sample point based on an image value of the sample point and the first color list; and

obtaining a volume rendering result of the plurality of tissues based on the color of the sample point.

2. The method of claim 1 , the determining whether the one or more neighboring labels belong to the tissue set comprising:

determining whether the target neighboring label is the same as one of the tissue labels in the tissue set;

in response to determining that the target neighboring label is the same as one of the tissue labels in the tissue set, determining that the target neighboring label belongs to the tissue set; and

in response to determining that the target neighboring label is different from any one of the tissue labels in the tissue set, determining that the target neighboring label does not belong to the tissue set.

3. The method of claim 1 , wherein the target neighboring label is a closest neighboring point of the sample point.

4. The method of claim 2 , the determining a color of the sample point based on the determination result further comprising:

in response to determining that the target neighboring point belongs to the tissue set, selecting a tissue label in the tissue set and normalizing image values of the plurality of neighboring points based on the selected tissue label;

obtaining an interpolation result of the sample point based on an interpolation of the normalized image values of the plurality of neighboring points; and

determining the color of the sampling point based on the interpolation result.

5. The method of claim 4 , the normalizing image values of the plurality of neighboring points based on the selected tissue label comprising:

traversing the neighboring labels in the neighboring point set;

for each of the traversed neighboring labels in the neighboring point set,

determining whether the neighboring label is identical to the selected tissue label;

in response to determining that the neighboring label is identical to the selected tissue label, designating a neighboring point corresponding to the neighboring label as belonging to a foreground region and setting an image value of the neighboring point as a first value; and

in response to determining that the neighboring label is not identical to the selected tissue label, designating the neighboring point corresponding to the neighboring label as belonging to a background region and setting the image value of the neighboring point as a second value.

6. The method of claim 5 , wherein the first value is 1 and the second value is 0.

7. The method of claim 4 , the determining the color of the sampling point based on the interpolation result comprising:

comparing the interpolation result of the sampling point with a threshold;

in response to determining that the interpolation result of the sampling point is greater than the threshold, obtaining a second color list based on the selected tissue label, the second color list including preset color attributes corresponding to image values respectively; and

determining the color of the sample point based on an image value of the sample point and the second color list.

8. The method of claim 7 , the determining the color of the sampling point based on the interpolation result further comprising:

in response to determining that the interpolation result of the sampling point is less than the threshold, selecting another tissue label from rest tissue labels in the rest tissue set and normalizing the image values of the plurality of neighboring points based on the updated selected tissue label;

obtaining an updated interpolation result of the sample point based on an interpolation of the updated normalized image values of the plurality of neighboring points;

comparing the updated interpolation result of the sampling point with a threshold; and

in response to determining that the updated interpolation result of the sampling point is less than the threshold, repeating operations of selecting another tissue label in rest tissue labels in the tissue set, normalizing the image values of the plurality of neighboring points based on the updated selected tissue label, and obtaining an updated interpolation result of the sample point based on an interpolation of the updated normalized image values of the plurality of neighboring points, until the updated interpolation result is larger than the threshold or otherwise all the tissue labels in the tissue set are traversed.

9. The method of claim 4 , wherein the interpolation includes at least one of a linear interpolation, a nonlinear interpolation, an interpolation based on a regularization function, or a diffusion interpolation based on a partial differential equation.

10. A system for image processing, comprising:

at least one storage device storing a set of instructions; and

at least one processor configured to communicate with the at least one storage device, wherein when executing the set of instructions, the at least one processor is directed to cause the system to:

obtain an image relating to volume data of a plurality of tissues, wherein tissue labels of the plurality of tissues are organized in a tissue set;

select a sample point based on the volume data;

obtain one or more neighboring points of the sample point, wherein one or more neighboring labels corresponding to the one or more neighboring points respectively are organized in a neighboring point set;

determine whether the one or more neighboring labels belong to the tissue set;

determine a color of the sample point based on the determination result, wherein to determine a color of the sample point based on the determination result, the at least one processor is directed to cause the system to:

in response to determining that a target neighboring label of the one or more neighboring labels does not belong to the tissue set, obtain a first color list based on the target neighboring label, the first color list including preset color attributes corresponding to image values respectively; and

determine the color of the sample point based on an image value of the sample point and the first color list; and

obtain a volume rendering result of the plurality of tissues based on the color of the sample point.

11. The system of claim 10 , wherein to determine whether the one or more neighboring labels belong to the tissue set, the at least one processor is directed to cause the system to:

determine whether the target neighboring label is the same as one of the tissue labels in the tissue set;

in response to determining that the target neighboring label is the same as one of the tissue labels in the tissue set, determine that the target neighboring label belongs to the tissue set; and

in response to determining that the target neighboring label is different from any one of the tissue labels in the tissue set, determine that the target neighboring label does not belong to the tissue set.

12. The method of claim 10 , wherein the target neighboring label is a closest neighboring point of the sample point.

13. The system of claim 11 , wherein to determine a color of the sample point based on the determination result, the at least one processor is further directed to cause the system to:

in response to determining that the target neighboring point belongs to the tissue set, select a tissue label in the tissue set and normalize image values of the plurality of neighboring points based on the selected tissue label;

obtain an interpolation result of the sample point based on an interpolation of the normalized image values of the plurality of neighboring points; and

determine the color of the sampling point based on the interpolation result.

14. The system of claim 13 , wherein to normalize image values of the plurality of neighboring points based on the selected tissue label, the at least one processor is directed to cause the system to:

travers the neighboring labels in the neighboring point set;

for each of the traversed neighboring labels in the neighboring point set,

determine whether the neighboring label is identical to the selected tissue label;

in response to determining that the neighboring label is identical to the selected tissue label, designating a neighboring point corresponding to the neighboring label as belonging to a foreground region and setting an image value of the neighboring point as a first value; and

in response to determining that the neighboring label is not identical to the selected tissue label, designate the neighboring point corresponding to the neighboring label as belonging to a background region and set the image value of the neighboring point as a second value.

15. The system of claim 14 , wherein the first value is 1 and the second value is 0.

16. The system of claim 13 , wherein to determine the color of the sampling point based on the interpolation result, the at least one processor is directed to cause the system to:

compare the interpolation result of the sampling point with a threshold;

in response to determining that the interpolation result of the sampling point is greater than the threshold, obtain a second color list based on the selected tissue label, the second color list including preset color attributes corresponding to image values respectively; and

determine the color of the sample point based on an image value of the sample point and the second color list.

17. The method of claim 16 , wherein to determine the color of the sampling point based on the interpolation result further comprising, the at least one processor is further directed to cause the system to:

in response to determining that the interpolation result of the sampling point is less than the threshold, select another tissue label from rest tissue labels in the rest tissue set and normalize the image values of the plurality of neighboring points based on the updated selected tissue label;

obtain an updated interpolation result of the sample point based on an interpolation of the updated normalized image values of the plurality of neighboring points;

compare the updated interpolation result of the sampling point with a threshold; and

in response to determine that the updated interpolation result of the sampling point is less than the threshold, repeat operations of selecting another tissue label in rest tissue labels in the tissue set, normalizing the image values of the plurality of neighboring points based on the updated selected tissue label, and obtaining an updated interpolation result of the sample point based on an interpolation of the updated normalized image values of the plurality of neighboring points, until the updated interpolation result is larger than the threshold or otherwise all the tissue labels in the tissue set are traversed.

18. A non-transitory computer readable medium storing instructions, the instructions, when executed by at least one machine, causing the at least one machine to implement a method comprising:

obtaining an image relating to volume data of a plurality of tissues, wherein tissue labels of the plurality of tissues are organized in a tissue set;

selecting a sample point based on the volume data;

obtaining one or more neighboring points of the sample point, wherein one or more neighboring labels corresponding to the one or more neighboring points respectively are organized in a neighboring point set;

determining whether the one or more neighboring labels belong to the tissue set;

determining a color of the sample point based on the determination result, wherein the determining a color of the sample point based on the determination result comprises:

in response to determining that a target neighboring label of the one or more neighboring labels does not belong to the tissue set, obtaining a first color list based on the target neighboring label, the first color list including preset color attributes corresponding to image values respectively; and

determining the color of the sample point based on an image value of the sample point and the first color list; and

obtaining a volume rendering result of the plurality of tissues based on the color of the sample point.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 21, 2020
From: MENG, XIAOLIN; WENG, XIN; ZHANG, LIBO; DUAN, QI; WANG, SHUAI
To: SHANGHAI UNITED IMAGING HEALTHCARE CO., LTD.
Reel/Frame 053557/0808 →
Priority Claims (2)
CN 201511027638.5 · Dec 31, 2015 · national
CN 201611061730.8 · Nov 25, 2016 · national
Continuity (3)
Division 16022873 · Jun 29, 2018
Continuation PCTCN2016113387 · Dec 30, 2016
Related Publication 20200388034A1 · Dec 10, 2020