IP Library Granted Patent US 10,019,797
Granted Patent B2
US 10,019,797 · App. 15/281,583 · Granted Jul 10, 2018

Rendering expanded lumen image

Inventors: Bingsheng Li (Shenyang, CN); Wei He (Shenyang, CN)
Assignee: Shenyang Neusoft Medical Systems Co., Ltd.
G06T7/0012G06T17/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,019,797
App. No.
15/281,583
Granted
Jul 10, 2018
Kind
B2
Abstract

Methods, systems, and apparatus including computer programs encoded on a computer storage medium, for rendering an expanded lumen image are disclosed. The methods include extracting a center line of a lumen from a three-dimensional lumen image and obtaining a plurality of viewpoints by sampling the center line, establishing a spherical projection plane for each of the viewpoints, a point on the spherical projection plane corresponding to a point on an inner wall of the lumen, determining a relationship between a two-dimensional projection plane and the inner wall of the lumen according to a corresponding relationship between the spherical projection plane and the two-dimensional projection plane, and obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane according to the determined relationship between the two-dimensional projection plane and the inner wall of the lumen.

Claims (78)

1. A method of rendering an expanded lumen image, comprising:

obtaining a plurality of viewpoints by sampling a centre line of a lumen based on a three-dimensional lumen image;

establishing a spherical projection plane for each of the viewpoints, wherein a point on the spherical projection plane corresponds to a point on an inner wall of the lumen;

determining a relationship between a two-dimensional projection plane and the inner wall of the lumen according to a corresponding relationship between the spherical projection plane and the two-dimensional projection plane; and

obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane according to the determined relationship between the two-dimensional projection plane and the inner wall of the lumen,

wherein establishing a spherical projection plane for each of the viewpoints comprises:

determining a gazing direction and a local coordinate system of the viewpoint, wherein a Z-axis direction of the local coordinate system is the gazing direction of the viewpoint; and

establishing the spherical projection plane by taking the viewpoint as a centre of sphere and R as a radius under the local coordinate system, wherein R is a preset radius value less than or equal to a radius of the inner wall of the lumen.

2. The method of claim 1 , wherein determining a gazing direction and a local coordinate system of a viewpoint comprises:

determining a gazing direction of a current viewpoint according to positions of viewpoints adjacent to the current viewpoint on the centre line; and

determining an X-axis direction, a Y-axis direction and a Z-axis direction of a local coordinate system of the current viewpoint according to a connecting line between a previous viewpoint before the current viewpoint and the current viewpoint and a local coordinate system of the previous viewpoint.

3. The method of claim 1 , wherein the point on the spherical projection plane corresponding to the point on the inner wall of the lumen comprises:

a first point on the spherical projection plane corresponding to a second point on the inner wall of the lumen directed by a three-dimensional vector of the first point, wherein the three-dimensional vector of the first point is a vector constituted by the first point and a centre of sphere of the spherical projection plane.

4. The method of claim 3 , wherein the corresponding relationship between the spherical projection plane and the two-dimensional projection plane comprises:

a corresponding relationship between a three-dimensional vector of the first point on the spherical projection plane and a two-dimensional coordinate of a third point on the two-dimensional projection plane.

5. The method of claim 4 , wherein determining a relationship between a two-dimensional projection plane and the inner wall of the lumen comprises:

dividing the spherical projection plane into a plurality of three-dimensional regions;

determining an image rending region of the two-dimensional projection plane, the image rending region comprising a plurality of two-dimensional regions respectively corresponding to the plurality of three-dimensional regions of the spherical projection plane; and

determining a three-dimensional vector on one of the three-dimensional regions corresponding to a point on one of the two-dimensional regions.

6. The method of claim 5 , wherein the plurality of three-dimensional regions comprises:

a three-dimensional region R 1 , which is a spherical surface positioned between an X-axis positive direction and a Z-axis negative direction,

a three-dimensional region R 2 , which is a spherical surface positioned in an X-axis negative direction, and

a three-dimensional region R 3 , which is a spherical surface excluding the three-dimensional regions R 1 and R 2 , and

wherein the image rendering region comprises:

a two-dimensional region R 1 ′ corresponding to the three-dimensional region R 1 , which is a semicircle with radius equal to a scaled lumen radius r and positioned on a left side of the image rendering region, the scaled lumen radius r being obtained by multiplying a radius of the inner wall of the lumen with a preset scaling ratio,

a two-dimensional region R 2 ′ corresponding to the three-dimensional region R 2 , which is a rectangle with width equal to πr and height equal to 2r and positioned in a middle part of the image rendering region, and

a two-dimensional region R 3 ′ corresponding to the three-dimensional region R 3 , which is a semicircle with radius equal to the scaled lumen radius r and positioned on a right side of the image rendering region.

7. The method of claim 4 , wherein obtaining a two-dimensional expanded image of the three-dimensional lumen image comprises:

obtaining color information of the second point on the inner wall of the lumen directed by a three-dimensional vector corresponding to the third point on the two-dimensional projection plane; and

obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane based on the obtained color information.

8. A device for rendering an expanded lumen image, the device comprising:

a processor which invokes machine readable instructions corresponding to a control logic for rendering an expanded lumen image stored on a storage medium and executes the machine readable instructions to:

obtain a plurality of viewpoints by sampling a centre line of a lumen based on a three-dimensional lumen image;

establish a spherical projection plane for each of the viewpoints, wherein a point on the spherical projection plane corresponds to a point on an inner wall of the lumen;

determine a relationship between a two-dimensional projection plane and the inner wall of the lumen according to a corresponding relationship between the spherical projection plane and the two-dimensional projection plane; and

obtain a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane according to the determined relationship between the two-dimensional projection plane and the inner wall of the lumen,

wherein the machine readable instructions causes the processor to establish the spherical projection plane by:

determining a gazing direction and a local coordinate system of a viewpoint, wherein a Z-axis direction of the local coordinate system is the gazing direction of the viewpoint and

establishing the spherical projection plane by taking the viewpoint as a centre of sphere and R as a radius under the local coordinate system, wherein R is a preset radius value less than or equal to a radius of the inner wall of the lumen.

9. The device of claim 8 , wherein the machine readable instructions causes the processor to determine the gazing direction and the local coordinate system of the viewpoint by:

determining a gazing direction of a current viewpoint according to positions of viewpoints adjacent to the current viewpoint on the centre line; and

determining an X-axis direction, a Y-axis direction and a Z-axis direction of a local coordinate system of the current viewpoint according to a connecting line between a previous viewpoint before the current viewpoint and the current viewpoint and a local coordinate system of the previous viewpoint.

10. The device of claim 8 , wherein the point on the spherical projection plane corresponding to the point on an inner wall of the lumen comprises:

a first point on the spherical projection plane corresponding to a second point on the inner wall of the lumen directed by a three-dimensional vector of the first point, wherein the three-dimensional vector of the first point is a vector constituted by the first point and a centre of sphere of the spherical projection plane.

11. The device of claim 10 , wherein the corresponding relationship between the spherical projection plane and the two-dimensional projection plane comprises:

a corresponding relationship between a three-dimensional vector of the first point on the spherical projection plane and a two-dimensional coordinate of a third point on the two-dimensional projection plane.

12. The device of claim 11 , wherein the machine readable instructions may further cause the processor to determine the relationship between the two-dimensional projection plane and the inner wall of the lumen by:

dividing the spherical projection plane into a plurality of three-dimensional regions;

determining an image rendering region of the two-dimensional projection plane, wherein the image rendering region comprises a plurality of two-dimensional regions respectively corresponding to the plurality of three-dimensional regions; and

determine a three-dimensional vector on one of the three-dimensional regions corresponding to a point on one of the two-dimensional regions.

13. The device of claim 12 , wherein the plurality of three-dimensional regions comprises:

a three-dimensional region R 1 , which is a spherical surface positioned between an X-axis positive direction and a Z-axis negative direction,

a three-dimensional region R 2 , which is a spherical surface positioned in an X-axis negative direction, and

a three-dimensional region R 3 , which is a spherical surface excluding the three-dimensional regions R 1 and R 2 , and

wherein the plurality of two-dimensional regions comprises:

a two-dimensional region R 1 ′ corresponding to the three-dimensional region R 1 , which is a semicircle with radius equal to a scaled lumen radius r and positioned on a left side of the image rendering region, the scaled lumen radius r being obtained by multiplying a radius of the inner wall of the lumen with a preset scaling ratio,

a two-dimensional region R 2 ′ corresponding to the three-dimensional region R 2 , which is a rectangle with width equal to πr and height equal to 2r and positioned in a middle part of the image rendering region, and

a two-dimensional region R 3 ′ corresponding to the three-dimensional region R 3 , which is a semicircle with radius equal to the scaled lumen radius r and positioned on a right side of the image rendering region.

14. The device of claim 11 , wherein the machine readable instructions may further cause the processor to obtain the two-dimensional expanded image of the three-dimensional lumen image by:

obtaining color information of the second point on the inner wall of the lumen directed by a three-dimensional vector corresponding to the third point on the two-dimensional projection plane; and

obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane based on the acquired color information.

15. A non-transitory computer readable storage medium storing instructions executable by one or more processors and upon such execution cause the one or more processors to perform operations comprising:

obtaining a plurality of viewpoints by sampling a centre line of a lumen based on a three-dimensional lumen image;

establishing a spherical projection plane for each of the viewpoints, wherein a point on the spherical projection plane corresponds to a point on an inner wall of the lumen;

determining a relationship between a two-dimensional projection plane and the inner wall of the lumen according to a corresponding relationship between the spherical projection plane and the two-dimensional projection plane; and

obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane according to the determined relationship between the two-dimensional projection plane and the inner wall of the lumen,

wherein establishing a spherical projection plane for each of the viewpoints comprises:

determining a gazing direction and a local coordinate system of the viewpoint, wherein a Z-axis direction of the local coordinate system is the gazing direction of the viewpoint and

establishing the spherical projection plane by taking the viewpoint as a centre of sphere and R as a radius under the local coordinate system, wherein R is a preset radius value less than or equal to a radius of the inner wall of the lumen.

16. The non-transitory computer readable storage medium of claim 15 , wherein the point on the spherical projection plane corresponding to the point on the inner wall of the lumen comprises a first point on the spherical projection plane corresponding to a second point on the inner wall of the lumen directed by a three-dimensional vector of the first point, wherein the three-dimensional vector of the first point is a vector constituted by the first point and a centre of sphere of the spherical projection plane,

wherein the corresponding relationship between the spherical projection plane and the two-dimensional projection plane comprises a corresponding relationship between a three-dimensional vector of the first point on the spherical projection plane and a two-dimensional coordinate of a third point on the two-dimensional projection plane, and

wherein determining a relationship between a two-dimensional projection plane and the inner wall of the lumen comprises:

dividing the spherical projection plane into a plurality of three-dimensional regions;

determining an image rending region of the two-dimensional projection plane, the image rending region comprising a plurality of two-dimensional regions respectively corresponding to the plurality of three-dimensional regions of the spherical projection plane; and

determining a three-dimensional vector on one of the three-dimensional regions corresponding to a point on one of the two-dimensional regions.

17. The non-transitory computer readable storage medium of claim 16 , wherein obtaining a two-dimensional expanded image of the three-dimensional lumen image comprises:

obtaining color information of the second point on the inner wall of the lumen directed by a three-dimensional vector corresponding to the third point on the two-dimensional projection plane; and

obtaining a two-dimensional expanded image of the three-dimensional lumen image by performing image rendering on the two-dimensional projection plane based on the obtained color information.

Assignments (2)
CHANGE OF NAME Recorded Apr 10, 2020
From: SHENYANG NEUSOFT MEDICAL SYSTEMS CO., LTD.
To: NEUSOFT MEDICAL SYSTEMS CO., LTD.
Reel/Frame 052373/0047 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2016
From: LI, BINGSHENG; HE, WEI
To: SHENYANG NEUSOFT MEDICAL SYSTEMS CO., LTD.
Reel/Frame 040510/0098 →
Priority Claims (1)
CN 2015 1 07385601 · Nov 3, 2015 · national
Continuity (1)
Related Publication 20170124702A1 · May 4, 2017