IP Library Granted Patent US 9,792,729
Granted Patent B2
US 9,792,729 · App. 14/353,168 · Granted Oct 17, 2017

System and method for context preserving maps of tubular structures

Inventors: Arie Kaufman (Plainview, NY); Xianfeng David Gu (Plainview, NY); Joseph Marino (Port Jefferson Station, NY); Wei Zeng (Stony Brook, NY)
Assignee: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK
G06T19/003G06T15/005G06T19/00A61B2034/105G06T2219/008G06T2219/021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,792,729
App. No.
14/353,168
Granted
Oct 17, 2017
Kind
B2
Abstract

A computer-based method for generating a context preserving mapping of tubular structures represented by a 3D dataset having the steps of projecting a skeleton of a 3D tubular structure on to a 2D plane, and adjusting the projected skeleton to correct projection imbued distortion in skeleton length. The 2D projected skeleton is processed to remove intersections, and a surface boundary around the 2D skeleton is determined for the map. The 3D surface of the skeleton is mapped to match the 3D boundary to create a 3D map of the tubular structure.

Claims (62)

1. A computer-based method for context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset comprising:

using a computer processor, processing the 3D dataset to project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

using the computer processor, processing the projected skeleton to remove intersections and to untangle the skeleton, wherein the untangling comprises first searching for abutments, then searching for loops, and then searching for crossings;

using the computer processor, determining a 3D boundary for a map of the tubular structure about the skeleton; and

using the computer processor, mapping a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

2. The method of claim 1 , further comprising further processing to modify the skeleton to separate areas lying close to each other.

3. The method of claim 1 , further comprising volumetric ray casting through an original CT data from which a mesh is extracted to generate a more detailed 3D map.

4. The method of claim 1 , wherein a surface of a 2D structure of a 2D map is mapped to a surface of a 2D rectangle.

5. The method of claim 4 , wherein the 2D map is mapped using Ricci flow.

6. The method of claim 1 , wherein determining the boundary comprises slicing open the skeleton from end to end and corresponding each boundary vertex with the skeleton.

7. The method of claim 6 , further comprising embedding each boundary vertex into 2D at an associated radius orthogonal to the 2D skeleton.

8. The method of claim 1 , wherein the projection of the skeleton is based on a discretized skeleton curve.

9. The method of claim 1 , further comprising adjusting the projected skeleton to correct projection imbued distortion in skeleton length prior to processing the skeleton.

10. The method of claim 9 , wherein the adjusting the skeleton comprises straightening and lengthening the skeleton.

11. The method of claim 10 , wherein lengthening of the skeleton comprises bending a straight skeleton with even spacing into a shape of a projected skeleton.

12. The method of claim 1 , wherein the projecting of the skeleton comprises projecting points of an orthogonal projection of a 3D skeleton on a 2D plane.

13. The method of claim 1 , further comprising viewing the 3D map on a display.

14. The method of claim 1 , wherein the tubular structure is internal to a human body.

15. A system for context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset comprising:

a computer hardware arrangement configured to:

project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

process the skeleton to remove intersections and to untangle the skeleton, wherein the untangling comprises first searching for abutments, then searching for loops, and then searching for crossings;

determine a 3D boundary for a map; and

map a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

16. The system of claim 15 , wherein the computer hardware arrangement is further configured to adjust the projected skeleton to correct projection imbued distortion in the skeleton prior to processing the skeleton.

17. A non-transitory computer readable media having instructions encoded thereon readable by a computer processor for performing generating context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset, the instructions comprising:

instructions for a computer processor to process the 3D dataset to project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

instructions for the computer processor to process the projected skeleton to remove intersections and to untangle the skeleton, wherein the untangling comprises first searching for abutments, then searching for loops, and then searching for crossings;

instructions for the computer processor to determine a 3D boundary for a map of the tubular structure about the skeleton; and

instructions for the computer processor to map a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

18. A computer-based method for context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset comprising:

using a computer processor, processing the 3D dataset to project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

using the computer processor, adjusting the projected skeleton to correct projection imbued distortion in skeleton length by straightening and lengthening the skeleton, wherein the lengthening of the skeleton comprises bending a straight skeleton with even spacing into a shape of a projected skeleton;

using the computer processor, processing the projected skeleton to remove intersections;

using the computer processor, determining a 3D boundary for a map of the tubular structure about the skeleton; and

using the computer processor, mapping a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

19. The method of claim 18 , further comprising further processing to modify the skeleton to separate areas lying close to each other.

20. The method of claim 18 , further comprising volumetric ray casting through an original CT data from which a mesh is extracted to generate a more detailed 3D map.

21. The method of claim 18 , wherein a surface of a 2D structure of a 2D map is mapped to a surface of a 2D rectangle.

22. The method of claim 21 , wherein the 2D map is mapped using Ricci flow.

23. The method of claim 18 , wherein determining the 3D boundary comprises slicing open the skeleton from end to end and corresponding each boundary vertex with the skeleton.

24. The method of claim 23 , further comprising embedding each boundary vertex into 2D at an associated radius orthogonal to the 2D skeleton.

25. The method of claim 18 , wherein the projection of the skeleton is based on a discretized skeleton curve.

26. The method of claim 18 , wherein the projecting of the skeleton comprises projecting points of an orthogonal projection of a 3D skeleton on a 2D plane.

27. The method of claim 18 , further comprising viewing the 3D map on a display.

28. The method of claim 18 , wherein the tubular structure is internal to a human body.

29. The method of claim 18 , wherein the processing comprises untangling the skeleton.

30. The method of claim 29 , wherein the untangling of the skeleton comprises searching the skeleton for at least one of abutments, loops or crossings.

31. The method of claim 30 , wherein a priority for searching the skeleton comprises first searching for abutments, then searching for loops, and then searching for crossings.

32. A system for context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset comprising:

a computer hardware arrangement configured to:

project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

adjust the projected skeleton to correct projection imbued distortion in skeleton length by straightening and lengthening the skeleton, wherein the lengthening of the skeleton comprises bending a straight skeleton with even spacing into a shape of a projected skeleton;

process the skeleton to remove intersections;

determine a 3D boundary for a map; and

map a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

33. A non-transitory computer readable media having instructions encoded thereon readable by a computer processor for performing generating context preserving mapping of tubular structures represented by a three-dimensional (3D) dataset, the instructions comprising:

instructions for a computer processor to process the 3D dataset to project a skeleton of a 3D tubular structure on to a two-dimensional (2D) plane;

instructions for the computer processor to adjust the projected skeleton to correct projection imbued distortion in skeleton length by straightening and lengthening the skeleton, wherein the lengthening of the skeleton comprises bending a straight skeleton with even spacing into a shape of a projected skeleton;

instructions for the computer processor to process the projected skeleton to remove intersections;

instructions for the computer processor to determine a 3D boundary for a map of the tubular structure about the skeleton; and

instructions for the computer processor to map a 3D surface of the skeleton to match the 3D boundary to create a 3D map.

Assignments (3)
CONFIRMATORY LICENSE Recorded Dec 20, 2018
From: STATE UNIVERSITY NEW YORK STONY BROOK
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 047968/0216 →
CONFIRMATORY LICENSE Recorded Sep 25, 2015
From: STATE UNIVERSITY NEW YORK STONY BROOK
To: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT
Reel/Frame 036690/0854 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 8, 2014
From: KAUFMAN, ARIE; GU, XIANFENG DAVID; MARINO, JOSEPH; ZENG, WEI
To: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY OF NEW YORK
Reel/Frame 033908/0417 →
Continuity (2)
Continuation 61549916 · Oct 21, 2011
Related Publication 20140362080A1 · Dec 11, 2014