IP Library › Granted Patent US 10,795,457
Granted Patent B2
US 10,795,457 · App. 15/878,463 · Granted Oct 6, 2020

Interactive 3D cursor

Inventors: Kathleen M. Douglas (Winter Park, FL); Robert E. Douglas (Winter Park, FL); David Byron Douglas (Winter Park, FL)
Assignee: D3D TECHNOLOGIES, INC.
G06F3/0346A61B6/466G06F3/03543G06F3/04812G06F3/04842G06T7/0012G06T7/0014G06T7/62G06T19/00G06T19/006G06T2207/10072G06T2207/10081G06T2207/10104G06T2207/20104G06T2207/30096G06T2207/30204G06T2210/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,795,457
App. No.
15/878,463
Filed
Jan 24, 2018
Granted
Oct 6, 2020
Kind
B2
Art Unit
2628
USPC
345/163
Abstract

An interactive 3D cursor facilitates selection and manipulation of a three-dimensional volume from any three-dimensional image. The selected volume image may be transparency-adjusted and filtered to remove selected items from view. Qualitative and quantitative analysis within a selected volume may be performed. Location indicators, annotations, and registration markers may be overlaid on selected volume images.

Claims (153)

1. A method comprising:

providing a three-dimensional cursor that has a non-zero volume;

selecting a volume of a three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image;

presenting a modified version of the selected volume of the three-dimensional image; and

displaying: orthogonal cross-sectional imaging slices, wherein the slices are marked with a corresponding visible boundary of the three-dimensional cursor, reference lines from the three-dimensional cursor to the orthogonal cross-sectional imaging slices, the three-dimensional cursor and results from a statistical analysis performed on the contents of the three-dimensional cursor.

2. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises removing an un-selected volume of the three-dimensional image from view.

3. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises changing transparency of presented tissues within or external to the selected volume.

4. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises filtering a selected tissue to remove the selected tissue from view.

5. The method of claim 1 , further comprising presenting the three-dimensional cursor with measurement markings on at least one edge, surface or side.

6. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted location indicators within the three-dimensional cursor.

7. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted annotations.

8. The method of claim 1 , further comprising changing the volume inside of the three-dimensional cursor responsive to an additional input.

9. The method of claim 8 , further comprising changing a volumetric shape of the three-dimensional cursor responsive to a further input.

10. The method of claim 1 , further comprising automatically generating a statistical representation of the selected volume of the three-dimensional image.

11. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting at least one tissue type with false color based on a composition of a structure within the three-dimensional cursor.

12. The method of claim 1 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting volumetric changes over time in between at least two different radiological imaging examinations with false color.

13. The method of claim 1 , further comprising presenting a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

14. The method of claim 13 , further comprising automatically calculating and presenting a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

15. The method of claim 1 , further comprising presenting inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

16. The method of claim 15 , further comprising automatically calculating volumetric change based on the registration markers.

17. The method of claim 15 , further comprising automatically re-orienting the selected volume of the three-dimensional image based on the registration markers.

18. The method of claim 1 , further comprising using multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

19. The method of claim 1 , further comprising presenting the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

20. The method of claim 1 , wherein the selecting is responsive to a user input.

21. The method of claim 1 , wherein the presenting is responsive to a user input.

22. The method of claim 1 , wherein the selecting is automatic.

23. The method of claim 1 , wherein the presenting is automatic.

24. A method comprising:

providing a three-dimensional cursor that has a non-zero volume:

selecting a volume of a three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image;

presenting a modified version of the selected volume of the three-dimensional image; and

displaying: a stack of contiguous cross-sectional imaging slices, wherein the slices are marked with a corresponding visible boundary of the three-dimensional cursor, reference lines from the three-dimensional cursor to the stack of contiguous cross-sectional imaging slices, the three-dimensional cursor and results from a statistical analysis performed on the contents of the three-dimensional cursor.

25. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises removing an un-selected volume of the three-dimensional image from view.

26. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises changing transparency of presented tissues within or external to the selected volume.

27. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises filtering a selected tissue to remove the selected tissue from view.

28. The method of claim 24 , further comprising presenting the three-dimensional cursor with measurement markings on at least one edge, surface or side.

29. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted location indicators within the three-dimensional cursor.

30. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted annotations.

31. The method of claim 24 , further comprising changing the volume inside of the three-dimensional cursor responsive to an additional input.

32. The method of claim 31 , further comprising changing a volumetric shape of the three-dimensional cursor responsive to a further input.

33. The method of claim 24 , further comprising automatically generating a statistical representation of the selected volume of the three-dimensional image.

34. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting at least one tissue type with false color based on a composition of a structure within the three-dimensional cursor.

35. The method of claim 24 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting volumetric changes over time in between at least two different radiological imaging examinations with false color.

36. The method of claim 24 , further comprising presenting a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

37. The method of claim 36 , further comprising automatically calculating and presenting a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

38. The method of claim 24 , further comprising presenting inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

39. The method of claim 38 , further comprising automatically calculating volumetric change based on the registration markers.

40. The method of claim 38 , further comprising automatically re-orienting the selected volume of the three-dimensional image based on the registration markers.

41. The method of claim 24 , further comprising using multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

42. The method of claim 24 , further comprising presenting the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

43. The method of claim 24 , wherein the selecting is responsive to a user input.

44. The method of claim 24 , wherein the presenting is responsive to a user input.

45. The method of claim 24 , wherein the selecting is automatic.

46. The method of claim 24 , wherein the presenting is automatic.

47. A method comprising:

providing a three-dimensional cursor that has a non-zero volume;

selecting a volume of a three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image;

presenting a modified version of the selected volume of the three-dimensional image, and

displaying: a maximum intensity projection (MIP) image with the three-dimensional cursor, reference lines from the three-dimensional cursor to the MIP image, the three-dimensional cursor and results from a statistical analysis performed on the contents of at least one three-dimensional cursor.

48. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises removing an un-selected volume of the three-dimensional image from view.

49. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises changing transparency of presented tissues within or external to the selected volume.

50. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises filtering a selected tissue to remove the selected tissue from view.

51. The method of claim 47 , further comprising presenting the three-dimensional cursor with measurement markings on at least one edge, surface or side.

52. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted location indicators within the three-dimensional cursor.

53. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting inputted annotations.

54. The method of claim 47 , further comprising changing the volume inside of the three-dimensional cursor responsive to an additional input.

55. The method of claim 54 , further comprising changing a volumetric shape of the three-dimensional cursor responsive to a further input.

56. The method of claim 47 , further comprising automatically generating a statistical representation of the selected volume of the three-dimensional image.

57. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting at least one tissue type with false color based on a composition of a structure within the three-dimensional cursor.

58. The method of claim 47 , wherein presenting the modified version of the selected volume of the three-dimensional image comprises presenting volumetric changes over time in between at least two different radiological imaging examinations with false color.

59. The method of claim 47 , further comprising presenting a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

60. The method of claim 59 , further comprising automatically calculating and presenting a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

61. The method of claim 47 , further comprising presenting inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

62. The method of claim 61 , further comprising automatically calculating volumetric change based on the registration markers.

63. The method of claim 61 , further comprising automatically re-orienting the selected volume of the three-dimensional image based on the registration markers.

64. The method of claim 47 , further comprising using multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

65. The method of claim 47 , further comprising presenting the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

66. The method of claim 47 , wherein the selecting is responsive to a user input.

67. The method of claim 47 , wherein the presenting is responsive to a user input.

68. The method of claim 47 , wherein the selecting is automatic.

69. The method of claim 47 , wherein the presenting is automatic.

70. An apparatus comprising:

a computing device; and

a human-machine interface comprising a three-dimensional cursor that has a non-zero volume;

the human-machine interface configured to select a volume of the three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image responsive to an input; and

the human-machine interface configured to present a modified version of the selected volume of the three-dimensional image responsive to another input,

wherein the human-machine interface is further configured to display: orthogonal cross-sectional imaging slices, wherein the slices are marked with a corresponding visible boundary of the three-dimensional cursor, reference lines from the three-dimensional cursor to the orthogonal cross-sectional imaging slices, the three-dimensional cursor and results from a statistical analysis performed on contents of the three-dimensional cursor.

71. The apparatus of claim 70 , wherein the human-machine interface is configured to remove an un-selected volume of the three-dimensional image from view.

72. The apparatus of claim 70 , wherein the human-machine interface is configured to change transparency of presented tissues within the selected volume.

73. The apparatus of claim 70 , wherein the human-machine interface is configured to filter a selected tissue to remove the selected tissue from view.

74. The apparatus of claim 70 , wherein the human-machine interface is configured to present the three-dimensional cursor with measurement markings on at least one edge, surface or side.

75. The apparatus of claim 70 , wherein the human-machine interface is configured to receive and implement inputted location indicators within the three-dimensional cursor.

76. The apparatus of claim 70 , wherein the human-machine interface is configured to receive and implement inputted annotations.

77. The apparatus of claim 70 , wherein the human-machine interface is configured to change the volume inside of the three-dimensional cursor responsive to an additional input.

78. The apparatus of claim 77 , wherein the human-machine interface is configured to change a volumetric shape of the three-dimensional cursor responsive to a further input.

79. The apparatus of claim 70 , wherein the human-machine interface is configured to automatically generate and present a statistical representation of the selected volume of the three-dimensional image.

80. The apparatus of claim 70 , wherein the human-machine interface is configured to present at least one tissue type with false color based on then composition of a structure within the three-dimensional cursor.

81. The apparatus of claim 70 , wherein the human-machine interface is configured to present volumetric changes over time in between at least two different radiological imaging examinations with false color.

82. The apparatus of claim 70 , wherein the human-machine interface is configured to present a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

83. The apparatus of claim 70 , wherein the human-machine interface is configured to automatically determine and present a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

84. The apparatus of claim 70 , wherein the human-machine interface is configured to present inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

85. The apparatus of claim 84 , wherein the human-machine interface is configured to automatically calculate volumetric change based on the registration markers.

86. The apparatus of claim 84 , wherein the human-machine interface is configured to automatically re-orient the selected volume of the three-dimensional image based on the registration markers.

87. The apparatus of claim 70 , wherein the human-machine interface is configured to present multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

88. The apparatus of claim 70 , wherein the human-machine interface is configured to present the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

89. An apparatus comprising:

a computing device; and

a human-machine interface comprising a three-dimensional cursor that has a non-zero volume;

the human-machine interface configured to select a volume of the three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image responsive to an input; and

the human-machine interface configured to present a modified version of the selected volume of the three-dimensional image responsive to another input,

wherein the human-machine interface is further configured to display; a stack of contiguous cross-sectional imaging slices, wherein the slices are marked with a corresponding visible boundary of the three-dimensional cursor, reference lines from the three-dimensional cursor to the stack of contiguous cross-sectional imaging slices, the three-dimensional cursor and results from a statistical analysis performed on contents of the three-dimensional cursor.

90. The apparatus of claim 89 , wherein the human-machine interface is configured to remove an un-selected volume of the three-dimensional image from view.

91. The apparatus of claim 89 , wherein the human-machine interface is configured to change transparency of presented tissues within the selected volume.

92. The apparatus of claim 89 , wherein the human-machine interface is configured to filter a selected tissue to remove the selected tissue from view.

93. The apparatus of claim 89 , wherein the human-machine interface is configured to present the three-dimensional cursor with measurement markings on at least one edge, surface or side.

94. The apparatus of claim 89 , wherein the human-machine interface is configured to receive and implement inputted location indicators within the three-dimensional cursor.

95. The apparatus of claim 89 , wherein the human-machine interface is configured to receive and implement inputted annotations.

96. The apparatus of claim 89 , wherein the human-machine interface is configured to change the volume inside of the three-dimensional cursor responsive to an additional input.

97. The apparatus of claim 96 , wherein the human-machine interface is configured to change a volumetric shape of the three-dimensional cursor responsive to a further input.

98. The apparatus of claim 89 , wherein the human-machine interface is configured to automatically generate and present a statistical representation of the selected volume of the three-dimensional image.

99. The apparatus of claim 89 , wherein the human-machine interface is configured to present at least one tissue type with false color based on a composition of a structure within the three-dimensional cursor.

100. The apparatus of claim 89 , wherein the human-machine interface is configured to present volumetric changes over time in between at least two different radiological imaging examinations with false color.

101. The apparatus of claim 89 , wherein the human-machine interface is configured to present a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

102. The apparatus of claim 89 , wherein the human-machine interface is configured to automatically determine and present a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

103. The apparatus of claim 89 , wherein the human-machine interface is configured to present inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

104. The apparatus of claim 103 , wherein the human-machine interface is configured to automatically calculate volumetric change based on the registration markers.

105. The apparatus of claim 103 , wherein the human-machine interface is configured to automatically re-orient the selected volume of the three-dimensional image based on the registration markers.

106. The apparatus of claim 89 , wherein the human-machine interface is configured to present multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

107. The apparatus of claim 89 , wherein the human-machine interface is configured to present the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

108. An apparatus comprising:

a computing device; and

a human-machine interface comprising a three-dimensional cursor that has a non-zero volume;

the human-machine interface configured to select a volume of the three-dimensional image designated by the three-dimensional cursor, wherein the three-dimensional cursor encloses the volume of the three-dimensional image responsive to an input; and

the human-machine interface configured to present a modified version of the selected volume of the three-dimensional image responsive to another input,

wherein the human-machine interface is further configured to display: a maximum intensity projection (MIP) image with the three-dimensional cursor, reference lines from the three-dimensional cursor to the MIP image, the three-dimensional cursor and results from a statistical analysis performed on the contents of the three-dimensional cursor.

109. The apparatus of claim 108 , wherein the human-machine interface is configured to remove an un-selected volume of the three-dimensional image from view.

110. The apparatus of claim 108 , wherein the human-machine interface is configured to change transparency of presented tissues within the selected volume.

111. The apparatus of claim 108 , wherein the human-machine interface is configured to filter a selected tissue to remove the selected tissue from view.

112. The apparatus of claim 108 , wherein the human-machine interface is configured to present the three-dimensional cursor with measurement markings on at least one edge, surface or side.

113. The apparatus of claim 108 , wherein the human-machine interface is configured to receive and implement inputted location indicators within the three-dimensional cursor.

114. The apparatus of claim 108 , wherein the human-machine interface is configured to receive and implement inputted annotations.

115. The apparatus of claim 108 , wherein the human-machine interface is configured to change the volume inside of the three-dimensional cursor responsive to an additional input.

116. The apparatus of claim 115 , wherein the human-machine interface is configured to change a volumetric shape of the three-dimensional cursor responsive to a further input.

117. The apparatus of claim 108 , wherein the human-machine interface is configured to automatically generate and present a statistical representation of the selected volume of the three-dimensional image.

118. The apparatus of claim 108 , wherein the human-machine interface is configured to present at least one tissue type with false color based on a composition of a structure within the three-dimensional cursor.

119. The apparatus of claim 108 , wherein the human-machine interface is configured to present volumetric changes over time in between at least two different radiological imaging examinations with false color.

120. The apparatus of claim 70 , wherein the human-machine interface is configured to present a radiology report enhanced with statistical information obtained using the three-dimensional cursor.

121. The apparatus of claim 108 , wherein the human-machine interface is configured to automatically determine and present a quantitative analysis and a qualitative analysis associated with multiple time points in between at least two different radiological imaging examinations.

122. The apparatus of claim 108 , wherein the human-machine interface is configured to present inputted registration markers on regions of interest within the volume contained within the three-dimensional cursor.

123. The apparatus of claim 122 , wherein the human-machine interface is configured to automatically calculate volumetric change based on the registration markers.

124. The apparatus of claim 122 , wherein the human-machine interface is configured to automatically re-orient the selected volume of the three-dimensional image based on the registration markers.

125. The apparatus of claim 108 , wherein the human-machine interface is configured to present multiple overlapping volumes selected with at least two three-dimensional cursors to designate a pre-operative planning pathway for guiding surgical intervention.

126. The apparatus of claim 108 , wherein the human-machine interface is configured to present the modified version of the selected volume inside the three-dimensional cursor with an extended reality headset.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 9, 2020
From: DOUGLAS, KATHLEEN MARY; DOUGLAS, ROBERT EDWIN; DOUGLAS, DAVID BYRON
To: D3D TECHNOLOGIES, INC.
Reel/Frame 053718/0591 →
NUNC PRO TUNC ASSIGNMENT Recorded Jul 15, 2020
From: DOUGLAS, KATHLEEN MARY; DOUGLAS, DAVID BYRON; DOUGLAS, ROBERT E.
To: TIPPING POINT MEDICAL IMAGES, LLC
Reel/Frame 053219/0572 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 15, 2020
From: TIPPING POINT MEDICAL IMAGES, LLC
To: D3D TECHNOLOGIES, INC.
Reel/Frame 053219/0743 →
Continuity (6)
Continuation In Part 14877442 · Oct 7, 2015
Continuation In Part 12176569 · Jul 21, 2008
Continuation In Part 11941578 · Nov 16, 2007
Provisional Application 60877931 · Dec 28, 2006
Related Publication 20190227641A1 · Jul 25, 2019
Related Publication 20200264709A9 · Aug 20, 2020
Cited By (1)
US 12,333,087