IP Library › Granted Patent US 10,878,639
Granted Patent B2
US 10,878,639 · App. 16/195,251 · Granted Dec 29, 2020

Interactive voxel manipulation in volumetric medical imaging for virtual motion, deformable tissue, and virtual radiological dissection

Inventors: David Byron Douglas (Winter Park, FL); Robert E Douglas (Winter Park, FL); Kathleen M Douglas (Winter Park, FL); Max Wintermark (San Carlos, CA)
G06T19/20A61B34/10G06F30/00G06T13/00G06T15/08A61B2034/104A61B2034/105G06T2200/24G06T2210/41G06T2219/008G06T2219/2012G06T2219/2016G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,878,639
App. No.
16/195,251
Filed
Nov 19, 2018
Granted
Dec 29, 2020
Kind
B2
Art Unit
2616
USPC
345/424
Abstract

A simulation is performed by assigning tissue type properties to voxels of a medical image and manipulating the voxels based on the assigned tissue type properties and an input that prompts voxel manipulation. Voxels may also be created and eliminated in response to the input. Tissue type properties may include elasticity, ductility, hardness, density, and thermal conductivity. Manipulation may include changing at least one of voxel size, location, orientation, shape, color, grayscale, and tissue type property value. The input may include insertion of a virtual volume-subtending surgical or anatomic object. Simulations may include virtual motion, deformation of tissue, and radiological dissection for pre-operative planning.

Claims (75)

1. A method comprising:

performing imaging of a tangible volume containing discrete structures to generate a three-dimensional dataset;

performing segmentation of the three-dimensional dataset to generate segmented structures which correspond to the discrete structures;

assigning properties to voxels of the three-dimensional dataset based on the segmented structures wherein the properties to voxels of the three-dimensional dataset are determined by the discrete structures;

presenting, at a first time step, the three-dimensional dataset to a user;

performing a deformation of the three-dimensional dataset based on the assigned properties to voxels wherein the deformation changes at least one of the group consisting of a size of the a segmented structure, a shape of the a segmented structure, a location of a segmented structure, and an orientation of a segmented structure to generate a modified three-dimensional dataset; and

presenting, at a second time step, the modified three-dimensional dataset to the user.

2. The method of claim 1 wherein assigning properties to the voxels of the medical image comprises assigning a value for at least one of: elasticity, ductility, and hardness.

3. The method of claim 1 wherein performing the deformation comprises representing virtual motion.

4. The method of claim 1 wherein performing the deformation comprises representing deformation of tissue.

5. The method of claim 1 wherein performing the deformation comprises representing a radiological dissection.

6. The method of claim 1 wherein performing the deformation comprises creating new voxels in response to an input.

7. The method of claim 6 wherein the input comprises inserting a virtual volume-subtending surgical object.

8. The method of claim 6 wherein the input comprises inserting a virtual volume-subtending anatomic object.

9. The method of claim 6 wherein creating new voxels comprises creating new fixed-type voxels that do not change unless acted upon by a user through an interface.

10. The method of claim 6 wherein creating new voxels comprises creating new invisible-type voxels.

11. The method of claim 6 wherein creating new voxels comprises creating new tissue-type voxels.

12. The method of claim 8 wherein creating new voxels comprises creating new dynamic-type voxels having at least one tissue type property that changes over time.

13. The method of claim 8 wherein creating new voxels comprises creating new mobile voxels that travel through a virtual vascular structure.

14. The method of claim 1 wherein deformation comprises eliminating selected voxels in response to an input.

15. The method of claim 14 comprising eliminating tissue type voxels to simulate ablation.

16. The method of claim 14 comprising inserting strategic elimination points that designate a direction in which voxels are eliminated in discrete steps.

17. The method of claim 14 comprising inserting strategic non-elimination points that designate voxels that are preserved from elimination.

18. The method of claim 1 comprising assignment of a strategic deformation feature that designates a maximum shift for at least one voxel.

19. An apparatus comprising:

an IO device; and

an image processor in communication with the IO device, the image processors comprising a program stored on computer-readable non-transitory media, the program comprising:

instructions that utilize a three-dimensional dataset wherein the three-dimensional dataset was generated based on an imaging examination of a tangible volume containing discrete structures;

instructions that perform segmentation of the three-dimensional dataset to generate segmented structures which correspond to the discrete structures;

instructions that assign properties to voxels of the three-dimensional dataset based on the segmented structures wherein the properties to voxels of the three-dimensional dataset are determined by the discrete structures;

instructions that present, at a first time step, the three-dimensional dataset to a user;

instructions that perform a deformation of the three-dimensional dataset based on the assigned properties to voxels wherein the deformation changes at least one of the group consisting of a size of the a segmented structure, a shape of the a segmented structure, a location of a segmented structure, and an orientation of a segmented structure to generate a modified three-dimensional dataset; and

instructions that present, at a second time step, the modified three-dimensional dataset to the user.

20. The apparatus of claim 19 wherein the instructions that assign properties to voxels assign a value for at least one of: elasticity, ductility, and hardness.

21. The apparatus of claim 19 wherein performing the deformation comprises representing virtual motion.

22. The apparatus of claim 19 wherein performing the deformation comprises representing deformation of tissue.

23. The apparatus of claim 19 wherein performing the deformation comprises representing a radiological dissection.

24. The apparatus of claim 19 wherein performing the deformation comprises creation of new voxels in response to an input.

25. The apparatus of claim 24 wherein the input comprises insertion of a virtual volume-subtending surgical object.

26. The apparatus of claim 24 wherein the input comprises insertion of a virtual volume-subtending anatomic object.

27. The apparatus of claim 24 wherein creation of new voxels comprises creation of new fixed-type voxels that do not change unless acted upon by a user through an interface.

28. The apparatus of claim 24 wherein creation of new voxels comprises creation of new invisible-type voxels.

29. The apparatus of claim 24 wherein creation of new voxels comprises creation of new tissue-type voxels.

30. The apparatus of claim 24 wherein creation of new voxels comprises creation of new dynamic-type voxels having at least one tissue type property that changes over time.

31. The apparatus of claim 24 wherein creation of new voxels comprises creation of new mobile voxels that travel through a virtual vascular structure.

32. The apparatus of claim 19 wherein the deformation comprises elimination of selected voxels in response to an input.

33. The apparatus of claim 32 wherein elimination of selected voxels comprises elimination of tissue type voxels to simulate ablation.

34. The apparatus of claim 32 comprising instructions that insert strategic elimination points that designate a direction in which voxels are eliminated in discrete steps.

35. The apparatus of claim 32 comprising instructions that insert strategic non-elimination points that designate voxels that are preserved from elimination.

36. The apparatus of claim 19 comprising a strategic deformation feature that designates a maximum shift for at least one voxel.

37. A computer-readable storage device comprising:

instructions which, when executed by a computer, cause the computer to carry out the steps of:

utilizing a three-dimensional dataset wherein the three-dimensional dataset was generated based on an imaging examination of a tangible volume containing discrete structures;

performing segmentation of the three-dimensional dataset to generate segmented structures which correspond to the discrete structures;

assigning properties to voxels of the three-dimensional dataset based on the segmented structures wherein the properties to voxels of the three-dimensional dataset are determined by the discrete structures;

presenting, at a first time step, the three-dimensional dataset to a user;

performing a deformation of the three-dimensional dataset based on the assigned properties to voxels wherein the deformation changes at least one of the group consisting of a size of the a segmented structure, a shape of the a segmented structure, a location of a segmented structure, and an orientation of a segmented structure to generate a modified three-dimensional dataset; and

presenting, at a second time step, the modified three-dimensional dataset to the user.

38. The computer-readable medium of claim 37 wherein the step of assigning properties to the voxels of the medical image comprises assigning a value for at least one of: elasticity, ductility, and hardness.

39. The computer-readable medium of claim 37 wherein the step of performing the deformation comprises representing virtual motion.

40. The computer-readable medium of claim 37 wherein the step of performing the simulation comprises representing deformation of tissue.

41. The computer-readable medium of claim 37 wherein the step of performing the simulation comprises representing a radiological dissection.

42. The computer-readable storage device of claim 37 wherein the step of performing the deformation comprises creating new voxels in response to an input.

43. The computer-readable medium of claim 42 wherein the input comprises inserting a virtual volume-subtending surgical object.

44. The computer-readable medium of claim 42 wherein the input comprises inserting a virtual volume-subtending anatomic object.

45. The computer-readable storage device of claim 42 wherein the step of creating new voxels comprises creating new fixed-type voxels that do not change unless acted upon by a user through an interface.

46. The computer-readable storage device of claim 42 wherein the step of creating new voxels comprises creating new invisible-type voxels.

47. The computer-readable medium of claim 42 wherein the step of creating new voxels comprises creating new tissue-type voxels.

48. The computer-readable medium of claim 42 wherein the step of creating new voxels comprises creating new dynamic-type voxels having at least one tissue type property that changes over time.

49. The computer-readable medium of claim 42 wherein the step of creating new voxels comprises creating new mobile voxels that travel through a virtual vascular structure.

50. The computer-readable storage device of claim 37 wherein the step of performing the deformation comprises eliminating selected voxels in response to the input.

51. The computer-readable storage device of claim 50 wherein the instructions comprise inserting strategic elimination points that designate a direction in which voxels are eliminated in discrete steps.

52. The computer-readable storage device of claim 50 wherein the instructions comprise inserting strategic non-elimination points that designate voxels that are preserved from elimination.

53. The computer-readable medium of claim 37 wherein the instructions comprise eliminating tissue type voxels to simulate ablation.

54. The computer-readable medium of claim 37 wherein the instructions comprise assignment of a strategic deformation feature that designates a maximum shift for at least one voxel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2022
From: DOUGLAS, DAVID BYRON; DOUGLAS, ROBERT EDWIN; DOUGLAS, KATHLEEN MARY
To: TIPPING POINT MEDICAL IMAGES, LLC
Reel/Frame 058727/0068 →
Continuity (5)
Continuation In Part 15904092 · Feb 23, 2018
Provisional Application 62695868 · Jul 10, 2018
Provisional Application 62651934 · Apr 3, 2018
Provisional Application 62628527 · Feb 9, 2018
Related Publication 20190251755A1 · Aug 15, 2019
Cited By (15)
US 12,186,028 US 12,201,384 US 12,206,837 US 12,239,385 US 12,290,416 US 12,354,227 US 12,383,369 US 12,412,346 US 12,417,595 US 12,458,411 US 12,461,375 US 12,475,662 US 12,491,044 US 12,502,163 US 12,521,201