IP Library Granted Patent US 12,266,111
Granted Patent B2
US 12,266,111 · App. 17/534,503 · Granted Apr 1, 2025

Visualization of sub-pleural regions

Inventors: Benj Thomas (Eden Prairie, MN); Samuel Peterson (Topanga, CA); John D. Newell, Jr. (Port Townsend, WA)
Assignee: Vida Diagnostics, Inc.
G06T7/0016A61B6/50G06F18/2413G06T7/50G06T2207/20081G06T2207/20092G06T2207/30061
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,266,111
App. No.
17/534,503
Granted
Apr 1, 2025
Kind
B2
Abstract

A method for visualizing sub-pleural regions of an anatomical structure of interest from a set of volumetric data includes receiving the set of volumetric data representative of the anatomical structure. The anatomical structure can comprise an outer surface and a plurality of sub-pleural regions with each of the plurality of sub-pleural regions being a region of the anatomical structure which is distant from the outer surface by a corresponding sub-pleural depth. The method further includes determine a first sub-pleural region of the anatomical structure of interest and extracting, from the set of volumetric data, the portions of volumetric data representative of the first sub-pleural region. The method also includes rendering a display image based upon the first sub-pleural region and the extracted volumetric data.

Claims (51)

1. A method for visualizing sub-pleural regions of an anatomical structure of interest from a set of volumetric data comprising:

receiving the set of volumetric data representative of the anatomical structure of interest, wherein:

the volumetric data representative of the anatomical structure of interest comprises:

volumetric data representative of an outer surface of the anatomical structure of interest; and

volumetric data representative of each of a plurality of sub-pleural regions of the anatomical structure of interest, the volumetric data representative of each of the plurality of sub-pleural regions being a region of the volumetric data representative of the anatomical structure of interest which is distant from the outer surface by a corresponding sub-pleural depth;

determining a first sub-pleural depth;

determining a first sub-pleural region of the plurality of sub-pleural regions of the anatomical structure of interest based on the determined first sub-pleural depth, the first sub-pleural region being distant from the outer surface of the anatomical structure of interest by the first sub-pleural depth;

based on the determined first sub-pleural region, extracting, from the set of volumetric data, the volumetric data representative of the first sub-pleural region; and

rendering a display image based upon the extracted volumetric data representative of the first sub-pleural region.

2. The method of claim 1 , wherein determining the first sub-pleural depth region-comprises receiving a first depth value.

3. The method of claim 2 , wherein receiving the first depth value comprises receiving a selection of the first depth value from a physician via a user interface.

4. The method of claim 2 , wherein the first depth value is selectable from a plurality of depth values.

5. The method of claim 1 , further comprising presenting the display image to a physician via a display.

6. The method of claim 5 , further comprising:

determining one or more additional features; and

presenting the one or more additional features along with the display image.

7. The method of claim 6 , wherein the one or more additional features comprises

one or more of disease phenotype and disease severity for one or more locations of the

displayed portions of the anatomical structure of interest.

8. The method of claim 6 , further comprising:

receiving a plurality of datasets, each of the plurality of datasets comprising volumetric images with known disease phenotypes and/or disease severity; and

determining the one or more additional features comprises:

comparing the volumetric data representative of the first sub-pleural region to the received plurality of datasets; and

classifying disease phenotypes and/or disease severity in the first sub-pleural region based on the comparisons with the received plurality of datasets.

9. The method of claim 8 , wherein comparing the volumetric data representative of the first sub-pleural region to the received plurality of datasets comprises using a training algorithm.

10. The method of claim 9 , wherein the training algorithm is configured to recognize characteristics present in the volumetric data representative of the first sub-pleural region based on characteristics present in the plurality of datasets.

11. A non-transitory computer readable medium programmed with instructions to cause one or more processors to:

receive a set of volumetric data representative of an anatomical structure of interest comprising volumetric data representative of an outer surface of the anatomical structure of interest and volumetric data representative of each of a plurality of sub-pleural regions of the anatomical structure of interest, the volumetric data representative of each of the plurality of sub-pleural regions being a region of the volumetric data representative of the anatomical structure of interest which is distant from the outer surface by a corresponding sub-pleural depth;

determine a first sub-pleural depth;

determine a first sub-pleural region of the plurality of sub-pleural regions of the anatomical structure of interest based on the determined first sub-pleural depth, the first sub-pleural region being distant from the outer surface of the anatomical structure of interest by the first sub-pleural depth;

based on the determined first sub-pleural region, extract, from the set of volumetric data, the volumetric data representative of the first sub-pleural region; and

render a display image based upon the extracted volumetric data representative of the first sub-pleural region.

12. The non-transitory computer readable medium of claim 11 , wherein the one or more processors are further caused to render a plurality of display images.

13. The non-transitory computer readable medium of claim 12 ,

wherein the set of volumetric data includes volumetric data taken at different points in time, and wherein the plurality of display images comprises display images of the anatomical structure of interest taken at the different points in time.

14. The non-transitory computer readable medium of claim 12 ,

wherein the plurality of display images comprises display images based upon extracted volumetric data representative of a plurality of different sub-pleural regions of the anatomical structure of interest.

15. The non-transitory computer readable medium of claim 12 ,

wherein the plurality of display images comprises display images rendered at a plurality of viewing directions from the set of volumetric data.

16. A system, for visualizing sub-pleural regions of an anatomical structure, the system comprising:

a memory, the memory configured to store volumetric data; and

a processor, the processor configured to:

receive a set of volumetric data representative of an anatomical structure of interest, wherein the anatomical structure of interest comprises an outer surface and a plurality of sub-pleural regions, each of the plurality of sub-pleural regions being a region of the anatomical structure of interest which is distant from the outer surface by a corresponding sub-pleural depth and wherein the volumetric data representative of the anatomical structure of interest comprises volumetric data representative of the outer surface and volumetric data representative of each of the plurality of sub-pleural regions;

determine a first subpleural depth;

determine a first sub-pleural region of the plurality of sub-pleural regions of the anatomical structure of interest, the first sub-pleural region being distant from the outer surface of the anatomical structure of interest by the first sub-pleural depth;

based on the determined first sub-pleural region, extract, from the set of volumetric data, the volumetric data representative of the first sub-pleural region; and

render a display image based upon the extracted volumetric data representative of the first sub-pleural region.

17. The system of claim 16 , wherein rendering the display image further comprises projecting the volumetric data representative of the first sub-pleural region onto the display image.

18. The system of claim 16 , wherein the anatomical structure of interest comprises at least one lung.

19. The system of claim 18 , wherein the outer surface comprises at least one of a lung pleurae or a visceral pleura.

20. The system of claim 16 , wherein each of the plurality of sub-pleural regions is a region which is offset from the surface of the anatomical structure of interest by the corresponding sub-pleural depth in an offset direction normal to the surface of the anatomical structure based on a three-dimensional model of the anatomical structure of interest.

Assignments (5)
SECURITY INTEREST Recorded Oct 10, 2025
From: VIDA DIAGNOSTICS, INC.
To: BROADOAK INCOME FUND, L.P.
Reel/Frame 072536/0164 →
RELEASE OF SECURITY INTEREST Recorded Aug 8, 2024
From: LIVE OAK BANKING COMPANY
To: VIDA DIAGNOSTICS, INC.
Reel/Frame 068224/0809 →
SECURITY INTEREST Recorded Jul 29, 2024
From: VIDA DIAGNOSTICS, INC.
To: WESTERN ALLIANCE BANK
Reel/Frame 068111/0257 →
SECURITY INTEREST Recorded Mar 18, 2024
From: VIDA DIAGNOSTICS, INC.
To: LIVE OAK BANKING COMPANY
Reel/Frame 066812/0125 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2021
From: THOMAS, BENJ; PETERSON, SAMUEL; NEWELL, JOHN D., JR.
To: VIDA DIAGNOSTICS, INC.
Reel/Frame 058234/0481 →
Continuity (2)
Provisional Application 63118808 · Nov 27, 2020
Related Publication 20220172367A1 · Jun 2, 2022
References Cited (122)
US 5558091A · Acker et al. · 1996 [cited by applicant]
US 6380732B1 · Gilboa · 2002 [cited by applicant]
US 6456868B2 · Saito et al. · 2002 [cited by applicant]
US 6466687B1 · Uppaluri et al. · 2002 [cited by applicant]
US 6466815B1 · Saito et al. · 2002 [cited by applicant]
US 6558333B2 · Gilboa et al. · 2003 [cited by applicant]
US 6580938B1 · Acker · 2003 [cited by applicant]
US 6615155B2 · Gilboa · 2003 [cited by applicant]
US 6711429B1 · Gilboa et al. · 2004 [cited by applicant]
US 6775404B1 · Pagoulatos et al. · 2004 [cited by applicant]
US 6807292B1 · Goto et al. · 2004 [cited by applicant]
US 7233820B2 · Gilboa · 2007 [cited by applicant]
US 7274810B2 · Reeves et al. · 2007 [cited by applicant]
US 7338452B2 · Shiina et al. · 2008 [cited by applicant]
US 7611452B2 · Allison et al. · 2009 [cited by applicant]
US 7711167B2 · Kiraly et al. · 2010 [cited by applicant]
US 7760941B2 · Bornemann et al. · 2010 [cited by applicant]
US 8045769B2 · Wiemker et al. · 2011 [cited by applicant]
US 8219179B2 · Ganatra et al. · 2012 [cited by applicant]
US 8428317B2 · Kimia et al. · 2013 [cited by applicant]
US 8611989B2 · Roberts · 2013 [cited by applicant]
US 8700132B2 · Ganatra et al. · 2014 [cited by applicant]
US 9076201B1 · Negahdar et al. · 2015 [cited by applicant]
US 11176666B2 · Peterson et al. · 2021 [cited by applicant]
US 20030029464A1 · Chen et al. · 2003 [cited by applicant]
US 20030051733A1 · Kotmel et al. · 2003 [cited by applicant]
US 20030108853A1 · Chosack et al. · 2003 [cited by applicant]
US 20050182295A1 · Soper et al. · 2005 [cited by applicant]
US 20050228250A1 · Bitter et al. · 2005 [cited by applicant]
US 20050251017A1 · Azar · 2005 [cited by applicant]
US 20050272971A1 · Ohnishi et al. · 2005 [cited by applicant]
US 20060030958A1 · Tschirren et al. · 2006 [cited by applicant]
US 20070003124A1 · Wood et al. · 2007 [cited by applicant]
US 20070053562A1 · Reinhardt et al. · 2007 [cited by applicant]
US 20070078334A1 · Scully et al. · 2007 [cited by applicant]
US 20070092864A1 · Reinhardt et al. · 2007 [cited by applicant]
US 20070223794A1 · Preiss et al. · 2007 [cited by applicant]
US 20070293721A1 · Gilboa · 2007 [cited by applicant]
US 20080205722A1 · Schaefer et al. · 2008 [cited by applicant]
US 20100305463A1 · Macklem et al. · 2010 [cited by applicant]
US 20110071404A1 · Schmitt et al. · 2011 [cited by applicant]
US 20120249546A1 · Tschirren et al. · 2012 [cited by applicant]
US 20120284657A1 · Hafey et al. · 2012 [cited by applicant]
US 20140105472A1 · Yin et al. · 2014 [cited by applicant]
US 20140275952A1 · Monroe et al. · 2014 [cited by applicant]
US 20150238270A1 · Raffy et al. · 2015 [cited by applicant]
US 20150332454A1 · Yin et al. · 2015 [cited by applicant]
US 20150351714A1 · De Backer · 2015 [cited by applicant]
US 20170124771A1 · Canfield et al. · 2017 [cited by applicant]
US 20170278301A1 · Peterson et al. · 2017 [cited by applicant]
US 20190131012A1 · Osawa · 2019 [cited by examiner]
US 20190290225A1 · Dunican et al. · 2019 [cited by applicant]
US 20200085382A1 · Taerum · 2020 [cited by examiner]
US 20210166382A1 · Kanada · 2021 [cited by examiner]
US 20210183054A1 · Guo et al. · 2021 [cited by applicant]
US 20210312616A1 · Thomas et al. · 2021 [cited by applicant]
CN 1395713A · 2003 [cited by applicant]
DE 102005039657A1 · 2007 [cited by applicant]
JP H11318884A · 1999 [cited by applicant]
JP 2004113537A · 2004 [cited by applicant]
JP 2004283373A · 2004 [cited by applicant]
JP 2010541114A · 2010 [cited by applicant]
JP 2014210084A · 2014 [cited by applicant]
WO 03007198A2 · 2003 [cited by applicant]
WO 03086498A2 · 2003 [cited by applicant]
WO 2005007023A2 · 2005 [cited by applicant]
WO 2005119505A2 · 2005 [cited by applicant]
WO 2009103046A2 · 2009 [cited by applicant]
WO WO2017150497A1 · 2017 [cited by examiner]
Machine translation of Iwasawa et al. (WO 2017/150497 A1, Sep. 8, 2017). [cited by examiner]
The Lungs (www.teachmeanatomy.info/thorax/organs/lungs/, retrieved Apr. 4, 2024). [cited by examiner]
Li, “Efficient Optimal Net Surface Detection for Image Segmentation—From Theory to Practice,” M.Sc. Thesis, The University of Iowa, Dec. 2003. [cited by applicant]
Tschirren et al., “Intrathoracic airway trees: segmentation and airway morphology analysis from low-dose CT scans,” IEEE Trans Med Imaging, vol. 12, Dec. 24, 2005, pp. 1529-1539. [cited by applicant]
Tschirren et al., “Matching and anatomical labeling of human airway tree,” IEEE Trans Med Imaging, vol. 12, Dec. 24, 2005, pp. 1540-1547. [cited by applicant]
Tschirren, “Segmentation, Anatomical Labeling, Branchpoint Matching, and Quantitative Analysis of Human Airway Trees in Volumetric CT Images,” Ph.D. Thesis, The University of Iowa, Aug. 2003. [cited by applicant]
Tschirren, “Segmentation, Branchpoint Matching, and Anatomical Labeling of Human Airway Trees in Volumetric CT Images,” Slides from Ph.D. Thesis, The University of Iowa, Jul. 10, 2003. [cited by applicant]
Austin, “Pulmonary emphysema: imaging assessment of lung volume reduction surgery,” Radiology, vol. 212, No. 1, Jul. 1999, pp. 1-3. [cited by applicant]
Auzinger et al., “Vessel Visualization using Curved Surface Reformation,” IEEE Transaction on Visualization and Computer Graphics, vol. 19, No. 12, Dec. 1, 2013, pp. 2858-2867. [cited by applicant]
Brown et al., “CAD in clinical trials: Current role and architectural requirements,” Available online at www.sciencedirect.com, Apr. 20, 2007, 6 pages. [cited by applicant]
Cetti et al., “Collateral ventilation,” Thorax Journal, vol. 61, 2006, pp. 371-373. [cited by applicant]
“COPD Essentials for Health Professionals,” Retrieved from: https://www.nhlbi.nih.gov/health/educational/copd/campaign-materials/html/providercard.htm on Aug. 18, 2014, 2 pages. [cited by applicant]
Frangi, A. et al., “Multiscale Vessel Enhancement Filtering,” MICCAI 1998; 1496 (3), pp. 130-137. [cited by applicant]
Herth et al., “Efficacy Predictors of Lung Volume Reduction with Zephyr Valves in a European Cohort,” European Respiratory Journal, vol. 39, No. 6, Jan. 26, 2012, pp. 1334-1342. [cited by applicant]
Herth, F.J.F. et al., “Endoscopic Lung Volume Reduction,” Respiration, vol. 79, No. 1, 2010, pp. 5-13. [cited by applicant]
Herth et al., “Radiological and clinical outcomes of using Chartis to plan endobronchial valve treatment,” European Respiratory Journal, electronic publication May 3, 2012, retrieved from <http://erj.ersjournals.com/con… [cited by applicant]
Horn, Berthold K. P., “Closed-form solution of absolute orientation using unit quartemions”, Journal of the Optical Society of America A, Apr. 1987, pp. 629-642, vol. 4. [cited by applicant]
“InterVapor—How it Works,” Uptake Medical, Retrieved online from <https://web.archive.org/web/20121124070645/http://www.uptakemedical.com/about-intervapor/how-it-works, dated Nov. 24, 2012, 3 pages. [cited by applicant]
Kanitsar et al., “Advanced Curved Planar Reformation,” IEEE Visualization 2003, Seattle, Washington, Oct. 19-24, 2003, pp. 43-50. [cited by applicant]
Kanitsar, “Curved Planar Reformation for Vessel Visualization,” Dissertation, 2004, 107 pages. [cited by applicant]
Kuhnigk, J-M. et al., “Lung lobe segmentation by anatomy-guided 3D watershed transform,” Proceedings of SPIE Medical Imaging, vol. 4, 2003, pp. 1482-1490. [cited by applicant]
Leotta, Daniel F., “An Efficient calibration Method for Freehand 3-D Ultrasound Imaging Systems”, May 13, 2004, pp. 999-1008, vol. 30, No. 7, Ultrasound in Medicine & Biology, (doi:10.1016/j.ultrasmedbio.2004.5.007). [cited by applicant]
Magnussen, H. et al., “Effect of fissure integrity on lung volume reduction using a polymer sealant* in advanced emphysema,” Thorax, vol. 67, No. 4, 2012, pp. 302-308. [cited by applicant]
Mishima et al., “Complexity of terminal airspace geometry assessed by lung computed tomography in normal subjects and patients with chronic obstructive pulmonary disease,” Proceedings of the National Academy of Sciences… [cited by applicant]
Mistelbauer et al., “Smart super views a knowledge-assisted interface for medical visualization”, 2012 IEEE Conference on Visual Analytics Science and Technology, Oct. 14, 2012, pp. 163-172. [cited by applicant]
Nimura et al., “A study on quantifying COPD severity by combining pulmonary function tests and CT image analysis,” Medical Imaging 2011: Computer-Aided Diagnosis, Mar. 3, 2011, 9 pages. [cited by applicant]
Noppen, Marc, “Collateral Ventilation in End-Stage Emphysema: a Blessing or a Curse for New Bronchoscopic Treatment Approaches (or Both)?” Respiration, vol. 74, No. 5, Jan. 2007, pp. 493-495. [cited by applicant]
Obuchowski, “ROC Analysis,” American Journal of Roentgenology, vol. 184, Feb. 2005, pp. 364-372. [cited by applicant]
Odry et al., “Automated detection of mucus plugs within bronchial tree in MSCT images,” Proceedings of SPIE, vol. 6511, Mar. 2007, 10 pages. [cited by applicant]
Pu, J. et al., “Computerized assessment of pulmonary fissure integrity using high resolution CT,” Medical Physics, vol. 37, No. 9, Sep. 2010, pp. 4661-4672. [cited by applicant]
Pu, J. et al., “Pulmonary Lobe Segmentation in CT Examinations Using Implicit Surface Fitting,” IEEE Transactions on Medical Imaging, vol. 28, No. 12, Dec. 2009, pp. 1986-1996, Abstract and author manuscript provided. [cited by applicant]
Reymond et al., Prediction of Lobar Collateral Ventilation in 25 Patients with Severe Emphysema by Fissure Analysis with CT, AJR—American Journal of Roentgenology (2013), vol. 201, No. 4, pp. W571-W575, AARS, Virginia. [cited by applicant]
Riquet, M. et al., “Lung cancer invading the fissure to the adjacent lobe: more a question of spreading mode than a staging problem,” European Journal of Cardio-Thoracic Surgery, vol. 41, 2012, pp. 1047-1051. [cited by applicant]
Rodarte, J.R. et al., “Regional lung strain in dogs during deflation from total lung capacity,” Journal of Applied Physiology, vol. 85, 1985, pp. 164-172. [cited by applicant]
Saroul et al., “Exploring curved anatomic structures with surface sections,” IEEE Visualization 2003, Annual IEEE Conference on Visualization, New York, NY, Oct. 19, 2003, pp. 27-34. [cited by applicant]
Saroul, “Surface Extraction and Flattening for Anatomical Visualization,” Thesis No. 3575, University of Saint-Etienne, France, 2006, 135 pages. [cited by applicant]
Sciurba et al., “A Randomized Study of Endobronchial Valves for Advanced Emphysema,” The New England Journal of Medicine, vol. 363, No. 13, Sep. 23, 2010, pp. 1233-1244. [cited by applicant]
Sterman, D.H. et al., “A multicenter Pilot Study of a Bronchial Valve for the Treatment of Severe Emphysema,” Respiration, vol. 79, No. 3, 2010, pp. 222-233. [cited by applicant]
Strange, C. et al., “Design of the Endobronchial Valve for Emphysema Palliation Trial (VENT): a non-surgical method of lung volume reduction,” BMC Pulmonary Medicine, vol. 7, Jul. 3, 2007, 12 pages. [cited by applicant]
The National Lung Screening Trial Research Team, “Reduced Lung-Cancer Mortality with Low-Dose Computed Tomographic Screening,” The New England Journal of Medicine, vol. 365, No. 5, Aug. 4, 2011, pp. 395-409. [cited by applicant]
Ukil, S. et al., “Anatomy-Guided Lung Lobe Segmentation in X-Ray CT Images,” IEEE Transactions on Medical Imaging, vol. 28, No. 2, Feb. 2009 pp. 202-214, Abstract only. [cited by applicant]
Van Rikxoort, E.M. et al., “Automatic Segmentation of Pulmonary Segments From Volumetric Chest CT Scans,” IEEE Transactions on Medical Imaging, vol. 28, No. 4, Apr. 2009, pp. 621-630, Abstract only. [cited by applicant]
Van Rikxoort, E. et al., “A method for the automatic quantification of the completeness of pulmonary fissures: evaluation in a database of subjects with severe emphysema,” European Radiology, vol. 22, 2012, pp. 302-309. [cited by applicant]
Venuta et al., “Long-term follow-up after bronchoscopic lung volume reduction in patients with emphysema,” European Respiratory Journal, vol. 39, No. 5, 2012, pp. 1084-1089. [cited by applicant]
Washko G.R. et al., “Physiological and Computed Tomographic Predictors of Outcome from Lung Volume Reduction Surgery,” American Journal of Respiratory and Critical Care Medicine, vol. 181, No. 5, 2010, pp. 494-5000. [cited by applicant]
Wiemker et al., “Unsupervised Extraction of the Pulmonary Interlobar Fissures from High Resolution Thoracic CT Data,” International Congress Series 1281, 2005, pp. 1121-1126. [cited by applicant]
Witten et al., “Data Mining: Practical Machine Learning Tools and Techniques,” Morgan Kaufmann Publishers, Burlington, MA, 2011, Third Edition. [cited by applicant]
Yee et al., “Animated exploration of dynamic graphs with radial layout”, INFOVIS 2001 IEEE Symposium on Information Visualization, Jan. 1, 2001, pp. 43-50. [cited by applicant]
Yu et al., “System for the analysis and visualization of large 3D anatomical trees”, Computers in Biology and Medicine, vol. 37, No. 12, Oct. 17, 2007, pp. 1802-1820. [cited by applicant]
Yuan et al., “Quantification of lung surface area using computed tomography,” Respiratory Research, vol. 11, No. 153, 2010, 9 pages. [cited by applicant]
Zach et al., “Correlations of CT Low Attenuation Cluster Size with Visually Assessed Extent and Pattern of Emphysema,” ATS, 2013, 1 page. [cited by applicant]
Zhou, X. et al., “Automatic recognition of lung lobes and fissures from multi-slice CT images, ” Proceedings of SPIE Medical Imaging, vol. 5370, 2004, pp. 1629-1633. [cited by applicant]
Valipour et al., “Patterns of Emphysema Heterogeneity,” Respiration, Oct. 3, 2015, 10 pages. [cited by applicant]