IP Library › Granted Patent US 12,213,836
Granted Patent B2
US 12,213,836 · App. 17/431,491 · Granted Feb 4, 2025

Methods and systems for segmentation and rendering of inverted data

Inventors: Paul Sheeran (Woodinville, WA); Thanasis Loupas (Kirkland, WA); Charles Tremblay-Darveau (Seattle, WA)
Assignee: KONINKLIJKE PHILIPS N.V.
A61B8/483A61B8/0866A61B8/5269G06N7/02G06T15/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,213,836
App. No.
17/431,491
Granted
Feb 4, 2025
Kind
B2
Abstract

Systems and methods for preprocessing three dimensional (3D) data prior to generating inverted renders are disclosed herein. The preprocessing may include segmenting the 3D data to remove portions of the data associated with noise such that those portions do not appear in the generated render. The segmentation may include applying a mask to the 3D data. The mask may be generated by sorting data points in the 3D data set into a first set or a second set. In some examples, the 3D data may be filtered prior to generating the mask. In some examples, the mask may be adjusted based on feature recognition. The preprocessing may allow the visualization of hypoechoic regions of interest in a volume.

Claims (33)

1. A method comprising:

sorting data points of a three dimensional (3D) dataset acquired by an ultrasound imaging system into one of a first set or a second set, wherein the 3D dataset defines a first volume;

generating a mask corresponding to the 3D dataset, wherein data points of the mask corresponding to data points of the 3D dataset sorted into the first set are set to a first value and data points of the mask corresponding to data points of the 3D dataset sorted into the second set are set to a second value, wherein an outer boundary of the data points of the mask set to the first value defines a second volume within the first volume;

applying the mask to the 3D dataset such that data points of the 3D dataset corresponding to data points outside the second volume are discarded to generate a subset of the 3D dataset; and

generating an inverted render from the subset of the 3D dataset, wherein generating the inverted render comprises rendering data points representing higher intensity signals with darker pixels than pixels used to render data points representing lower intensity signals,

further comprising filtering the 3D dataset to increase a difference between signal values and noise values prior to sorting the data points of the 3D dataset.

2. The method of claim 1 , wherein the data points of the 3D data set above a threshold value are sorted into the first set and data points of the 3D data set below the threshold value are sorted into the second set.

3. The method of claim 1 , wherein the data points of the 3D data set are further sorted into a third set, wherein data points of the mask corresponding to data points of the 3D dataset sorted into the third set are set to a third value.

4. The method of claim 3 , wherein the data points of the 3D data set sorted into the third set are rendered differently in the inverted render compared to the data points of the 3D data set sorted into the first set or the second set.

5. The method of claim 4 , wherein the data points of the 3D data set sorted into the third set are rendered with a lower opacity value than the data points of the 3D data set sorted into the first set.

6. The method of claim 1 , wherein a threshold value is set based on the filtering.

7. The method of claim 1 , wherein filtering the 3D dataset comprises applying a two-dimensional or three-dimensional smoothing kernel; or applying a histogram equalization and remapping algorithm, or applying an adaptive smoothing algorithm.

8. The method of claim 2 , wherein the threshold value is based on a tissue type being scanned.

9. The method of claim 1 , further comprising:

applying image segmentation to the mask to recognize morphological features that extend from the second volume to the first volume; and

adjusting the second volume to include the morphological features.

10. The method of claim 1 , wherein the sorting the data points is performed by fuzzy logic.

11. The method of claim 1 , wherein sorting the data points is performed by a deep learning algorithm.

12. A system comprising:

a non-transitory computer readable medium including a three dimensional (3D) dataset acquired by an ultrasound imaging system, the dataset defining a volume; and

a processor configured to:

sort data points of the 3D dataset into one of a first set or a second set;

generate a mask corresponding to the 3D dataset, wherein data points of the mask corresponding to data points of the 3D dataset sorted into the first set are set to a first value and data points of the mask corresponding to data points of the 3D dataset sorted into the second set are set to a second value;

determine an outer boundary of the data points of the mask set to the first value;

define a second volume within the first volume based on the outer boundary;

apply the mask to the 3D dataset to discard data points of the 3D dataset corresponding to data points outside the second volume to generate a subset of the 3D dataset; and

generate an inverted render from the subset of the 3D dataset, wherein the inverted render is generated by rendering data points representing higher intensity signals with darker pixels than pixels used to render data points representing lower intensity signals,

wherein the processor is further configured to filter the 3D dataset to increase a difference between signal values and noise values prior to comparing the data points of the 3D dataset to a threshold value.

13. The system of claim 12 , further comprising a user interface configured to receive a user input, wherein the user input defines a threshold value; or

defines a filter applied by the processor to filter the 3D dataset; or

defines the volume of the 3D data set; or

defines a feature to be included in the inverted render; or

sets a contrast of the inverted render or an opacity of the inverted render.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 17, 2021
From: SHEERAN, PAUL; LOUPAS, THANASIS; TREMBLAY-DARVEAU, CHARLES
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 057199/0145 →
Continuity (2)
Provisional Application 62808572 · Feb 21, 2019
Related Publication 20220133278A1 · May 5, 2022
References Cited (18)
US 6443896B1 · Detmer · 2002 [cited by applicant]
US 6530885B1 · Entrekin et al. · 2003 [cited by applicant]
US 11497557B2 · Haslam · 2022 [cited by examiner]
US 20050273009A1 · Deischinger et al. · 2005 [cited by applicant]
US 20060171578A1 · Novak · 2006 [cited by applicant]
US 20100099991A1 · Snyder · 2010 [cited by examiner]
US 20160199036A1 · Pelissier · 2016 [cited by examiner]
US 20180144471A1 · Govindjee · 2018 [cited by examiner]
US 20190114532A1 · Sunwoo · 2019 [cited by examiner]
US 20190130188A1 · Zhou · 2019 [cited by examiner]
US 20200372658A1 · De Winde · 2020 [cited by examiner]
EP 2272434A1 · 2011 [cited by applicant]
JP 2004287603A · 2004 [cited by applicant]
WO 2014168500A1 · 2014 [cited by applicant]
WO 2019145188A1 · 2019 [cited by applicant]
PCT/EP2020/054631 ISR & Written Opinion, Feb. 21, 2020, 15 Page Document. [cited by applicant]
Krucker et al: 3D Spatial Compounding of Ultrasound Images Using Image-Based Nonrigid Registration; Ultrasound in Med. & Biol., vol. 26, No. 9, pp. 1475-1488, 2000. [cited by applicant]
Nagy: “3D/4D Volumetry in the Second and Third Trimester of Pregnancy”; Donald School Journal of Ultrasound in Obstetrics and Gynecology, Apr.-Jun. 2009, 3(2), pp. 18-24. [cited by applicant]