IP Library Granted Patent US 12,657,694
Granted Patent B2
US 12,657,694 · App. 17/792,526 · Granted Jun 16, 2026

Image enhancement based on fiber optic shape-sensing

Inventors: Torre Michelle Bydlon (Melrose, MA); Molly Lara Flexman (Melrose, MA); Raoul Florent (Ville D'Avray, FR); Roland Wilhelmus Maria Bullens (Mierlo, NL)
Assignee: KONINKLIJKE PHILIPS N.V.
G06T7/0012G06V10/25G06T2207/10116G06T2207/20172G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,657,694
App. No.
17/792,526
Granted
Jun 16, 2026
Kind
B2
Abstract

The present invention relates to an image processing system ( 10 ), comprising: a processor unit ( 20 ) arranged to receive imaging data associated with an imaging system ( 40 ) and optical shape sensing data associated with an optical shape sensing system ( 50 ) registered with the imaging system ( 40 ) such that the optical shape sensing data can be positioned in the imaging system; wherein the processor unit ( 20 ) is configured to define in the imaging data a region of interest based on the imaging data and/or the optical shape sensing data and further configured to use the optical shape sensing data as markers within the region of interest such that the processor unit applies image enhancement of imaging data on the region of interest based on received optical shape sensing data.

Claims (31)

1 . An image processing system, comprising:

a processor unit arranged to receive imaging data associated with an imaging system and optical shape sensing data associated with an optical shape sensing system registered with the imaging system, such that the optical shape sensing data can be positioned in the imaging data, wherein the imaging data comprise a series of X-Ray images taken by the imaging system; and

wherein the processor unit is configured to define in the imaging data a region of interest based on the imaging data and/or the optical shape sensing data and is further configured to use the optical shape sensing data as markers within the region of interest such that the processor unit applies image enhancement of the series of X-Ray images of the region of interest based on received optical shape sensing data, the image enhancement comprises motion compensation in the series of X-ray images based on the received optical shape sensing data; wherein the markers: are nodes with position and shape used directly as localizers for co-registering the series of X-ray images with each other for motion compensation; or the markers establish a region in which predetermined image localizers can be searched in the series of X-ray images for co-registering the series of X-ray images for motion compensation.

2 . The image processing system according to claim 1 , wherein the series of X-Ray images are a series of contrast-enhanced X-Ray images of the region of interest taken by the imaging system.

3 . The image processing system according to claim 1 , wherein the processor unit is configured to search and identify the markers in terms of restricting the markers a subgroup of markers located on a pathway for an interventional instrument.

4 . The image processing system according to claim 1 , wherein the processor unit is configured to define the region of interest based on a location of a balloon, a stent, an endograft or an interventional instrument.

5 . The image processing system according to claim 1 , wherein the processor unit is configured to use the optical shape sensing data to filter-out frames of the imaging system that are out of plane.

6 . The image processing system according to claim 1 , wherein the processor unit is configured to use the optical shape sensing data in between at least two markers to evaluate a shape change of an interventional instrument.

7 . The image processing system according to claim 1 , wherein the processor unit is arranged to receive imaging data associated with the imaging system in terms of a computed tomography system or a magnetic resonance imaging system or an ultrasound or an optical imaging system or a X-ray imaging system or a medical imaging system or a diagnostic imaging system.

8 . The image processing system according to claim 1 , wherein the processor unit is configured to identify markers in series of X-ray images taken by the imaging system.

9 . The image processing system according to claim 8 , wherein the series of X-ray images taken by the imaging system is part of the applied image enhancement on the region of interest.

10 . An imaging system configured to communicate with the image processing system according to claim 9 .

11 . An optical shape sensing system configured to communicate with the image processing system according to claim 9 .

12 . A method for embedding fiber optic shape sensing in a medical imaging device, the method comprising:

receiving imaging data associated with an imaging system and optical shape sensing data associated with an optical shape sensing system registered with the imaging system such that the optical shape sensing data can be positioned in the imaging data by a processor unit, wherein the imaging data comprise a series of X-Ray images taken by the imaging system;

defining, in the imaging data, a region of interest based on the imaging data and/or the optical shape sensing data and further using the optical shape sensing data as markers within the region of interest such that the processor unit applies image enhancement of the series of X-Ray images of the region of interest based on received optical shape sensing data by the processor unit, wherein the image enhancement comprises motion compensation in the series of X-ray images based on the received optical shape sensing data; wherein said markers: are nodes with position and shape used directly as localizers for co-registering the series of X-ray images with each other for motion compensation; or the markers establish a region in which predetermined image localizers can be searched in the series of X-ray images for co-registering the series of X-ray images for motion compensation;

receiving optical shape sensing data of the optical shape sensing fiber by the processor; and

applying co-registering and motion compensation on the region of interest based on the received optical shape sensing data by the processor.

13 . The method according to claim 12 , wherein the method further comprises the step of applying the image enhancement to a series of contrast-enhanced X-Ray images of the region of interest taken by the imaging system.

14 . The method according to claim 12 , wherein the method further comprises the step of applying searching and identifying the markers in terms of restricting the markers a subgroup of markers located on pathway for an interventional instrument.

15 . A non-transitory computer storage medium that stores instructions, which when executed by a processor, causes the processor to:

receive imaging data associated with an imaging system and optical shape sensing data associated with an optical shape sensing system registered with the imaging system such that the optical shape sensing data adapted to be positioned in the imaging data, wherein the imaging data comprise a series of X-Ray images taken by the imaging system;

define, in the imaging data, a region of interest based on the imaging data and/or the optical shape sensing data and further using the optical shape sensing data as markers within the region of interest such that the processor applies image enhancement of the series of X-Ray images of the region of interest based on received optical shape sensing data, the image enhancement comprising motion compensation in the series of X-ray images based on the received optical shape sensing data, wherein markers:

are nodes with position and shape used directly as localizers for co-registering the series of X-ray images for motion compensation, or the markers establish a region in which predetermined image localizers can be searched in the series of X-ray images for co-registering the series of X-ray images with each other for motion compensation;

optical shape sensing data of the optical shape sensing fiber; and

apply image co-registering and motion compensation on the region of interest based on the received receive optical shape sensing data.

16 . The non-transitory computer readable medium according to claim 15 , wherein the series of X-Ray images a series of contrast-enhanced X-Ray images of the region of interest taken by the imaging system.

17 . The non-transitory computer readable medium according to claim 15 , wherein the instructions further cause the processor to search and identify the markers in terms of restricting the markers a subgroup of markers located on a pathway for an interventional instrument.

18 . The non-transitory computer readable medium according to claim 15 , wherein the instructions further cause the processor to define the region of interest based on a location of a balloon, a stent, an endograft or an interventional instrument.

19 . The non-transitory computer readable medium according to claim 15 , wherein the instructions further cause the processor to use the optical shape sensing data to filter-out frames of the imaging system that are out of plane.

20 . The non-transitory computer readable medium according to claim 15 , wherein the instructions further cause the processor to use the optical shape sensing data in between at least two markers to evaluate a shape change of an interventional instrument.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2022
From: BYDLON, TORRE MICHELLE; FLEXMAN, MOLLY LARA; FLORENT, RAOUL; BULLENS, ROLAND WILHELMUS MARIA
To: KONINKLIJKE PHILIPS N.V.
Reel/Frame 060495/0250 →
Continuity (2)
Provisional Application 62960964 · Jan 14, 2020
Related Publication 20230005135A1 · Jan 5, 2023
References Cited (19)
US 7289652B2 · Florent · 2007 [cited by applicant]
US 8000507B2 · Rongen · 2011 [cited by applicant]
US 9918659B2 · Chopra · 2018 [cited by applicant]
US 11064955B2 · Klinder · 2021 [cited by examiner]
US 11610329B2 · Ekin · 2023 [cited by examiner]
US 11779396B2 · Duindam · 2023 [cited by examiner]
US 20090169080A1 · Noordhoek · 2009 [cited by examiner]
US 20130308137A1 · Manzke · 2013 [cited by examiner]
US 20170265946A1 · Ramachandran · 2017 [cited by examiner]
US 20170281293A1 · Verstege · 2017 [cited by applicant]
US 20180008352A1 · Flexman · 2018 [cited by applicant]
US 20180206807A1 · Baruth · 2018 [cited by examiner]
US 20180256131A1 · Bracken · 2018 [cited by applicant]
US 20190213940A1 · Veidhes et al. · 2019 [cited by applicant]
US 20190346319A1 · Bydlon · 2019 [cited by applicant]
WO 2003045263A2 · 2003 [cited by applicant]
WO WO2013144912A1 · 2013 [cited by examiner]
International Search Report and Written Opinion of PCT/EP2021/050399, dated Mar. 12, 2021. [cited by applicant]
Mishell, Jacob M. et al.“Determination of Adequate Coronary Stent Expanion using StentBoost, a Novel Fluoroscopic Image Processing Technique”, Catheterization and Cardiovascular Interventions, vol. 69, 2007, pp. 84-93. [cited by applicant]