IP Library › Granted Patent US 12,254,643
Granted Patent B2
US 12,254,643 · App. 17/856,297 · Granted Mar 18, 2025

Method and navigation system for registering two-dimensional image data set with three-dimensional image data set of body of interest

Inventors: Sheng-Fang Lin (Taiwan, TW); Ying-Yi Cheng (Taiwan, TW); Chen-Tai Lin (Taiwan, TW); Shan-Chien Cheng (Taiwan, TW)
Assignee: REMEX MEDICAL CORP.
G06T7/344A61B34/10A61B34/20A61B90/36G06T7/0014G06T7/30G06T7/33G06T7/337G06T7/50G06T7/70G06T7/80G06T11/005G06T11/008G06T15/20G06T19/20A61B2034/2057A61B2090/367G06T2200/04G06T2207/10072G06T2207/10081G06T2207/10088G06T2207/10101G06T2207/10121G06T2207/10136G06T2207/30004G06T2207/30012G06T2207/30204G06T2210/41G06T2219/2004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,643
App. No.
17/856,297
Granted
Mar 18, 2025
Kind
B2
Abstract

A method for registering a two-dimensional image data set with a three-dimensional image data set of a body of interest is discloses herein. The method includes the following steps: defining a first vector of a registered virtual camera in a coordinate system of the three-dimensional image data et; obtaining a first transformed vector of an unregistered virtual camera in the coordinate system of the three-dimensional image data set by transforming the first vector of the registered virtual camera through at least one transforming matrix; defining a focal point of the unregistered virtual camera at a reference point of the two-dimensional image data set in the coordinate system of the three-dimensional image data set; and repositioning the unregistered virtual camera according to the first transformed vector and the focal point of the unregistered virtual camera.

Claims (46)

1. A method for registering a two-dimensional image data set with a three-dimensional image data set of a body of interest, the method comprising:

defining a first vector of a registered virtual camera in a coordinate system of the three-dimensional image data set;

obtaining a first transformed vector of an unregistered virtual camera in the coordinate system of the three-dimensional image data set by transforming the first vector of the registered virtual camera through at least one transforming matrix;

defining a focal point of the unregistered virtual camera at a reference point of the two-dimensional image data set in the coordinate system of the three-dimensional image data set; and

repositioning the unregistered virtual camera according to the first transformed vector and the focal point of the unregistered virtual camera for generating an update reconstructed image based on the reposition of the unregistered virtual camera.

2. The method of claim 1 , wherein the first vector is from a position of the registered virtual camera to the focal point of the registered virtual camera.

3. The method of claim 1 , wherein the first vector is defined as a Z axis of the registered virtual camera in the coordinate system of the three-dimensional image data set.

4. The method of claim 1 , the method comprises:

defining a second vector of the registered virtual camera in the coordinate system of the three-dimensional image data set; and

obtaining a second transformed vector of the unregistered virtual camera in the coordinate system of the three-dimensional image data set according to the second vector of the registered virtual camera.

5. The method of claim 3 , wherein a second vector is from a central point to a top edge of a reconstructed image obtained by the registered virtual camera parallel to the reconstructed image.

6. The method of claim 4 , wherein the second vector is defined as a Y axis of the registered virtual camera in the coordinate system of the three-dimensional image data set.

7. The method of claim 1 , wherein the two-dimensional image data set comprises a first and second two-dimensional images, and the at least one transforming matrix comprises a first matrix which functions to transform the coordinate system of the first two-dimensional image to the coordinate system of the second two-dimensional image.

8. The method of claim 1 , wherein the reference point is at a central point of a calibrator module in the two-dimensional image data set in the coordinate system of the three-dimensional image data set.

9. The method of claim 8 , wherein the at least one transforming matrix comprises a second matrix and a third matrix, wherein the second matrix which functions to transform the coordinate system of a reference mark to the coordinate system of the three-dimensional image data set and the third matrix which functions to transform the coordinate system of the reference mark to the coordinate system of a tracker module.

10. The method of claim 1 , further comprising:

generating a first reconstructed image from the unregistered virtual camera which is repositioned corresponding to the three-dimensional image data set with a first spatial parameter;

calculating a reference similarity value according to the first reconstructed image and the two-dimensional image data set;

generating a second reconstructed image from the unregistered virtual camera which is repositioned corresponding to the three-dimensional image data set with a second spatial parameter;

calculating a comparison similarity value according to the second reconstructed image and the two-dimensional image data set; and

comparing the comparison similarity value with the reference similarity value; and

registering the two-dimensional image data set to the three-dimensional image data set if the comparison similarity value is not greater than the reference similarity value.

11. A navigation system for registering a two-dimensional image data set with a three-dimensional image data set of a body of interest, comprising:

a memory, configured to store a plurality of commands; and

a processor, configured to obtain the plurality of commands from the memory to perform following steps:

defining a first vector of a registered virtual camera in a coordinate system of the three-dimensional image data set;

obtaining a first transformed vector of an unregistered virtual camera in the coordinate system of the three-dimensional image data set by transforming the first vector of the registered virtual camera through at least one transforming matrix;

defining a focal point of the unregistered virtual camera at a reference point of the two-dimensional image data set in the coordinate system of the three-dimensional image data set; and

repositioning the unregistered virtual camera according to the first transformed vector and the focal point of the unregistered virtual camera for generating an update reconstructed image based on the reposition of the unregistered virtual camera.

12. The navigation system of claim 11 , wherein the first vector is from a position of the registered virtual camera to the focal point of the registered virtual camera.

13. The navigation system of claim 11 , wherein the first vector is defined as a Z axis of the registered virtual camera in the coordinate system of the three-dimensional image data set.

14. The navigation system of claim 11 , wherein the processor is configured to obtain the plurality of commands from the memory to perform following steps:

defining a second vector of the registered virtual camera in the coordinate system of the three-dimensional image data set;

obtaining a second transformed vector of the unregistered virtual camera in the coordinate system of the three-dimensional image data set according to the second vector of the registered virtual camera.

15. The navigation system of claim 13 , wherein a second vector is from a central point to a top edge of a reconstructed image obtained by the registered virtual camera parallel to the reconstructed image.

16. The navigation system of claim 14 , wherein the second vector is defined as a Y axis of the registered virtual camera in the coordinate system of the three-dimensional image data set.

17. The navigation system of claim 11 , wherein the two-dimensional image data set comprises a first and second two-dimensional images, and the at least one transforming matrix comprises a first matrix which functions to transform the coordinate system of the first two-dimensional image to the coordinate system of the second two-dimensional image.

18. The navigation system of claim 11 , wherein the reference point is at a central point of a calibrator module in the two-dimensional image data set in the coordinate system of the three-dimensional image data set.

19. The navigation system of claim 18 , wherein the at least one transforming matrix comprises a second matrix and a third matrix, wherein the second matrix which functions to transform the coordinate system of a reference mark to the coordinate system of the three-dimensional image data set and the third matrix which functions to transform the coordinate system of the reference mark to the coordinate system of a tracker module.

20. The navigation system of claim 11 , wherein the processor is configured to obtain the plurality of commands from the memory to perform following step:

generating a first reconstructed image from the unregistered virtual camera which is repositioned corresponding to the three-dimensional image data set with a first spatial parameter;

calculating a reference similarity value according to the first reconstructed image and the two-dimensional image data set;

generating a second reconstructed image from the unregistered virtual camera which is repositioned corresponding to the three-dimensional image data set with a second spatial parameter;

calculating a comparison similarity value according to the second reconstructed image and the two-dimensional image data set; and

comparing the comparison similarity value with the reference similarity value; and

registering the two-dimensional image data set to the three-dimensional image data set if the comparison similarity value is not greater than the reference similarity value.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 1, 2022
From: LIN, SHENG-FANG; CHENG, YING-YI; LIN, CHEN-TAI; CHENG, SHAN-CHIEN
To: REMEX MEDICAL CORP.
Reel/Frame 060425/0102 →
Continuity (2)
Provisional Application 63264250 · Nov 18, 2021
Related Publication 20230154018A1 · May 18, 2023
References Cited (21)
US 6470207B1 · Simon et al. · 2002 [cited by applicant]
US 20080089566A1 · Node-Langlois · 2008 [cited by examiner]
US 20090290771A1 · Frank · 2009 [cited by examiner]
US 20110128352A1 · Higgins · 2011 [cited by examiner]
US 20130113802A1 · Weersink · 2013 [cited by examiner]
US 20150117605A1 · Sugiura · 2015 [cited by examiner]
US 20180293805A1 · Wang et al. · 2018 [cited by applicant]
US 20200138518A1 · Lang · 2020 [cited by applicant]
US 20200286222A1 · Essenreiter · 2020 [cited by examiner]
US 20210192759A1 · Lang · 2021 [cited by applicant]
US 20220079675A1 · Lang · 2022 [cited by applicant]
US 20230149083A1 · Lin · 2023 [cited by applicant]
US 20230154021A1 · Lin · 2023 [cited by applicant]
US 20230355309A1 · Grupp, Jr. · 2023 [cited by applicant]
US 20240013412A1 · Aghdasi · 2024 [cited by examiner]
US 20240016576A1 · Borovinskih · 2024 [cited by examiner]
WO 2016182550A1 · 2016 [cited by applicant]
WO 2022202536A1 · 2022 [cited by applicant]
Wein, Wolfgang, “Intensity based rigid 2D-3D registration algorithms for radiation therapy”, Dec. 15, 2003, Retrieved from the internet onFeb. 8, 2023: URL: https://campar.in.tum.de/twiki/pub/Main/WolfgangWein/thesis.pd… [cited by applicant]
Russakoff, D.B., et al., “Fast generation of digitally reconstructed radiographs using attenuation fields with application to 2D-3D image registration”, IEEE Transactions on Medical Imaging, IEEE, USA, vol. 24, No., 11,… [cited by applicant]
Non-Final Office Action Received for U.S. Appl. No. 17/856,301 on Oct. 31, 2024, 25 pgs. [cited by applicant]