IP Library › Granted Patent US 12,414,821
Granted Patent B2
US 12,414,821 · App. 17/128,230 · Granted Sep 16, 2025

System and method for registering operating images

Inventors: Bing-Feng Huang (Kaohsiung, TW); Jin-Yuan Syue (Tainan, TW); Hsiang-Hsiang Choo (Taipei, TW); Chih-Lung Lin (Kaohsiung, TW)
Assignee: METAL INDUSTRIES RESEARCH & DEVELOPMENT CENTRE
A61B34/20A61B6/12A61B6/4441A61B6/5247A61B6/583G01T1/161G06F18/25G06T7/33G06V10/10A61B2034/2057G06T2207/10116G06T2207/30004G06T2207/30196G06T2207/30204G06V2201/03H04N23/54
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,414,821
App. No.
17/128,230
Granted
Sep 16, 2025
Kind
B2
Abstract

A system for registering operating images includes an X-ray imaging machine, a visible-light camera, a rectifier and a computer system. The X-ray imaging machine captures a first X-ray image of the rectifier, and the visible-light camera captures a first visible-light image of the rectifier at the same time. The computer system recognizes the rectifier in the first X-ray image and in the first visible-light image to compute a conversion model between a coordinate system of the X-ray imager and a coordinate system of the visible-light camera. The X-ray imaging machine also captures a second X-ray image of a patient on which a positioning marker is set, and the visible-light camera captures a second visible-light image of the positioning marker. The computer system provides a navigation interface by combining the second X-ray image and the second visible-light image based on the conversion model.

Claims (25)

1. A system for registering operating images, the system comprising:

an X-ray imaging machine;

a visible-light camera disposed on the X-ray imaging machine;

a visible marker, wherein the X-ray imaging machine is configured to capture a first X-ray image of the visible marker, and the visible-light camera is configured to capture a first visible-light image of the visible marker at same time; and

a computer system configured to recognize the visible marker in the first X-ray image and in the first visible-light image to compote a conversion model between a first coordinate system of the X-ray imaging machine and a second coordinate system of the visible-light camera,

wherein the X-ray imaging machine is further configured to capture a second X-ray image of a patient on which a positioning mark is set, and the visible-light camera is configured to capture a second visible-light image of the positioning mark, wherein the second X-ray image is scanned on the patient with the positioning mark is set on, wherein the conversion model is a matrix, wherein the computer system is configured to transform coordinates of the positioning mark in the second visible-light image into coordinates in the second X-ray image based on the matrix,

wherein the computer system is configured to provide a navigation interface by combining the second X-ray image and the second visible-light image based on the conversion model,

wherein the visible marker comprises a pentagon shape with a plurality of metal balls.

2. The system of claim 1 , wherein coordinates of the visible marker in the first coordinate system are represented as a vector X, coordinates of the visible marker in the second coordinate system are represented as a vector Y, and the computer system is configured to compute the conversion model according to an equation (1),

X=T XM Y  (1)

wherein the conversion model is the matrix T XM .

3. The system of claim 1 , wherein the X-ray imaging machine is a C-arm X-ray machine which comprises an emitting terminal and a receiving terminal, and the visible-light camera is disposed on the receiving terminal.

4. The system of claim 1 , further comprising a surgical instrument and an instrument camera which is fixed on the surgical instrument.

5. A method for registering operating images for a computer system, the method comprising:

capturing, by an X-ray imaging machine, a first X-ray image of a visible marker, and capturing, by a visible-light camera, a first visible-light image of the visible marker at same time, wherein the visible-light camera is disposed on the X-ray imaging machine;

recognizing the visible marker in the first X-ray image and in the first visible-light image to compote a conversion model between a first coordinate system of the X-ray imaging machine and a second coordinate system of the visible-light camera;

capturing, by the X-ray imaging machine, a second X-ray image of a patient on which a positioning mark is set;

capturing, by the visible-light camera, a second visible-light image of the positioning mark, wherein the second X-ray image is scanned on the patient with the positioning mark is set on, wherein the conversion model is a matrix, wherein coordinates of the positioning mark in the second visible-light image is transformed into coordinates in the second X-ray image based on the matrix; and

providing a navigation interface by combining the second X-ray image and the second visible-light image based on the conversion model,

wherein the visible marker comprises a pentagon shape with a plurality of metal balls.

6. The method of claim 5 , wherein coordinates of the visible marker in the first coordinate system are represented as a vector X, coordinates of the visible marker in the second coordinate system are represented as a vector Y, and the method further comprises:

computing the conversion model according to an equation (1):

X=T XM Y  (1)

wherein the conversion model is the matrix T XM .

7. The method of claim 5 , wherein the X-ray imaging machine is a C-arm X-ray machine which comprises an emitting terminal and a receiving terminal, and the visible-light camera is disposed on the receiving terminal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 21, 2020
From: HUANG, BING-FENG; SYUE, JIN-YUAN; CHOO, HSIANG-HSIANG; LIN, CHIH-LUNG
To: METAL INDUSTRIES RESEARCH & DEVELOPMENT CENTRE
Reel/Frame 054715/0377 →
Continuity (1)
Related Publication 20220192752A1 · Jun 23, 2022
References Cited (15)
US 6351659B1 · Vilsmeier · 2002 [cited by applicant]
US 10182872B2 · Chang et al. · 2019 [cited by applicant]
US 10512451B2 · Mahfouz · 2019 [cited by applicant]
US 20070270660A1 · Caylor, III et al. · 2007 [cited by applicant]
US 20130066196A1 · Graumann et al. · 2013 [cited by applicant]
US 20150257849A1 · Barth · 2015 [cited by examiner]
US 20180092699A1 · Finley · 2018 [cited by applicant]
US 20190000564A1 · Navab · 2019 [cited by examiner]
US 20210330273A1 · Crawford · 2021 [cited by examiner]
US 20240041558A1 · Siewerdsen · 2024 [cited by examiner]
CN 104000654A · 2014 [cited by applicant]
CN 104619254A · 2015 [cited by applicant]
TW I572316B · 2017 [cited by applicant]
TW I586327B · 2017 [cited by applicant]
TW I605789B · 2017 [cited by applicant]