IP Library › Granted Patent US 11,600,021
Granted Patent B2
US 11,600,021 · App. 16/884,757 · Granted Mar 7, 2023

System and method for calibration between coordinate systems of 3D camera and medical imaging apparatus and application thereof

Inventors: Yu Huang (Beijing, CN); Fanbo Meng (Beijing, CN); Yanran Xu (Beijing, CN)
Assignee: GE Precision Healthcare LLC
G06T7/80A61B5/0035A61B5/0037A61B5/055G06T7/73H04N13/246A61B6/102A61B6/488A61B2560/0238G06T2207/10028G06T2207/30196G06T2207/30204G06T2207/30244
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,600,021
App. No.
16/884,757
Granted
Mar 7, 2023
Kind
B2
Abstract

The present invention relates to a system and a method for calibration between coordinate systems of a 3D camera and a medical imaging apparatus and an application thereof. The calibration system comprises: a calibration tool arranged on a scanning table, wherein the calibration tool is provided with markers and a reference point, the reference point is aligned with a center of the medical imaging apparatus to serve as an origin of the coordinate system of the medical imaging apparatus, and positions of the markers in the coordinate system of the medical imaging apparatus are calculated according to relative positions of the markers with respect to the reference point; a 3D camera for capturing images of the markers and determining positions of the markers in the coordinate system of the 3D camera based on the captured images; and a calculation device for calculating a calibration matrix using the positions of the markers in the coordinate system of the 3D camera and the positions of the markers in the coordinate system of the medical imaging apparatus, and performing calibration between the coordinate system of the 3D camera and the coordinate system of the medical imaging apparatus using the calibration matrix. The method corresponds to the aforementioned system. The present invention further relates to an application of the calibration and a computer-readable storage medium capable of implementing the method and the application.

Claims (38)

1. A system for calibration between a coordinate system of a 3D camera and a coordinate system of a medical imaging apparatus, the system comprising:

a calibration tool arranged on a scanning table in the medical imaging apparatus, wherein the calibration tool is provided with markers and a reference point, the reference point is aligned with a center of the medical imaging apparatus to serve as an origin of the coordinate system of the medical imaging apparatus, and positions of the markers in the coordinate system of the medical imaging apparatus are calculated according to relative positions of the markers with respect to the reference point;

a 3D camera for capturing images of the markers and determining positions of the markers in the coordinate system of the 3D camera based on the captured images; and

a calculation device for using the positions of the markers in the coordinate system of the 3D camera as a first data set, using the positions of the markers in the coordinate system of the medical imaging apparatus as a second data set, calculating a calibration matrix between the coordinate system of the 3D camera and the coordinate system of the medical imaging apparatus based on the first data set and the second data set, and performing calibration between the coordinate system of the 3D camera and the coordinate system of the medical imaging apparatus using the calibration matrix, wherein laser beams emitted by a laser in the medical imaging apparatus intersect the reference point at the center of the medical imaging apparatus, wherein the calibration tool is further provided with two auxiliary lines intersecting at the reference point, the laser beams comprise a first beam and a second beam, and the two auxiliary lines coincide with the first beam and the second beam respectively.

2. The system according to claim 1 , wherein the calibration matrix comprises a rotation matrix, a translation matrix, and a scaling matrix.

3. The system according to claim 1 , wherein the system further comprises:

a checking unit for checking the calibration matrix through comparing a third data set with a fourth data set, wherein

the third data set is positions of the markers in the coordinate system of the medical imaging apparatus which are obtained by calibrating the positions of the markers acquired from the 3D camera through the calibration matrix, and the fourth data set is actual positions of the markers in the coordinate system of the medical imaging apparatus.

4. The system according to claim 3 , wherein in the checking unit, a mean absolute error between the third data set and the fourth data set is calculated, and the mean absolute error is compared with a threshold.

5. The system according to claim 1 , wherein shapes and sizes of the markers are set, and the positions of the markers in the coordinate system of the medical imaging apparatus are calculated according to the relative positions of the markers with respect to the reference point and the set shapes and sizes.

6. The system according to claim 1 , wherein the medical imaging apparatus comprises a CT apparatus, an MR apparatus, a PET apparatus, or a combination of the apparatuses.

7. A method for calibration between a coordinate system of a 3D camera and a coordinate system of a medical imaging apparatus, wherein a calibration tool is arranged on a scanning table in the medical imaging apparatus, and the calibration tool is provided with a reference point and markers, the method comprising:

aligning the reference point with a center of the medical imaging apparatus to serve as an origin of the coordinate system of the medical imaging apparatus;

calculating positions of the markers in the coordinate system of the medical imaging apparatus according to relative positions of the markers with respect to the reference point;

capturing images of the markers through the 3D camera and determining positions of the markers in the coordinate system of the 3D camera based on the captured images;

using the positions of the markers in the coordinate system of the 3D camera as a first data set, and meanwhile using the positions of the markers in the coordinate system of the medical imaging apparatus as a second data set, and calculating a calibration matrix between the coordinate system of the 3D camera and the coordinate system of the medical imaging apparatus based on the first data set and the second data set; and

performing calibration between the coordinate system of the 3D camera and the coordinate system of the medical imaging apparatus using the calibration matrix, wherein laser beams emitted by a laser in the medical imaging apparatus are made to intersect the reference point at the center of the medical imaging apparatus, wherein the calibration tool is further provided with two auxiliary lines intersecting at the reference point, the laser beams comprise a first beam and a second beam, and the two auxiliary lines are made coincide with the first beam and the second beam respectively.

8. The method according to claim 7 , wherein the calibration matrix comprises a rotation matrix, a translation matrix, and a scaling matrix.

9. The method according to claim 7 , further comprising:

checking the calibration matrix through comparing a third data set with a fourth data set, wherein the third data set is positions of the markers in the coordinate system of the medical imaging apparatus which are obtained by calibrating the positions of the markers acquired from the 3D camera through the calibration matrix, and the fourth data set is actual positions of the markers in the coordinate system of the medical imaging apparatus.

10. The method according to claim 9 , wherein in the step of checking the calibration matrix, a mean absolute error between the third data set and the fourth data set is calculated, and the mean absolute error is compared with a threshold.

11. The method according to claim 7 , wherein in the step of calculating positions of the markers in the coordinate system of the medical imaging apparatus, shapes and sizes of the markers are set, and the positions of the markers in the coordinate system of the medical imaging apparatus are calculated according to the relative positions of the markers with respect to the reference point and the set shapes and sizes.

12. The method according to claim 7 , wherein the medical imaging apparatus comprises a CT apparatus, an MR apparatus, a PET apparatus, or a combination of the apparatuses.

13. A scanning positioning method for a medical imaging apparatus, the method comprising:

acquiring a 3D image of a patient to be scanned on a scanning table of the medical imaging apparatus through a 3D camera;

identifying the acquired 3D image to obtain human anatomical structure information of the patient to be scanned;

determining a range to be scanned in the 3D image based on the human anatomical structure information; and

calibrating the range to be scanned in a coordinate system of the 3D camera to a coordinate system of the medical imaging apparatus through the method according to claim 7 .

14. A method for displaying a scanning range, the method comprising:

acquiring key points of the scanning range through a 3D camera;

calibrating positions of the key points in a coordinate system of the 3D camera to positions of the key points in a coordinate system of a medical imaging apparatus through the method according to claim 7 ;

acquiring positions of a start point and an end point of the scanning range in the coordinate system of the medical imaging apparatus according to a predetermined distance between the start point and the end point and the positions of the key points in the coordinate system of the medical imaging apparatus; and

displaying pixel positions of the start point and the end point of the scanning range in a screen of the 3D camera which are obtained through an inverse operation of the calibration matrix.

15. A method for predicting collision of a human body, the method comprising:

acquiring point cloud data of the human body through a 3D camera;

calibrating the point cloud data to a coordinate system of a medical imaging apparatus through the method according to claim 7 ; and

predicting a possibility of collision between the human body and a scanning gantry through comparing positions of the point cloud data in the coordinate system of the medical imaging apparatus with a position of the scanning gantry in the coordinate system of the medical imaging apparatus.

16. A non-transitory computer-readable storage medium, having coded instructions recorded thereon, wherein when the instructions are executed, the method according to claim 7 is implemented.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: HUANG, YU; MENG, FANBO; XU, YANRAN
To: GE PRECISION HEALTHCARE LLC
Reel/Frame 052764/0032 →
Priority Claims (1)
CN 201910506016.2 · Jun 12, 2019 · national
Continuity (1)
Related Publication 20200394821A1 · Dec 17, 2020