IP Library Granted Patent US 9,827,053
Granted Patent B2
US 9,827,053 · App. 15/173,512 · Granted Nov 28, 2017

Intraoperative tracking method

Inventors: Chieh-Hsiao Chen (Taichung, TW); Kuan-Ju Wang (Hsinchu County, TW)
A61B34/10A61B34/30A61B2034/105A61B2034/107A61B2090/364A61B2090/376A61B2090/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,827,053
App. No.
15/173,512
Granted
Nov 28, 2017
Kind
B2
Abstract

One example method to determine an actual surgical pathway of a patient based on a planned surgical pathway may include retrieve a first two-dimensional image of the patient associated with information collected at a first point in time. A first coordinate system describes a spatial relationship between the patient and an apparatus in an operating room. The method further includes modifying a three-dimensional model of the patient including the planned surgical pathway with a first set of modification parameter values. A second coordinate system describes the three-dimensional model constructed by information collected at a second point in time earlier than the first point in time. The method further includes retrieving a second two-dimensional image from the modified three-dimensional model, computing a first correlation between the first two-dimensional image and the second two-dimensional image; and transforming the planned surgical pathway to the first coordinate system based on the first set of modification parameter values to identify the actual surgical pathway.

Claims (48)

1. A method to determine an actual surgical pathway of a patient based on a planned surgical pathway, comprising:

retrieving a first two-dimensional image of the patient associated with information collected at a first point in time, wherein a spatial relationship between the patient and an apparatus in an operating room is described by a first coordinate system;

modifying a three-dimensional model of the patient including the planned surgical pathway with a first set of modification parameter values, wherein the three-dimensional model is described by a second coordinate system and constructed by information collected at a second point in time earlier than the first point in time;

retrieving a second two-dimensional image from the modified three-dimensional model;

computing a first correlation between the first two-dimensional image and the second two-dimensional image; and

in response to the first correlation exceeding a threshold, transforming the planned surgical pathway in the second coordinate system to the first coordinate system based on the first set of modification parameter values to determine the actual surgical pathway.

2. The method of claim 1 , wherein the modifying the three-dimensional model includes scaling the three-dimensional model, rotating the three-dimensional model or moving the three-dimensional model based on the set of modification parameter values.

3. The method of claim 1 , wherein the second two-dimensional image is a projection of the modified three-dimensional model.

4. The method of claim 1 , wherein the patient is on an operating table in the operating room at the first point in time, and the patient is under a medical image scan at the second point in time.

5. The method of claim 1 , in response to the first correlation not exceeding the threshold, further comprising:

modifying the three-dimensional model of the patient including the planned surgical pathway with a second set of modification parameter values,

retrieving a third two-dimensional image from the three-dimensional model modified with the second set of modification parameter values;

computing a second correlation between the first two-dimensional image and the third two-dimensional image; and

in response to the second correlation exceeding a threshold, transforming the planned surgical pathway in the second coordinate system to the first coordinate system based on the second set of modification parameter values to identify the actual surgical pathway.

6. The method of claim 1 , further comprising performing edge detection on the first two-dimensional image and the second two-dimensional image.

7. The method of claim 6 , wherein the edge detection is performed before the computation of the correlation.

8. A non-transitory computer-readable storage medium containing a set of executable instructions which, in response to execution by a processor in one of one or more surgical system, cause the processor to perform a method to determine an actual surgical pathway of a patient based on a planned surgical pathway, the method comprising:

retrieving a first two-dimensional image of the patient associated with information collected at a first point in time, wherein a spatial relationship between the patient and an apparatus in an operating room is described by a first coordinate system;

modifying a three-dimensional model of the patient including the planned surgical pathway with a first set of modification parameter values, wherein the three-dimensional model is described by a second coordinate system and constructed by information collected at a second point in time earlier than the first point in time;

retrieving a second two-dimensional image from the modified three-dimensional model;

computing a first correlation between the first two-dimensional image and the second two-dimensional image; and

in response to the first correlation exceeding a threshold, transforming the planned surgical pathway in the second coordinate system to the first coordinate system based on the first set of modification parameter values to identify the actual surgical pathway.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the modifying the three-dimensional model includes scaling the three-dimensional model, rotating the three-dimensional model or moving the three-dimensional model based on the set of modification parameter values.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the second two-dimensional image is a projection of the modified three-dimensional model.

11. The non-transitory computer-readable storage medium of claim 8 , wherein the patient is on an operating table in the operating room at the first point in time, and the patient is under a medical image scan at the second point in time.

12. The non-transitory computer-readable storage medium of claim 8 , in response to the first correlation not exceeding the threshold, the method further comprising:

modifying the three-dimensional model of the patient including the planned surgical pathway with a second set of modification parameter values,

retrieving a third two-dimensional image from the three-dimensional model modified with the second set of modification parameter values;

computing a second correlation between the first two-dimensional image and the third two-dimensional image; and

in response to the second correlation exceeding a threshold, transforming the planned surgical pathway in the second coordinate system to the first coordinate system based on the second set of modification parameter values to identify the actual surgical pathway.

13. The non-transitory computer-readable storage medium of claim 8 , the method further comprising performing edge detection on the first two-dimensional image and the second two-dimensional image.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the edge detection is performed before the computation of the correlation.

15. A surgical system configured to determine an actual surgical pathway of a patient based on a planned surgical pathway, comprising:

a storage system;

a robotic arm;

an image collection apparatus; and

a processor, wherein the processor is configured to

retrieve a first two-dimensional image of the patient associated with information collected by the image collection apparatus at a first point in time from the storage system, wherein a spatial relationship between the patient and the robotic arm is described by a first coordinate system;

modify a three-dimensional model of the patient including the planned surgical pathway with a first set of modification parameter values, wherein the three-dimensional model is described by a second coordinate system and constructed by information collected at a second point in time earlier than the first point in time;

retrieve a second two-dimensional image from the modified three-dimensional model from the storage system;

compute a first correlation between the first two-dimensional image and the second two-dimensional image;

in response to the first correlation exceeding a threshold, transform the planned surgical pathway in the second coordinate system to the first coordinate system based on the first set of modification parameter values to identify the actual surgical pathway; and

instruct the robotic arm to perform the surgery based on the actual surgical pathway.

16. The system of claim 15 , wherein the three-dimensional model is modified with a scaling factor, a rotation degree, and/or a translation vector.

17. The system of claim 15 , wherein the image collection apparatus is fixed with the robotic arm.

18. The system of claim 15 , wherein the image collection apparatus is configured to take a plurality of images while the robotic arm is moving.

19. The system of claim 15 , wherein the patient is on an operating table in the operating room at the first point in time, and the patient is under a medical image scan at the second point in time.

20. The system of claim 15 , wherein the processor is further configured to perform an edge detection operation on the first two-dimensional image and the second two-dimensional image.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2022
From: CHEN, CHIEH-HSIAO; WANG, KUAN JU
To: BRAIN NAVI BIOTECHNOLOGY CO., LTD.
Reel/Frame 060251/0597 →
Continuity (2)
Provisional Application 62171245 · Jun 5, 2015
Related Publication 20160354157A1 · Dec 8, 2016