IP Library Granted Patent US 11,129,681
Granted Patent B2
US 11,129,681 · App. 15/902,420 · Granted Sep 28, 2021

Bone and tool tracking in robotized computer-assisted surgery

Inventors: Louis-Philippe Amiot (Montreal, CA); Pierre Couture (Montreal, CA)
Assignee: ORTHOSOFT ULC
A61B34/20A61B34/10G01B11/25G16H40/60A61B34/30A61B90/96A61B2034/105A61B2034/2048A61B2034/2051A61B2034/2055A61B2034/2057A61B2034/2059A61B2034/2063A61B2034/2065A61B2090/371A61B2090/373
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,129,681
App. No.
15/902,420
Granted
Sep 28, 2021
Kind
B2
Abstract

A system for tracking at least one bone in robotized computer-assisted surgery, comprises a processing unit and a non-transitory computer-readable memory communicatively coupled to the processing unit and comprising computer-readable program instructions executable by the processing unit for: obtaining backscatter images of the at least one bone from a tracking device in a coordinate system; generating a three-dimensional geometry of a surface of the at least one bone from the backscatter images, the three-dimensional geometry of the surface being in the coordinate system; determining a position and orientation of the at least one bone in the coordinate system by matching the three-dimensional geometry of the surface of the at least one bone to a three-dimensional model of the bone; controlling an automated robotized variation of at least one of a position and orientation of the tracking device as a function of a processing of the backscatter images; and continuously outputting the position and orientation of the at least one bone in the coordinate system to a robot driver controlling a robot arm supporting a surgical tool in the coordinate system for altering the bone.

Claims (41)

1. A system for tracking at least one bone in robotized computer-assisted surgery, comprising:

a tracking device on a robotized tracker arm;

a robot arm supporting a surgical tool;

a processing unit; and

a non-transitory computer-readable memory communicatively coupled to the processing unit and comprising computer-readable program instructions executable by the processing unit for:

obtaining backscatter images of the at least one bone from a tracking device in a coordinate system;

generating a three-dimensional geometry of a surface of the at least one bone from the backscatter images, the three-dimensional geometry of the surface being in the coordinate system;

determining a position and orientation of the at least one bone in the coordinate system by matching the three-dimensional geometry of the surface of the at least one bone to a three-dimensional model of the bone;

controlling an automated robotized variation of at least one of a position and orientation of the tracking device on the robotized tracker arm as a function of a processing of the backscatter images; and

continuously outputting the position and orientation of the at least one bone in the coordinate system to a robot driver controlling the robot arm supporting the surgical tool in the coordinate system for altering the bone.

2. The method according to claim 1 , wherein controlling the automated robotized variation comprises identifying an image ratio of the at least one bone relative to environment in the backscatter images and controlling the automated robotized variation to increase the image ratio.

3. The system according to claim 1 , wherein controlling the automated robotized variation comprises creating field of view data indicative of the orientation of the at least one bone relative to the position and orientation of the tracking device, and selecting the position and orientation of the tracking device as a function of a desired point of view of the at least bone.

4. The system according to claim 3 , wherein selecting the position and orientation of the tracking device as a function of a desired point of view of the at least bone includes determining an upcoming location of the surgical tool on the robot arm from a surgical flow of surgery planning.

5. The system according to claim 1 , wherein:

obtaining backscatter images of the at least one bone from the tracking device in the coordinate system comprises obtaining backscatter images of the surgical tool; and

generating the three-dimensional geometry of the surface of the at least one bone from the backscatter images comprises generating a three-dimensional geometry of a surface of the surgical tool from the backscatter images in the coordinate system.

6. The system according claim 5 , wherein continuously outputting the position and orientation of the at least one bone in the coordinate system includes continuously outputting the position and orientation of the surgical tool to the robot driver controlling the robot arm supporting the surgical tool in the coordinate system.

7. The system according to claim 6 , further comprising verifying the position and orientation of the surgical tool obtained from the backscatter images with a position and orientation of the surgical tool provided by the robot driver and outputting a discrepancy.

8. The system according to claim 5 , wherein determining the position and orientation of the at least one bone in the coordinate system includes determining the position and orientation of the surgical tool in the coordinate system by matching the three-dimensional geometry of the surface of the surgical tool to a three-dimensional model of the surgical tool.

9. The system according to claim 1 , wherein obtaining backscatter images of the at least one bone from a tracking device in a coordinate system includes obtaining the backscatter images in a first frequency capture mode when the surgical tool is distal to the bone, and in a second frequency capture mode when the surgical tool is proximal to the bone, the second frequency capture mode being greater than the first frequency capture mode.

10. The system according to claim 9 , wherein obtaining the backscatter images in the first frequency capture mode or the second frequency capture mode includes determining an upcoming location of the surgical tool on the robot arm from a surgical flow of surgery planning.

11. The system according to claim 1 , wherein obtaining the backscatter images of the at least one bone includes obtaining the backscatter images from a point of view on a tool interfacing with an anatomical part surrounding the bone or with the bone.

12. The system according to claim 1 , wherein controlling the automated robotized variation of at least one of the position and orientation of the tracking device includes controlling the robotized tracker arm of the tracking device.

13. The system according to claim 1 , wherein generating the three-dimensional geometry of the surface of the at least one bone from the backscatter images includes generating the three-dimensional geometry of an altered surface, and wherein determining the position and orientation of the at least one bone in the coordinate system includes determining the position and orientation of the altered surface in the bone.

14. The system according to claim 13 , further comprising verifying the position and orientation of altered surface with a position and orientation of a planned altered surface from surgery planning and outputting a discrepancy.

15. The system according to claim 1 , further comprising identifying an interference from the backscatter images of the at least one bone and outputting an indication of interference.

16. The system according to claim 1 , wherein obtaining the backscatter images includes obtaining the backscatter images from visible structured light.

17. A system for tracking at least one bone in robotized computer-assisted surgery, comprising:

a tracking device including at least a structured light source and a camera to generate and obtain the backscatter images, the tracking device being on the robotized tracker arm

a robot arm supporting a surgical tool; and

a computer-assisted surgery controller for

obtaining backscatter images of the at least one bone from the tracking device in a coordinate system,

generating a three-dimensional geometry of a surface of the at least one bone from the backscatter images, the three-dimensional geometry of the surface being in the coordinate system,

determining a position and orientation of the at least one bone in the coordinate system by matching the three-dimensional geometry of the surface of the at least one bone to a three-dimensional model of the bone,

controlling an automated robotized variation of at least one of a position and orientation of the tracking device as a function of a processing of the backscatter images, and

continuously outputting the position and orientation of the at least one bone in the coordinate system to a robot driver controlling the robot arm supporting Hall the surgical tool in the coordinate system for altering the bone.

18. A method for tracking at least one bone in computer-assisted surgery, comprising:

obtaining backscatter images of the at least one bone from a tracking device in a coordinate system, as positioned on a tool interfacing with an anatomical part surrounding the bone or with the bone;

generating a three-dimensional geometry of a surface of the at least one bone from the backscatter images, the three-dimensional geometry of the surface being in the coordinate system;

determining a position and orientation of the at least one bone in the coordinate system by matching the three-dimensional geometry of the surface of the at least one bone to a three-dimensional model of the bone; and

continuously outputting the position and orientation of the at least one bone in the coordinate system to an interface for providing guidance in altering the bone.

Assignments (2)
CONTINUANCE Recorded Oct 22, 2019
From: ORTHOSOFT INC.
To: ORTHOSOFT ULC
Reel/Frame 050791/0237 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 16, 2018
From: AMIOT, LOUIS-PHILIPPE; COUTURE, PIERRE
To: ORTHOSOFT INC.
Reel/Frame 045256/0894 →
Continuity (3)
Provisional Application 62529745 · Jul 7, 2017
Provisional Application 62461995 · Feb 22, 2017
Related Publication 20180235715A1 · Aug 23, 2018
Cited By (4)
US 1,117,755 US 1,120,320 US 12,594,134 US 12,629,307