IP Library Granted Patent US 11,589,933
Granted Patent B2
US 11,589,933 · App. 16/023,014 · Granted Feb 28, 2023

Guiding a robotic surgical system to perform a surgical procedure

Inventors: Justin Esterberg (Mercer Island, WA); Jeffrey Roh (Seattle, WA)
Assignee: IX INNOVATION LLC
A61B34/30A61B17/1615A61B34/20A61B90/361A61B90/37A61B17/00234A61B17/1622A61B34/74A61B2034/102A61B2034/105A61B2034/107A61B2034/2048A61B2034/256A61B2034/305A61B2090/365A61B2090/371A61B2090/372A61B2090/3937A61B2090/502
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,589,933
App. No.
16/023,014
Filed
Jun 29, 2018
Granted
Feb 28, 2023
Kind
B2
Art Unit
3793
USPC
600/424
Abstract

A robotic surgical system may be used to perform a surgical procedure. Providing guidance for the robotic surgical system includes integrating a Point of View (PoV) surgical drill with a camera to capture a PoV image of a surgical area of a subject patient; displaying an image of the surgical area, based on a viewing angle of the PoV surgical drill, thus enabling the surgeon to operate on the surgical area using the PoV surgical drill. The PoV surgical drill operates based on the surgeon's control of a guidance drill. The content of the images may change based on a change in the viewing angle of the PoV surgical drill.

Claims (31)

1. A method of guiding a robotic surgical drill, the method comprising:

displaying a point of view (PoV) image of an affected area of a subject patient, using a plurality of cameras provided around a periphery of a drill bit of the robotic surgical drill, in a digital display, wherein a field of view of the plurality of cameras includes a PoV image region;

displaying an augmented reality (AR) anatomical image or virtual reality (VR) anatomical image, based on a viewing angle and the PoV image region of the robotic surgical drill;

guiding the robotic surgical drill, remotely, based on the displayed AR or VR anatomical image using a hand-held guidance drill, the hand-held guidance drill being a same type of drill as the robotic surgical drill, wherein the robotic surgical drill tracks maneuvering of the hand-held guidance drill;

updating the displayed AR or VR anatomical image based on a change in the viewing angle and the PoV image region of the robotic surgical drill; and

guiding the robotic surgical drill based on a position and a direction of a virtual version of the robotic surgical drill relative to the updated displayed AR or VR anatomical image.

2. The method of claim 1 , wherein the robotic surgical drill is integrated with at least one LASER device.

3. The method of claim 1 , wherein the guiding of the robotic surgical drill based on the displayed anatomical image is at least partially manual.

4. The method of claim 1 , wherein the guiding of the robotic surgical drill based on the displayed anatomical image is at least partially automatic.

5. The method of claim 1 , wherein the robotic surgical drill comprises an end effector attached to a robotic arm.

6. The method of claim 1 , wherein a movement of the hand-held guidance drill is tracked by an operating table to a surgical drill reference system and a reference holder system.

7. A non-transitory computer-readable medium having executable instructions stored thereon that, when executed, cause one or more processors to:

display a point of view (PoV) image of an affected area of a subject patient, using digital images from a plurality of front-facing cameras provided around a periphery of a drill bit of a robotic surgical drill, in a digital display, wherein a field of view of the plurality of cameras includes a PoV image region;

create references in a Three-Dimensional (3D) space;

display an augmented reality (AR) anatomical image or a virtual reality (VR) anatomical image, based on a viewing angle and the PoV region of the robotic surgical drill in the 3D space;

guide the robotic surgical drill, remotely, based on guided movement of a virtual version of the robotic surgical drill on the displayed AR or VR anatomical image from movement of a hand-held guidance drill, the hand-held guidance drill being a same type of tool as the robotic surgical drill, wherein the robotic surgical drill tracks maneuvering of the hand-held guidance drill;

update the displayed AR or VR anatomical image based on a change in the viewing angle and the PoV image region of the robotic surgical drill; and

guide the robotic surgical drill based on a position and a direction of a guided movement of the virtual version of the robotic surgical drill on the updated displayed AR or VR anatomical image.

8. The computer-readable medium of claim 7 , wherein the robotic surgical drill is integrated with at least one LASER device.

9. The computer-readable medium of claim 7 , wherein the guiding of the robotic surgical drill on the displayed anatomical image is at least partially manual.

10. The computer-readable medium of claim 7 , wherein the guiding of the robotic surgical drill based on the displayed anatomical image is at least partially automatic.

11. The computer-readable medium of claim 7 , wherein the robotic surgical drill comprises an end effector attached to a robotic arm.

12. A system, comprising:

a robotic surgical drill configured to capture a point of view (PoV) image of an affected anatomical area of a subject patient using a plurality of integrated cameras provided around a periphery of a drill bit of the robotic surgical drill, wherein a field of view of the plurality of cameras includes a PoV image region;

a display to display, based on a viewing angle and the PoV image region of the robotic surgical drill, an augmented reality (AR) image or virtual reality (VR) image of the affected anatomical area of the subject patient;

an interface to guide the robotic surgical drill, remotely, based on movement of a virtual version of the robotic surgical drill on the displayed AR or VR image of the affected anatomical area of the subject patient, wherein the interface comprises a hand-held guidance drill, the hand-held guidance drill being a same type of drill as the robotic surgical drill, wherein the robotic surgical drill that is able to be manipulated tracks maneuvering of the hand-held guidance drill; and

an image database to store and update the AR or VR image of the affected anatomical area of the subject patient,

wherein the interface updates guidance for the robotic surgical drill based on updates to the AR or VR image of the affected anatomical area of the subject patient retrieved from the image database.

13. The system of claim 12 , wherein the robotic surgical drill is integrated with at least a LASER device.

14. The system of claim 12 , wherein the guiding of the robotic surgical drill based on the displayed image of the affected anatomical area is at least partially manual.

15. The system of claim 12 , wherein the guiding of the robotic surgical drill based on the displayed image of the affected anatomical area is at least partially automatic.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 19, 2022
From: NAVLAB HOLDINGS II, LLC
To: IX INNOVATION LLC
Reel/Frame 061133/0975 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2020
From: NAVLAB INC
To: NAVLAB HOLDINGS II, LLC
Reel/Frame 053712/0833 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2018
From: ESTERBERG, JUSTIN; ROH, JEFFREY
To: NAVLAB, INC.
Reel/Frame 046239/0024 →
Continuity (4)
Provisional Application 62526439 · Jun 29, 2017
Provisional Application 62528102 · Jul 2, 2017
Provisional Application 62529019 · Jul 6, 2017
Related Publication 20190000570A1 · Jan 3, 2019
Cited By (1)
US 12,533,199