IP Library Granted Patent US 10,499,997
Granted Patent B2
US 10,499,997 · App. 15/860,057 · Granted Dec 10, 2019

Systems and methods for surgical navigation

Inventors: Jeremy Weinstein (Santa Clara, CA); Andrei Danilchenko (Miami, FL); Jose Luis Moctezuma de la Barrera (Freiburg, DE)
Assignee: MAKO Surgical Corp.
A61B34/20A61B90/361A61F2/461A61B34/30A61B2034/105A61B2034/107A61B2034/2048A61B2034/2055A61B2034/2057A61B2034/2059A61B2034/2065A61B2034/2068A61B2034/2072A61B2034/252A61B2090/372A61B2090/373A61B2090/395A61B2090/3983A61B2090/502A61F2002/4633
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,499,997
App. No.
15/860,057
Granted
Dec 10, 2019
Kind
B2
Abstract

System and methods for surgical navigation providing mixed reality visualization are provided. The mixed reality visualization depicts virtual images in conjunction with real objects to provide improved visualization to users.

Claims (24)

1. A method of calibrating registration of a HMD coordinate system and a localizer coordinate system, the HMD coordinate system being associated with a head-mounted display and the localizer coordinate system being associated with a surgical navigation localizer, said method comprising the steps of:

obtaining a registration of the HMD coordinate system and the localizer coordinate system such that images displayed by the head-mounted display can be associated with real objects tracked by the localizer;

indicating a registration error to a user using at least one real calibration marker viewable by the user and at least one virtual calibration marker image displayed to the user, wherein the at least one virtual calibration marker image has a congruency with the at least one real calibration marker so that the at least one virtual calibration marker image is capable of being aligned with the at least one real calibration marker whereby a magnitude of misalignment is indicative of the registration error; and

calibrating the registration of the HMD coordinate system and the localizer coordinate system to reduce the registration error by receiving input from the user associated with adjusting a position of the at least one virtual calibration marker image relative to the at least one real calibration marker to better align the at least one virtual calibration marker image with the at least one real calibration marker.

2. The method of claim 1 , wherein the at least one real calibration marker is tracked by the localizer.

3. The method of claim 1 , wherein at least one real object is tracked by the localizer, the at least one real object having a predetermined spatial relationship to the at least one real calibration marker.

4. The method of claim 1 , wherein the method is started in response to the user directing a viewing direction of the user toward the real calibration markers, wherein the head-mounted display is configured to be worn by the user.

5. The method of claim 1 , wherein receiving input from the user comprises receiving input that defines coordinates of the at least one virtual calibration marker image in the localizer coordinate system.

6. A method of calibrating registration of a HMD coordinate system and a localizer coordinate system, the HMD coordinate system being associated with a head-mounted display and the localizer coordinate system being associated with a surgical navigation localizer, said method comprising the steps of:

registering the HMD coordinate system and the localizer coordinate system such that images displayed by the head-mounted display can be associated with real objects tracked by the localizer;

indicating a registration error to the user using a plurality of real calibration markers viewable by the user and a plurality of virtual calibration marker images displayed to the user, wherein the virtual calibration marker images have a congruency with the real calibration markers so that the virtual calibration marker images are capable of being aligned with the real calibration markers whereby a magnitude of misalignment is indicative of the registration error; and

calibrating the registration of the HMD coordinate system and the localizer coordinate system to reduce the registration error by receiving input from the user associated with adjusting positions of the virtual calibration marker images relative to the real calibration markers to better align the virtual calibration marker images with the real calibration markers.

7. The method of claim 6 , wherein the at least one real calibration marker is tracked by the localizer.

8. The method of claim 6 , wherein at least one real object is tracked by the localizer, the at least one real object having a predetermined spatial relationship to the at least one real calibration marker.

9. The method of claim 6 , wherein the step of registering is performed in response to the user directing the head-mounted display toward the real calibration markers.

10. The method of claim 6 , wherein the step of registering is performed in response to the user directing the head-mounted display toward the real calibration markers so that the real calibration markers are within images captured by a camera comprised in the head-mounted display.

11. The method of claim 6 , wherein the step of registering is performed in response to one or more position sensors comprised in the surgical navigation localizer sensing tracking markers comprised in a registration device, wherein the registration device further comprises the real calibration markers.

12. The method of claim 6 , wherein receiving input from the user comprises receiving input that alters coordinates of the virtual calibration marker images in the localizer coordinate system.

13. The method of claim 12 , wherein receiving input from the user comprises receiving input that alters the coordinates by incremental amounts in any one or more of three directions corresponding to x, y and/or z-axes of the localizer coordinate system.

14. The method of claim 6 , wherein the real calibration markers are similar to registration markers used in registering the HMD coordinate system and the localizer coordinate system.

15. The method of claim 1 , wherein the at least one real calibration marker is tracked by the localizer and wherein the method is started in response to the user directing a viewing direction of the user toward the real calibration markers, wherein the head-mounted display is configured to be worn by the user.

16. The method of claim 1 , wherein at least one real object is tracked by the localizer, the at least one real object having a predetermined spatial relationship to the at least one real calibration marker and wherein the method is started in response to the user directing a viewing direction of the user toward the real calibration markers, wherein the head-mounted display is configured to be worn by the user.

17. The method of claim 6 , wherein the at least one real calibration marker is tracked by the localizer and wherein the step of registering is performed in response to the user directing the head-mounted display toward the real calibration markers.

18. The method of claim 6 , wherein at least one real object is tracked by the localizer, the at least one real object having a predetermined spatial relationship to the at least one real calibration marker and wherein the step of registering is performed in response to the user directing the head-mounted display toward the real calibration markers.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2018
From: MOCTEZUMA DE LA BARRERA, JOSE LUIS
To: STRYKER LEIBINGER GMBH & CO. KG
Reel/Frame 047131/0324 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2018
From: STRYKER LEIBINGER GMBH & CO. KG
To: MAKO SURGICAL CORP.
Reel/Frame 047131/0454 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 11, 2018
From: WEINSTEIN, JEREMY; DANILCHENKO, ANDREI
To: MAKO SURGICAL CORP.
Reel/Frame 047131/0633 →
Continuity (2)
Provisional Application 62441713 · Jan 3, 2017
Related Publication 20180185100A1 · Jul 5, 2018
Cited By (18)
US 12,186,028 US 12,201,384 US 12,201,484 US 12,206,837 US 12,239,385 US 12,290,416 US 12,354,227 US 12,383,347 US 12,383,369 US 12,412,346 US 12,417,595 US 12,458,411 US 12,461,375 US 12,467,489 US 12,475,662 US 12,491,044 US 12,502,163 US 12,521,201