IP Library › Granted Patent US 11,382,700
Granted Patent B2
US 11,382,700 · App. 16/869,706 · Granted Jul 12, 2022

Extended reality headset tool tracking and control

Inventors: Thomas Calloway (Pelham, NH); Dana Wisniewski (Audubon, PA); Amaya Raphaelson (Upperville, VA); Michael Robinson (Concord, NH)
Assignee: Globus Medical Inc.
A61B34/20G06F3/011G06T7/73A61B2017/00207A61B2034/2057A61B2034/2072A61B2090/365A61B2090/373A61B2090/3937A61B2090/502G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,382,700
App. No.
16/869,706
Filed
May 8, 2020
Granted
Jul 12, 2022
Kind
B2
Examiner
SADIO, INSA
Art Unit
2628
USPC
345/156
Abstract

A surgical tool tracking array can include a first marker holder, a second marker holder, and a tool holder. The first marker holder is configured to couple a first marker to the surgical tracking array in a first plane. The second marker holder is configured to couple a second marker to the surgical tool tracking array in a second plane that is independent and substantially parallel to the first plane. The tool holder is configured to couple a portion of a surgical tool to the surgical tool tracking array in a third plane that is independent from the first plane and the second plane.

Claims (49)

1. A surgical tool tracking array comprising:

a first marker holder configured to couple a first marker to the surgical tool tracking array in a first plane;

a second marker holder configured to couple a second marker to the surgical tool tracking array in a second plane that is at least substantially parallel to the first plane and is spaced apart from the first plane in a direction orthogonal to one of the first and second planes; and

a tool holder configured to couple a portion of a surgical tool to the surgical tool tracking array in a third plane that is spaced part from the first plane and the second plane in a direction orthogonal to one of the first and second planes.

2. The surgical tool tracking array of claim 1 , wherein the third plane is at an angle between 125° and 145° of the first plane and the second plane.

3. The surgical tool tracking array of claim 1 , further comprising:

a third marker holder configured to couple a third marker to the surgical tool tracking array in the second plane; and

a fourth marker holder configured to couple a fourth marker to the surgical tool tracking array in the second plane;

wherein the second marker holder and the third marker holder are positioned along a first line,

wherein the third marker holder and the fourth marker holder are positioned along a second line that is independent from the first line, and

wherein the surgical tool tracking array is identifiable by a position of the third marker holder relative to the second marker holder and the third marker holder.

4. The surgical tool tracking array of claim 1 , further comprising:

a third marker holder configured to couple a third marker to the surgical tool tracking array in the second plane;

a fourth marker holder configured to couple a fourth marker to the surgical tool tracking array in the second plane; and

a fifth marker holder configured to couple a fifth marker to the surgical tool tracking array in the second plane,

wherein the second marker holder and the third marker holder are positioned along a first line,

wherein the fourth marker holder and the fifth marker holder are positioned along a second line that is independent from the first line,

wherein a distance between the second marker holder and the third marker holder is the same as a distance between the fourth marker holder and the fifth marker holder, and

wherein the surgical tool tracking array is identifiable by the distance.

5. The surgical tool tracking array of claim 1 , further comprising:

the first marker coupled to the tracking array by the first marker holder and detectable by a camera tracking system; and

the second marker coupled to the tracking array by the second marker holder and detectable by the camera tracking system.

6. The surgical tool tracking array of claim 5 , wherein the first marker and the second marker are disk markers including a retro-reflective material detectable by the camera tracking system.

7. A method of operating a camera tracking system, the method comprising:

detecting a position of a first marker in a first plane;

detecting a position of a second marker in a second plane that is independent of the first plane and substantially parallel to the first plane;

determining a position of a surgical tool based on the position of the first marker and the position of the second marker.

8. The method of claim 7 , further comprising:

detecting, by the camera tracking system, a position of a third marker in the second plane; and

determining an identity of the surgical tool based on the position of the second maker relative to the position of the third marker.

9. The method of claim 8 , further comprising:

responsive to the position of the first marker, the position of the second marker, and the position of the third marker being detected by a camera associated with an XR headset, determining that a user wearing the XR headset is selecting the surgical tool.

10. The method of claim 9 , wherein determining that the user wearing the XR headset is selecting the surgical tool comprises:

detecting a position of a hand of the user; and

determining that the user wearing the XR headset is selecting the surgical tool based on the position of the hand of the user relative to the position of the of the surgical tool.

11. The method of claim 9 , wherein determining that the user wearing the XR headset is selecting the surgical tool comprises:

determining a length of time that the first marker and the second marker are within view of the camera associated with the XR headset; and

determining that the user wearing the XR headset is selecting the surgical tool based on the length of time exceeding a predetermined amount of time.

12. A surgical system comprising:

an extended reality (“XR”) headset configured to be worn by a user during a surgical procedure and including a see-through display screen configured to display an XR image and to allow at least a portion of a real-world scene to pass therethrough for viewing by the user; and

a tracking system comprising a first camera associated with the XR headset and configured to:

detect a tracking array positioned in a field of view of the user; and

determine that the user is selecting a surgical tool associated with the tracking array based on the tracking array being detected in the field of view of the user; and

an XR headset controller configured to, responsive to determining that the user is selecting the surgical tool, generate the XR image based on information associated with the surgical tool.

13. The surgical system of claim 12 , wherein the camera is further configured to determine that the user is selecting the surgical tool based on determining that the tracking array is in the field of view of the user for a period of time that exceeds a predetermined amount of time.

14. The surgical system of Clam 12 , wherein the camera is further configured to determine that the user is selecting the surgical tool by:

detecting a position of a hand of the user of the XR headset; and

determining that the user is selecting the surgical tool based on a distance between the position of the hand and a position of the tracking array is below a threshold value.

15. The surgical system of claim 12 , wherein the camera tracking system further comprises a second camera configured to, responsive to determining that the user is selecting the surgical tool, track a pose of the surgical tool.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2020
From: CALLOWAY, THOMAS; WISNIEWSKI, DANA; RAPHAELSON, AMAYA; ROBINSON, MICHAEL
To: GLOBUS MEDICAL, INC.
Reel/Frame 052682/0106 →
Continuity (1)
Related Publication 20210346098A1 · Nov 11, 2021
Cited By (37)
US 12,186,028 US 12,201,384 US 12,206,837 US 12,228,987 US 12,235,697 US 12,239,353 US 12,239,385 US 12,290,416 US 12,293,432 US 12,315,036 US 12,354,186 US 12,354,227 US 12,369,994 US 12,376,896 US 12,383,369 US 12,412,346 US 12,417,595 US 12,444,094 US 12,458,411 US 12,461,375 US 12,462,439 US 12,475,662 US 12,488,512 US 12,491,044 US 12,493,996 US 12,502,163 US 12,505,584 US 12,521,201 US 12,629,194 US 12,639,250 US 12,661,188 US 12,670,670 US 12,682,578 US 12,682,579 US 12,697,178 US 12,731,340 US 12,737,991