IP Library › Granted Patent US 12,003,869
Granted Patent B2
US 12,003,869 · App. 18/213,360 · Granted Jun 4, 2024

Systems and methods for tracking objects

Inventors: Jochen Breisacher (Teningen, DE); David Hofmann (Freiburg, DE); Emeric Umbdenstock (Freiburg, DE); Jonathan Morgan (Biscayne Park, FL); Paul Hoekstra (Kalamazoo, MI)
Assignee: MAKO Surgical Corp.
H04N25/44A61B34/20H04N23/60H04N23/61H04N25/40H04N25/443A61B2034/2046A61B2034/2055A61B2034/2057A61B2034/2065A61B34/70H04N23/695H04N25/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,003,869
App. No.
18/213,360
Granted
Jun 4, 2024
Kind
B2
Abstract

Systems and methods to track an object within an operating room with a camera unit. The camera unit includes a first optical sensor with sensing elements to sense light in a near-infrared spectrum and a second optical sensor to sense light in a visible light spectrum. A controller is in communication with the first and second optical sensors. The controller obtains, from the second optical sensor, data related to the object within the operating room. The controller modifies control of the sensing elements of the first optical sensor based on the data of the object obtained by the second optical sensor.

Claims (36)

1. A surgical navigation system for tracking an object within an operating room, the surgical navigation system comprising:

a camera unit comprising:

a housing;

a first optical sensor coupled to housing and comprising sensing elements adapted to sense light in a near-infrared spectrum;

a second optical sensor coupled to the housing and being adapted to sense light in a visible light spectrum; and

a controller in communication with the first and second optical sensors, and wherein the controller is configured to:

obtain, from the second optical sensor, data related to the object within the operating room; and

modify control of the sensing elements of the first optical sensor based on the data of the object obtained by the second optical sensor.

2. The surgical navigation system of claim 1 , wherein the data related to the object within the operating room comprises one or more of (1) a type of the object (2) a pose data of the object, and/or (3) an expected movement of the object.

3. The surgical navigation system of claim 2 , wherein the controller is configured to modify control of the sensing elements to activate a subset of the sensing elements, the subset being less than all of the sensing elements.

4. The surgical navigation system of claim 2 , wherein the controller is configured to modify control of the sensing elements to prevent processing of a subset of the sensing elements, the subset being less than all of the sensing elements.

5. The surgical navigation system of claim 2 , wherein the controller is configured to modify control of the sensing elements to adjust a size of a field-of-view viewed by the first optical sensor.

6. The surgical navigation system of claim 2 , wherein the controller is configured to modify control of the sensing elements to define a size and/or position of a region-of-interest viewed by the first optical sensor, the region-of-interest being a sub-region within a full field-of-view of the first optical sensor.

7. The surgical navigation system of claim 2 , wherein the controller is configured to modify control of the sensing elements by adjusting a frequency by which the sensing elements are read-out.

8. The surgical navigation system of claim 2 , wherein the pose data of the object includes one or more of: a velocity of the object and/or an acceleration of the object.

9. The surgical navigation system of claim 1 , wherein the camera unit comprises two first optical sensors coupled to the housing and each comprising the sensing elements adapted to sense light in the near-infrared spectrum.

10. The surgical navigation system of claim 9 , wherein the camera unit comprises:

a rigid support structure disposed within the housing and being configured to support the two first optical sensors, and wherein the two first optical sensors are spaced apart from one another on the rigid support structure; and

the second optical sensor rigidly supported by the housing relative to the two first optical sensors in a predefined relationship.

11. The surgical navigation system of claim 9 , wherein the housing has an elongated shape defining a first end and an opposing second end, and wherein one of the first optical sensors is disposed adjacent to the first end of the housing and the other one of the first optical sensors is disposed adjacent to the opposing second end of the housing.

12. A method of operating a surgical navigation system for tracking an object within an operating room, the surgical navigation system comprising a camera unit comprising a housing, a first optical sensor coupled to housing and comprising sensing elements adapted to sense light in a near-infrared spectrum, a second optical sensor coupled to the housing and being adapted to sense light in a visible light spectrum, and a controller in communication with the first and second optical sensors, the method comprising the controller performing the steps of:

obtaining, from the second optical sensor, data related to the object within the operating room; and

modifying control of the sensing elements of the first optical sensor based on the data of the object obtained by the second optical sensor.

13. The method of claim 12 , comprising the controller obtaining the data related to the object as being one or more of: (1) a type of the object (2) a pose data of the object, and/or (3) an expected movement of the object.

14. The method of claim 13 , comprising the controller modifying control of the sensing elements by activating a subset of the sensing elements, the subset being less than all of the sensing elements.

15. The method of claim 13 , comprising the controller modifying control of the sensing elements by preventing processing of a subset of the sensing elements, the subset being less than all of the sensing elements.

16. The method of claim 13 , comprising the controller modifying control of the sensing elements for adjusting a size of a field-of-view viewed by the first optical sensor.

17. The method of claim 13 , comprising the controller modifying control of the sensing elements for defining a size and/or position of a region-of-interest viewed by the first optical sensor, the region-of-interest being a sub-region within a full field-of-view of the first optical sensor.

18. The method of claim 13 , comprising the controller modifying control of the sensing elements by adjusting a frequency by which the sensing elements are read-out.

19. The method of claim 13 , comprising the controller obtaining the pose data of the object as being one or more of: a velocity of the object and/or an acceleration of the object.

20. A camera unit for tracking an object within an operating room, the camera unit comprising:

a first optical sensor comprising sensing elements adapted to sense light in a near-infrared spectrum;

a second optical sensor adapted to sense light in a visible light spectrum; and

a controller in communication with the first and second optical sensors, and wherein the controller is configured to:

obtain, from the second optical sensor, data related to the object within the operating room; and

modify control of the sensing elements of the first optical sensor based on the data of the object obtained by the second optical sensor.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2023
From: BREISACHER, JOCHEN; HOFMANN, DAVID; UMBDENSTOCK, EMERIC
To: STRYKER LEIBINGER GMBH & CO. KG
Reel/Frame 065519/0402 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2023
From: MORGAN, JONATHAN; HOEKSTRA, PAUL
To: MAKO SURGICAL CORP.
Reel/Frame 065519/0413 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 10, 2023
From: STRYKER LEIBINGER GMBH & CO. KG
To: MAKO SURGICAL CORP.
Reel/Frame 065519/0424 →
Continuity (5)
Continuation 17972625 · Oct 25, 2022
Continuation 17317191 · May 11, 2021
Continuation 16441645 · Jun 14, 2019
Provisional Application 62685470 · Jun 15, 2018
Related Publication 20230329803A1 · Oct 19, 2023