IP Library Granted Patent US 10,650,536
Granted Patent B2
US 10,650,536 · App. 16/592,008 · Granted May 12, 2020

Systems and methods for tracker characterization and verification

Inventors: Andre Novomir Hladio (Waterloo, CA); Richard Tyler Fanson (Stoney Creek, CA); Luke Becker (Kitchener, CA); Arash Abadpour (Toronto, CA); Joseph Arthur Schipper (Kitchener, CA)
Assignee: INTELLIJOINT SURGICAL INC.
G06T7/246A61B34/20A61B6/0457A61B2017/00725A61B2034/207A61B2034/2055A61N5/1049A61N2005/1051A61N2005/1059G06T2207/30004G06T2207/30204
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,650,536
App. No.
16/592,008
Granted
May 12, 2020
Kind
B2
Abstract

The present application relates to systems and methods used to characterize or verify the accuracy of a tracker comprising optically detectable features. The tracker may be used in spatial localization using an optical sensor. Characterization results in the calculation of a Tracker Definition that includes geometrical characteristics of the tracker. Verification results in an assessment of accuracy of a tracker against an existing Tracker Definition.

Claims (47)

1. A system comprising:

a computer-readable storage device storing instructions and/or data which, when executed on a computing unit, configures the computing unit to:

receive a first image of a tracker from an optical sensor at a first vantage point and a first inertial measurement from one or more inertial sensors, wherein the one or more inertial sensors are co-registered to the optical sensor and wherein the first image and first inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at a resting position in a field of view of the optical sensor;

receive a second image of the tracker from the optical sensor at a second vantage point and a second inertial measurement from the one or more inertial sensors, wherein the second image and second inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at the resting position in a field of view of the optical sensor;

calculate at least one of:

a tracker definition using the first image, the second image and a difference in orientation in at least 2 DOF between the first vantage point and the second vantage point; and

a tracker assessment parameter using the first image, the second image, the difference in orientation in at least 2 DOF between the first vantage point and the second vantage point, and a static tracker definition; and

provide one of the tracker definition and the tracker assessment parameter for use in a localization procedure.

2. The system of claim 1 wherein the computing unit is further configured to calculate the difference in orientation in at least 2 DOF between the first vantage point and the second vantage point using the first inertial measurement and the second inertial measurement.

3. The system of claim 1 wherein each of the one or more inertial sensors comprises any of an accelerometer, a gyroscope and a magnetometer.

4. The system of claim 1 wherein the computing unit is configured to calculate the tracker definition and further configured to:

calculate a tracker base geometry using the first image, the first inertial measurement, the second image, the second inertial measurement and the resting position of the tracker; and

provide the tracker base geometry for use in a localization procedure.

5. The system of claim 1 wherein the computing unit is further configured to provide user instructions, for display on a display unit, to move the sensor apparatus from the first vantage point to the second vantage point.

6. The system of claim 1 wherein the computing unit is configured to calculate the tracker assessment parameter and is further configured to provide the tracker assessment parameter for display on a display unit.

7. The system of claim 6 further comprising the display unit to display the tracker assessment parameter.

8. The system of claim 1 further comprising the tracker and the optical sensor.

9. The system of claim 1 further comprising the computing unit.

10. The system claim 1 further comprising the one or more inertial sensors.

11. A computer-implemented method comprising:

receiving, by a computing unit, a first image of a tracker from an optical sensor at a first vantage point and a first inertial measurement from one or more inertial sensors, wherein the one or more inertial sensors are co-registered to the optical sensor and wherein the first image and first inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at a resting position in a field of view of the optical sensor;

receiving, by the computing unit, a second image of the tracker from the optical sensor at a second vantage point and a second inertial measurement from the one or more inertial sensors, wherein the second image and second inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at the resting position in a field of view of the optical sensor; and

calculating, by the computing unit, at least one of:

a tracker definition using the first image, the second image and a difference in orientation in at least 2 DOF between the first vantage point and the second vantage point; and

a tracker assessment parameter using the first image, the second image, the difference in orientation in at least 2 DOF between the first vantage point and the second vantage point and a static tracker definition; and

providing the at least one of the tracker definition and the tracker assessment parameter for display and/or use in a procedure.

12. The method of claim 11 comprising calculating, by the computing unit, the difference in orientation in at least 2 DOF between the first vantage point and the second vantage point using the first inertial measurement and the second inertial measurement.

13. The method of claim 11 wherein the procedure is a localization procedure.

14. A system comprising:

a computer-readable storage device storing instructions and/or data which, when executed on a computing unit, configures the computing unit to:

receive a first image of a tracker from an optical sensor at a first vantage point and a first inertial measurement from one or more inertial sensors, wherein the one or more inertial sensors are co-registered to the optical sensor and wherein the first image and first inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at a resting position in a field of view of the optical sensor; and

calculate a tracker assessment parameter using the first image, the first inertial measurement, the resting position of the tracker, and a static tracker definition; and

provide the tracker assessment parameter for display and/or use in a procedure.

15. The system of claim 14 wherein the data stored by the computer readable storage device comprises the static tracker definition.

16. The system of claim 15 wherein the static tracker definition comprises a static tracker base geometry.

17. The system of claim 14 wherein the procedure is a localization procedure.

18. The system of claim 14 wherein the computing unit is further configured to provide user instructions, for display on a display unit, to capture the first image.

19. The system of claim 14 further comprising:

the computing unit;

the tracker;

the optical sensor;

the one or more inertial sensors; and

a display unit.

20. A computer-implemented method comprising:

receiving, by a computing unit, a first image of a tracker from an optical sensor at a first vantage point and a first inertial measurement from one or more inertial sensors, wherein the one or more inertial sensors are co-registered to the optical sensor and wherein the first image and first inertial measurement are obtained by the respective optical sensor and one or more inertial sensors when the tracker is at a resting position in a field of view of the optical sensor; and

calculating, by the computing unit, a tracker assessment parameter using the first image, the first inertial measurement, the resting position of the tracker, and a static tracker definition; and

providing the tracker assessment parameter for display and/or use in a procedure.

Assignments (2)
SECURITY INTEREST Recorded Oct 20, 2022
From: INTELLIJOINT SURGICAL INC.
To: BDC CAPITAL INC.
Reel/Frame 061729/0162 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2019
From: HLADIO, ANDRE NOVOMIR; FANSON, RICHARD TYLER; BECKER, LUKE; ABADPOUR, ARASH; SCHIPPER, JOSEPH ARTHUR
To: INTELLIJOINT SURGICAL INC.
Reel/Frame 050616/0897 →
Continuity (7)
Continuation 16253641 · Jan 22, 2019
Continuation 15606723 · May 26, 2017
Provisional Application 62342366 · May 27, 2016
Provisional Application 62349887 · Jun 14, 2016
Provisional Application 62354355 · Jun 24, 2016
Provisional Application 62362857 · Jul 15, 2016
Related Publication 20200043178A1 · Feb 6, 2020