IP Library Granted Patent US 10,548,672
Granted Patent B2
US 10,548,672 · App. 15/270,373 · Granted Feb 4, 2020

Integrated illumination and optical surface topology detection system and methods of use thereof

Inventors: Victor X. D. Yang (North York, CA); Adrian Linus Dinesh Mariampillai (Toronto, CA); Beau Anthony Standish (Toronto, CA); Michael Ka Kit Leung (Markham, CA)
Assignee: 7D SURGICAL INC.
A61B34/20A61B5/0064A61B5/0077A61B6/06A61B6/467A61B6/54A61B50/28A61B90/20A61B90/30A61B90/35A61B90/37G01B11/2513G01N21/4738G01N21/55A61B5/1113A61B5/1128A61B6/544A61B2034/2057A61B2090/309A61B2090/373
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,548,672
App. No.
15/270,373
Granted
Feb 4, 2020
Kind
B2
Abstract

Systems and methods are provided for optical topology detection and illumination. Embodiments provide an integrated system, and methods of operation thereof, where the integrated system includes an illumination system and an optical topology detection system, and where at least a portion of the spectral content of illumination light from the illumination system is within an optical detection bandwidth of the optical topology detection system, and where the operation of the optical topology detection system and the illumination system are interleaved to avoid crosstalk, such that the optical topology detection system detects the optical topology detection light when the illumination system is not emitting illumination light. The system may include, and control the operation of, an optical navigation system. The components of the system may be mounted to a rigid frame to maintain calibration.

Claims (67)

1. An integrated surgical system for optical topology detection, illumination, and tracking, comprising:

a surgical illumination system comprising one or more illumination light sources for illuminating a region of interest with illumination light;

an optical topology detection system comprising a structured light projection device for projecting optical topology detection light comprising structured light patterns onto the region of interest and one or more optical topology detection cameras for imaging optical topology detection light scattered or reflected from the region of interest; and

an optical tracking system comprising a plurality of tracking cameras, wherein said optical tracking system is rigidly mounted to said optical topology detection system such that a tracking volume associated with said optical tracking system is fixed relative to an optical topology detection field of said optical topology detection system;

wherein at least a portion of the spectral content of the illumination light from said surgical illumination system is within an optical detection bandwidth of said optical topology detection system; and

one or more processors configured to:

provide one or more control signals for repeatedly triggering interleaved operation of said optical topology detection system with said surgical illumination system;

synchronize the operation of said optical topology detection system and said surgical illumination system according to the one or more control signals, such that said optical topology detection system detects optical topology detection light in the absence of the illumination light;

wherein said optical tracking system is configured to:

detect periodic motion of a patient being imaged by said optical topology detection system when a fiducial marker is secured to the patient; and

wherein said one or more processors are configured to control acquisition of the optical topology detection light based on the detected periodic motion, such that acquisition of the optical topology detection light is performed during a portion of a cycle of motion of the patient, while maintaining interleaved operation of said surgical illumination system during the cycle of motion.

2. The integrated system according to claim 1 wherein said one or more processors are further configured to synchronize the operation of said optical topology detection system, said surgical illumination system and said optical tracking system, according to the one or more control signals, such that said optical topology detection system detects optical topology detection light in the absence of the illumination light and tracking light.

3. The integrated system according to claim 2 wherein at least a portion of the spectral content of tracking light detected by said optical tracking system is within the optical detection bandwidth of said optical topology detection system.

4. The integrated system according to claim 2 wherein said one or more processors are configured to control the operation of said optical tracking system.

5. The integrated system according to claim 4 wherein said one or more processors are configured to synchronously control the operation of said surgical illumination system and said optical tracking system.

6. The integrated system according to claim 5 wherein said one or more processors are configured to control said surgical illumination system such that said surgical illumination system is intermittently activated during a series of illumination time intervals, and to control said optical tracking system such that said optical tracking system is activated during a portion of each illumination time interval.

7. The integrated system according to claim 2 wherein said optical tracking system comprises one or more tracking light sources, and wherein said integrated surgical system further comprises:

a photodetector configured to detect the emission of tracking light from said one or more tracking light sources;

wherein said one or more processors are configured to control the operation of said optical topology detection system and said surgical illumination system such that said optical topology detection system detects optical topology detection light when said photodetector detects the absence of tracking light.

8. The integrated system according to claim 7 wherein said one or more processors are configured to control the operation of said optical topology detection system such that said optical topology detection system is activated to detect optical topology detection light after a prescribed time delay following detection of the absence of tracking light by said photodetector.

9. The integrated system according to claim 2 wherein said one or more processors are configured such that said surgical illumination system and said optical topology detection system are intermittently activated two or more times between successive activations of said optical tracking system.

10. The integrated system according to claim 2 wherein said structured light projection device is configured to project an ordered series of patterns for topology detection, and wherein two or more patterns are projected during the time between successive activations of said optical tracking system.

11. The integrated system according to claim 2 wherein said structured light projection device is configured to project an ordered series of patterns for topology detection, and wherein all of the patterns are projected during the time between successive activations of said optical tracking system.

12. The integrated system according to claim 2 wherein said structured light projection device is configured to project an ordered series of patterns for topology detection, and wherein one pattern is projected during the time between at least one pair of successive illumination cycles.

13. The integrated system according to claim 2 wherein said structured light projection device is configured to project an ordered series of patterns for topology detection, and wherein two or more patterns are projected during the time between at least one pair of successive illumination cycles.

14. The integrated system according to claim 2 wherein said structured light projection device is configured to project an ordered series of patterns for topology detection, and wherein all of the patterns are projected during the time between at least one pair of successive illumination cycles.

15. The integrated system according to claim 2 wherein said one or more processors are configured to control said surgical illumination system and said optical topology detection system such that the illumination light and the optical topology detection light are interleaved at a sufficiently high frequency that the illumination light is perceived as being continuous in time by an observer.

16. The integrated system according to claim 15 wherein the duration of the optical topology detection light is controlled relative to the duration of the illumination light in order to reduce visual disruptions perceived by the observer.

17. The integrated system according to claim 15 wherein the sequence of light patterns is selected to reduce visual disruptions perceived by the observer.

18. The integrated system according to claim 17 wherein the intensity of projected light patterns is controlled relative to the intensity of the illumination light in order to reduce visual disruptions perceived by the observer.

19. The integrated system according to claim 2 wherein said plurality of tracking cameras are oriented such that they are centered on an illumination field of said illumination light sources.

20. The integrated system according to claim 2 wherein said optical topology detection system and said optical tracking system are supported by a rigid housing.

21. The integrated system according to claim 20 wherein said rigid housing is further adapted to rigidly support said surgical illumination system.

22. The integrated system according to claim 21 wherein said illumination light sources are a plurality of illumination light sources, and wherein said optical tracking system comprises a plurality of tracking light sources, and wherein said plurality of illumination light sources and said plurality of tracking light sources are spatially arranged as a plurality of composite lighting panels.

23. The integrated system according to claim 20 wherein said rigid housing is supported on an articulating arm for varying a position and/or angle of said rigid housing.

24. The integrated system according to claim 20 wherein said optical tracking system comprises a tracking system housing that is rigidly supported by said rigid housing, and wherein said optical tracking system is recessed or off-axis relative to said optical topology detection system to accommodate said tracking system housing.

25. The integrated system according to claim 2 wherein said surgical illumination system is an overhead illumination device.

26. The integrated system according to claim 1 wherein said one or more processors are further configured to:

generate a trigger signal based on the detected periodic motion; and

control the acquisition of the optical topology detection light based on the trigger signal.

27. The integrated system according to claim 2 wherein said optical tracking system is configured to:

track the locations of one or more fiducial markers associated with a surgical region of interest; and

wherein said one or more processors are configured to process the tracked locations to determine whether or not the tracked locations lie within the optical topology detection field associated with said optical topology detection system.

28. The integrated system according to claim 27 wherein said one or more processors are further configured to notify a user when the tracked locations lie outside of the optical topology detection field.

29. The integrated system according to claim 27 wherein said one or more processors are further configured to generate control signals for repositioning said optical topology detection system when the tracked locations lie outside of the optical topology detection field.

30. The integrated system according to claim 2 wherein said optical topology detection cameras comprise three or more optical topology detection cameras spatially distributed to avoid light-of-sight obstructions.

31. The integrated system according to claim 2 wherein said plurality of tracking cameras comprise three or more tracking cameras spatially distributed to avoid light-of-sight obstructions.

32. An integrated surgical system for optical topology detection, illumination, and tracking, comprising:

a surgical illumination system comprising one or more illumination light sources for illuminating a region of interest with illumination light;

an optical topology detection system comprising a structured light projection device for projecting optical topology detection light comprising structured light patterns onto the region of interest and one or more optical topology detection cameras for imaging optical topology detection light scattered or reflected from the region of interest; and

an optical tracking system comprising a plurality of tracking cameras;

wherein at least a portion of the spectral content of the illumination light from said surgical illumination system is within an optical detection bandwidth of said optical topology detection system; and

one or more processors configured to:

provide one or more control signals for repeatedly triggering interleaved operation of said optical topology detection system with said surgical illumination system and said optical tracking system;

synchronize the operation of said optical topology detection system, said surgical illumination system and said optical tracking system according to the one or more control signals, such that said optical topology detection system detects optical topology detection light in the absence of the illumination light and the tracking light;

employ said optical topology detection system to detect periodic motion of a fiducial marker secured to a patient; and

control acquisition of the optical topology detection light based on the detected periodic motion, such that acquisition of the optical topology detection light is performed during a portion of a cycle of motion of the patient, while maintaining interleaved operation of said surgical illumination system during the cycle of motion.

33. An integrated surgical system for optical topology detection, illumination, and tracking, comprising:

a surgical illumination system comprising one or more illumination light sources for illuminating a region of interest with illumination light;

an optical topology detection system comprising a structured light projection device for projecting optical topology detection light comprising structured light patterns onto the region of interest and one or more optical topology detection cameras for imaging optical topology detection light scattered or reflected from the region of interest; and

an optical tracking system comprising a plurality of tracking cameras;

wherein at least a portion of the spectral content of the illumination light from said surgical illumination system is within an optical detection bandwidth of said optical topology detection system; and

one or more processors configured to:

provide one or more control signals for repeatedly triggering interleaved operation of said optical topology detection system with said surgical illumination system;

synchronize the operation of said optical topology detection system and said surgical illumination system according to the one or more control signals, such that said optical topology detection system detects optical topology detection light in the absence of the illumination light;

employ said optical topology detection system to detect periodic motion of a fiducial marker secured to a patient; and

control acquisition of the optical topology detection light based on the detected periodic motion, such that acquisition of the optical topology detection light is performed during a portion of a cycle of motion of the patient, while maintaining interleaved operation of said surgical illumination system during the cycle of motion.

Assignments (8)
SECURITY INTEREST Recorded Jan 14, 2025
From: 7D SURGICAL ULC
To: OXFORD FINANCE LLC, AS AGENT
Reel/Frame 069861/0322 →
RELEASE OF SECURITY INTEREST Recorded Jan 9, 2023
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: SEASPINE HOLDINGS CORPORATION; SEASPINE ORTHOPEDICS CORPORATION; SEASPINE, INC.; ISOTIS, INC.; SEASPINE SALES LLC; ISOTIS ORTHOBIOLOGICS, INC.; THEKEN SPINE, LLC; SEASPINE ORTHOPEDICS INTERMEDIATECO, INC.; 7D SURGICAL USA INC.
Reel/Frame 062336/0593 →
SECOND AMENDMENT TO PATENT SECURITY AGREEMENT Recorded Jul 18, 2022
From: SEASPINE HOLDINGS CORPORATION; SEASPINE ORTHOPEDICS CORPORATION; SEASPINE, INC.; ISOTIS, INC.; SEASPINE SALES LLC; ISOTIS ORTHOBIOLOGICS, INC.; THEKEN SPINE, LLC; SEASPINE ORTHOPEDICS INTERMEDIATECO, INC.; 7D SURGICAL USA INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 060715/0395 →
CERTIFICATE OF AMALGAMATION Recorded Jul 21, 2021
From: 7D SURGICAL INC.
To: PROJECT MAPLE LEAF ACQUISITION ULC
Reel/Frame 056933/0416 →
CHANGE OF NAME Recorded Jul 21, 2021
From: PROJECT MAPLE LEAF ACQUISITION ULC
To: 7D SURGICAL ULC
Reel/Frame 056933/0176 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNOR'S NAME PREVIOUSLY RECORDED ON REEL 042163 FRAME 0621. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF ADDRESS. Recorded Jun 9, 2017
From: 7D SURGICAL INC.
To: 7D SURGICAL INC.
Reel/Frame 042747/0359 →
CHANGE OF ADDRESS Recorded Apr 5, 2017
From: 7D SURIGIAL INC.
To: 7D SURGICAL INC.
Reel/Frame 042163/0621 →
NUNC PRO TUNC ASSIGNMENT Recorded Sep 20, 2016
From: YANG, VICTOR X. D.; MARIAMPILLAI, ADRIAN LINUS DINESH; STANDISH, BEAU ANTHONY; LEUNG, MICHAEL KA KIT
To: 7D SURGICAL INC.
Reel/Frame 039802/0251 →
Continuity (3)
Continuation 14439009
Provisional Application 61719744 · Oct 29, 2012
Related Publication 20170079724A1 · Mar 23, 2017
Cited By (2)
US 12,315,215 US 12,383,368