IP Library Granted Patent US 11,000,270
Granted Patent B2
US 11,000,270 · App. 16/128,179 · Granted May 11, 2021

Surgical visualization platform

Inventors: Charles J. Scheib (Loveland, OH); Paul G. Ritchie (Loveland, OH); Sarah A. Moore (Los Gatos, CA); Jeffrey S. Swayze (West Chester, OH); Joshua D. Talbert (Cottonwood Heights, UT)
Assignee: Ethicon LLC
A61B17/0482A61B1/00002A61B1/00006A61B1/00013A61B1/00043A61B1/00045A61B1/00096A61B1/00149A61B1/04A61B1/045A61B1/05A61B1/051A61B1/06A61B1/063A61B1/0607A61B1/0638A61B1/0661A61B1/07A61B1/3132A61B5/0036A61B5/0086A61B5/0095A61B17/00234A61B17/0218A61B17/0469A61B17/0483A61B17/062A61B17/064A61B17/06066A61B17/1114A61B17/1155A61B17/3423A61B34/20A61B34/30A61B34/32A61B34/73A61B90/03A61B90/13A61B90/30A61B90/35A61B90/36A61B90/361A61B90/37G06T1/0007A61B1/00009A61B1/0676A61B2017/00061A61B2017/00119A61B2017/00367A61B2017/00477A61B2017/00876A61B2034/105A61B2034/107A61B2034/2051A61B2034/2055A61B2034/2057A61B2034/2063A61B2034/2065A61B2034/301A61B2034/302A61B2090/061A61B2090/064A61B2090/306A61B2090/367A61B2090/373A61B2090/374A61B2090/378A61B2090/3762A61B2505/05A61B2560/0462A61B2576/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,000,270
App. No.
16/128,179
Granted
May 11, 2021
Kind
B2
Abstract

A surgical visualization system is disclosed. The surgical visualization system is configured to identify one or more structure(s) and/or determine one or more distances with respect to obscuring tissue and/or the identified structure(s). The surgical visualization system can facilitate avoidance of the identified structure(s) by a surgical device. The surgical visualization system can comprise a first emitter configured to emit a plurality of tissue-penetrating light waves and a second emitter configured to emit structured light onto the surface of tissue. The surgical visualization system can also include an image sensor configured to detect reflected visible light, tissue-penetrating light, and/or structured light. The surgical visualization system can convey information to one or more clinicians regarding the position of one or more hidden identified structures and/or provide one or more proximity indicators.

Claims (40)

1. A surgical visualization system, comprising:

a structured light emitter configured to emit a structured light pattern on a surface of an anatomical structure;

a hyperspectral waveform emitter configured to emit hyperspectral waveforms in a plurality of wavelengths capable of penetrating the anatomical structure and reaching an embedded structure located below the surface of the anatomical structure;

an image sensor configured to detect reflected structured light pattern, reflected hyperspectral waveforms, and reflected visible light; and

a control circuit in signal communication with the image sensor, wherein the control circuit is configured to:

construct a three-dimensional digital representation of the anatomical structure from the reflected structured light pattern detected by the image sensor;

detect the embedded structure from the reflected hyperspectral waveforms detected by the image sensor;

integrate the embedded structure with the three-dimensional digital representation of the anatomical structure; and

determine at least one distance from the structured light emitter to the anatomical structure, wherein the at least one distance from the structured light emitter to the anatomical structure comprises a distance from the structured light emitter to a portion of the anatomical structure obscuring the embedded structure.

2. The surgical visualization system of claim 1 , further comprising a display configured to selectively depict the embedded structure and a three-dimensional rendering of the anatomical structure based on the three-dimensional digital representation of the anatomical structure.

3. The surgical visualization system of claim 2 , wherein the display is configured to selectively provide an alert when the distance between the structured light emitter and the anatomical structure is reduced to a minimum distance.

4. The surgical visualization system of claim 1 , wherein the hyperspectral waveform emitter is configured to emit hyperspectral waveforms in a plurality of infrared wavelengths capable of penetrating the anatomical structure and reaching the embedded structure.

5. The surgical visualization system of claim 1 , wherein the hyperspectral waveform emitter is supported on a first robotic arm, and wherein the structured light emitter is supported on a second robotic arm.

6. The surgical visualization system of claim 1 , wherein the control circuit further comprises a time-of-flight module configured to determine a distance from the hyperspectral waveform emitter to the embedded structure.

7. A surgical visualization system, comprising:

a hyperspectral imaging system configured to emit a plurality of wavelengths, wherein the hyperspectral imaging system is configured to identify a hidden structure;

a structured light system configured to emit a structured light pattern onto a visible tissue surface, wherein the structured light system is further configured to generate a three-dimensional digital representation of the visible tissue surface;

a sensor system configured to detect visible light, the plurality of wavelengths, and the structured light pattern;

an imaging system configured to selectively depict the hidden structure on a three-dimensional rendering of the visible tissue surface; and

a control circuit configured to determine a distance to a portion of the visible tissue surface overlaying the hidden structure.

8. The surgical visualization system of claim 7 , wherein the control circuit is further configured to determine a depth of the hidden structure below the visible tissue surface.

9. A surgical visualization system, comprising:

a source configured to emit hyperspectral waveforms in a plurality of wavelengths capable of penetrating an anatomical structure and reaching an embedded structure located below a surface of the anatomical structure;

a receiver configured to detect the plurality of wavelengths reflected by the embedded structure; and

a control circuit comprising a time-of-flight module configured to:

determine a distance from the source to the embedded structure based on a delay between an emitted signal from the source and a detected signal by the receiver; and

determine a second distance from the source to a portion of the surface of the anatomical structure overlaying the embedded structure.

10. The surgical visualization system of claim 9 , wherein the control circuit is further configured to communicate the distance to an imaging system.

11. The surgical visualization system of claim 9 , wherein the control circuit is further configured to determine a proximity of a surgical device with respect to the embedded structure and provide an alert when the proximity is reduced to a minimum amount.

12. The surgical visualization system of claim 9 , wherein the source is configured to emit hyperspectral waveforms in a plurality of infrared wavelengths capable of penetrating the anatomical structure and reaching an embedded structure located below the surface of the anatomical structure.

13. The surgical visualization system of claim 9 , further comprising an imaging system comprising:

a video monitor; and

a control configured to toggle a display on the video monitor between a plurality of views.

14. The surgical visualization system of claim 9 , wherein the source is further configured to emit a structured light pattern on the surface of the anatomical structure.

15. The surgical visualization system of claim 14 , wherein the control circuit is further configured to:

recognize surface contours of the anatomical structure based on the structured light pattern;

construct a three-dimensional digital representation of the anatomical structure; and

convey the three-dimensional digital representation to an imaging system.

16. The surgical visualization system of claim 15 , further comprising the imaging system comprising a display configured to selectively depict the three-dimensional digital representation of the anatomical structure and the embedded structure.

17. The surgical visualization system of claim 9 , wherein the control circuit is further configured to determine a depth of the embedded structure within the anatomical structure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056601/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 20, 2018
From: SCHEIB, CHARLES J.; RITCHIE, PAUL G.; MOORE, SARAH A.; SWAYZE, JEFFREY S.; TALBERT, JOSHUA D.
To: ETHICON LLC
Reel/Frame 047549/0591 →
Continuity (2)
Provisional Application 62698625 · Jul 16, 2018
Related Publication 20200015923A1 · Jan 16, 2020
Cited By (25)
US 12,207,881 US 12,228,987 US 12,235,697 US 12,239,353 US 12,239,404 US 12,293,432 US 12,315,036 US 12,354,186 US 12,369,960 US 12,369,994 US 12,376,896 US 12,444,094 US 12,453,592 US 12,462,439 US 12,465,429 US 12,488,512 US 12,493,996 US 12,505,584 US 12,629,194 US 12,639,250 US 12,661,188 US 12,670,670 US 12,682,578 US 12,682,579 US 12,697,178