IP Library Granted Patent US 11,369,366
Granted Patent B2
US 11,369,366 · App. 16/128,193 · Granted Jun 28, 2022

Surgical visualization and monitoring

Inventors: Charles J. Scheib (Loveland, OH); Joshua D. Young (Flanders, NJ)
Assignee: Cilag GmbH International
A61B17/0482A61B1/00006A61B1/00043A61B1/00045A61B1/00096A61B1/00149A61B1/04A61B1/045A61B1/05A61B1/051A61B1/06A61B1/063A61B1/0607A61B1/0638A61B1/0661A61B1/07A61B1/3132A61B5/0036A61B5/0086A61B5/0095A61B17/00234A61B17/0218A61B17/0469A61B17/0483A61B17/062A61B17/064A61B17/06066A61B17/1114A61B17/1155A61B17/3423A61B34/20A61B34/30A61B34/32A61B34/73A61B90/03A61B90/13A61B90/30A61B90/35A61B90/36A61B90/361A61B90/37G02F1/1326A61B1/00009A61B1/0676A61B34/25A61B2017/00061A61B2017/00119A61B2017/00367A61B2017/00477A61B2017/00876A61B2034/105A61B2034/107A61B2034/2051A61B2034/2055A61B2034/2057A61B2034/2063A61B2034/2065A61B2034/301A61B2034/302A61B2090/061A61B2090/064A61B2090/306A61B2090/367A61B2090/373A61B2090/374A61B2090/378A61B2090/3762A61B2505/05A61B2560/0462A61B2576/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,369,366
App. No.
16/128,193
Granted
Jun 28, 2022
Kind
B2
Abstract

A surgical visualization system is disclosed. The surgical visualization system is configured to identify one or more structure(s) and/or determine one or more distances with respect to obscuring tissue and/or the identified structure(s). The surgical visualization system can facilitate avoidance of the identified structure(s) by a surgical device. The surgical visualization system can comprise a first emitter configured to emit a plurality of tissue-penetrating light waves and a second emitter configured to emit structured light onto the surface of tissue. The surgical visualization system can also include an image sensor configured to detect reflected visible light, tissue-penetrating light, and/or structured light. The surgical visualization system can convey information to one or more clinicians regarding the position of one or more hidden identified structures and/or provide one or more proximity indicators. In various instances, a robotic camera of the surgical visualization system can monitor and track one or more tagged structures.

Claims (93)

1. A surgical visualization system, comprising:

a first source configured to emit a plurality of spectral light waves configured to penetrate a tissue;

a second source configured to emit a structured light pattern onto a surface of the tissue;

an image sensor configured to detect at least one of the reflected structured light pattern and the plurality of spectral light waves;

a display screen;

a control circuit communicatively coupled to the first source, the second source, the image sensor, and the display screen; and

a memory communicatively coupled to the control circuit, wherein the memory stores program instructions which, when executed, cause the control circuit to:

receive an input corresponding to an embedded structure for tracking;

cause the first source to emit the plurality of spectral light waves toward the embedded structure;

cause the second source to emit the structured light pattern;

receive first information from the image sensor corresponding to the structured light pattern on the surface of the tissue;

receive second information from the image sensor corresponding to the spectral light waves reflected from the embedded structure;

identify the embedded structure from the second information received by the image sensor;

provide a signal to the display screen corresponding to the identified embedded structure; and

adjust the image sensor when the embedded structure is no longer viewed on the display screen;

wherein the control circuit is configured to identify the embedded structure absent fluoroscopic imaging techniques.

2. The surgical visualization system of claim 1 , wherein the embedded structure is at least partially hidden.

3. The surgical visualization system of claim 1 , wherein adjusting the image sensor comprises adjusting a zoom level of the image sensor.

4. The surgical visualization system of claim 1 , wherein adjusting the image sensor comprises adjusting an orientation of the image sensor.

5. The surgical visualization system of claim 1 , wherein adjusting the image sensor comprises adjusting a location of the image sensor.

6. The surgical visualization system of claim 1 , wherein the embedded structure is no longer viewed by the image sensor when at least a portion of the embedded structure is positioned outside of a field of view of the image sensor.

7. The surgical visualization system of claim 1 , wherein the memory further comprises program instructions which, when executed, cause the control circuit to provide an alert when the embedded structure is no longer captured by the image sensor.

8. A surgical visualization system, comprising:

a first source configured to emit a plurality of spectral light waves configured to penetrate a tissue;

a second source configured to emit a structured light pattern onto a surface of the tissue;

an image sensor configured to detect at least one of the reflected plurality of spectral light waves and the reflected structured light pattern;

a display screen;

a control circuit communicatively coupled to the first source, the second source, the image sensor, and the display screen; and

a memory communicatively coupled to the control circuit, wherein the memory stores program instructions which, when executed, cause the control circuit to:

receive a first input corresponding to a structure below the surface of the tissue selected for tracking;

cause the first source to emit the plurality of spectral light waves toward the structure below the surface of the tissue;

cause the second source to emit the structured light pattern;

receive first information from the image sensor corresponding to the structured light pattern on the surface of the tissue;

receive second information from the image sensor corresponding to the spectral light waves reflected from the structure below the surface of the tissue;

identify the structure below the surface of the tissue from the second information received by the image sensor;

provide a signal to the display screen corresponding to the identified structure below the surface of the tissue; and

adjust the image sensor when the structure below the surface of the tissue is no longer captured by the image sensor;

wherein the structure does not comprise a contrast agent.

9. A surgical visualization system, comprising:

a first source configured to emit a plurality of spectral light waves configured to penetrate a tissue;

a second source configured to emit a structured light pattern onto a surface of the tissue;

an image sensor configured to detect at least one of the reflected plurality of spectral light waves and the reflected structured light pattern;

a display screen;

a control circuit communicatively coupled to the first source, the second source, the image sensor, and the display screen; and

a memory communicatively coupled to the control circuit, wherein the memory stores program instructions which, when executed, cause the control circuit to:

receive a first input corresponding to a structure below the surface of the tissue selected for tracking;

cause the first source to emit the plurality of spectral light waves toward the structure below the surface of the tissue;

cause the second source to emit the structured light pattern;

receive first information from the image sensor corresponding to the structured light pattern on the surface of the tissue;

receive second information from the image sensor corresponding to the spectral light waves reflected from the structure below the surface of the tissue;

identify the structure below the surface of the tissue from the second information received by the image sensor;

provide a signal to the display screen corresponding to the identified structure below the surface of the tissue; and

adjust the image sensor when the structure below the surface of the tissue is no longer captured by the image sensor;

wherein the second information received from the image sensor does not comprise fluoroscopic information.

10. The surgical visualization system of claim 9 , wherein the structure below the surface of the tissue is at least partially hidden.

11. The surgical visualization system of claim 9 , wherein adjusting the image sensor comprises adjusting a zoom level of the image sensor.

12. The surgical visualization system of claim 9 , wherein adjusting the image sensor comprises adjusting an orientation of the image sensor.

13. The surgical visualization system of claim 9 , wherein adjusting the image sensor comprises adjusting a location of the image sensor.

14. A surgical visualization system, comprising:

a first source configured to emit a plurality of spectral light waves configured to penetrate a tissue;

a second source configured to emit a structured light pattern onto a surface of the tissue;

an image sensor configured to detect at least one of the reflected plurality of spectral light waves and the reflected structured light pattern;

a display screen;

a control circuit communicatively coupled to the first source, the second source, the image sensor, and the display screen; and

a memory communicatively coupled to the control circuit, wherein the memory stores program instructions which, when executed, cause the control circuit to:

receive a first input corresponding to a structure below the surface of the tissue selected for tracking;

cause the first source to emit the plurality of spectral light waves toward the structure below the surface of the tissue;

cause the second source to emit the structured light pattern;

receive first information from the image sensor corresponding to the structured light pattern on the surface of the tissue;

receive second information from the image sensor corresponding to the spectral light waves reflected from the structure below the surface of the tissue;

identify the structure below the surface of the tissue from the second information received by the image sensor;

provide a signal to the display screen corresponding to the identified structure below the surface of the tissue; and

adjust the image sensor when the structure below the surface of the tissue is no longer captured by the image sensor;

wherein the control circuit is configured to identify the structure below the surface of the tissue absent fluoroscopic imaging techniques.

15. The surgical visualization system of claim 14 , wherein the structure below the surface of the tissue is at least partially hidden.

16. The surgical visualization system of claim 14 , wherein adjusting the image sensor comprises adjusting a zoom level of the image sensor.

17. The surgical visualization system of claim 14 , wherein adjusting the image sensor comprises adjusting an orientation of the image sensor.

18. The surgical visualization system of claim 14 , wherein adjusting the image sensor comprises adjusting a location of the image sensor.

19. The surgical visualization system of claim 14 , wherein the structure below the surface of the tissue is no longer captured by the image sensor when at least a portion of the structure below the surface of the tissue is positioned outside of a field of view of the image sensor.

20. The surgical visualization system of claim 14 , wherein the memory further comprises program instructions which, when executed, cause the control circuit to provide an alert when the structure below the surface of the tissue is no longer captured by the image sensor.

21. A surgical visualization system, comprising:

a source configured to emit a plurality of spectral light waves configured to penetrate a tissue;

an image sensor configured to detect the reflected plurality of spectral light waves;

a display screen;

a control circuit communicatively coupled to the source, the image sensor, and the display screen; and

a memory communicatively coupled to the control circuit, wherein the memory stores program instructions which, when executed, cause the control circuit to:

receive an input corresponding to an embedded structure for tracking;

cause the source to emit the plurality of spectral light waves toward the embedded structure;

receive information from the image sensor corresponding to the spectral light waves reflected from the embedded structure;

identify the embedded structure from the information received by the image sensor;

provide a signal to the display screen corresponding to the identified embedded structure; and

track the embedded structure over time such that the embedded structure remains viewable on the display screen;

wherein the control circuit is configured to identify the embedded structure absent fluoroscopic imaging techniques.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056601/0339 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2018
From: SCHEIB, CHARLES J.; YOUNG, JOSHUA D.
To: ETHICON LLC
Reel/Frame 047538/0213 →
Continuity (2)
Provisional Application 62698625 · Jul 16, 2018
Related Publication 20200015906A1 · Jan 16, 2020
Cited By (59)
US 12,185,946 US 12,213,666 US 12,213,671 US 12,228,987 US 12,232,723 US 12,235,697 US 12,239,316 US 12,239,319 US 12,239,353 US 12,239,404 US 12,245,901 US 12,256,930 US 12,262,888 US 12,262,890 US 12,274,445 US 12,290,261 US 12,293,432 US 12,295,575 US 12,310,585 US 12,315,036 US 12,324,581 US 12,354,186 US 12,369,911 US 12,369,960 US 12,369,994 US 12,376,896 US 12,383,266 US 12,383,267 US 12,396,727 US 12,414,767 US 12,414,768 US 12,432,790 US 12,433,584 US 12,440,208 US 12,444,094 US 12,446,877 US 12,453,554 US 12,453,556 US 12,453,557 US 12,458,455 US 12,462,439 US 12,471,982 US 12,488,512 US 12,493,996 US 12,505,584 US 12,521,116 US 12,527,571 US 12,527,572 US 12,557,989 US 12,629,194 US 12,636,006 US 12,636,009 US 12,639,250 US 12,661,188 US 12,670,670 US 12,682,578 US 12,682,579 US 12,697,121 US 12,697,178