IP Library Granted Patent US 11,284,963
Granted Patent B2
US 11,284,963 · App. 16/729,807 · Granted Mar 29, 2022

Method of using imaging devices in surgery

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Andrew C. Deck (Cincinnati, OH); Jason L. Harris (Lebanon, OH); Chad E. Eckert (Terrace Park, OH); Daniel J. Mumaw (Liberty Township, OH); Kevin M. Fiebig (Cincinnati, OH); Sarah A. Worthington (Cincinnati, OH)
Assignee: Cilag GmbH International
A61B90/37A61B90/361G06T7/30G06T7/521G06T19/00A61B17/064A61B34/25A61B34/30A61B2090/064A61B2090/367A61B2090/3735G06T2200/24G06T2207/10081G06T2207/10088G06T2207/20221G06T2207/30092G06T2210/41G06T2219/004
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,284,963
App. No.
16/729,807
Granted
Mar 29, 2022
Kind
B2
Abstract

A method for generating and updating a three-dimensional representation of a surgical site based on imaging data from an imaging system is disclosed. The method comprises the steps of generating a first image of the surgical site based on structured electromagnetic radiation emitted from the imaging system, receiving a second image of the surgical site, aligning the first image and the second image, generating a three-dimensional representation of the surgical site based on the first image and the second image as aligned, displaying the three-dimensional representation on a display screen, receiving a user selection to manipulate the three-dimensional representation, and updating the three-dimensional representation as displayed on the display screen from a first state to a second state according to the received user selection.

Claims (36)

1. A method for generating a three-dimensional representation of a surgical site comprising the steps of:

detecting a first pattern of structured light on an anatomical surface contour of the surgical site via an image sensor;

detecting a second pattern of structured light on a subsurface contour of the surgical site via the image sensor;

transmitting, using a processor, first imaging data indicative of the first pattern of structured light to a control circuit;

transmitting, using the processor, second imaging data indicative of the second pattern of structured light to the control circuit;

processing the first imaging data and the second imaging data via the control circuit;

generating a three-dimensional digital representation of an anatomical structure including the anatomical surface contour and the subsurface contour; and

transmitting, using the processor, the three-dimensional digital representation of the anatomical structure to a display.

2. The method of claim 1 , further comprising the steps of:

updating the three-dimensional digital representation of the anatomical structure in real time in response to changes to the first pattern of structured light and changes to the second pattern of structured light detected by the image sensor; and

transmitting the updated three-dimensional digital representation of the anatomical structure in real time to the display.

3. The method of claim 1 , further comprising the steps of:

obtaining metadata from the first imaging data and the second imaging data; and

overlaying the metadata with the three-dimensional digital representation.

4. The method of claim 3 , wherein the metadata comprises at least one of tissue velocity, tissue distortion, tissue irregularity, tissue vascularization, or identification of an embedded structure within the anatomical structure.

5. The method of claim 4 , wherein the metadata is indicative of tissue compression along a staple line.

6. A method for determining a surgical scenario based on input signals from multiple surgical devices, wherein the method comprises:

detecting imaging data from a plurality of light sources via an image sensor, wherein the plurality of light sources are configured to emit a pattern of structured light onto an anatomical structure;

receiving the imaging data from the image sensor;

generating a three-dimensional digital representation of the anatomical structure from the pattern of structured light detected by the imaging data;

obtaining metadata from the imaging data;

overlaying the metadata on the three-dimensional digital representation;

receiving updated imaging data from the image sensor;

generating an updated three-dimensional digital representation of the anatomical structure based on the updated imaging data; and

updating the overlaid metadata on the updated three-dimensional digital representation of the anatomical structure in response to a surgical scenario determined by a situational awareness module, using a processor.

7. The method of claim 6 , wherein the plurality of light sources comprises a plurality of coherent light sources.

8. The method of claim 7 , wherein the metadata comprises phase shift data for the plurality of coherent light sources.

9. The method of claim 7 , wherein the plurality of coherent light sources are configured to emit the pattern of structured light.

10. The method of claim 9 , wherein the pattern of structured light is emitted from the coherent light sources at a plurality of different wavelengths having different tissue penetration depths.

11. The method of claim 10 , wherein the image sensor is configured to capture the pattern of structured light at the different tissue penetration depths.

12. The method of claim 11 , wherein the three-dimensional digital representation is generated from a surface pattern of structured light and a sub-surface pattern of structured light.

13. The method of claim 12 , wherein the overlaid metadata is indicative of a tissue irregularity.

14. The method of claim 13 , wherein the tissue irregularity comprises a sub-surface irregularity.

15. The method of claim 14 , wherein the overlaid metadata is indicative of tissue compression along a staple line.

16. The method of claim 6 , wherein the overlaid metadata is indicative of a margin around an embedded structure.

17. The method of claim 6 , wherein the overlaid metadata comprises at least one of tissue velocity, tissue distortion, tissue irregularity, tissue vascularization, and identification of an embedded structure within the anatomical structure.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 6, 2021
From: ETHICON LLC
To: CILAG GMBH INTERNATIONAL
Reel/Frame 056983/0569 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 21, 2020
From: SHELTON, FREDERICK E., IV; DECK, ANDREW C.; HARRIS, JASON L.; ECKERT, CHAD E.; MUMAW, DANIEL J.; FIEBIG, KEVIN M.; WORTHINGTON, SARAH A.
To: ETHICON LLC
Reel/Frame 051888/0563 →