IP Library › Granted Patent US 11,992,200
Granted Patent B2
US 11,992,200 · App. 17/449,769 · Granted May 28, 2024

Instrument control surgical imaging systems

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Jason L. Harris (Lebanon, OH)
Assignee: Cilag GmbH International
A61B17/0218A61B1/00004A61B1/00006A61B1/00009A61B1/000095A61B1/00045A61B1/00048A61B1/0005A61B1/3132A61B17/00234A61B17/12099A61B17/12104A61B17/12136A61B17/3421A61B17/3474A61B34/20A61B34/30A61B90/06A61B90/361A61B90/37A61B90/39A61B90/50G06T7/74H04N13/111H04N13/156A61B5/0075A61B2017/00022A61B2017/00057A61B2017/00061A61B2017/00075A61B2017/00199A61B2017/00292A61B2017/00809A61B2017/00818A61B2017/3419A61B2017/3484A61B2034/2055A61B2034/2057A61B2034/301A61B2090/064A61B2090/3937A61B2090/3945G06T2207/10068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,992,200
App. No.
17/449,769
Granted
May 28, 2024
Kind
B2
Abstract

Surgical systems are provided. The surgical system includes a first scope device configured to transmit image data of a first scene within a field of view of the first scope device. A second scope device is configured to transmit image data of a second scene within a field of view of the second scope device. A tracking device is associated with one of the scope devices and configured to transmit a signal indicative of a location of the one of the scope devices. A controller is configured to receive the transmitted image data and the transmitted signal to determine a relative distance between the scope devices and to provide a merged image of at least a portion of the scope devices in a single scene, where at least one of the scope devices in the merged image is a representative depiction.

Claims (35)

1. A surgical system, comprising:

a first scope device configured to be at least partially disposed within at least one of a natural body lumen and an organ and configured to transmit image data of a first scene within a field of view of the first scope device;

a second scope device configured to be at least partially disposed outside of the at least one of the natural body lumen and the organ and to transmit image data of a second scene within a field of view of the second scope device, the second scene being different than the first scene;

a tracking device associated with one of the first scope device or the second scope device and configured to transmit a signal indicative of a location of the one of the first scope device or the second scope device relative to the other one of the first scope device or the second scope device; and

a controller configured to receive (i) the transmitted image data of the first and second scenes and (ii) the transmitted signal, to determine, based on the transmitted signal, a relative distance between the first scope device and the second scope device, and to provide, based on the transmitted image data and relative distance between the first and second scopes, a merged image of at least a portion of at least the first scope device and the second scope device in a single scene, wherein at least one of the first scope device and the second scope device in the merged image is a representative depiction thereof.

2. The surgical system of claim 1 , wherein the first scope device and the second scope device are each illustrated as a representative depiction thereof in the merged image.

3. The surgical system of claim 1 , further comprising a first display that is configured to display the first scene and a second display that is configured to display the second scene.

4. The surgical system of claim 3 , wherein at least one of the first display and the second display is further configured to display the single scene.

5. The surgical system of claim 3 , further comprising a third display that is configured to display the single scene.

6. The surgical system of claim 1 , wherein the first scope device is an endoscope and the second scope device is a laparoscope.

7. The surgical system of claim 1 , wherein the first scene does not include the second scope device, and wherein the second scene does not include the first scope device.

8. The surgical system of claim 1 , wherein the tracking device is associated with the first scope device.

9. The surgical system of claim 1 , wherein the tracking device is associated with the second scope device.

10. The surgical system of claim 1 , wherein the signal is further indicative of an orientation of the first scope device within one of the natural body lumen and the organ relative to the second scope device, and wherein the controller is further configured to determine, based on the transmitted signal, a relative orientation of the first scope device.

11. The surgical system of claim 1 , wherein the signal is further indicative of an orientation of the second scope device positioned outside of the at least one of the natural body lumen and the organ relative to the first scope device, and wherein the controller is further configured to determine, based on the transmitted signal, a relative orientation of the second scope device.

12. The surgical system of claim 1 , the controller is further configured to determine, based on at least the transmitted image data, at least one of a location and an orientation of at least one instrument positioned outside of the at least one natural body lumen and the organ relative to the first scope device, wherein at least a portion of the at least one instrument is illustrated as an actual depiction or representative depiction thereof in the merged image.

13. Surgical system of claim 1 , wherein the controller is further configured to (i) receive an additional signal that is indicative of at least one of a location and an orientation of at least one instrument positioned outside of the at least one natural body lumen and the organ relative to the second scope device, (ii) to determine, based on the transmitted additional signal, at least one of a relative location and a relative orientation of the at least one instrument, wherein at least a portion of the at least one instrument is illustrated as an actual depiction or representative depiction thereof in the merged image.

14. A method, comprising:

transmitting, by a first scope device, image data of a first scene within a field of view of the first scope device while at least a portion of the first device is positioned within at least one of a natural body lumen and an organ;

transmitting, by a second scope device, image data of a second scene within a field of view of the second scope device while the second scope device is positioned outside of the at least one of the natural body lumen and the organ, the second scene being different than the first scene;

transmitting, by a tracking device, a signal indicative of a location of one of the positioned first scope device or second scope device relative to the other positioned first scope device or second scope device;

receiving, by a controller, the transmitted image data of the first and second scenes and the transmitted signals of the location of the first and second scope devices;

determining, by the controller and based on the transmitted signal, a relative distance between the first scope device and the second scope device; and

generating, by the controller and based on the transmitted image data and the relative distance between the first and second scope devices, a merged image of at least a portion of at least the first scope device and the second scope device in a single scene, wherein at least one of the first scope device and the second scope device in the single scene is a representative depiction thereof.

15. The method of claim 14 , further comprising:

illustrating a representative depiction of the first scope device in the merged image; and

illustrating a representative depiction of the second scope device in the merged image.

16. The method of claim 14 , further comprising:

displaying the first scene on a first display; and

displaying the second scene on a second display.

17. The method of claim 14 , further comprising displaying the single scene on at least one of the first display and the second display.

18. The method of claim 14 , further comprising displaying the single scene on a third display.

19. The method of claim 14 , further comprising transmitting, by the tracking device, a signal indicative of an orientation of the one of the first scope device or the second scope device relative to the other one of the first scope device or the second scope device.

20. The method of claim 14 , further comprising:

determining, by the controller and based on the transmitted image data, at least one of a position and an orientation of at least one or more instruments positioned outside of the at least one natural body lumen and the organ relative to the first scope device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; HARRIS, JASON L.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 058104/0912 →
Continuity (2)
Provisional Application 63249980 · Sep 29, 2021
Related Publication 20230097151A1 · Mar 30, 2023