IP Library › Granted Patent US 12,295,667
Granted Patent B2
US 12,295,667 · App. 17/493,909 · Granted May 13, 2025

Surgical devices, systems, and methods using multi-source imaging

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Kevin M. Fiebig (Cincinnati, OH)
Assignee: Cilag GmbH International
A61B34/20A61B1/05A61B1/0638A61B1/0661A61B1/2676A61B1/313A61B34/30A61B90/37A61B2034/2065A61B2034/301A61B2090/3762A61B2090/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,295,667
App. No.
17/493,909
Filed
Oct 5, 2021
Granted
May 13, 2025
Kind
B2
Art Unit
3795
USPC
600/160
Abstract

In general, devices, systems, and methods for multi-source imaging are provided.

Claims (56)

1. A surgical system, comprising:

a first imaging system configured to provide visualization of a surgical site including a tissue wall, the first imaging system being a thoracoscopic imaging system or a laparoscopic imaging system;

a first surgical instrument configured to be releasably coupled to a robotic surgical system;

an endoscopic imaging system configured to be advanced to the surgical site transorally and configured to provide visualization of the surgical site including the tissue wall; and

a second surgical instrument configured to be releasably coupled to the robotic surgical system;

wherein, with the first imaging system and the endoscopic imaging system being unable to directly visualize each other, the first imaging system is configured to visualize a first side of the tissue wall during performance of a surgical procedure and the endoscopic imaging system is configured to visualize a second, opposite side of the tissue wall during the performance of the surgical procedure; and

wherein the first imaging system and the endoscopic imaging system are configured to be operatively coupled together such that:

with the first surgical instrument releasably coupled to the robotic surgical system, the first surgical instrument is also configured to have its movement automatically and electronically guided in a first area facing the first side of the tissue wall based on the visualization provided by the endoscopic imaging system, and

with the second surgical instrument releasably coupled to the robotic surgical system, the second surgical instrument is also configured to have its movement automatically and electronically guided in a second area facing the second side of the tissue wall based on the visualization provided by the first imaging system.

2. The system of claim 1 , wherein at least one of the first and second surgical instruments includes integrated tracking and coordinating means configured to identify a location of the at least one first surgical instrument and second surgical instrument and is configured to communicate the location to the first imaging system and the endoscopic imaging system so as to provide secondary location verification to the first imaging system and the endoscopic imaging system.

3. The system of claim 1 , wherein the first imaging system is configured to determine a location and orientation of the second surgical instrument relative to the first surgical instrument to facilitate the first surgical instrument being guided based on the visualization provided by the endoscopic imaging system; and

the endoscopic imaging system is configured to determine a location and orientation of the first surgical instrument relative to the second surgical instrument to facilitate the second surgical instrument being guided based on the visualization provided by the first imaging system.

4. The system of claim 1 , wherein the first imaging system and the endoscopic imaging system are configured to each visualize a common anatomic landmark and thereby facilitate guiding of the first and second surgical instruments relative to one another.

5. The system of claim 1 , wherein one of the first imaging system and the endoscopic imaging system includes

a structured light emitter configured to emit a structured light pattern on a surface of an organ,

a spectral light emitter configured to emit spectral light in a plurality of wavelengths capable of penetrating the organ and reaching an internal aspect located below the surface of the organ, and

an image sensor configured to detect reflected structured light pattern, reflected spectral light, and reflected visible light; and

the surgical system further comprises a controller configured to

construct a three-dimensional (3D) digital representation of the organ from the reflected structured light pattern detected by the image sensor,

detect the internal aspect from the reflected spectral light detected by the image sensor,

integrate the internal aspect with the 3D digital representation of the organ, and

cause a display device to show the internal aspect and a 3D rendering of the organ based on the 3D digital representation of the organ.

6. The system of claim 1 , further comprising a computerized tomography (CT) imaging system configured to provide visualization of the first and second instruments and thereby facilitate guiding of the first and second surgical instruments relative to one another.

7. The system of claim 1 , further comprising a non-magnetic sensing system that uses at least one of ultrasonic energy and radiofrequency (RF) energy and is configured to gather data indicative of a location of the first and second surgical instruments and thereby facilitate guiding of the first and second surgical instruments relative to one another.

8. The system of claim 1 , wherein the robotic surgical system is configured to control the automatic and electronic guiding of the movements of the first and second surgical instruments.

9. The system of claim 1 , wherein a surgical hub operatively coupled to the robotic surgical system is configured to control the automatic and electronic guiding of the movements of the first and second surgical instruments.

10. The system of claim 1 , wherein the first imaging system is a thoracoscopic imaging system, the tissue wall is a wall of a lung, the first side of the tissue wall and the first area are outside of the lung, and the second, opposite side of the tissue wall and the second area are inside the lung.

11. The system of claim 1 , wherein the first imaging system is a laparoscopic imaging system, the tissue wall is a wall of a stomach, the first side of the tissue wall and the first area are outside of the stomach, and the second, opposite side of the tissue wall and the second area are inside the stomach.

12. The system of claim 1 , wherein the first imaging system has a first electromagnetic fiducial marker thereon;

the endoscopic imaging system has a second electromagnetic fiducial marker thereon;

the first imaging system is configured to, with the endoscopic imaging system visualizing the second, opposite side of the tissue wall, magnetically sense the second electromagnetic fiducial marker to detect a location of the endoscopic imaging system; and

the endoscopic imaging system is configured to, with the first imaging system visualizing the first side of the tissue wall, magnetically sense the first electromagnetic fiducial marker to detect a location of the first imaging system.

13. The system of claim 1 , wherein the first imaging system includes a rigid scoping device, the endoscopic imaging system includes a flexible scoping device, the first side of the tissue wall and the first area are outside of an organ, and the second, opposite side of the tissue wall and the second area are inside the organ.

14. A surgical system, comprising:

a first imaging system configured to provide visualization of a surgical site including a tissue wall, the first imaging system being a thoracoscopic imaging system or a laparoscopic imaging system, and the first imaging system having a first electromagnetic fiducial marker thereon;

an endoscopic imaging system configured to be advanced to the surgical site transorally, configured to provide visualization of the surgical site including the tissue wall, and configured to, with the first imaging system and the endoscopic imaging system being unable to directly visualize each other and with the first imaging system visualizing a first side of the tissue wall, magnetically sense the first electromagnetic fiducial marker to detect a location of the first imaging system, wherein the endoscopic imaging system has a second electromagnetic fiducial marker thereon, and the first imaging system is configured to, with the first imaging system and the endoscopic imaging system being unable to directly visualize each other and with the endoscopic imaging system visualizing a second, opposite side of the tissue wall, magnetically sense the second electromagnetic fiducial marker to detect a location of the endoscopic imaging system;

a first surgical instrument; and

a second surgical instrument;

wherein the first imaging system and the endoscopic imaging system are configured to be operatively coupled together such that, with the first imaging system and the endoscopic imaging system being unable to directly visualize each other, with the first imaging system being unable to directly visualize the second surgical instrument, and with the endoscopic imaging system being unable to directly visualize the first surgical instrument, the first surgical instrument is configured to be guided based on the visualization provided by the endoscopic imaging system and the second surgical instrument is configured to be guided based on the visualization provided by the first imaging system.

15. The system of claim 14 , wherein at least one of the first and second surgical instruments includes integrated tracking and coordinating means configured to identify a location of the at least one first surgical instrument and second surgical instrument and is configured to communicate the location to the first imaging system and the endoscopic imaging system so as to provide secondary location verification to the first imaging system and the endoscopic imaging system.

16. The system of claim 14 , wherein the first imaging system and the endoscopic imaging system are configured to each visualize a common anatomic landmark and thereby facilitate guiding of the first and second surgical instruments relative to one another.

17. The system of claim 14 , wherein a robotic surgical system is configured to control the guiding of the first and second surgical instruments.

18. The system of claim 14 , wherein a surgical hub is configured to control the guiding of the first and second surgical instruments.

19. The system of claim 14 , wherein the first imaging system is a thoracoscopic imaging system, the tissue wall is a wall of a lung, the first side of the tissue wall is outside of the lung, the guiding of the first surgical instrument includes automatically and electronically guiding the first surgical instrument outside of the lung, the second, opposite side of the tissue wall is inside the lung, and the guiding of the second surgical instrument includes automatically and electronically guiding the second surgical instrument inside of the lung.

20. The system of claim 14 , wherein the first imaging system is a laparoscopic imaging system, the tissue wall is a wall of a stomach, the first side of the tissue wall is outside of the stomach, the guiding of the first surgical instrument includes automatically and electronically guiding the first surgical instrument outside of the stomach, the second, opposite side of the tissue wall is inside the stomach, and the guiding of the second surgical instrument includes automatically and electronically guiding the second surgical instrument within the stomach.

21. A surgical system, comprising:

a first imaging system configured to provide visualization of a surgical site including a tissue wall, the first imaging system being a thoracoscopic imaging system or a laparoscopic imaging system;

a first surgical instrument configured to be guided based on the visualization provided by the first imaging system;

an endoscopic imaging system configured to be advanced to the surgical site transorally and configured to provide visualization of the surgical site including the tissue wall;

a second surgical instrument configured to be guided based on the visualization provided by the endoscopic imaging system; and

a controller configured to, with the first imaging system and the endoscopic imaging system being unable to directly visualize each other, with the first imaging system visualizing a first side of the tissue wall, and with the endoscopic imaging system visualizing a second, opposite side of the tissue wall:

receive first visualization data from the first imaging system indicative of first images gathered by the first imaging system,

receive second visualization data from the endoscopic imaging system indicative of second images gathered by the endoscopic imaging system,

automatically cause movement of the first surgical instrument based on the second visualization data, and

automatically cause movement of the second surgical instrument based on the first visualization data.

22. The system of claim 21 , wherein one of a surgical hub and a robotic surgical system includes the controller.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2022
From: FIEBIG, KEVIN M.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 062058/0312 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 28, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 057947/0036 →
Continuity (2)
Provisional Application 63249644 · Sep 29, 2021
Related Publication 20230116781A1 · Apr 13, 2023
References Cited (283)
US 5188104A · Wernicke et al. · 1993 [cited by applicant]
US 5231988A · Wernicke et al. · 1993 [cited by applicant]
US 5256149A · Banik et al. · 1993 [cited by applicant]
US 5263480A · Wernicke et al. · 1993 [cited by applicant]
US 5540730A · Terry, Jr. et al. · 1996 [cited by applicant]
US 5558671A · Yates · 1996 [cited by applicant]
US 6086528A · Adair · 2000 [cited by applicant]
US 6332089B1 · Acker · 2001 [cited by examiner]
US 6471172B1 · Lemke et al. · 2002 [cited by applicant]
US 7143925B2 · Shelton, IV et al. · 2006 [cited by applicant]
US 7585290B2 · Kathrani et al. · 2009 [cited by applicant]
US 7601118B2 · Smith et al. · 2009 [cited by applicant]
US 8068649B2 · Green · 2011 [cited by applicant]
US 8317070B2 · Hueil et al. · 2012 [cited by applicant]
US 8352026B2 · DiUbaldi · 2013 [cited by applicant]
US 8393514B2 · Shelton, IV et al. · 2013 [cited by applicant]
US 8465417B2 · Yamaguchi et al. · 2013 [cited by applicant]
US 8517933B2 · Mohr · 2013 [cited by applicant]
US 8545515B2 · Prisco et al. · 2013 [cited by applicant]
US 8551115B2 · Steger et al. · 2013 [cited by applicant]
US 8623028B2 · Rogers et al. · 2014 [cited by applicant]
US 8632462B2 · Yoo et al. · 2014 [cited by applicant]
US 8636751B2 · Albrecht et al. · 2014 [cited by applicant]
US 8734478B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8753338B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8771180B2 · Mohr · 2014 [cited by applicant]
US 8812100B2 · Voegele et al. · 2014 [cited by applicant]
US 8831782B2 · Itkowitz · 2014 [cited by applicant]
US 8888789B2 · Prisco et al. · 2014 [cited by applicant]
US 8919348B2 · Williams et al. · 2014 [cited by applicant]
US 8961406B2 · Ortiz et al. · 2015 [cited by applicant]
US 9044606B2 · Harris et al. · 2015 [cited by applicant]
US 9072535B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9072536B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9204879B2 · Shelton, IV · 2015 [cited by applicant]
US 9216062B2 · Duque et al. · 2015 [cited by applicant]
US 9254178B2 · Prisco et al. · 2016 [cited by applicant]
US 9274047B2 · Velten et al. · 2016 [cited by applicant]
US 9283050B2 · Prisco et al. · 2016 [cited by applicant]
US 9320416B2 · Cooper et al. · 2016 [cited by applicant]
US 9339341B2 · Cooper · 2016 [cited by applicant]
US 9358074B2 · Schena et al. · 2016 [cited by applicant]
US 9393017B2 · Flanagan et al. · 2016 [cited by applicant]
US 9561038B2 · Shelton, IV et al. · 2017 [cited by applicant]
US 9572481B2 · Duindam et al. · 2017 [cited by applicant]
US 9636186B2 · Kumar et al. · 2017 [cited by applicant]
US 9757128B2 · Baber et al. · 2017 [cited by applicant]
US 9833254B1 · Barral et al. · 2017 [cited by applicant]
US 9962161B2 · Scheib et al. · 2018 [cited by applicant]
US 10092738B2 · Harris et al. · 2018 [cited by applicant]
US 10159487B2 · Gagner et al. · 2018 [cited by applicant]
US 10179024B2 · Yeung · 2019 [cited by applicant]
US 10206682B2 · Bakos et al. · 2019 [cited by applicant]
US 10245069B2 · Rogers et al. · 2019 [cited by applicant]
US 10492788B2 · Swayze et al. · 2019 [cited by applicant]
US 10517600B2 · Beisel et al. · 2019 [cited by applicant]
US 10569071B2 · Harris et al. · 2020 [cited by applicant]
US 10607738B2 · Davidson et al. · 2020 [cited by applicant]
US 10639104B1 · Barral et al. · 2020 [cited by applicant]
US 10716564B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10722301B2 · Amirana et al. · 2020 [cited by applicant]
US 10751117B2 · Witt et al. · 2020 [cited by applicant]
US 10779831B2 · Lukin et al. · 2020 [cited by applicant]
US 10792034B2 · Scheib et al. · 2020 [cited by applicant]
US 10856928B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10925598B2 · Scheib et al. · 2021 [cited by applicant]
US 11033272B2 · Fegelman et al. · 2021 [cited by applicant]
US 11051876B2 · Shelton, IV et al. · 2021 [cited by applicant]
US 11751877B2 · Seddon et al. · 2023 [cited by applicant]
US 11864764B2 · Tinkham et al. · 2024 [cited by applicant]
US 20050182295A1 · Soper et al. · 2005 [cited by applicant]
US 20050277998A1 · Tracey et al. · 2005 [cited by applicant]
US 20060195146A1 · Tracey et al. · 2006 [cited by applicant]
US 20060195153A1 · DiUbaldi et al. · 2006 [cited by applicant]
US 20070113860A1 · Anderson · 2007 [cited by examiner]
US 20070185541A1 · DiUbaldi et al. · 2007 [cited by applicant]
US 20080132962A1 · DiUbaldi et al. · 2008 [cited by applicant]
US 20080147146A1 · Wahlgren et al. · 2008 [cited by applicant]
US 20080312498A1 · Moll · 2008 [cited by examiner]
US 20090062792A1 · Vakharia et al. · 2009 [cited by applicant]
US 20090132018A1 · DiUbaldi et al. · 2009 [cited by applicant]
US 20090135280A1 · Johnston et al. · 2009 [cited by applicant]
US 20090137868A1 · Yamaguchi · 2009 [cited by examiner]
US 20090137893A1 · Seibel et al. · 2009 [cited by applicant]
US 20090149918A1 · Krulevitch et al. · 2009 [cited by applicant]
US 20090157149A1 · Wahlgren et al. · 2009 [cited by applicant]
US 20100161001A1 · DiUbaldi et al. · 2010 [cited by applicant]
US 20100161005A1 · Wahlgren et al. · 2010 [cited by applicant]
US 20100191267A1 · Fox · 2010 [cited by applicant]
US 20100239648A1 · Smith et al. · 2010 [cited by applicant]
US 20110094773A1 · Bare et al. · 2011 [cited by applicant]
US 20110118708A1 · Burbank et al. · 2011 [cited by applicant]
US 20120150192A1 · Dachs, II et al. · 2012 [cited by applicant]
US 20120209314A1 · Weir et al. · 2012 [cited by applicant]
US 20120245576A1 · Epstein et al. · 2012 [cited by applicant]
US 20130105545A1 · Burbank · 2013 [cited by applicant]
US 20130105552A1 · Weir et al. · 2013 [cited by applicant]
US 20130146643A1 · Schmid et al. · 2013 [cited by applicant]
US 20130221065A1 · Aronhalt et al. · 2013 [cited by applicant]
US 20130256377A1 · Schmid et al. · 2013 [cited by applicant]
US 20140066717A1 · Rogers et al. · 2014 [cited by applicant]
US 20140121678A1 · Trusty et al. · 2014 [cited by applicant]
US 20140253684A1 · Kumar et al. · 2014 [cited by applicant]
US 20140268046A1 · Narasimha-Iyer et al. · 2014 [cited by applicant]
US 20150129634A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133995A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133996A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134076A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134077A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150238268A1 · Weir et al. · 2015 [cited by applicant]
US 20150257841A1 · Dachs, II · 2015 [cited by applicant]
US 20150257842A1 · Dachs, II · 2015 [cited by applicant]
US 20150272575A1 · Leimbach et al. · 2015 [cited by applicant]
US 20150282736A1 · Huldin · 2015 [cited by examiner]
US 20150351758A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20160015469A1 · Goshayesh et al. · 2016 [cited by applicant]
US 20160128782A1 · Wei et al. · 2016 [cited by applicant]
US 20160256071A1 · Shelton, IV et al. · 2016 [cited by applicant]
US 20160262761A1 · Beisel et al. · 2016 [cited by applicant]
US 20160303743A1 · Rockrohr · 2016 [cited by applicant]
US 20160324523A1 · Lukin et al. · 2016 [cited by applicant]
US 20160331473A1 · Yamamura · 2016 [cited by examiner]
US 20170035425A1 · Fegelman et al. · 2017 [cited by applicant]
US 20170055819A1 · Hansen et al. · 2017 [cited by applicant]
US 20170071693A1 · Taylor et al. · 2017 [cited by applicant]
US 20170128041A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128144A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128145A1 · Hasser et al. · 2017 [cited by applicant]
US 20170202591A1 · Shelton, IV et al. · 2017 [cited by applicant]
US 20170251900A1 · Hansen et al. · 2017 [cited by applicant]
US 20170265866A1 · Ryou et al. · 2017 [cited by applicant]
US 20180028187A1 · Gagner et al. · 2018 [cited by applicant]
US 20180049820A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20180049821A1 · Shelton, IV et al. · 2018 [cited by applicant]
US 20180146839A1 · Friedlander · 2018 [cited by examiner]
US 20180168757A1 · Bono · 2018 [cited by examiner]
US 20180177556A1 · Noonan · 2018 [cited by applicant]
US 20180256008A1 · Nishizawa · 2018 [cited by applicant]
US 20180353174A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20190099209A1 · Witt et al. · 2019 [cited by applicant]
US 20190125431A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190125457A1 · Parihar et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200905A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200981A1 · Harris et al. · 2019 [cited by applicant]
US 20190201046A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201088A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201114A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201136A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190204201A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206004A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206050A1 · Yates et al. · 2019 [cited by applicant]
US 20190206555A1 · Morgan et al. · 2019 [cited by applicant]
US 20190207857A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190290247A1 · Popovic et al. · 2019 [cited by applicant]
US 20190307331A1 · Saadat et al. · 2019 [cited by applicant]
US 20190343581A1 · Panescu et al. · 2019 [cited by applicant]
US 20200000530A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200015668A1 · Scheib · 2020 [cited by applicant]
US 20200015897A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015898A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015899A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015900A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015901A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015902A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015903A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015906A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015907A1 · Scheib · 2020 [cited by applicant]
US 20200015914A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015923A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015924A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015925A1 · Scheib · 2020 [cited by examiner]
US 20200078109A1 · Steger et al. · 2020 [cited by applicant]
US 20200085516A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200100855A1 · Leparmentier et al. · 2020 [cited by applicant]
US 20200170720A1 · Ummalaneni · 2020 [cited by applicant]
US 20200188041A1 · Toporek · 2020 [cited by examiner]
US 20200188043A1 · Yu et al. · 2020 [cited by applicant]
US 20200222146A1 · Komp · 2020 [cited by applicant]
US 20200229866A1 · Harlev et al. · 2020 [cited by applicant]
US 20200297403A1 · Kochavi et al. · 2020 [cited by applicant]
US 20200315723A1 · Hassan et al. · 2020 [cited by applicant]
US 20200391053A1 · Koyama et al. · 2020 [cited by applicant]
US 20210085410A1 · Hassan et al. · 2021 [cited by applicant]
US 20210196108A1 · Shelton, IV · 2021 [cited by applicant]
US 20210196109A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196381A1 · Eckert et al. · 2021 [cited by applicant]
US 20210196383A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196384A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196385A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196386A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196423A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196424A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196425A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210199557A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210289189A1 · Sela · 2021 [cited by applicant]
US 20210307687A1 · Culman et al. · 2021 [cited by applicant]
US 20220192758A1 · Roh et al. · 2022 [cited by applicant]
US 20220218435A1 · Shirazian et al. · 2022 [cited by applicant]
US 20220395342A1 · Weiss et al. · 2022 [cited by applicant]
US 20230015694A1 · Lim · 2023 [cited by examiner]
US 20230096406A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230097906A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230098670A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230105509A1 · Shelton, IV et al. · 2023 [cited by applicant]
EP 1886711B1 · 2018 [cited by applicant]
EP 3305173A1 · 2018 [cited by applicant]
EP 3679851A1 · 2020 [cited by applicant]
EP 3845192A1 · 2021 [cited by applicant]
EP 3845193A1 · 2021 [cited by applicant]
WO WO2012007052A1 · 2012 [cited by applicant]
WO WO2014151621A1 · 2014 [cited by applicant]
WO WO2015142814A1 · 2015 [cited by applicant]
WO WO2015148378A1 · 2015 [cited by applicant]
WO WO2015153636A1 · 2015 [cited by applicant]
WO WO2015153642A1 · 2015 [cited by applicant]
WO WO2016144937A1 · 2016 [cited by applicant]
WO WO2016144998A1 · 2016 [cited by applicant]
WO WO2016183054A1 · 2016 [cited by applicant]
WO WO2016205266A1 · 2016 [cited by applicant]
WO WO2016205452A1 · 2016 [cited by applicant]
WO WO2016209769A1 · 2016 [cited by applicant]
WO WO2017044406A1 · 2017 [cited by applicant]
WO WO2017053358A1 · 2017 [cited by applicant]
WO WO2017053363A1 · 2017 [cited by applicant]
WO WO2017053507A1 · 2017 [cited by applicant]
WO WO2017053698A1 · 2017 [cited by applicant]
WO WO2017075121A1 · 2017 [cited by applicant]
WO WO2017116793A1 · 2017 [cited by applicant]
WO WO2018226050A1 · 2018 [cited by applicant]
WO WO2020243432A1 · 2020 [cited by applicant]
WO WO211639A1 · 2021 [cited by applicant]
“Fiber Bragg Gatings,” RP Photonics Encyclopedia, available at <https://www.rp-photonics.com/fiber_bragg_gratings.html>, dated no later than Apr. 5, 2021 (12 pages). [cited by applicant]
“Ion by Intuitive,” available at <https://www.intuitive.com/en-us/products-and-services/ion>, dated no later than Apr. 5, 2021 (5 pages). [cited by applicant]
Aisu et al., Laparoscopic and endoscopic cooperative surgery for gastric tumors: Perspective for actual practice and oncological benefits,: World J Gastrointest Oncol, Nov. 15, 2018, 10(11):381-397. [cited by applicant]
Akirov, “Duodenal Mucosal Resurfacing May Safely Improve Glycemic Control in T2D,” Aug. 19, 2019, Haymarket Media, Inc., 14 pages. [cited by applicant]
Brace et al., “Thermal Tumor Ablation in Clinical Use,” IEEE Pulse, 2011, 2(5):28-38. [cited by applicant]
Carlota V., “4D printing reconfigurable materials for use in aerospace, medical and robotics fields,” Apr. 3, 2019, available at <https://www.3dnatices.com/en/4d-printing-materials-030420195/> (7 pages). [cited by applicant]
Chauhan et al, “Enteroscopy,” Gastrointestinal Endoscopy, 2015, vol. 82, No. 6, 975-990. [cited by applicant]
Conway et al., “Endoscopic hemostatic devices,” Gastrointestinal Endoscopy, 2009, vol. 69, No. 6, 987-996. [cited by applicant]
Dunkin et al., “Thin-layer ablation of human esophagael epithelium using a bipolar radiofrequency balloon device,” Surg Endosc (2006) 20: 125-130. [cited by applicant]
Ethicon, “Laparoscopic Sizing Tool: LINX® Reflux Management System,” 2019 (6 pages). [cited by applicant]
Fried et al., “A novel approach to glycemic control in type 2 diabetes mellius, partial jejunal diversion: pre-clinical to clinical pathway,” BMJ Open Diab Res Care 2017; 5:e000431.doi:10.1136*BMJdrc-2017000431. [cited by applicant]
Garvey, “Ablation of the Duodenal Mucosa as a Strategy for Glycemic Control in Diabetes: Role of Nutrient Signaling or Simple Weight Loss,” Diabetes Care 2016; 39:2108-2110. [cited by applicant]
Gioux et al., “Image-Guided Surgery using Invisible Near-Infrared Light: Fundamental of Clinical Translation,” Mol Imaging, Oct. 2010, 9)5): 237-255. [cited by applicant]
Gupta, “Understanding Image Recognition and Its Uses,” eInfochips, available at <http://www.einfochips.com/blog/understanding-image-recognition-and-its-uses/>, Dec. 11, 2019. [cited by applicant]
Hiki et al., “Laparoscopic and endoscopic cooperative surgery for gastrointestinal stromal tumor dissection,” Surg Endosc (2008) 22:1729-1735. [cited by applicant]
Intuitive Surgical, “Da Vinci Xi Single-Site Technology: Solutions For Single-Incision Surgery,” 2016 (10 pages). [cited by applicant]
Kurata et al., “Time-Of-Flight Near-Infrared Spectroscopy For Nondestructive Measurement Of Internal Quality In Grapefruit,” Journal of the American Society for Horticultural Science, May 2013 vol. 138 No. 3 225-228. [cited by applicant]
Machytka et al., “Partial jejunal diversion using an incisionless magnetic anastomosis system: 1-year interim results in patients with obesity and diabetes,” Gastrointestinal Endoscopy, 2017, vol. 86, No. 5, 904-912. [cited by applicant]
Matsuda et al., “Laparoscopic endoscopic cooperative surgery (LECS) for the upper gastrointestinal tract,” Transl Gastroenterol Hepatol 2017, 2:40 (6 pages). [cited by applicant]
Miklavčič et al., “Electric Properties of Tissues,” Wiley Encyclopedia of Biomedical Engineering, 2006, 1-12. [cited by applicant]
Sculpteo, “4D Printing: A technology coming from the future,” 3D Learning Hub, dated no later than Aug. 26, 2021 (12 pages). [cited by applicant]
Seeley et al., “The Role of Gut Adaptation in the Potent Effects of Multiple Bariatric Surgeries on Obesity and Diabetes,” Cell Metabolism 21, Mar. 3, 2015, 369-378. [cited by applicant]
Tamegai et al., “Laparoscopic and endoscopic cooperative surgery (LECS) to overcome the limitations of endoscopic resection for colorectal tumors,” Endosc Int Open, Dec. 2018, 6(12):E1477-E1485. [cited by applicant]
Tokar et al., “Electrosurgical generators,” Gastrointestinal Endoscopy, 2013, vol. 78, No. 2, 197-208. [cited by applicant]
Tomie et al., “Blue Laser Imaging-Bright Improves Endoscopic Recognition of Superficial Esophagael Squamous Cell Carcinoma,” Gastroenterology Research and Practice, vol. 2016, Article ID 6140854, 7 pages. [cited by applicant]
Toposens, “Advanced Ultrasonic Sensors: What Makes Them Different?” available at <https://toposens.com/technology/>, 2020. [cited by applicant]
Toposens, “Beacon Based 3D Tracking System,” available at <https://toposens.com/beacon-based-3d-ttracking-system/>, 2020. [cited by applicant]
U.S. Appl. No. 17/449,765 entitled “Cooperative Access Hybrid Procedures” filed Oct. 1, 2021. [cited by applicant]
U.S. Appl. No. 17/450,020 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,025 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,027 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/493,913 entitled “Surgical Methods Using Fiducial Identification and Tracking” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/494,364 entitled “Surgical Methods for Control of One Visualization With Another ” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/068,857 entitled “Adaptive Responses From Smart Packaging Of Drug Delivery Absorbable Adjuncts” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,858 entitled “Drug Administration Devices That Communicate With Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,859 entitled “Controlling Operation Of Drug Administration Devices Using Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,863 entitled “Patient Monitoring Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,865 entitled “Monitoring And Communicating Information Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,867 entitled “Aggregating And Analyzing Drug Administration Data” filed Oct. 13, 2020. [cited by applicant]
Van Baar et al., “Endoscopic duodenal mucosal resurfacing for the treatment of type 2 diabetes mellitus: one year results from the first international, open label, prospective, multicentre study,” Gut 2020, 69:295-303. [cited by applicant]
Yang et al., “4d printing reconfigurable, deployable and mechanically tunable materials,” Material Science, 2019 (33 pages). [cited by applicant]
Zuo et al., “Pulmonary Intersegmental Places: Imaging Appearance and Possible Reasons Leading to Their Visualization,” Radiology, vol. 267, No. 1, Apr. 2013, 267-275. [cited by applicant]
U.S. Appl. No. 17/493,904, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,906, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,907, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,911, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
International Search Report and Written Opinion received for Intl. Pat. App. No. PCT/IB2022/059077 mailed on Nov. 23, 2022. (14 pages). [cited by applicant]
International Search Report and Written Opinion received for Intl. Pat. App. No. PCT/IB2022/059090 mailed on Dec. 6, 2022. (13 pages). [cited by applicant]
C|International Search Report and Written Opinion received for Intl. Pat. App. No. PCT/IB2022/059089 mailed on Dec. 8, 2022. (14 pages). [cited by applicant]
International Search Report and Written Opinion received for Intl. Pat. App. No. PCT/IB2022/059110 mailed on Dec. 14, 2022. (16 pages). [cited by applicant]