IP Library Granted Patent US 12,239,387
Granted Patent B2
US 12,239,387 · App. 17/493,913 · Granted Mar 4, 2025

Surgical methods using fiducial identification and tracking

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Jason L. Harris (Lebanon, OH); David C. Yates (Morrow, OH); Daniel J. Mumaw (Cincinnati, OH); Charles J. Scheib (Loveland, OH)
Assignee: Cilag GmbH International
A61B34/20A61B1/000095A61B1/042A61B34/30A61B90/30A61B90/37A61B90/39A61B90/96A61B90/98G06T5/50G06T5/77G06T5/80G06T7/00G06T7/0014G06V10/10A61B2034/2051A61B2034/2055A61B2034/2068A61B2034/302A61B2090/371A61B2090/374A61B2090/3762A61B2090/378A61B2090/3958G06T2207/10016G06T2207/10081G06T2207/10088G06T2207/10132G06T2207/30004G06T2207/30168G06T2207/30204G06V2201/034
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,239,387
App. No.
17/493,913
Filed
Oct 5, 2021
Granted
Mar 4, 2025
Kind
B2
Art Unit
2646
USPC
382/128
Abstract

In general, devices, systems, and methods for fiducial identification and tracking are provided.

Claims (29)

1. A surgical method, comprising:

gathering, with an imaging device, an image visualizing a fiducial marker on a distal portion of a surgical device located in a body of the patient during performance of a surgical procedure, the fiducial marker storing information associated with the surgical device; and

in real time with the performance of the surgical procedure, analyzing, with a controller, the image to detect the information associated with the surgical device;

wherein the stored information is not static; and

the method further comprising changing, with a second controller of the surgical device, the stored information during the performance of the surgical procedure.

2. The method of claim 1 , wherein the stored information is unique to the surgical device and includes at least one of a model number of the surgical device and a serial number of the surgical device.

3. The method of claim 1 , wherein the stored information is unique to a visualization system including the surgical device.

4. The method of claim 1 , wherein the stored information includes an authentication signature indicating that the surgical device is certified authentic; and

the method further comprises analyzing, with the controller, the detected information, thereby determining that the surgical device is certified authentic.

5. The method of claim 1 , wherein the stored information is changed based on a current status of the surgical device and/or of a component of the surgical device.

6. The method of claim 1 , wherein the stored information is changed via at least one of a magnetic parameter change, an electromagnetic parameter change, or an electrical parameter change.

7. The method of claim 1 , wherein the fiducial marker is attached to a stationary portion of the surgical device.

8. The method of claim 1 , wherein the fiducial marker is attached to a movable portion of the surgical device; and

the method further comprises analyzing, with the controller, the detected information, thereby determining a condition of the movable portion of the surgical device.

9. The method of claim 1 , wherein the fiducial marker is active and is configured to emit energy configured to be detected by the imaging device; and

the method further comprises analyzing in real time with the performance of the surgical procedure, with the controller, the energy detected by the imaging device and thereby determine a location of the surgical device relative to a target.

10. The method of claim 1 , wherein a surgical hub includes the controller.

11. The method of claim 1 , wherein a robotic surgical system includes the controller, and the surgical device and the imaging device are each releasably coupled to and controlled by the robotic surgical system.

12. A surgical method, comprising:

using a first energy modality to detect, with a first imaging device, a fiducial marker on an exterior of a distal portion of a surgical device located in a body of a patient; and

using a second, different energy modality to detect, with a second imaging device, the fiducial marker in the body of the patient;

wherein the first modality is visible light, and the second modality is non-visible light;

the fiducial marker is the only fiducial marker on the exterior of the surgical device; and

the fiducial marker is multi-modal such that the fiducial marker stores first information that is detectable by the first energy modality but not the second energy modality and stores second information that is detectable by the second energy modality but not the first energy modality.

13. The method of claim 12 , wherein the second modality is one or more of multi-spectral light, computerized tomography (CT), ultrasound, Hall effect magnetism, and magnetic resonance imaging (MRI).

14. The method of claim 12 , further comprising causing, with a controller, a display device to show data indicative of the fiducial marker detected by each of the first and second imaging devices.

15. The method of claim 14 , wherein a robotic surgical system includes the controller, and the surgical device and the first and second imaging devices are each releasably coupled to and controlled by the robotic surgical system.

16. The method of claim 14 , wherein a surgical hub includes the controller.

17. The method of claim 12 , wherein the first and second information communicate the same information associated with the surgical device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2021
From: SHELTON, FREDERICK E., IV; HARRIS, JASON L.; YATES, DAVID C.; MUMAW, DANIEL J.; SCHEIB, CHARLES J.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 057959/0204 →
Continuity (2)
Provisional Application 63249652 · Sep 29, 2021
Related Publication 20230095002A1 · Mar 30, 2023
References Cited (262)
US 5188104A · Wernicke et al. · 1993 [cited by applicant]
US 5231988A · Wernicke et al. · 1993 [cited by applicant]
US 5256149A · Banik et al. · 1993 [cited by applicant]
US 5263480A · Wernicke et al. · 1993 [cited by applicant]
US 5540730A · Terry, Jr. et al. · 1996 [cited by applicant]
US 5558091A · Acker et al. · 1996 [cited by applicant]
US 5558671A · Yates · 1996 [cited by applicant]
US 6086528A · Adair · 2000 [cited by applicant]
US 7143925B2 · Shelton, IV et al. · 2006 [cited by applicant]
US 7585290B2 · Kathrani et al. · 2009 [cited by applicant]
US 7601118B2 · Smith et al. · 2009 [cited by applicant]
US 8068649B2 · Green · 2011 [cited by applicant]
US 8114345B2 · Dlugos, Jr. et al. · 2012 [cited by applicant]
US 8317070B2 · Hueil et al. · 2012 [cited by applicant]
US 8352026B2 · DiUbaldi · 2013 [cited by applicant]
US 8393514B2 · Shelton, IV et al. · 2013 [cited by applicant]
US 8517933B2 · Mohr · 2013 [cited by applicant]
US 8545515B2 · Prisco et al. · 2013 [cited by applicant]
US 8551115B2 · Steger et al. · 2013 [cited by applicant]
US 8623028B2 · Rogers et al. · 2014 [cited by applicant]
US 8632462B2 · Yoo et al. · 2014 [cited by applicant]
US 8636751B2 · Albrecht et al. · 2014 [cited by applicant]
US 8734478B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8753338B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8771180B2 · Mohr · 2014 [cited by applicant]
US 8812100B2 · Voegele et al. · 2014 [cited by applicant]
US 8831782B2 · Itkowitz · 2014 [cited by applicant]
US 8888789B2 · Prisco et al. · 2014 [cited by applicant]
US 8919348B2 · Williams et al. · 2014 [cited by applicant]
US 8961406B2 · Ortiz et al. · 2015 [cited by applicant]
US 9044606B2 · Harris et al. · 2015 [cited by applicant]
US 9072535B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9072536B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9204879B2 · Shelton, IV · 2015 [cited by applicant]
US 9216062B2 · Duque et al. · 2015 [cited by applicant]
US 9254178B2 · Prisco et al. · 2016 [cited by applicant]
US 9274047B2 · Velten et al. · 2016 [cited by applicant]
US 9283050B2 · Prisco et al. · 2016 [cited by applicant]
US 9320416B2 · Cooper et al. · 2016 [cited by applicant]
US 9339341B2 · Cooper · 2016 [cited by applicant]
US 9358074B2 · Schena et al. · 2016 [cited by applicant]
US 9393017B2 · Flanagan et al. · 2016 [cited by applicant]
US 9561038B2 · Shelton, IV et al. · 2017 [cited by applicant]
US 9572481B2 · Duindam et al. · 2017 [cited by applicant]
US 9636186B2 · Kumar et al. · 2017 [cited by applicant]
US 9757128B2 · Baber et al. · 2017 [cited by applicant]
US 9962161B2 · Scheib et al. · 2018 [cited by applicant]
US 10092738B2 · Harris et al. · 2018 [cited by applicant]
US 10179024B2 · Yeung · 2019 [cited by applicant]
US 10206682B2 · Bakos et al. · 2019 [cited by applicant]
US 10245069B2 · Rogers et al. · 2019 [cited by applicant]
US 10492788B2 · Swayze et al. · 2019 [cited by applicant]
US 10517600B2 · Beisel et al. · 2019 [cited by applicant]
US 10569071B2 · Harris et al. · 2020 [cited by applicant]
US 10716564B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10751117B2 · Witt et al. · 2020 [cited by applicant]
US 10779831B2 · Lukin et al. · 2020 [cited by applicant]
US 10792034B2 · Scheib et al. · 2020 [cited by applicant]
US 10856928B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10925598B2 · Scheib et al. · 2021 [cited by applicant]
US 11033272B2 · Fegelman et al. · 2021 [cited by applicant]
US 11051876B2 · Shelton, IV et al. · 2021 [cited by applicant]
US 11432828B1 · Lang · 2022 [cited by examiner]
US 20050277998A1 · Tracey et al. · 2005 [cited by applicant]
US 20060195146A1 · Tracey et al. · 2006 [cited by applicant]
US 20060195153A1 · DiUbaldi et al. · 2006 [cited by applicant]
US 20070185541A1 · DiUbaldi et al. · 2007 [cited by applicant]
US 20080132962A1 · DiUbaldi et al. · 2008 [cited by applicant]
US 20080147146A1 · Wahlgren et al. · 2008 [cited by applicant]
US 20080294258A1 · Revie et al. · 2008 [cited by applicant]
US 20090062792A1 · Vakharia et al. · 2009 [cited by applicant]
US 20090132018A1 · DiUbaldi et al. · 2009 [cited by applicant]
US 20090149918A1 · Krulevitch et al. · 2009 [cited by applicant]
US 20090157149A1 · Wahlgren et al. · 2009 [cited by applicant]
US 20090216116A1 · Roger · 2009 [cited by applicant]
US 20100056900A1 · Whitcomb et al. · 2010 [cited by applicant]
US 20100161001A1 · DiUbaldi et al. · 2010 [cited by applicant]
US 20100161005A1 · Wahlgren et al. · 2010 [cited by applicant]
US 20100191267A1 · Fox · 2010 [cited by applicant]
US 20100239648A1 · Smith et al. · 2010 [cited by applicant]
US 20110094773A1 · Bare et al. · 2011 [cited by applicant]
US 20110118708A1 · Burbank et al. · 2011 [cited by applicant]
US 20120095458A1 · Cybulski et al. · 2012 [cited by applicant]
US 20120150192A1 · Dachs, II et al. · 2012 [cited by applicant]
US 20120209314A1 · Weir et al. · 2012 [cited by applicant]
US 20130060146A1 · Yang et al. · 2013 [cited by applicant]
US 20130105545A1 · Burbank · 2013 [cited by applicant]
US 20130105552A1 · Weir et al. · 2013 [cited by applicant]
US 20130146643A1 · Schmid et al. · 2013 [cited by applicant]
US 20130221065A1 · Aronhalt et al. · 2013 [cited by applicant]
US 20130256377A1 · Schmid et al. · 2013 [cited by applicant]
US 20130317353A1 · Frank et al. · 2013 [cited by applicant]
US 20140066717A1 · Rogers et al. · 2014 [cited by applicant]
US 20140121678A1 · Trusty et al. · 2014 [cited by applicant]
US 20140266591A1 · Klammer et al. · 2014 [cited by applicant]
US 20150129634A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133995A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133996A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134076A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134077A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150238268A1 · Weir et al. · 2015 [cited by applicant]
US 20150257841A1 · Dachs, II · 2015 [cited by applicant]
US 20150257842A1 · Dachs, II · 2015 [cited by applicant]
US 20150272575A1 · Leimbach et al. · 2015 [cited by applicant]
US 20150351758A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20160015471A1 · Piron · 2016 [cited by examiner]
US 20160256071A1 · Shelton, IV et al. · 2016 [cited by applicant]
US 20160262761A1 · Beisel et al. · 2016 [cited by applicant]
US 20160303743A1 · Rockrohr · 2016 [cited by applicant]
US 20170035425A1 · Fegelman et al. · 2017 [cited by applicant]
US 20170055819A1 · Hansen et al. · 2017 [cited by applicant]
US 20170071693A1 · Taylor et al. · 2017 [cited by applicant]
US 20170128041A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128144A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128145A1 · Hasser et al. · 2017 [cited by applicant]
US 20170202591A1 · Shelton, IV et al. · 2017 [cited by applicant]
US 20170251900A1 · Hansen et al. · 2017 [cited by applicant]
US 20170265866A1 · Ryou et al. · 2017 [cited by applicant]
US 20180049820A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20180092698A1 · Chopra et al. · 2018 [cited by applicant]
US 20180177556A1 · Noonan · 2018 [cited by applicant]
US 20180353174A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20190099209A1 · Witt et al. · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190125431A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200905A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200981A1 · Harris et al. · 2019 [cited by applicant]
US 20190201046A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201088A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201114A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201136A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190204201A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190205820A1 · Nuthi · 2019 [cited by applicant]
US 20190206004A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206050A1 · Yates et al. · 2019 [cited by applicant]
US 20190206555A1 · Morgan et al. · 2019 [cited by applicant]
US 20190206562A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190207857A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190289284A1 · Smith et al. · 2019 [cited by applicant]
US 20190374290A1 · Stolka et al. · 2019 [cited by applicant]
US 20200000530A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200015668A1 · Scheib · 2020 [cited by applicant]
US 20200015897A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015898A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015899A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015900A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015901A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015902A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015903A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015906A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015907A1 · Scheib · 2020 [cited by applicant]
US 20200015914A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015923A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015924A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015925A1 · Scheib · 2020 [cited by applicant]
US 20200078109A1 · Steger et al. · 2020 [cited by applicant]
US 20200085516A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200170720A1 · Ummalaneni · 2020 [cited by applicant]
US 20200188043A1 · Yu et al. · 2020 [cited by applicant]
US 20200315723A1 · Hassan et al. · 2020 [cited by applicant]
US 20210056700A1 · Chen et al. · 2021 [cited by applicant]
US 20210152802A1 · Varekamp · 2021 [cited by examiner]
US 20210196108A1 · Shelton, IV · 2021 [cited by applicant]
US 20210196109A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196381A1 · Eckert et al. · 2021 [cited by applicant]
US 20210196383A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196384A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196385A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196386A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196423A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196424A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196425A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210199557A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210289189A1 · Sela · 2021 [cited by applicant]
US 20210393344A1 · Graetzel · 2021 [cited by examiner]
US 20210401507A1 · Stylos et al. · 2021 [cited by applicant]
US 20220047745A1 · Neveu et al. · 2022 [cited by applicant]
US 20220160428A1 · Murray et al. · 2022 [cited by applicant]
US 20220226069A1 · Vogtmeier et al. · 2022 [cited by applicant]
US 20230100989A1 · Shelton, IV · 2023 [cited by examiner]
US 20230102358A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230109848A1 · Shelton, IV · 2023 [cited by examiner]
CN 113767176A · 2021 [cited by examiner]
EP 1886711B1 · 2018 [cited by applicant]
EP 3679851A1 · 2020 [cited by applicant]
WO WO1998030166A1 · 1998 [cited by applicant]
WO WO2012007052A1 · 2012 [cited by applicant]
WO WO2014151621A1 · 2014 [cited by applicant]
WO WO2015142814A1 · 2015 [cited by applicant]
WO WO2015153636A1 · 2015 [cited by applicant]
WO WO2015153642A1 · 2015 [cited by applicant]
WO WO2016144937A1 · 2016 [cited by applicant]
WO WO2016144998A1 · 2016 [cited by applicant]
WO WO2016183054A1 · 2016 [cited by applicant]
WO WO2016205266A1 · 2016 [cited by applicant]
WO WO2016205452A1 · 2016 [cited by applicant]
WO WO2016209769A1 · 2016 [cited by applicant]
WO WO2017042171A1 · 2017 [cited by applicant]
WO WO2017044406A1 · 2017 [cited by applicant]
WO WO2017053358A1 · 2017 [cited by applicant]
WO WO2017053363A1 · 2017 [cited by applicant]
WO WO2017053507A1 · 2017 [cited by applicant]
WO WO2017053698A1 · 2017 [cited by applicant]
WO WO2017075121A1 · 2017 [cited by applicant]
WO WO2017116793A1 · 2017 [cited by applicant]
WO WO2019030235A1 · 2019 [cited by examiner]
WO WO2020163318A1 · 2020 [cited by applicant]
WO WO2021019369A1 · 2021 [cited by examiner]
WO WO2021216516A1 · 2021 [cited by examiner]
“Fiber Bragg Gatings,” RP Photonics Encyclopedia, available at <https://www.rp-photonics.com/fiber_bragg_gratings.html>, dated no later than Apr. 5, 2021 (12 pages). [cited by applicant]
“Ion by Intuitive,” available at <https://www.intuitive.com/en-us/products-and-services/ion>, dated no later than Apr. 5, 2021 (5 pages). [cited by applicant]
Aisu et al., Laparoscopic and endoscopic cooperative surgery for gastric tumors: Perspective for actual practice and oncological benefits,: World J Gastrointest Oncol, Nov. 15, 2018, 10(11):381-397. [cited by applicant]
Akirov, “Duodenal Mucosal Resurfacing May Safely Improve Glycemic Control in T2D,” Aug. 19, 2019, Haymarket Media, Inc., 14 pages. [cited by applicant]
Brace et al., “Thermal Tumor Ablation in Clinical Use,” IEEE Pulse, 2011, 2(5):28-38. [cited by applicant]
Carlota V., “4D printing reconfigurable materials for use in aerospace, medical and robotics fields,” Apr. 3, 2019, available at <https://www.3dnatices.com/en/4d-printing-materials-030420195/> (7 pages). [cited by applicant]
Chauhan et al., “Enteroscopy,” Gastrointestinal Endoscopy, 2015, vol. 82, No. 6, 975-990. [cited by applicant]
Conway et al., “Endoscopic hemostatic devices,” Gastrointestinal Endoscopy, 2009, vol. 69, No. 6, 987-996. [cited by applicant]
Dunkin et al., “Thin-layer ablation of human esophagael epithelium using a bipolar radiofrequency balloon device,” Surg Endosc (2006) 20: 125-130. [cited by applicant]
Ethicon, “Laparoscopic Sizing Tool: LINX® Reflux Management System,” 2019 (6 pages). [cited by applicant]
Fried et al., “A novel approach to glycemic control in type 2 diabetes mellius, partial jejunal diversion: pre-clinical to clinical pathway,” BMJ Open Diab Res Care 2017; 5:e000431.doi:10.1136*BMJdrc-2017000431. [cited by applicant]
Garvey, “Ablation of the Duodenal Mucosa as a Strategy for Glycemic Control in Diabetes: Role of Nutrient Signaling or Simple Weight Loss,” Diabetes Care 2016; 39:2108-2110. [cited by applicant]
Gioux et al., “Image-Guided Surgery using Invisible Near-Infrared Light: Fundamental of Clinical Translation,” Mol Imaging, Oct. 9, 2010 )5): 237-255. [cited by applicant]
Gupta, “Understanding Image Recognition and Its Uses,” einfochips, available at <http://www.einfochips.com/blog/understanding-image-recognition-and-its-uses/>, Dec. 11, 2019. [cited by applicant]
Hiki et al., “Laparoscopic and endoscopic cooperative surgery for gastrointestinal stromal tumor dissection,” Surg Endosc (2008) 22:1729-1735. [cited by applicant]
Intuitive Surgical, “Da Vinci Xi Single-Site Technology: Solutions For Single-Incision Surgery,” 2016 (10 pages). [cited by applicant]
Kurata et al., “Time-Of-Flight Near-Infrared Spectroscopy For Nondestructive Measurement Of Internal Quality In Grapefruit,” Journal of the American Society for Horticultural Science, May 2013 vol. 138 No. 3 225-228. [cited by applicant]
Machytka et al., “Partial jejunal diversion using an incisionless magnetic anastomosis system: 1-year interim results in patients with obesity and diabetes,” Gastrointestinal Endoscopy, 2017, vol. 86, No. 5, 904-912. [cited by applicant]
Matsuda et al., “Laparoscopic endoscopic cooperative surgery (LECS) for the upper gastrointestinal tract,” Transl Gastroenterol Hepatol 2017, 2:40 (6 pages). [cited by applicant]
Miklav?i? et al., “Electric Properties of Tissues,” Wiley Encyclopedia of Biomedical Engineering, 2006, 1-12. [cited by applicant]
Sculpteo, “4D Printing: A technology coming from the future,” 3D Learning Hub, dated no later than Aug. 26, 2021 (12 pages). [cited by applicant]
Seeley et al., “The Role of Gut Adaptation in the Potent Effects of Multiple Bariatric Surgeries on Obesity and Diabetes,” Cell Metabolism 21, Mar. 3, 2015, 369-378. [cited by applicant]
Tamegai et al., “Laparoscopic and endoscopic cooperative surgery (LECS) to overcome the limitations of endoscopic resection for colorectal tumors,” Endosc Int Open, Dec. 2018, 6(12):E1477-E1485. [cited by applicant]
Tokar et al., “Electrosurgical generators,” Gastrointestinal Endoscopy, 2013, vol. 78, No. 2, 197-208. [cited by applicant]
Tomie et al., “Blue Laser Imaging-Bright Improves Endoscopic Recognition of Superficial Esophagael Squamous Cell Carcinoma,” Gastroenterology Research and Practice, vol. 2016, Article ID 6140854, 7 pages. [cited by applicant]
Toposens, “Advanced Ultrasonic Sensors: What Makes Them Different?” available at <https://toposens.com/technology/>, 2020. [cited by applicant]
Toposens, “Beacon Based 3D Tracking System,” available at <https://toposens.com/beacon-based-3d-ttracking-system/>, 2020. [cited by applicant]
U.S. Appl. No. 17/449,765 entitled “Cooperative Access Hybrid Procedures” filed Oct. 1, 2021. [cited by applicant]
U.S. Appl. No. 17/450,020 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,025 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,027 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/494,364 entitled “Surgical Methods for Control of One Visualization With Another” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/493,904 entitled “Surgical Methods Using Multi-Source Imaging” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/068,857 entitled “Adaptive Responses From Smart Packaging of Drug Delivery Absorbable Adjuncts” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,858 entitled “Drug Administration Devices That Communicate With Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,859 entitled “Controlling Operation of Drug Administration Devices Using Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,863 entitled “Patient Monitoring Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,865 entitled “Monitoring And Communicating Information Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,867 entitled “Aggregating And Analyzing Drug Administration Data” filed Oct. 13, 2020. [cited by applicant]
van Baar et al., “Endoscopic duodenal mucosal resurfacing for the treatment of type 2 diabetes mellitus: one year results from the first international, open label, prospective, multicentre study,” Gut 2020, 69:295-303. [cited by applicant]
Yang et al., “4d printing reconfigurable, deployable and mechanically tunable materials,” Material Science, 2019 (33 pages). [cited by applicant]
Zuo et al., “Pulmonary Intersegmental Places: Imaging Appearance and Possible Reasons Leading to Their Visualization,” Radiology, vol. 267, No. 1, Apr. 2013, 267-275. [cited by applicant]
U.S. Appl. No. 17/493,914, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,919, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,920, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059092 mailed Apr. 2, 2024. (9 pages). [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059099 mailed Apr. 2, 2024. (8 pages). [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059111 mailed Apr. 2, 2024. (15 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059092 mailed Jan. 9, 2023. (10 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059099 mailed Jan. 9, 2023. (9 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059111 mailed Jan. 25, 2023. (20 pages). [cited by applicant]