IP Library › Granted Patent US 12,472,002
Granted Patent B2
US 12,472,002 · App. 17/493,920 · Granted Nov 18, 2025

Surgical devices, systems, and methods using fiducial identification and tracking

Inventors: Frederick E. Shelton, IV (Hillsboro, OH); Charles J. Scheib (Loveland, OH); Andrew C. Deck (Cincinnati, OH)
Assignee: Cilag GmbH International
A61B34/20A61B1/000095A61B1/042A61B34/30A61B90/30A61B90/37A61B90/39A61B90/96A61B90/98G06T5/50G06T5/77G06T5/80G06T7/00G06T7/0014G06V10/10A61B2034/2051A61B2034/2055A61B2034/2068A61B2034/302A61B2090/371A61B2090/374A61B2090/3762A61B2090/378A61B2090/3958G06T2207/10016G06T2207/10081G06T2207/10088G06T2207/10132G06T2207/30004G06T2207/30168G06T2207/30204G06V2201/034
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,472,002
App. No.
17/493,920
Granted
Nov 18, 2025
Kind
B2
Abstract

In general, devices, systems, and methods for fiducial identification and tracking are provided.

Claims (52)

1 . A surgical system, comprising:

a first imaging device configured to gather a first image of a surgical site during performance of a surgical procedure, the first image being an undistorted visualization of the surgical site;

a second imaging device configured to gather a second image of the surgical site during the performance of the surgical procedure, the second image being a distorted visualization of the surgical site; and

a processor operatively coupled to the first and second imaging devices, the processor configured to:

receive information indicating the first image of the undistorted visualization of the surgical site and the second image of the distorted visualization of the surgical site;

identify a critical structure associated with the surgical site;

determine that the distorted visualization of the surgical site includes a portion of the identified critical structure;

based at least on the determination that the distorted visualization of the surgical site includes at least the portion of the identified critical structure, supplement the second image by filling in an element missing from the second image with an element present in the first image to reduce the distorted visualization of the second image;

generate a third image based on the supplemented second image; and

send an indication of the third image to a display, to cause the display to show the third image.

2 . The system of claim 1 , wherein the second image is distorted due to at least one of strain of tissue at the surgical site, compression of tissue at the surgical site, collapse of tissue at the surgical site, or obstruction of an image sensor of the second imaging device by at least one of tissue or fluid at the surgical site.

3 . The system of claim 1 , wherein the element missing from the second image associated with the portion of the identified critical structure.

4 . The system of claim 1 , wherein the supplementing further includes replacing a distorted element in the second image with an undistorted element in the first image.

5 . The system of claim 1 , wherein the processor is further configured to:

compare pixels of the first image with pixels of the second image to detect an irregularity in the second image; and

correct the irregularity based on the pixels of the first image, wherein the second image is further supplemented based on the corrected irregularity.

6 . The system of claim 5 , wherein the first and second images are video images, each including a plurality of frames, and wherein the processor is further configured to:

obtain a first set of pixels in a first frame of the first image, wherein the first set of pixels is gathered within a predefined time period associated with a second frame of the second image; and

replace a second set of pixels in the second frame of the second image with the first set of pixels in the first frame of the first image, wherein the second image is supplemented further based on the replaced second set of pixels.

7 . The system of claim 1 , wherein the first and second images are video images, each including a plurality of frames, and wherein the processor is further configured to:

identify a distorted frame in the second image; and

correct the distorted frame in the second image using a frame in the first image that was gathered within a predefined time period of the distorted frame of the second image.

8 . The system of claim 1 , wherein the first imaging device is further configured to gather the first image using visible light, and wherein the second imaging device is further configured to gather the second image using non-visible light.

9 . The system of claim 1 , wherein the processor is further configured to:

obtain a first set of pixels in a first frame from the first image, wherein the first set of pixels is gathered within a predefined time period associated with a second frame; and

merge a second set of pixels in the second frame of the second image with the first set of pixels in the first frame to obtain merged pixels, wherein the second image is supplemented further based on the merged pixels.

10 . The system of claim 1 , wherein a robotic surgical system includes the processor, and the first and second imaging devices are each configured to be releasably coupled to and controlled by the robotic surgical system.

11 . The system of claim 1 , wherein the first imaging device has a first point of view (POV) of the surgical site when the first image is gathered; and

the second imaging device has a second POV of the surgical site when the second image is gathered, wherein the second POV and the first POV are different.

12 . The system of claim 1 , wherein the processor is configured to supplement the second image further based on the distorted visualization of the surgical site being within a predetermined threshold distance of the second imaging device.

13 . The system of claim 1 , wherein the critical structure includes at least one of an anatomical structure, an artery, a vein, a tumor, or a foreign structure.

14 . A surgical method, comprising:

receiving information during performance of a surgical procedure, wherein the information indicates a first image of an undistorted visualization of a surgical site from a first surgical device and a second image of a distorted visualization of the surgical site;

identifying a critical structure associated with the surgical site;

determining that the distorted visualization of the surgical site includes a portion of the identified critical structure;

based on the determination that the distorted visualization of the surgical site includes at least the portion of the identified critical structure, supplementing the second image by filling in an element missing from the second image with the element present in the first image to reduce the distorted visualization of the second image;

generating a third image based on the supplemented second image; and

sending an indication of the third image to a display, to cause the display to show the third image.

15 . A surgical system, comprising:

a first imaging device configured to gather a first image of an undistorted visualization of a surgical site from a first point of view (POV) during performance of a surgical procedure, wherein the first image is gathered via a common wavelength of light, and wherein the first imaging device is configured to be advanced to the surgical site through a first cannulated access device;

a second imaging device configured to gather a second image of a distorted visualization of the surgical site from a second POV during the performance of the surgical procedure, wherein the second image is gathered via the common wavelength of light, and wherein the second imaging device is configured to be advanced to the surgical site through a second cannulated access device independently of the first imaging device; and

a processor operatively coupled to the first and the second imaging devices, the processor configured to:

identify a critical structure associated with the surgical site;

determine that distorted visualization of the surgical site includes at least a portion of the critical structure; and

based on the determination that the distorted visualization of the surgical site includes the portion of the critical structure, supplement the second image by filling in an element missing from the second image with an element present in the first image to reduce the distorted visualization of the second image;

generate a third image based on the supplemented second image; and

send an indication of the third image to a display, to cause the display to show the third image.

16 . The system of claim 15 , wherein the first imaging device includes a first scope and is further configured to gather the first image from a first body cavity and the second imaging device includes a second scope and is configured to gather the second image from a second body cavity.

17 . The system of claim 15 , wherein the third image includes an overlay of a portion of the first image on the second image.

18 . The system of claim 15 , wherein the processor is further configured to adjust the second image based on the first image, and wherein the third image includes the adjusted second image.

19 . The system of claim 15 , wherein the element missing from the second image is associated with the portion of the identified critical structure.

20 . The system of claim 15 , wherein a robotic surgical system includes the processor, and the first and second imaging devices are each configured to be releasably coupled to and controlled by the robotic surgical system.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 29, 2021
From: SHELTON, FREDERICK E., IV; SCHEIB, CHARLES J.; DECK, ANDREW C.
To: CILAG GMBH INTERNATIONAL
Reel/Frame 057959/0538 →
Continuity (2)
Provisional Application 63249652 · Sep 29, 2021
Related Publication 20230100989A1 · Mar 30, 2023
References Cited (275)
US 5188104A · Wernicke et al. · 1993 [cited by applicant]
US 5231988A · Wernicke et al. · 1993 [cited by applicant]
US 5256149A · Banik et al. · 1993 [cited by applicant]
US 5263480A · Wernicke et al. · 1993 [cited by applicant]
US 5540730A · Terry, Jr. et al. · 1996 [cited by applicant]
US 5558091A · Acker et al. · 1996 [cited by applicant]
US 5558671A · Yates · 1996 [cited by applicant]
US 6086528A · Adair · 2000 [cited by applicant]
US 7143925B2 · Shelton, IV et al. · 2006 [cited by applicant]
US 7585290B2 · Kathrani et al. · 2009 [cited by applicant]
US 7601118B2 · Smith et al. · 2009 [cited by applicant]
US 8068649B2 · Green · 2011 [cited by applicant]
US 8114345B2 · Dlugos, Jr. et al. · 2012 [cited by applicant]
US 8317070B2 · Hueil et al. · 2012 [cited by applicant]
US 8352026B2 · DiUbaldi · 2013 [cited by applicant]
US 8393514B2 · Shelton, IV et al. · 2013 [cited by applicant]
US 8517933B2 · Mohr · 2013 [cited by applicant]
US 8545515B2 · Prisco et al. · 2013 [cited by applicant]
US 8551115B2 · Steger et al. · 2013 [cited by applicant]
US 8623028B2 · Rogers et al. · 2014 [cited by applicant]
US 8632462B2 · Yoo et al. · 2014 [cited by applicant]
US 8636751B2 · Albrecht et al. · 2014 [cited by applicant]
US 8734478B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8753338B2 · Widenhouse et al. · 2014 [cited by applicant]
US 8771180B2 · Mohr · 2014 [cited by applicant]
US 8812100B2 · Voegele et al. · 2014 [cited by applicant]
US 8831782B2 · Itkowitz · 2014 [cited by applicant]
US 8888789B2 · Prisco et al. · 2014 [cited by applicant]
US 8919348B2 · Williams et al. · 2014 [cited by applicant]
US 8961406B2 · Ortiz et al. · 2015 [cited by applicant]
US 9044606B2 · Harris et al. · 2015 [cited by applicant]
US 9072535B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9072536B2 · Shelton, IV et al. · 2015 [cited by applicant]
US 9204879B2 · Shelton, IV · 2015 [cited by applicant]
US 9216062B2 · Duque et al. · 2015 [cited by applicant]
US 9254178B2 · Prisco et al. · 2016 [cited by applicant]
US 9274047B2 · Velten et al. · 2016 [cited by applicant]
US 9283050B2 · Prisco et al. · 2016 [cited by applicant]
US 9320416B2 · Cooper et al. · 2016 [cited by applicant]
US 9339341B2 · Cooper · 2016 [cited by applicant]
US 9358074B2 · Schena et al. · 2016 [cited by applicant]
US 9393017B2 · Flanagan et al. · 2016 [cited by applicant]
US 9561038B2 · Shelton, IV et al. · 2017 [cited by applicant]
US 9572481B2 · Duindam et al. · 2017 [cited by applicant]
US 9636186B2 · Kumar et al. · 2017 [cited by applicant]
US 9757128B2 · Baber et al. · 2017 [cited by applicant]
US 9962161B2 · Scheib et al. · 2018 [cited by applicant]
US 10092738B2 · Harris et al. · 2018 [cited by applicant]
US 10179024B2 · Yeung · 2019 [cited by applicant]
US 10206682B2 · Bakos et al. · 2019 [cited by applicant]
US 10245069B2 · Rogers et al. · 2019 [cited by applicant]
US 10492788B2 · Swayze et al. · 2019 [cited by applicant]
US 10517600B2 · Beisel et al. · 2019 [cited by applicant]
US 10569071B2 · Harris et al. · 2020 [cited by applicant]
US 10716564B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10751117B2 · Witt et al. · 2020 [cited by applicant]
US 10779831B2 · Lukin et al. · 2020 [cited by applicant]
US 10792034B2 · Scheib et al. · 2020 [cited by applicant]
US 10856928B2 · Shelton, IV et al. · 2020 [cited by applicant]
US 10925598B2 · Scheib et al. · 2021 [cited by applicant]
US 11033272B2 · Fegelman et al. · 2021 [cited by applicant]
US 11051876B2 · Shelton, IV et al. · 2021 [cited by applicant]
US 11432828B1 · Lang · 2022 [cited by applicant]
US 11607216B2 · Krulevitch et al. · 2023 [cited by applicant]
US 11723642B2 · Shelton, IV et al. · 2023 [cited by applicant]
US 20050277998A1 · Tracey et al. · 2005 [cited by applicant]
US 20060195146A1 · Tracey et al. · 2006 [cited by applicant]
US 20060195153A1 · DiUbaldi et al. · 2006 [cited by applicant]
US 20070185541A1 · DiUbaldi et al. · 2007 [cited by applicant]
US 20080132962A1 · DiUbaldi et al. · 2008 [cited by applicant]
US 20080147146A1 · Wahlgren et al. · 2008 [cited by applicant]
US 20080294258A1 · Revie et al. · 2008 [cited by applicant]
US 20090062792A1 · Vakharia et al. · 2009 [cited by applicant]
US 20090132018A1 · DiUbaldi et al. · 2009 [cited by applicant]
US 20090149918A1 · Krulevitch et al. · 2009 [cited by applicant]
US 20090157149A1 · Wahlgren et al. · 2009 [cited by applicant]
US 20090216116A1 · Roger · 2009 [cited by applicant]
US 20100056900A1 · Whitcomb et al. · 2010 [cited by applicant]
US 20100161001A1 · DiUbaldi et al. · 2010 [cited by applicant]
US 20100161005A1 · Wahlgren et al. · 2010 [cited by applicant]
US 20100191267A1 · Fox · 2010 [cited by applicant]
US 20100239648A1 · Smith et al. · 2010 [cited by applicant]
US 20110094773A1 · Bare et al. · 2011 [cited by applicant]
US 20110118708A1 · Burbank et al. · 2011 [cited by applicant]
US 20120095458A1 · Cybulski et al. · 2012 [cited by applicant]
US 20120150192A1 · Dachs, II et al. · 2012 [cited by applicant]
US 20120209314A1 · Weir et al. · 2012 [cited by applicant]
US 20130060146A1 · Yang et al. · 2013 [cited by applicant]
US 20130105545A1 · Burbank · 2013 [cited by applicant]
US 20130105552A1 · Weir et al. · 2013 [cited by applicant]
US 20130146643A1 · Schmid et al. · 2013 [cited by applicant]
US 20130221065A1 · Aronhalt et al. · 2013 [cited by applicant]
US 20130256377A1 · Schmid et al. · 2013 [cited by applicant]
US 20130317353A1 · Frank et al. · 2013 [cited by applicant]
US 20140066717A1 · Rogers et al. · 2014 [cited by applicant]
US 20140121678A1 · Trusty et al. · 2014 [cited by applicant]
US 20140266591A1 · Klammer et al. · 2014 [cited by applicant]
US 20150129634A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133995A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150133996A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134076A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150134077A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20150238268A1 · Weir et al. · 2015 [cited by applicant]
US 20150257841A1 · Dachs, II · 2015 [cited by applicant]
US 20150257842A1 · Dachs, II · 2015 [cited by applicant]
US 20150272575A1 · Leimbach et al. · 2015 [cited by applicant]
US 20150351758A1 · Shelton, IV et al. · 2015 [cited by applicant]
US 20160015471A1 · Piron et al. · 2016 [cited by applicant]
US 20160256071A1 · Shelton, IV et al. · 2016 [cited by applicant]
US 20160262761A1 · Beisel et al. · 2016 [cited by applicant]
US 20160303743A1 · Rockrohr · 2016 [cited by applicant]
US 20170035425A1 · Fegelman et al. · 2017 [cited by applicant]
US 20170055819A1 · Hansen et al. · 2017 [cited by applicant]
US 20170071693A1 · Taylor et al. · 2017 [cited by applicant]
US 20170128041A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128144A1 · Hasser et al. · 2017 [cited by applicant]
US 20170128145A1 · Hasser et al. · 2017 [cited by applicant]
US 20170202591A1 · Shelton, IV et al. · 2017 [cited by applicant]
US 20170251900A1 · Hansen et al. · 2017 [cited by applicant]
US 20170265866A1 · Ryou et al. · 2017 [cited by applicant]
US 20180049820A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20180092698A1 · Chopra et al. · 2018 [cited by applicant]
US 20180177556A1 · Noonan · 2018 [cited by applicant]
US 20180353174A1 · Widenhouse et al. · 2018 [cited by applicant]
US 20190099209A1 · Witt et al. · 2019 [cited by applicant]
US 20190125361A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190125431A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200844A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200905A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190200981A1 · Harris et al. · 2019 [cited by applicant]
US 20190201046A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201088A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201114A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190201136A1 · Shelton, IV · 2019 [cited by examiner]
US 20190201140A1 · Yates et al. · 2019 [cited by applicant]
US 20190204201A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190205820A1 · Nuthi · 2019 [cited by applicant]
US 20190206004A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190206050A1 · Yates et al. · 2019 [cited by applicant]
US 20190206555A1 · Morgan et al. · 2019 [cited by applicant]
US 20190206562A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190207857A1 · Shelton, IV et al. · 2019 [cited by applicant]
US 20190289284A1 · Smith · 2019 [cited by examiner]
US 20190374290A1 · Stolka et al. · 2019 [cited by applicant]
US 20200000530A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200015668A1 · Scheib · 2020 [cited by applicant]
US 20200015897A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015898A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015899A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015900A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015901A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015902A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015903A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015906A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015907A1 · Scheib · 2020 [cited by applicant]
US 20200015914A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015923A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015924A1 · Scheib et al. · 2020 [cited by applicant]
US 20200015925A1 · Scheib · 2020 [cited by applicant]
US 20200078109A1 · Steger et al. · 2020 [cited by applicant]
US 20200085516A1 · DeFonzo et al. · 2020 [cited by applicant]
US 20200170720A1 · Ummalaneni · 2020 [cited by applicant]
US 20200188043A1 · Yu et al. · 2020 [cited by applicant]
US 20200315723A1 · Hassan et al. · 2020 [cited by applicant]
US 20200359881A1 · Rosenberg · 2020 [cited by examiner]
US 20210056700A1 · Chen · 2021 [cited by examiner]
US 20210152802A1 · Varekamp et al. · 2021 [cited by applicant]
US 20210196108A1 · Shelton, IV · 2021 [cited by applicant]
US 20210196109A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196381A1 · Eckert et al. · 2021 [cited by applicant]
US 20210196383A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196384A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196385A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196386A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196423A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196424A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210196425A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210199557A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210289189A1 · Sela · 2021 [cited by applicant]
US 20210345952A1 · Harris et al. · 2021 [cited by applicant]
US 20210345953A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210350895A1 · Bakos et al. · 2021 [cited by applicant]
US 20210350896A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210350897A1 · Shelton, IV et al. · 2021 [cited by applicant]
US 20210393344A1 · Graetzel et al. · 2021 [cited by applicant]
US 20210401507A1 · Stylos et al. · 2021 [cited by applicant]
US 20220047745A1 · Neveu et al. · 2022 [cited by applicant]
US 20220160428A1 · Murray et al. · 2022 [cited by applicant]
US 20220226069A1 · Vogtmeier et al. · 2022 [cited by applicant]
US 20230095002A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230096268A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230097906A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230100698A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230101750A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230102358A1 · Shelton, IV et al. · 2023 [cited by applicant]
US 20230103005A1 · Shelton · 2023 [cited by applicant]
US 20230109848A1 · Shelton, IV et al. · 2023 [cited by applicant]
CN 113767176A · 2021 [cited by applicant]
EP 1886711B1 · 2018 [cited by applicant]
EP 3679851A1 · 2020 [cited by applicant]
WO WO1998030166A1 · 1998 [cited by applicant]
WO WO2012007052A1 · 2012 [cited by applicant]
WO WO2014151621A1 · 2014 [cited by applicant]
WO WO2015142814A1 · 2015 [cited by applicant]
WO WO2015153636A1 · 2015 [cited by applicant]
WO WO2015153642A1 · 2015 [cited by applicant]
WO WO2016144937A1 · 2016 [cited by applicant]
WO WO2016144998A1 · 2016 [cited by applicant]
WO WO2016183054A1 · 2016 [cited by applicant]
WO WO2016205266A1 · 2016 [cited by applicant]
WO WO2016205452A1 · 2016 [cited by applicant]
WO WO2016209769A1 · 2016 [cited by applicant]
WO WO2017042171A1 · 2017 [cited by applicant]
WO WO2017044406A1 · 2017 [cited by applicant]
WO WO2017053358A1 · 2017 [cited by applicant]
WO WO2017053363A1 · 2017 [cited by applicant]
WO WO2017053507A1 · 2017 [cited by applicant]
WO WO2017053698A1 · 2017 [cited by applicant]
WO WO2017075121A1 · 2017 [cited by applicant]
WO WO2017116793A1 · 2017 [cited by applicant]
WO WO2019030235A1 · 2019 [cited by applicant]
WO WO2020163318A1 · 2020 [cited by applicant]
WO WO2021019369A1 · 2021 [cited by applicant]
WO WO2021216516A1 · 2021 [cited by applicant]
U.S. Appl. No. 17/493,913, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,914, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
U.S. Appl. No. 17/493,919, filed Oct. 5, 2021, Frederick E. Shelton et al. [cited by applicant]
“Fiber Bragg Gatings,” RP Photonics Encyclopedia, available at <https://www.rp-photonics.com/fiber_bragg_gratings.html>, dated no later than Apr. 5, 2021 (12 pages). [cited by applicant]
“Ion by Intuitive,” available at <https://www.intuitive.com/en-us/products-and-services/ion>, dated no later than Apr. 5, 2021 (5 pages). [cited by applicant]
Aisu et al., Laparoscopic and endoscopic cooperative surgery for gastric tumors: Perspective for actual practice and oncological benefits,: World J Gastrointest Oncol, Nov. 15, 2018, 10(11): 381-397. [cited by applicant]
Akirov, “Duodenal Mucosal Resurfacing May Safely Improve Glycemic Control in T2D,” Aug. 19, 2019, Haymarket Media, Inc., 14 pages. [cited by applicant]
Brace et al., “Thermal Tumor Ablation in Clinical Use,” IEEE Pulse, 2011, 2(5):28-38. [cited by applicant]
Carlota V., “4D printing reconfigurable materials for use in aerospace, medical and robotics fields,” Apr. 3, 2019, available at <https://www.3dnatices.com/en/4d-printing-materials-030420195/> (7 pages). [cited by applicant]
Chauhan et al., “Enteroscopy,” Gastrointestinal Endoscopy, 2015, vol. 82, No. 6, 975-990. [cited by applicant]
Conway et al., “Endoscopic hemostatic devices,” Gastrointestinal Endoscopy, 2009, vol. 69, No. 6, 987-996. [cited by applicant]
Dunkin et al., “Thin-layer ablation of human esophagael epithelium using a bipolar radiofrequency balloon device,” Surg Endosc (2006) 20: 125-130. [cited by applicant]
Ethicon, “Laparoscopic Sizing Tool: LINX® Reflux Management System,” 2019 (6 pages). [cited by applicant]
Fried et al., “A novel approach to glycemic control in type 2 diabetes mellius, partial jejunal diversion: pre-clinical to clinical pathway,” BMJ Open Diab Res Care 2017; 5:e000431.doi:10.1136*BMJdrc-2017000431. [cited by applicant]
Garvey, “Ablation of the Duodenal Mucosa as a Strategy for Glycemic Control in Diabetes: Role of Nutrient Signaling or Simple Weight Loss,” Diabetes Care 2016; 39:2108-2110. [cited by applicant]
Gioux et al., “Image-Guided Surgery using Invisible Near-Infrared Light: Fundamental of Clinical Translation,” Mol Imaging, Oct. 2010, 9)5): 237-255. [cited by applicant]
Gupta, “Understanding Image Recognition and Its Uses,” eInfochips, available at <http://www.einfochips.com/blog/understanding-image-recognition-and-its-uses/>, Dec. 11, 2019. [cited by applicant]
Hiki et al., “Laparoscopic and endoscopic cooperative surgery for gastrointestinal stromal tumor dissection,” Surg Endosc (2008) 22:1729-1735. [cited by applicant]
Intuitive Surgical, “Da Vinci Xi Single-Site Technology: Solutions for Single-Incision Surgery,” 2016 (10 pages). [cited by applicant]
Kurata et al., “Time-of-Flight Near-Infrared Spectroscopy for Nondestructive Measurement of Internal Quality in Grapefruit,” Journal of the American Society for Horticultural Science, May 2013 vol. 138 No. 3 225-228. [cited by applicant]
Machytka et al., “Partial jejunal diversion using an incisionless magnetic anastomosis system: 1-year interim results in patients with obesity and diabetes,” Gastrointestinal Endoscopy, 2017, vol. 86, No. 5, 904-912. [cited by applicant]
Matsuda et al., “Laparoscopic endoscopic cooperative surgery (LECS) for the upper gastrointestinal tract,” Transl Gastroenterol Hepatol 2017, 2:40 (6 pages). [cited by applicant]
Miklav?i ? et al., “Electric Properties of Tissues,” Wiley Encyclopedia of Biomedical Engineering, 2006, 1-12. [cited by applicant]
Sculpteo, “4D Printing: A technology coming from the future,” 3D Learning Hub, dated no later than Aug. 26, 2021 (12 pages). [cited by applicant]
Seeley et al., “The Role of Gut Adaptation in the Potent Effects of Multiple Bariatric Surgeries on Obesity and Diabetes,” Cell Metabolism 21, Mar. 3, 2015, 369-378. [cited by applicant]
Tamegai et al., “Laparoscopic and endoscopic cooperative surgery (LECS) to overcome the limitations of endoscopic resection for colorectal tumors,” Endosc Int Open, Dec. 2018, 6(12): E1477-E1485. [cited by applicant]
Tokar et al., “Electrosurgical generators,” Gastrointestinal Endoscopy, 2013, vol. 78, No. 2, 197-208. [cited by applicant]
Tomie et al., “Blue Laser Imaging-Bright Improves Endoscopic Recognition of Superficial Esophagael Squamous Cell Carcinoma,” Gastroenterology Research and Practice, vol. 2016, Article ID 6140854, 7 pages. [cited by applicant]
Toposens, “Advanced Ultrasonic Sensors: What Makes Them Different?” available at <https://toposens.com/technology/>, 2020. [cited by applicant]
Toposens, “Beacon Based 3D Tracking System,” available at <https://toposens.com/beacon-based-3d-ttracking-system/>, 2020. [cited by applicant]
U.S. Appl. No. 17/449,765 entitled “Cooperative Access Hybrid Procedures” filed Oct. 1, 2021. [cited by applicant]
U.S. Appl. No. 17/450,020 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,025 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/450,027 entitled “Methods for Controlling Cooperative Surgical Instruments” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/494,364 entitled “Surgical Methods for Control of One Visualization With Another” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/493,904 entitled “Surgical Methods Using Multi-Source Imaging” filed Oct. 5, 2021. [cited by applicant]
U.S. Appl. No. 17/068,857 entitled “Adaptive Responses From Smart Packaging of Drug Delivery Absorbable Adjuncts” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,858 entitled “Drug Administration Devices That Communicate With Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,859 entitled “Controlling Operation of Drug Administration Devices Using Surgical Hubs” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,863 entitled “Patient Monitoring Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,865 entitled “Monitoring And Communicating Information Using Drug Administration Devices” filed Oct. 13, 2020. [cited by applicant]
U.S. Appl. No. 17/068,867 entitled “Aggregating And Analyzing Drug Administration Data” filed Oct. 13, 2020. [cited by applicant]
Van Baar et al., “Endoscopic duodenal mucosal resurfacing for the treatment of type 2 diabetes mellitus: one year results from the first international, open label, prospective, multicentre study,” Gut 2020, 69:295-303. [cited by applicant]
Yang et al., “4d printing reconfigurable, deployable and mechanically tunable materials,” Material Science, 2019 (33 pages). [cited by applicant]
Zuo et al., “Pulmonary Intersegmental Places: Imaging Appearance and Possible Reasons Leading to Their Visualization,” Radiology, vol. 267, No. 1, Apr. 2013, 267-275. [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059092 mailed Apr. 2, 2024. (9 pages). [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059099 mailed Apr. 2, 2024. (8 pages). [cited by applicant]
International Preliminary Report on Patentability for Intl. Pat. App. No. PCT/IB2022/059111 mailed Apr. 2, 2024. (15 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059092 mailed Jan. 9, 2023. (10 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059099 mailed Jan. 9, 2023. (9 pages). [cited by applicant]
International Search Report and Written Opinion for Intl. Pat. App. No. PCT/IB2022/059111 mailed Jan. 25, 2023. (20 pages). [cited by applicant]