IP Library Granted Patent US 12,232,691
Granted Patent B2
US 12,232,691 · App. 17/081,621 · Granted Feb 25, 2025

User interface for steerable endoscope

Inventors: Derek Scot Tata (Longmont, CO); Peter Douglas Colin Inglis (Boulder, CO); Alexandra Hause (Denver, CO); Bo Chen (Louisville, CO); Michael Ng (Kowloon, HK); Craig Allen Patton (Boulder, CO)
Assignee: Covidien AG
A61B1/00055A61B1/00009A61B1/00042A61B1/0005A61B1/00097A61B1/00147A61B1/018A61B1/05A61B1/267A61B90/36A61B2090/368
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,232,691
App. No.
17/081,621
Granted
Feb 25, 2025
Kind
B2
Abstract

An endoscope system is provided with a graphical orientation indicator. An endoscope includes a flexible tubular body with a steerable distal end having a camera. A controller for the endoscope presents a user interface that displays a view from the camera and a graphical orientation indicator visually representing an orientation of the distal end of the endoscope.

Claims (52)

1. An endoscope system, comprising:

an endoscope comprising a working channel and a steerable distal end with a camera and an orientation sensor; and

a hand-held controller in communication with the endoscope and comprising a display screen and a hardware memory storing instructions for:

displaying on the display screen:

a view from the camera;

a graphical orientation indicator representing an orientation of the steerable distal end of the endoscope; and

a graphical working-channel indicator representative of a rotational orientation of the working channel of the endoscope;

based on signals from the orientation sensor in the steerable distal end, detecting rotational movement of the steerable distal end of the endoscope;

maintaining a rotational orientation of the view from the camera displayed on the display screen; and

modifying the graphical orientation indicator and the working-channel indicator to represent the detected rotational movement of the steerable distal end.

2. The endoscope system of claim 1 , wherein the graphical orientation indicator comprises a roll indicator, and wherein the stored instructions further comprise instructions for displaying a second graphical orientation indicator comprising a pitch or yaw indicator.

3. The endoscope system of claim 1 , wherein the graphical orientation indicator comprises horizon markers.

4. The endoscope system of claim 1 , wherein the view from the camera is displayed within a circle, and wherein the graphical orientation indicator comprises visual marks along the circle.

5. The endoscope system of claim 1 , wherein the graphical orientation indicator comprises a gravity indicator.

6. The endoscope system of claim 1 , wherein maintaining the rotational orientation of the view from the camera comprises counter-rotating the view in proportion to the detected rotational movement of the steerable distal end of the endoscope.

7. The endoscope system of claim 1 , wherein the endoscope is removable from the controller and disposable, and wherein the controller is reusable.

8. The endoscope system of claim 1 , wherein the display screen comprises a touch screen, and wherein the controller further comprises instructions for steering the distal end in response to an input from the user on the touch screen.

9. The endoscope system of claim 1 , wherein the hand-held controller comprises a video laryngoscope.

10. An endoscope system, comprising:

an endoscope comprising a working channel and a steerable distal end with a camera and an orientation sensor;

a controller in communication with the endoscope and comprising a display screen; and

a user interface (UI) presented on the display screen, wherein the UI comprises:

a window displaying a view from the camera;

a first orientation icon visually representing a first orientation of the steerable distal end;

a second orientation icon visually representing a first articulation of the steerable distal end;

a working-channel indicator representative of a rotational orientation of the working channel of the endoscope; and

a touch interface for receiving a touch input from a user;

wherein the controller comprises a hardware memory storing instructions for:

detecting, based on signals from the orientation sensor in the steerable distal end, a change to a second orientation and a second articulation of the steerable distal end of the endoscope;

modifying the first orientation icon and the working-channel indicator to visually represent the second orientation; and

modifying the second orientation icon to visually represent the second articulation.

11. The endoscope system of claim 10 , wherein the first orientation icon comprises one or more of a roll indicator, a yaw indicator, and a pitch indicator.

12. The endoscope system of claim 10 , wherein the first orientation icon comprises horizon markers.

13. The endoscope system of claim 10 , wherein the steerable distal end is actively steerable within a range of motion having a limit, and wherein modifying the first orientation icon comprises visually changing the icon when the limit is reached.

14. The endoscope system of claim 13 , wherein the controller further comprises a haptic generator, and wherein the stored instructions further comprise providing a haptic response when the limit is reached.

15. The endoscope system of claim 10 , wherein the second orientation icon is a graphic of the steerable distal end that shows a current orientation and articulation state of the distal end.

16. The endoscope system of claim 1 , wherein the graphical working-channel indicator is displayed as an overlay over the view from the camera.

17. The endoscope system of claim 16 , wherein the graphical working-channel indicator is a partially transparent shaded region.

18. A visualization system comprising:

an endoscope comprising a steerable distal end that includes a camera and an orientation sensor; and

a video laryngoscope in communication with the endoscope and comprising a display screen and a hardware memory storing instructions for:

concurrently displaying on the display screen:

a view from the camera;

a first graphical orientation indicator representing an orientation of the steerable distal end of the endoscope;

a second graphical orientation indicator visually representing an articulation of the steerable distal end; and

a graphical working-channel indicator representative of a rotational orientation of a working channel of the endoscope;

based on signals from the orientation sensor in the steerable distal end:

detecting movement of the steerable distal end of the endoscope;

maintaining a rotational orientation of the view from the camera displayed on the display screen; and

modifying the first graphical orientation indicator, the second graphical orientation indicator, and the graphical working-channel indicator.

19. The visualization system of claim 18 , wherein the graphical working-channel indicator is displayed as an overlay over the view from the camera.

20. The visualization system of claim 18 , wherein the second orientation indicator is a graphic of the steerable distal end that shows a current articulation state and orientation of the distal end.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2022
From: AIRCRAFT MEDICAL LIMITED
To: COVIDIEN AG
Reel/Frame 058855/0920 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2020
From: TATA, DEREK SCOT; INGLIS, PETER DOUGLAS COLIN; HAUSE, ALEXANDRA; CHEN, BO; NG, MICHAEL; PATTON, CRAIG ALLEN
To: AIRCRAFT MEDICAL LIMITED
Reel/Frame 054184/0560 →
Continuity (2)
Provisional Application 62928854 · Oct 31, 2019
Related Publication 20210127949A1 · May 6, 2021
References Cited (60)
US 5529570A · Storz · 1996 [cited by applicant]
US 7568619B2 · Todd et al. · 2009 [cited by applicant]
US 8055830B2 · Waldhoff et al. · 2011 [cited by applicant]
US 8194122B2 · Amling et al. · 2012 [cited by applicant]
US 8634031B2 · Ikeda · 2014 [cited by applicant]
US 8652033B2 · Berci et al. · 2014 [cited by applicant]
US 8715172B1 · Girgis · 2014 [cited by applicant]
US 8746239B2 · Yoshida · 2014 [cited by applicant]
US 8827899B2 · Farr et al. · 2014 [cited by applicant]
US 8982199B2 · Amling et al. · 2015 [cited by applicant]
US 9033895B2 · Furlong et al. · 2015 [cited by applicant]
US 9498112B1 · Stewart et al. · 2016 [cited by applicant]
US 9538908B2 · Allyn et al. · 2017 [cited by applicant]
US 9687141B2 · McGrath · 2017 [cited by applicant]
US 9820641B2 · McGrath · 2017 [cited by applicant]
US 10149957B2 · Runnels · 2018 [cited by applicant]
US 11511064B2 · Taniguchi · 2022 [cited by examiner]
US 20050272971A1 · Ohnishi · 2005 [cited by examiner]
US 20060084840A1 · Hoeg · 2006 [cited by examiner]
US 20060247606A1 · Batch · 2006 [cited by applicant]
US 20070167686A1 · McGrath · 2007 [cited by applicant]
US 20070197896A1 · Moll et al. · 2007 [cited by applicant]
US 20080177146A1 · Chen · 2008 [cited by applicant]
US 20080177148A1 · Chen et al. · 2008 [cited by applicant]
US 20080312507A1 · Kim · 2008 [cited by applicant]
US 20090187078A1 · Dunlop · 2009 [cited by applicant]
US 20100125166A1 · Henzler · 2010 [cited by examiner]
US 20110130632A1 · McGrail et al. · 2011 [cited by applicant]
US 20110137127A1 · Schwartz · 2011 [cited by applicant]
US 20110245609A1 · Laser · 2011 [cited by applicant]
US 20130204085A1 · Alexander et al. · 2013 [cited by applicant]
US 20130237763A1 · Qui · 2013 [cited by applicant]
US 20140160261A1 · Miller et al. · 2014 [cited by applicant]
US 20140266577A1 · Anderson et al. · 2014 [cited by applicant]
US 20150080655A1 · Peterson et al. · 2015 [cited by applicant]
US 20160120394A1 · McGrath et al. · 2016 [cited by applicant]
US 20160279365A1 · Esnouf · 2016 [cited by applicant]
US 20170215720A1 · Walker et al. · 2017 [cited by applicant]
US 20190133430A1 · Inglis et al. · 2019 [cited by applicant]
US 20190142262A1 · Inglis et al. · 2019 [cited by applicant]
US 20190159662A1 · Papas · 2019 [cited by examiner]
US 20190246873A1 · Lu · 2019 [cited by examiner]
US 20200254204A1 · Moffat et al. · 2020 [cited by applicant]
EP 2433553A1 · 2012 [cited by applicant]
JP 2014210085A · 2014 [cited by applicant]
WO 2011141686A1 · 2011 [cited by applicant]
WO 2018005842A1 · 2018 [cited by applicant]
WO 2018136905A1 · 2018 [cited by applicant]
WO 2022133248A1 · 2022 [cited by applicant]
WO 2022266500A1 · 2022 [cited by applicant]
Ambu_aScope_3_Large_Brochure_4963605 (Oct. 2017). [cited by applicant]
International Search Report and Written Opinion for PCT Application PCT/GB2018/053300 dated Feb. 20, 2019; 15 pgs. [cited by applicant]
International Search Report and Written Opinion for PCT/US2020/051734 dated May 14, 2020; 11 pgs. [cited by applicant]
Rothfield, Kenneth; “The video laryngoscopy market: Past, present, and future,” Anesthesiology News Guide to Airway Management, 2014, pp. 29-34. [cited by applicant]
Siena, Francesco Luke, et al.; “The development of a novel steerable bougie to assist in airway management,” Austrasian Medical Journal, 2016, vol. 9, No. 5, pp. 124-137. http://dx.doi.org/10.4066/AMJ.2016.2619. [cited by applicant]
Sowers, Nicholas, et al.; “Use of a flexible intubating scope in combination with a channeled video laryngoscope for managing a difficult airway in the emergency department,” The Journal of Emergency Medicine, 2016, vol… [cited by applicant]
Weissbrod, Philip A., et al.; “Reducing injury during video-assisted endotracheal intubation: The “smart stylet” concept,” The Laryngoscope, Nov. 2011, vol. 121, pp. 2391-2393. [cited by applicant]
Höller, Kurt et al., “Endoscopic Orientation Correction,” Big Data Analytics in the Social and Ubiquitous Context: 5th International Workshop on Modeling Social Media, MSM 2014, 5th International Workshop on Mining Ubiq… [cited by applicant]
International Search Report and Written Opinion for PCT Application No. PCT/EP2020/080489, mailed Feb. 17, 2021, 12 pgs. [cited by applicant]
Lee, Hyung-Chul et al.; “Real-time endoscopic image orientation correction system using an accelerometer and gyrosensor,” PLOS ONE, 12(11), Nov. 3, 2017, 12 pgs. [cited by applicant]