IP Library Granted Patent US 11,832,787
Granted Patent B2
US 11,832,787 · App. 17/562,599 · Granted Dec 5, 2023

User-interface with navigational aids for endoscopy procedures

Inventors: Daniel Freedman (Haifa, IL); Yacob Yochai Blau (Haifa, IL); Dmitri Veikherman (Ness Ziona, IL); Roman Goldenberg (Haifa, IL); Ehud Rivlin (Haifa, IL)
Assignee: Verily Life Sciences LLC
A61B1/0005G06T11/001G06T11/206A61B1/31G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,832,787
App. No.
17/562,599
Granted
Dec 5, 2023
Kind
B2
Abstract

A user-interface for aiding navigation of an endoscope through a lumen of a tubular anatomical structure during an endoscopy procedure includes a video region in which a live video feed received from the endoscope is displayed and an observation location map. The observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope longitudinally traverses the tubular anatomical structure within the lumen during the endoscopy procedure.

Claims (44)

1. At least one non-transitory machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to perform operations comprising:

generating an endoscopy user-interface for display on a screen during an endoscopy procedure;

outputting a live video feed of a lumen of a tubular anatomical structure received from an endoscope during the endoscopy procedure for display within a video region of the endoscopy user-interface; and

generating an observation location map for display within the endoscopy user-interface, wherein the observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope moves longitudinally along the tubular anatomical structure within the lumen during the endoscopy procedure, wherein the cross-sectional depiction comprises a cross-sectional perimeter shape depiction of the lumen and the observation location map conveys a position of the point of observation relative to the cross-sectional perimeter shape depiction.

2. The at least one non-transitory machine-accessible storage medium of claim 1 , wherein the cross-sectional depiction comprises a localized cross-section in a vicinity of a distal tip of the endoscope.

3. The at least one non-transitory machine-accessible storage medium of claim 1 , wherein the observation location map is contemporaneously presented proximate to the live video feed within the endoscopy user-interface to provide real-time navigation context with the live video feed.

4. The at least one non-transitory machine-accessible storage medium of claim 1 , wherein generating the observation location map comprises:

determining a focus of expansion point within the live video feed;

identifying a cross-sectional perimeter of the lumen in the live video feed; and

comparing a relative position of the focus of expansion point to the cross-sectional perimeter.

5. The at least one non-transitory machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:

generating a velocity indicator for display within the endoscopy user-interface, wherein the velocity indicator visually depicts in real-time a direction of longitudinal motion of the endoscope moving through the lumen and a magnitude of longitudinal motion of the endoscope moving through the lumen.

6. The at least one non-transitory machine-accessible storage medium of claim 5 , wherein the velocity indicator comprises a dynamic bar graph that extends in a positive direction from a zero point to indicate a positive longitudinal motion of the endoscope moving through the lumen or extends in a negative direction from the zero point to indicate a negative longitudinal motion of the endoscope moving through the lumen.

7. The at least one non-transitory machine-accessible storage medium of claim 5 , wherein the velocity indicator is contemporaneously presented proximate to the live video feed within the endoscopy user-interface to provide real-time navigation context with the live video feed.

8. The at least one non-transitory machine-accessible storage medium of claim 1 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:

generating a visibility indicator that indicates a proportion of interior surface area of the tubular anatomical structure surrounding the lumen that was viewable versus unviewable in the live video feed as the endoscope traverses a longitudinal section of the tubular anatomical structure.

9. The at least one non-transitory machine-accessible storage medium of claim 8 , wherein the proportion of interior surface area that was viewable versus unviewable is based upon a temporal integration window ranging between 5 to 30 seconds.

10. The at least one non-transitory machine-accessible storage medium of claim 8 , wherein the visibility indicator discretizes the proportion of interior surface area into four or less ranges.

11. The at least one non-transitory machine-accessible storage medium of claim 8 , wherein the visibility indicator discretizes the proportion into three discrete ranges that are color coded.

12. The at least one non-transitory machine-accessible storage medium of claim 1 , wherein the endoscope comprises a colonoscope, the tubular anatomical structure comprises a colon, and the endoscopy procedure comprises a colonoscopy procedure.

13. The at least one non-transitory machine-accessible storage medium of claim 12 , wherein generating the observation location map comprises generating the observation location map during a withdrawal phase of the colonoscopy procedure.

14. At least one non-transitory machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to output a signal for rendering a user-interface to a display, the user-interface adapted for navigating an endoscope through a lumen of a tubular anatomical structure during an endoscopy procedure, the user-interface comprising:

a video region in which a live video feed received from the endoscope is displayed; and

an observation location map that depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope longitudinally traverses the tubular anatomical structure within the lumen during the endoscopy procedure, wherein the observation location map comprises an observation point marker disposed within a cross-sectional perimeter shape depiction of the lumen and conveys a position of the point of observation relative to the cross-sectional perimeter shape depiction.

15. The at least one non-transitory machine-accessible storage medium of claim 14 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:

generating a velocity indicator for display within the endoscopy user-interface, wherein the velocity indicator visually depicts in real-time a direction of longitudinal motion of the endoscope moving through the lumen and a magnitude of longitudinal motion of the endoscope moving through the lumen.

16. The at least one non-transitory machine-accessible storage medium of claim 15 , wherein the velocity indicator comprises a dynamic bar graph that extends in a positive direction from a zero point to indicate a positive longitudinal motion of the endoscope moving through the lumen or extends in a negative direction from the zero point to indicate a negative longitudinal motion of the endoscope moving through the lumen.

17. The at least one non-transitory machine-accessible storage medium of claim 14 , wherein the user-interface further comprises:

a visibility indicator that indicates a proportion of interior surface area of the tubular anatomic structure surrounding the lumen that was viewable versus unviewable in the live video feed as the endoscope traverses a longitudinal section of the tubular anatomical structure.

18. The at least one non-transitory machine-accessible storage medium of claim 17 , wherein the proportion of interior surface area that was viewable versus unviewable is based upon a temporal integration window.

19. The at least one non-transitory machine-accessible storage medium of claim 18 , wherein the visibility indicator discretizes the proportion of interior surface area into three discrete ranges that are color coded.

20. At least one non-transitory machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to perform operations comprising:

generating an endoscopy user-interface for display on a screen during an endoscopy procedure;

outputting a live video feed of a lumen of a tubular anatomical structure received from an endoscope during the endoscopy procedure for display within a video region of the endoscopy user-interface; and

generating a velocity indicator for display within the endoscopy user-interface, wherein the velocity indicator visually depicts in real-time a direction of longitudinal motion of the endoscope moving through the lumen and a magnitude of longitudinal motion of the endoscope moving through the lumen, wherein the velocity indicator is contemporaneously presented proximate to the live video feed within the endoscopy user-interface to provide real-time navigation context with the live video feed.

21. The at least one non-transitory machine-accessible storage medium of claim 20 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:

generating an observation location map for display within the endoscopy user-interface, wherein the observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope moves longitudinally along the tubular anatomical structure within the lumen during the endoscopy procedure.

22. At least one non-transitory machine-accessible storage medium that provides instructions that, when executed by a machine, will cause the machine to perform operations comprising:

generating an endoscopy user-interface for display on a screen during an endoscopy procedure;

outputting a live video feed of a lumen of a tubular anatomical structure received from an endoscope during the endoscopy procedure for display within a video region of the endoscopy user-interface; and

generating a visibility indicator that indicates a proportion of interior surface area of the tubular anatomical structure surrounding the lumen that was viewable versus unviewable in the live video feed as the endoscope traverses a longitudinal section of the tubular anatomical structure, wherein the visibility indicator discretizes the proportion of interior surface area into four or less ranges.

23. The at least one non-transitory machine-accessible storage medium of claim 22 , further providing instructions that, when executed by the machine, will cause the machine to perform further operations, comprising:

generating an observation location map for display within the endoscopy user-interface, wherein the observation location map depicts a point of observation from which the live video feed is acquired within the lumen relative to a cross-sectional depiction of the lumen as the endoscope moves longitudinally along the tubular anatomical structure within the lumen during the endoscopy procedure.

24. The at least one non-transitory machine-accessible storage medium of claim 22 , wherein the visibility indicator discretizes the proportion of interior surface area into three discrete ranges that are color coded.

Assignments (2)
CHANGE OF NAME Recorded Apr 1, 2026
From: VERILY LIFE SCIENCES LLC
To: VERILY HEALTH INC.
Reel/Frame 075367/0775 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 27, 2021
From: FREEDMAN, DANIEL; BLAU, YACOB YOCHAI; VEIKHERMAN, DMITRI; GOLDENBERG, ROMAN; RIVLIN, EHUD
To: VERILY LIFE SCIENCES LLC
Reel/Frame 058483/0718 →
Continuity (2)
Provisional Application 63192479 · May 24, 2021
Related Publication 20220369895A1 · Nov 24, 2022