IP Library Granted Patent US 11,298,047
Granted Patent B1
US 11,298,047 · App. 17/064,196 · Granted Apr 12, 2022

Method for displaying relative position information of an endoscope image

Inventors: Bradley Scott Thomas (Cary, NC); Brian P Cash (Cary, NC)
Assignee: Asensus Surgical US, Inc.
A61B5/1076A61B1/00045A61B1/05A61B1/0676A61B5/1077A61B5/1079G06T7/521G06T7/593H04N13/239H04N13/254H04N13/324A61B1/00193A61B2090/366G06T2207/10012G06T2207/10068H04N2013/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,298,047
App. No.
17/064,196
Granted
Apr 12, 2022
Kind
B1
Abstract

Imaging methods aid a user in understanding relative depths of objects or topography within a field of view. In one method, image data is gathered using 3D image sensors, while illumination of an area of interest is alternated with projection of a pattern onto the area of interest. The captured image data is used to display a 3D true color image; a monochrome grid on surfaces of the area of interest; a 3D true color image with a monochrome grid on surfaces of the area of interest; a 2D or 3D false color image where different colors identify different depths of regions of the area of interest; and/or a 2D or 3D true color image of an area of interest with features in the area of interest located a first depth relative to the image sensors highlighted with a common color. In another method, 3D image data is used to generate a 2D image that highlights features at a common depth using the same color.

Claims (27)

1. An imaging method, comprising:

providing an imaging head having a pair of image sensors and a pattern projector;

providing an illumination source;

alternating the steps of (a) illuminating an area of interest using an illumination source and (b) projecting a pattern onto the area of interest;

capturing images of the region of interest during illumination using the illumination source;

capturing a depth triangulation grid of the region of interest during projection of the pattern;

identifying first regions in the region of interest that are at a first depth, and identifying second regions in the region of interest that are at a second depth, the first depth different from the second depth, and

displaying captured image data, wherein the displaying step includes generating a display in which

the first regions are displayed in a first false color, the first false color being different from a color of said first regions features as captured in the image data, and

the second regions are displayed in a second false color different from the first false color, the second false color being different from a color of said first regions features as captured in the image data.

2. An imaging method, comprising:

(a) obtaining an image of a field of interest using a 3D imaging system;

(b) determining a depth of a structure within the field of interest;

(c) identifying additional features located at the depth;

(d) generating an image of the field of interest in which the structure and the additional features are digitally highlighted using a common color, and displaying the generated image.

3. The imaging method of claim 2 , wherein the displayed image is a 2D image.

4. The imaging method of claim 2 , wherein the structure is a portion of a medical device, and the additional features are tissue.

5. The imaging method of claim 3 , wherein structure is an instrument tip moving within the body cavity, and wherein the method further includes repeating steps (a) through (d) such that as the instrument tip is moved within the body cavity, the image updates to visually indicate to the user what tissues lie in the plane of the instrument tip.

6. An imaging method, comprising:

(a) obtaining an image of a field of interest using at least one camera;

(b) determining first features at a first depth within the field of interest;

(c) determining second features at a second depth within the field of interest, the second depth different than the first depth;

(d) generating an image of the field of interest in which

the first features are generated to have a first color that differs from a color of the first features in the image obtained in step (a), and the second features are generated to have a second color that differs from a color of the second features in the image obtained in step (a), wherein the first color and second color are different colors; and

(e) displaying the generated image.

7. The imaging method of claim 6 , wherein said at least one camera comprises a stereoscopic camera pair.

8. The imaging method of claim 7 , wherein determining the first and second features includes the step of projecting a pattern onto the field of interest and capturing a depth triangulation grid of the region of interest during projection of the pattern.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2025
From: ASENSUS SURGICAL US, INC.
To: KARL STORZ SE & CO. KG
Reel/Frame 073841/0423 →
SECURITY INTEREST Recorded Dec 31, 2024
From: ASENSUS SURGICAL, INC.; ASENSUS SURGICAL US, INC.; ASENSUS SURGICAL EUROPE S.À R.L.; ASENSUS SURGICAL ITALIA S.R.L.
To: KARL STORZ SE & CO. KG
Reel/Frame 069795/0381 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 18, 2022
From: THOMAS, BRADLEY SCOTT; CASH, BRIAN P.
To: ASENSUS SURGICAL US, INC.
Reel/Frame 059044/0727 →