IP Library Granted Patent US 12670549
Granted Patent B2
US 12670549 · App. 18/316,083 · Granted Jun 30, 2026

Visualization adjustments for instrument roll

Inventors: Chauncey F. Graetzel (Palo Alto, CA); Rachel Leigh Chok (Sunnyvale, CA); Claire Elizabeth Kingston (San Francisco, CA); Sarah Plewe (Redwood City, CA); Jason J. Hsu (Mountain View, CA)
Assignee: Auris Health, Inc.
G06T3/60A61B1/00006A61B1/00039A61B1/0005A61B1/00149A61B1/018
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12670549
App. No.
18/316,083
Granted
Jun 30, 2026
Kind
B2
Abstract

Techniques relate to providing image data, indicators, and/or other data associated with a medical instrument with the appropriate orientation to assist a user in performing a procedure. For example, a user interface can present an image representation representing image data from a scope and/or a working channel indicator indicating an angle of rotation of a working channel of the scope. When the scope rolls, a rotation adjustment can be applied to the image representation to rotate the image representation within the user interface. Further, the working channel indicator can rotate within the user interface.

Claims (64)

1 . A control system comprising:

a communication interface configured to receive image data from an imaging device associated with a scope that includes a working channel to deploy a medical instrument; and

control circuitry communicatively coupled to the communication interface and configured to:

generate an image representation of the image data;

display the image representation in a user interface;

display a working channel indicator in the user interface, the working channel indicator indicating an angle of rotation of the working channel relative to the image representation;

determine an amount that the scope has rolled;

rotate the working channel indicator within the user interface based at least in part on the amount that the scope has rolled;

rotate the image data in the opposite direction of the scope roll so that an orientation of the image representation remains fixed relative to the user interface while the scope rolls and the working channel indicator rotates; and

selectively crop the image representation in the user interface based on whether the scope is rolling, the selective cropping including:

displaying the image representation in a cropped form while the scope is rolling; and

displaying the image representation in a non-cropped form while the scope is not rolling.

2 . The control system of claim 1 , wherein rotating the working channel indicator includes:

causing the working channel indicator to rotate within the user interface from a first orientation relative to the user interface to a second orientation relative to the user interface.

3 . The control system of claim 2 , wherein the control circuitry is configured to display the working channel indicator by overlaying the working channel indicator on the image representation.

4 . The control system of claim 1 , wherein the control circuitry is configured to:

determine that the amount that the scope has rolled has reached a predetermined angle of rotation; and

in response to determining that the amount that the scope has rolled has reached the predetermined angle of rotation, cause the image representation to rotate within the user interface.

5 . The control system of claim 1 , wherein rotating the image data includes rotating the image data in the opposite direction of the scope roll in a continuous manner as the scope rolls.

6 . The control system of claim 1 , wherein the control circuitry is configured to determine the amount that the scope has rolled based on at least one of feedback data from a robotic arm configured to couple to the scope, sensor data generated by a position sensor associated with the scope, or a control signal generated to control the robotic arm.

7 . The control system of claim 1 , wherein the control circuitry is configured to:

receive, from an input device, an input control signal to rotate the working channel; and

control the scope to roll a predetermined amount based at least in part on the input control signal.

8 . The control system of claim 7 , wherein the control circuitry is configured to control the scope to roll by controlling the scope to roll a predetermined amount.

9 . The control system of claim 1 , wherein the control circuitry is further configured to:

determine that the scope has stopped rolling, wherein the image representation is displayed in the non-cropped form responsive to determining that the scope has stopped rolling.

10 . A method comprising:

receiving image data from an imaging device associated with a scope, the scope including a working channel;

displaying, by control circuitry, an image representation of the image data in a user interface;

displaying, by the control circuitry, a working channel indicator in the user interface, the working channel indicator indicating an angle of rotation of the working channel relative to the image representation;

determining an amount that the scope has rolled;

rotating the working channel indicator within the user interface based at least in part on the amount that the scope has rolled;

rotating the image data in the opposite direction of the scope roll so that an orientation of the image representation remains fixed relative to the user interface while the scope rolls and the working channel indicator rotates; and

selectively cropping the image representation in the user interface based on whether the scope is rolling, the selective cropping including:

displaying the image representation in a cropped form while the scope is rolling; and

displaying the image representation in a non-cropped form while the scope is not rolling.

11 . The method of claim 10 , further comprising:

determining that the amount that the scope has rolled has reached a predetermined angle of rotation, wherein the rotating the image representation and the rotating the working channel indicator occurs in response to the determining that the amount that the scope has rolled has reached the predetermined angle of rotation.

12 . The method of claim 10 , wherein;

rotating the image data includes rotating the image data in the opposite direction of the scope roll in a continuous manner as the scope rolls; and

the determining the amount that the scope has rolled is based on at least one of feedback data from a robotic arm configured to couple to the scope, position data generated by a position sensor associated with the scope, or a control signal generated to control the robotic arm.

13 . The method of claim 10 , further comprising:

receiving, from an input device, user input to rotate the scope by a predetermined amount; and

controlling the scope to roll the predetermined amount.

14 . The method of claim 10 , wherein the displaying the working channel indicator includes overlaying the working channel indicator on the image representation.

15 . A system comprising:

a scope that includes a working channel to removably receive a medical instrument;

an imaging device configured to couple to the scope; and

control circuitry communicatively coupled to the scope and the imaging device, the control circuitry being configured to:

receive image data from the imaging device;

cause an image representation of the image data to be displayed in a user interface;

cause a working channel indicator to be displayed in the user interface, the working channel indicator indicating an angle of rotation of the working channel;

determine an amount that the scope has rolled;

based at least in part on the amount that the scope has rolled, rotate the working channel indicator in the user interface;

rotate the image data in the opposite direction of the scope roll so that an orientation of the image representation remains fixed relative to the user interface while the scope rolls and the working channel indicator rotates; and

selectively crop the image representation in the user interface based on whether the scope is rolling, the selective cropping including:

displaying the image representation in a cropped form while the scope is rolling; and

displaying the image representation in a non-cropped form while the scope is not rolling.

16 . The system of claim 15 , wherein the working channel is offset from a longitudinal axis of the scope.

17 . The system of claim 15 , wherein the control circuitry is configured to:

control the scope to roll in a rotation direction, wherein rotating the image data in the opposite direction of the scope roll causes the image representation to rotate within the user interface in the rotation direction.

18 . The system of claim 15 , wherein the control circuitry is further configured to:

determine that the amount that the scope has rolled has reached a predetermined angle of rotation, wherein, in response to determining that the amount that the scope has rolled has reached the predetermined angle of rotation, causing the image representation to rotate within the user interface.

19 . The system of claim 15 , wherein the control circuitry is configured to rotate the image data in a continuous manner as the scope rolls.