IP Library Granted Patent US 11,389,255
Granted Patent B2
US 11,389,255 · App. 16/689,949 · Granted Jul 19, 2022

Providing information of tools by filtering image areas adjacent to or on displayed images of the tools

Inventors: Simon P. DiMaio (San Carlos, CA); Brian D. Hoffman (Mountain View, CA); Brandon D. Itkowitz (San Jose, CA); Paul W. Mohr (Mountain View, CA); David W. Robinson (Los Altos, CA); Tao Zhao (Sunnyvale, CA); Wenyi Zhao (Weston, FL)
Assignee: INTUITIVE SURGICAL OPERATIONS, INC.
A61B34/30A61B34/37A61B90/361
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,389,255
App. No.
16/689,949
Filed
Nov 20, 2019
Granted
Jul 19, 2022
Kind
B2
Examiner
KHALID, OMER
Art Unit
2422
USPC
348/45
Abstract

A system may comprise an image capture device disposed to capture an image of a work site, a display, and a processor. The processor may be configured to determine whether a tool disposed at the work site is energized and determine an area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized. Conditioned upon determining that the tool is energized, the processer may also filter the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create a glowing effect on the image of the portion of the energized tool, indicating that the tool is being energized. The image of the work site with the filtered area may be displayed on the display.

Claims (46)

1. A system comprising:

an image capture device disposed to capture an image of a work site;

a display; and

a processor configured to:

determine whether a tool disposed at the work site is energized;

determine an area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized; and

conditioned upon determining that the tool is energized, filter the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create a glowing effect on the image of the portion of the energized tool, indicating that the tool is being energized; and

cause the image of the work site with the filtered area to be displayed on the display.

2. The system of claim 1 ,

wherein the portion of the tool comprises a working end of the tool.

3. The system of claim 1 ,

wherein the processor is further configured to:

determine whether the tool is energized by determining whether a working end of the tool is energized for performing electrocautery, wherein the glowing effect on the portion of the energized tool indicates that the tool is energized for performing electrocautery.

4. The system of claim 1 , wherein the

image capture device comprises a stereo camera, wherein the display is a stereo viewer, and

wherein the image of the work site is a stereo image of the work site.

5. A system comprising:

an image capture device disposed to capture an image of a work site;

a display; and

a processor configured to:

determine whether a tool disposed at the work site is energized;

determine an area of the captured image of the work site, surrounding an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized; and

conditioned upon determining that the tool is energized, filter the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create an aura effect on the portion when displayed on the display, the aura effect indicating that the tool is being energized; and

cause the image of the work site with the filtered area to be displayed on the display.

6. The system of claim 5 ,

wherein the portion of the tool comprises a working end of the tool.

7. The system of claim 5 , wherein the processor is further configured to:

determine whether the tool is energized by determining whether a working end of the tool is energized for performing electrocautery, wherein the aura effect indicates that the tool is energized for performing electrocautery.

8. The system of claim 5 ,

wherein the image capture device comprises a stereo camera,

wherein the display is a stereo viewer, and

wherein the image of the work site is a stereo image of the work site.

9. A method for providing tool information on a display, the method comprising:

an image capture device capturing an image of a work site;

a processor determining whether a tool disposed at the work site is energized;

a processor determining an area of the captured image of the work site, including or adjacent to an image of a portion of the tool in the captured image, to be filtered to indicate the tool has been energized; and

conditioned upon the tool being energized, the processor filtering the area of the captured image of the work site to generate a filtered area of the captured image of the work site so as to create one of a glowing effect on the tool and an aura effect about the tool when displayed on a display, the one of the glowing effect and aura effect indicating that the tool is being energized; and

the processor causing the image of the work site to be displayed with the filtered area on the display.

10. The method of claim 9 ,

wherein the area of the image comprises an image of a working end of the tool.

11. The method of claim 9 ,

wherein the processor determining whether the tool is energized comprises the processor determining whether a working end of the tool is energized for performing electrocautery, wherein the one of the glowing effect and the aura effect indicates that the tool is energized for performing electrocautery.

12. The method of claim 9 ,

wherein the image capture device comprises a stereo camera,

wherein the display is a stereo viewer, and

wherein the image of the work site is a stereo image of the work site.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 22, 2019
From: DIMAIO, SIMON P.; HOFFMAN, BRIAN D.; ITKOWITZ, BRANDON D.; MOHR, PAUL W.; ROBINSON, DAVID W.; ZHAO, TAO; ZHAO, WENYI
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 051092/0208 →
Continuity (2)
Continuation 13768062 · Feb 15, 2013
Related Publication 20200085520A1 · Mar 19, 2020
Cited By (20)
US 1,087,135 US 1,087,995 US 12,239,396 US 12,266,040 US 12,295,681 US 12,357,400 US 12,376,934 US 12,465,447 US 12,479,098 US 12,496,728 US 12,599,445 US 12,599,449 US 12,611,272 US 12,616,474 US 12,617,078 US 12,642,613 US 12,648,685 US 12,661,192 US 12,672,927 US 12,708,466