IP Library › Granted Patent US 9,948,852
Granted Patent B2
US 9,948,852 · App. 14/210,986 · Granted Apr 17, 2018

Intelligent manual adjustment of an image control element

Inventors: Paul E. Lilagan (Sunnyvale, CA); Wenyi Zhao (Mountain View, CA)
Assignee: Intuitive Surgical Operations, Inc.
H04N5/23216A61B1/00006A61B1/00188A61B1/00193A61B90/361H04N5/238H04N5/2353H04N5/23212H04N5/23293H04N13/0203H04N13/0296
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,948,852
App. No.
14/210,986
Granted
Apr 17, 2018
Kind
B2
Abstract

An imaging system comprises an image capturing device, a viewer, a control element, and a processor. The control element controls or adjusts an image characteristic of one of the image capturing device and the viewer. The processor is programmed to determine a depth value relative to the image capturing device, determine a desirable adjustment to the control element by using the determined depth value, and control adjustment of the control element to assist manual adjustment of the control element to the desirable adjustment. The processor may also be programmed to determine whether the adjustment of the control element is to be automatically or manually adjusted and control adjustment of the control element automatically to the desirable adjustment if the control element is to be automatically adjusted.

Claims (45)

1. A method for intelligent manual adjustment of a manually rotatable focus control of a camera, the method comprising:

determining a depth value of a target area relative to the camera;

determining a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area; and

assisting an operator of the manually rotatable focus control to the desirable focus adjustment by:

receiving an indication of a rotation direction of the manually rotatable focus control in which the manually rotatable focus control is first rotated by the operator in order to manually adjust the focus of the camera;

defining and setting the rotation direction as corresponding to moving the focal point towards the depth value of the target area, regardless of whether the rotation direction is in a clockwise direction or a counter-clockwise direction, and

defining and setting an opposite rotation direction of the manually rotatable focus control as corresponding to moving the focal point away from the depth value of the target area.

2. The method of claim 1 , further comprising:

determining the depth value as one of an average depth value and a minimum depth value for a surface topology of the target area.

3. The method of claim 1 , wherein the target area is a default area unless overridden by an operator specified area.

4. The method of claim 3 , wherein the operator specified area is specified by the operator gazing for a specified period of time at a gaze point on a display upon which images, which are derived from images captured by the camera, are being displayed.

5. The method of claim 4 , wherein the target area and the depth value of the target area relative to the camera are determined by translating a specified area about the gaze point on the display to the target area in a reference frame of the camera.

6. The method of claim 5 , further comprising:

displaying an indicator of the operator specified area on the display.

7. The method of claim 4 , wherein the camera is a stereo camera and the method further comprises:

determining the depth value by applying a sparse image mapping algorithm on the target area in captured stereo images received from the stereo camera.

8. The method of claim 1 , wherein assisting the operator of the manually rotatable focus control to the desirable focus adjustment further comprises:

providing a sensory indication when the focal point of the camera coincides with the target point, wherein the sensory indication is one or more of:

a visual indication on a display upon which images, which are derived from images captured by the camera, are being displayed,

an auditory indication, and

a force feedback on the manually rotatable focus control.

9. The method of claim 8 , wherein the force feedback is a haptic force on the manually rotatable focus control that nudges the operator of the manually rotatable focus control towards the amount that the focal point of the camera is to be moved in order to coincide with the depth value of the target area.

10. The method of claim 9 , wherein the haptic force decreases as the focal point of the camera moves towards the depth value of the target area and increases as the focal point of the camera moves away from the depth value of the target area.

11. An imaging system comprising:

a camera;

a manually rotatable focus control; and

a processor programmed to:

determine a depth value of a target area relative to the camera;

determine a desirable focus adjustment according to a direction and an amount that a focal point of the camera is to be moved in order to coincide with the depth value of the target area; and

assist an operator of the manually rotatable focus control to the desirable focus adjustment by:

receiving an indication of a rotation direction of the manually rotatable focus control in which the manually rotatable focus control is first rotated by the operator in order to manually adjust the focus of the camera;

defining and setting the rotation direction as corresponding to moving the focal point towards the depth value of the target area, regardless of whether the rotation direction is in a clockwise direction or a counter-clockwise direction, and

defining and setting an opposite rotation direction of the manually rotatable focus control as corresponding to moving the focal point away from the depth value of the target area.

12. The imaging system of claim 11 , wherein the processor is programmed to determine the depth value as an average depth value for a surface topology of the target area.

13. The imaging system of claim 11 , wherein the target area is a default area unless overridden by an operator specified area.

14. The imaging system of claim 13 , wherein the operator specified area is specified by the operator gazing for a specified period of time at a gaze point on a display upon which images, which are derived from images captured by the camera are being displayed.

15. The imaging system of claim 14 , wherein the target area and the depth value of the target area relative to the camera are determined by translating a specified area about the gaze point on the display to the target area in a reference frame of the camera.

16. The imaging system of claim 15 , wherein the processor is programmed to cause displaying an indicator of the operator specified area on the display.

17. The imaging system of claim 14 , wherein the camera is a stereo camera, and wherein the processor is programmed to determine the depth value by applying a sparse image mapping algorithm on the target area in captured stereo images received from the stereo camera.

18. The imaging system of claim 11 , wherein the processor is programmed to assist the operator of the manually rotatable focus control to the desirable focus adjustment by further:

providing a sensory indication when the focal point of the camera coincides with the target point, wherein the sensory indication is one or more of:

a visual indication on a display upon which images derived from images captured by the camera are being displayed,

an auditory indication, and

a force feedback on the manually rotatable focus control.

19. The imaging system of claim 18 , wherein the force feedback is a haptic force on the manually rotatable focus control that nudges the operator of the manually rotatable focus control towards the amount that the focal point of the camera is to be moved in order to coincide with the depth value of the target area.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2014
From: LILAGAN, PAUL E.; ZHAO, WENYI
To: INTUITIVE SURGICAL OPERATIONS, INC.
Reel/Frame 032789/0538 →
Continuity (2)
Provisional Application 61794068 · Mar 15, 2013
Related Publication 20140267626A1 · Sep 18, 2014