IP Library Granted Patent US 11,471,241
Granted Patent B2
US 11,471,241 · App. 16/629,351 · Granted Oct 18, 2022

Video based microscope adjustment

Inventors: Sebastian Stopp (Munich, DE); Johannes Manus (Munich, DE)
Assignee: Brainlab AG
A61B90/25A61B17/00A61B34/20A61B90/361G02B27/017A61B2017/00203A61B2017/00207A61B2017/00973A61B2034/2057A61B2034/2065A61B2034/2068
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,471,241
App. No.
16/629,351
Granted
Oct 18, 2022
Kind
B2
Abstract

The present application relates to an optical observation device which is controlled in a sterility preserving manner, and to a corresponding controlling program and/or program storage medium. The optical observation device includes a main structure having at least one optical camera, a motorized support for positioning the main structure, and a control unit that receives a sequence of images from the at least one optical camera, searches a current image from the sequence of images for a trackable object, tracks the trackable object shown in the sequence of images subsequent to the current image, and controls the motorized support structure.

Claims (40)

1. An optical observation device comprising:

a main structure comprising a surgical microscope having at least one optical camera adapted to be aimed at a patient to be treated;

a motorized support structure adapted to variably position the main structure at or near a workplace to be observed; and

a control unit adapted to:

receive a sequence of images from the at least one optical camera;

search a current image from the sequence of images for a trackable object positioned within a field of view of the at least one optical camera;

track the trackable object shown in the sequence of images subsequent to the current image; and

control the motorized support structure, an optical set-up and/or the at least one optical camera, wherein motion of the main structure, and/or adjustable properties of the optical set-up and/or of the at least one optical camera, is coupled to a motion of the trackable object via at least one conversion factor.

2. The optical observation device according to claim 1 , wherein the motorized support structure is controlled to move the main structure in accordance with the motion of the trackable object, wherein the motorized support structure is an articulated arm with at least two arm sections which are hingedly connected to each other via at least one motorized joint.

3. The optical observation device according to claim 1 , wherein the control unit is adapted to receive a trigger signal via a sterility preserving user interface via covering or uncovering an optically recognizable feature provided on the trackable object, wherein the trigger signal is activated by a foot pedal switch, voice command, and/or gestures which are recognizable from the sequence of images.

4. The optical observation device according to claim 3 , wherein covering a designated feature of the trackable object, which is visible to the at least one optical camera is recognized as a gesture provoking the trigger signal.

5. The optical observation device according to claim 2 , wherein the motion of the main structure is coupled to the motion of the trackable object via the at least one conversion factor causing:

the motion of the main structure to be amplified as compared to the motion of the trackable object;

the motion of the main structure to be reduced as compared to the motion of the trackable object; and/or

the motion of the main structure to be damped as compared to the motion of the trackable object.

6. The optical observation device according to claim 1 , wherein an upper threshold for a speed of motion of the trackable object is defined and motions above the threshold are ignored.

7. The optical observation device according to claim 1 , wherein at least two degrees of freedom for the motion of the main structure are controlled separately, such that motion of the main structure in at least one of the at least two degrees of freedom is blocked while the main structure is controlled to move within at least one other of the at least two degrees of freedom.

8. The optical observation device according to claim 1 , wherein the control unit is also adapted to control at least one of:

properties of AR-content superimposed with the sequence of images, the properties being a location, orientation and/or size of AR-content with respect to the sequence of images;

a focus-point of the optical set-up; and

a zoom-factor of the at least one optical camera; in accordance with the motion of the trackable object.

9. The optical observation device according to claim 1 , wherein a handheld medical instrument is recognized as trackable object, which is provided as a disposable device.

10. The optical observation device according to claim 9 , wherein the medical instrument is tracked via a ring pattern provided on the medical instrument and visible in the sequence of images.

11. An optical observation device comprising:

a main structure comprising at least one optical camera adapted to transmit a sequence of images;

a motorized support structure adapted to move the main structure; and

a control unit adapted to receive the sequence of images from the optical camera, track a trackable object shown in the sequence of images, and transmit a signal to the motorized support structure of where to move the main structure in accordance with a motion of the trackable object via at least one conversion factor.

12. The optical observation device according to claim 11 , wherein the control unit is further adapted to search a current image from the sequence of images for the trackable object after receipt of the sequence of images.

13. The optical observation device according to claim 12 , wherein the control unit is further adapted to receive a trigger signal for controlling the motorized support structure in accordance with the motion of the trackable object.

14. The optical observation device according to claim 11 , wherein the motorized support structure is controlled to move the main structure in accordance with the motion of the trackable object, and wherein the motorized support structure is an articulated arm with at least two arm sections which are hingedly connected to each other via at least one joint, via at least one motorized joint.

15. The optical observation device according to claim 11 , wherein the control unit is adapted to receive a trigger signal for controlling the motorized support structure, via a sterility preserving user interface, via covering or uncovering an optically recognizable feature provided on the trackable object, wherein the trigger signal is activated by a foot pedal switch, voice command, and/or gestures which are recognizable from the sequence of images.

16. The optical observation device according to claim 15 , wherein covering a designated feature of the trackable object, which is visible to the at least one optical camera is recognized as a gesture provoking the trigger signal.

17. The optical observation device according to claim 13 , wherein the motion of the main structure is coupled to the motion of the trackable object via the at least one conversion factor causing the motion of the main structure to be reduced as compared to the motion of the trackable object, and/or the motion of the main structure to be damped as compared to the motion of the trackable object.

18. The optical observation device according to claim 11 , wherein at least two degrees of freedom for the motion of the main structure are controlled separately, such that motion of the main structure in at least one of the at least two degrees of freedom is blocked while the main structure is controlled to move within at least one other of the at least two degrees of freedom.

19. The optical observation device according to claim 11 , wherein the control unit is also adapted to control properties of AR-content superimposed with the sequence of images; the at least one optical camera; and/or an optical set-up of the at least one optical camera.

20. A non-transitory computer readable storage medium storing a program, which when executed on a computer or loaded onto a computer, causes the computer to:

receive a sequence of images from at least one optical camera;

search a current image from a sequence of images for a trackable object;

track the trackable object shown in the sequence of images subsequent to the current image; and

control a motorized support structure, an optical set-up, and/or the at least one optical camera, wherein motion of a main structure, and/or adjustable properties of the optical set-up and/or of the at least one optical camera, is coupled to a motion of the trackable object via at least one conversion factor.

Assignments (2)
CHANGE OF NAME Recorded Feb 23, 2026
From: BRAINLAB AG
To: BRAINLAB SE
Reel/Frame 074966/0329 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 8, 2020
From: STOPP, SEBASTIAN; MANUS, JOHANNES
To: BRAINLAB AG
Reel/Frame 051445/0805 →
Priority Claims (1)
WO PCT/EP2017/070487 · Aug 11, 2017 · international
Continuity (1)
Related Publication 20210137632A1 · May 13, 2021