IP Library Granted Patent US 10,477,190
Granted Patent B2
US 10,477,190 · App. 15/458,199 · Granted Nov 12, 2019

Constant horizon 3D imaging system and related method

Inventors: Andreas Heni (Fridingen, DE); Markus Kupferschmid (Emmingen-Liptingen, DE); Daniel Ulmschneider (Nendingen, DE); Lawrence Natusch (Tuttlingen, DE); George E. Duckett, III (Castaic, CA)
Assignees: Karl Storz Imaging, Inc.; Karl Storz SE & Co. KG
H04N13/296A61B1/00179A61B1/00193G02B23/2415G02B23/2423G02B23/2484H04N13/189H04N13/243H04N13/239
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,477,190
App. No.
15/458,199
Granted
Nov 12, 2019
Kind
B2
Abstract

An imaging system includes an imaging scope, a controller, a camera, and a processor. The imaging scope is selectively rotatable about a longitudinal axis relative to a horizon plane. The imaging scope has at least three optical channels, each including a respective objective that captures light. The objectives are positioned such that respective viewing direction axes of the optical channels extend at least substantially parallel to one another. The controller activates a pair of optical channels that is at least as parallel relative to the horizon plane as any other pair of optical channels. The camera generates a first image representative of light captured by a first optical channel of the activated pair of optical channels, and a second image representative of light captured by a second optical channel of the activated pair of optical channels. The processor generates a 3D image using the first and second images.

Claims (43)

1. An imaging system, comprising:

an imaging scope extending along a longitudinal axis between a proximal end portion and a distal end portion thereof, the imaging scope selectively rotatable about the longitudinal axis relative to a horizon plane, the imaging scope having at least three optical channels, each including a respective objective positioned at the distal end portion of the imaging scope, and each configured to capture light reflected from an object, the objectives of the at least three optical channels being annularly-spaced relative to one another and positioned such that respective viewing direction axes of the at least three optical channels extend at least substantially parallel to one another;

a controller configured to activate, among the at least three optical channels, a pair of optical channels that is at least as parallel relative to the horizon plane as any other pair of optical channels among the at least three optical channels;

a camera configured to generate a first 2D digital image representative of light captured by a first optical channel of the activated pair of optical channels, and a second 2D digital image representative of light captured by a second optical channel of the activated pair of optical channels; and

a 3D processor configured to generate a 3D digital image using the first 2D digital image and the second 2D digital image.

2. The imaging system of claim 1 , wherein the pair of optical channels defines a viewing horizon line that is at least as parallel relative to the horizon plane as that of any other pair of optical channels among the at least three optical channels, the viewing horizon line being a line that extends perpendicularly between the respective viewing direction axes of the pair of optical channels.

3. The imaging system of claim 2 , wherein the horizon plane is oriented perpendicular relative to a gravity vector.

4. The imaging system of claim 2 , wherein the horizon plane is oriented parallel relative to a gravity vector.

5. The imaging system of claim 2 , wherein the horizon plane is non-perpendicularly offset relative to a gravity vector.

6. The imaging system of claim 2 , wherein an orientation of the horizon plane is selectively chosen by a user.

7. The imaging system of claim 2 , wherein the horizon plane is determined by the controller based on a data signal received from a gravity sensor, the data signal including data regarding an orientation and/or movement of the imaging scope relative to a direction of a gravity vector.

8. The imaging system of claim 1 , wherein the controller is configured such that, during activation of the pair of optical channels, the controller causes first and second optical channels of the at least three optical channels to be those from which captured light is used by the camera to generate the 2D digital images.

9. The imaging system of claim 1 , wherein light captured and transmitted through a first optical channel of the pair of optical channels is subsequently received by a light-sensitive surface of a first image sensor of the camera, and the first image sensor generates the first 2D digital image representative thereof; and

wherein light captured and transmitted through a second optical channel of the pair of optical channels is subsequently received by a light-sensitive surface of a second image sensor of the camera, and the second image sensor generates the second 2D digital image representative thereof.

10. The imaging system of claim 1 , wherein the controller is configured to activate the pair of optical channels by instructing corresponding image sensors of the camera to generate respective 2D digital images representative of light received from first and second optical channels of the pair of optical channels.

11. The imaging system of claim 1 , wherein the controller is configured to activate the pair of optical channels by moving image sensors of the camera relative to the pair of optical channels until the image sensors are aligned with the pair of optical channels.

12. The imaging system of claim 1 , wherein the imaging scope further includes:

a shaft that extends in a direction of the longitudinal axis of the imaging scope, the shaft being rigid, and the shaft including a tubular shaft wall and a shaft channel defined by an inner surface of the shaft wall; and

a housing connected to a proximal end portion of the shaft.

13. The imaging system of claim 12 , wherein the imaging scope further includes a window disposed at the distal end portion of the shaft, the window being at least substantially transparent.

14. The imaging system of claim 12 , wherein the housing houses the camera; and

wherein each of the at least three optical channels includes a respective image transmission device that transmits captured light from the respective objectives of the at least three optical channels to the camera.

15. The imaging system of claim 12 , wherein the camera is housed in a distal end portion of the shaft.

16. The imaging system of claim 12 , wherein at least one of the camera, the controller, and the 3D processor are remotely positioned relative to the imaging scope.

17. The imaging system of claim 1 , wherein the respective viewing direction axes of the at least three optical channels are angularly offset relative to the longitudinal axis of the imaging scope.

18. The imaging system of claim 1 , wherein the camera includes at least two image sensors, each of the at least two image sensors including at least a portion of a light-sensitive surface configured to receive captured light from one of the at least three optical channels, and configured to generate 2D digital images representative of such captured light.

19. The imaging system of claim 18 , wherein a number of image sensors included in the camera is the same as a number of optical channels.

20. The imaging system of claim 18 , wherein the at least two image sensors are positionally fixed relative to the at least three optical channels.

21. The imaging system of claim 18 , wherein the camera includes a number of image sensors that is fewer than the number of optical channels.

22. The imaging system of claim 21 , wherein the at least two image sensors are rotatable relative to the at least three optical channels so that a parallel alignment of the image sensors relative to the horizon plane remains fixed during operation of the imaging system.

23. The imaging system of claim 22 , wherein respective rotational positions of the at least two image sensors relative to the at least three optical channels are controlled by the controller.

24. The imaging system of claim 1 , wherein the respective viewing direction axes of the at least three optical channels each have a fixed angular offset relative to the longitudinal axis of the imaging scope.

25. An imaging system, comprising:

an imaging scope extending along a longitudinal axis between a proximal end portion and a distal end portion thereof, the imaging scope selectively rotatable about the longitudinal axis relative to a horizon plane, the imaging scope having at least three optical channels, each including a respective objective positioned at the distal end portion of the imaging scope, and each configured to capture light reflected from an object, the objectives of the at least three optical channels being annularly-spaced relative to one another and positioned such that respective viewing direction axes of the at least three optical channels extend at least substantially parallel to one another;

a controller configured to activate, among the at least three optical channels, a pair of optical channels defining a viewing horizon line that is at least as parallel relative to the horizon plane as that of any other pair of optical channels among the at least three optical channels, the viewing horizon line being a line that extends perpendicularly between the respective viewing direction axes of the pair of optical channels;

a camera configured to generate a first 2D digital image representative of light captured by a first optical channel of the activated pair of optical channels, and a second 2D digital image representative of light captured by a second optical channel of the activated pair of optical channels; and

a 3D processor configured to generate a 3D digital image using the first 2D digital image and the second 2D digital image.

26. A method, comprising:

providing an imaging scope that extends along a longitudinal axis between a proximal end portion and a distal end portion thereof, the imaging scope having at least three optical channels, each including a respective objective positioned at the distal end portion of the imaging scope, and each configured to capture light reflected from an object, the objectives being annularly-spaced relative to one another and positioned such that respective viewing direction axes of the at least three optical channels extend at least substantially parallel to one another;

rotating the imaging scope about the longitudinal axis relative to a horizon plane;

activating, among the at least three optical channels, a pair of optical channels that is at least as parallel relative to the horizon plane as any other pair of optical channels among the at least three optical channels;

generating a first 2D digital image representative of light captured by a first optical channel of the activated pair of optical channels, and a second 2D digital image representative of light captured by a second optical channel of the activated pair of optical channels; and

generating a 3D digital image using the first 2D digital image and the second 2D digital image.

Assignments (3)
CHANGE OF NAME Recorded Aug 27, 2018
From: KARL STORZ GMBH & CO. KG
To: KARL STORZ SE & CO. KG
Reel/Frame 047469/0287 →
CHANGE OF NAME Recorded Jan 5, 2018
From: KARL STORZ GMBH & CO. KG
To: KARL STORZ SE & CO. KG
Reel/Frame 044545/0126 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 6, 2017
From: HENI, ANDREAS; KUPFERSCHMID, MARKUS; ULMSCHNEIDER, DANIEL; NATUSCH, LAWRENCE; DUCKETT, GEORGE E., III
To: KARL STORZ GMBH & CO. KG; KARL STORZ IMAGING, INC.
Reel/Frame 041885/0256 →
Continuity (1)
Related Publication 20180270466A1 · Sep 20, 2018