IP Library Granted Patent US 11,729,522
Granted Patent B2
US 11,729,522 · App. 17/495,828 · Granted Aug 15, 2023

Optical scope system for capturing an image of a scene

Inventors: Thimo Emmerich (Stuttgart, DE); Zoltan Facius (Stuttgart, DE); Paul Springer (Stuttgart, DE)
Assignee: SONY GROUP CORPORATION
H04N23/959A61B1/00188A61B1/045H04N23/16H04N23/55H04N23/62H04N23/673H04N23/676H04N23/951H04N23/555
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,729,522
App. No.
17/495,828
Granted
Aug 15, 2023
Kind
B2
Abstract

An optical device for capturing an image of a scene, the optical device comprising: a plurality of image sensors each operable to capture a respective initial image of the scene; a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

Claims (39)

1. An optical scope system for capturing an image of a scene, the optical scope system comprising:

a plurality of image sensors each operable to capture a respective initial image of the scene;

at least one lens to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the at least one lens and at an angle relative to other image sensors; and

an image processor operable to:

divide each of the captured initial images into predetermined portions;

determine an image sharpness level for corresponding predetermined portions of each of the captured initial images;

determine the highest one of the determined image sharpness levels; and

generate, on the basis of image data from each of the captured initial images, the captured image of the scene the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level.

2. The optical scope system according to claim 1 , wherein:

each of the image sensors is operable to capture light using each of red, green and blue (RGB) colour channels; and

the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions the captured initial images on the basis of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level.

3. The optical scope system according to claim 1 , wherein:

the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions of the captured initial images by:

transporting the image sharpness level of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level to the other corresponding portions of the captured initial images; and

combining the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level with the other corresponding portions of the captured initial images to which the determined highest image sharpness level has been transported.

4. The optical scope system according to claim 1 , wherein each of the plurality of image sensors is located along a different respective optical path with respect to the at least one lens.

5. The optical scope system according to claim 1 , wherein the lens arrangement is operable to receive light from the scene captured by an optical instrument and to form the initial image of the scene on each image sensor using the received light, wherein the distance of each respective image sensor from the at least one lens is determined on the basis of one or more characteristics of the optical instrument.

6. The optical scope system according to claim 5 , comprising a plurality of image sensor adjustment devices each operable to adjust the distance of a respective one of the image sensors from the at least one lens.

7. The optical scope system according to claim 6 , comprising:

a user interface operable to receive information from a user for determining the distance of each respective image sensor from the at least one lens; and

a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

8. The optical scope system according to claim 6 , comprising:

an instrument interface operable to receive information from the optical instrument for determining the distance of each respective image sensor from the at least one lens; and

a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

9. The optical scope system according to claim 8 , wherein the information for determining the distance of each respective image sensor from the at least one lens comprises (a) the distance of each respective image sensor from the lens arrangement, (b) one or more optical properties of the optical instrument on the basis of which the controller is configured to calculate the distance of each respective image sensor from the at least one lens, or (c) an identifier of the optical instrument on the basis of which the controller is configured to consult a database in order to obtain the distance of each respective image sensor from the at least one lens or the one or more optical properties of the optical instrument for calculating the distance of each respective image sensor from the lens arrangement.

10. The optical scope system according to claim 5 , wherein the optical instrument is an endoscope.

11. The optical scope system according to claim 10 , wherein the endoscope is a medical endoscope.

12. An endoscopic system comprising an optical scope system according to claim 5 and an optical instrument configured to capture light from the scene for use by the lens arrangement of the optical device in forming an initial image of the scene on each image sensor of the optical device.

13. A method of capturing an image of a scene in an optical scope system, the method comprising:

capturing a plurality of initial images of the scene, each initial image of the scene being captured using a respective one of a plurality of image sensors, wherein each image sensor is located at a different respective distance from at least one lens and at an angle relative to other image sensors, each image sensor being operable to receive light from the scene and to form each initial image on each respective image sensor;

dividing each of the captured initial images into predetermined portions;

determining an image sharpness level for corresponding predetermined portions of each of the captured initial images;

determining the highest one of the determined image sharpness levels; and

generating, on the basis of image data from each of the captured initial images, the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level.

14. A non-transitory recording medium storing a computer program for controlling a computer to perform a method according to claim 13 .

15. An optical scope system for capturing an image of a scene comprising means configured to perform a method according to claim 13 .

16. The method according to claim 13 , further comprising:

transporting the image sharpness level of the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level to the other corresponding predetermined portions of the captured initial images; and

combining the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level with the other corresponding predetermined portions of the captured initial images to which the determined highest image sharpness level has been transported into a combined image.

Assignments (1)
CHANGE OF NAME Recorded Oct 7, 2021
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 057746/0914 →
Priority Claims (1)
EP 16204872 · Dec 16, 2016 · regional
Continuity (2)
Continuation 16464688
Related Publication 20220030174A1 · Jan 27, 2022