IP Library › Granted Patent US 11,089,190
Granted Patent B2
US 11,089,190 · App. 17/121,315 · Granted Aug 10, 2021

Forming combined image by imaging system with rotatable reflector

Inventor: Ziv Attar (Los Altos, CA)
Assignee: Glass Imaging Inc.
H04N5/2254H04N5/232933G02B7/182
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,089,190
App. No.
17/121,315
Granted
Aug 10, 2021
Kind
B2
Abstract

The following relates to forming a combined image by an imaging system with a rotatable reflector. A reflector is rotated about an axis to a first position relative to an image sensor. At the first position, the reflector directs light from a first portion of a view corresponding to an external environment towards the image sensor. An image of the first portion of the view is captured by the image sensor. The reflector is rotated about the axis to a second position relative to the image sensor. At the second position, the reflector directs light from a second portion of the view corresponding to the external environment towards the image sensor. An image of the second portion of the view is captured by the image sensor. The image of the first portion and the image of the second portion are combined to form an image corresponding to the view.

Claims (80)

1. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

capture an image of a second view corresponding to the external environment, the second view including the first and second portions; and

combine the image of the first portion and the image of the second portion based on the image of the second view to form a combined image corresponding to the view of the external environment.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the second portion of the view has at least some overlap with the first portion of the view.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the instruction to combine the image of the first portion and the image of the second portion to form a combined image comprise an instruction to stitch the image of the first portion and the image of the second portion.

4. The non-transitory computer-readable storage medium of claim 1 , wherein at least one of: the instruction to capture the image of the first portion by the image sensor or the instruction to capture the image of the second portion of the view by the image sensor further comprises instructions that when executed by the processor causes the reflector to continually rotate.

5. The non-transitory computer-readable storage medium of claim 1 , wherein at least one of: the instruction to capture the image of the first portion by the image sensor or the instruction to capture the image of the second portion of the view by the image sensor further comprises instructions that when executed by the processor causes the reflector to remain relatively stationary relative to the image sensor.

6. The non-transitory computer-readable storage medium of claim 1 , wherein the image of the second view is captured by a second image sensor that is physically separate from the image sensor.

7. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

receive motion data from a motion sensor, the motion data indicating motion of the image sensor relative to the view of the external environment;

responsive to determining the motion of the image sensor relative to the view of the external environment is above a threshold, modify the first position of the reflector to compensate for the motion, the reflector at the modified first position directing light from the first portion of the view of the external environment towards the image sensor;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor; and

combine the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment.

8. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

combine the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment;

rotate the reflector about the axis to a third position relative to the image sensor, wherein an opposite side of the reflector directs light from the first portion of the view towards the image sensor when the reflector is in the third position; and

capture a second image of the first portion of the view by the image sensor.

9. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

combine the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment;

rotate a second reflector about a second axis relative to the image sensor, the second reflector directing light from a third portion of view towards the image sensor; and

capture an image of the third portion of the view by the image sensor.

10. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position, wherein the reflector at the first position directs light from the first portion of the view towards a first portion of the image sensor;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

combine the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment; and

rotate the reflector about the axis to a third position relative to the image sensor, the reflector directing light from the first portion of the view towards a second portion of the image sensor.

11. A non-transitory computer-readable storage medium comprising stored instructions, the instructions when executed cause at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of the view corresponding to the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

combine the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment; and

capture an image of a portion of the of the view by an infrared camera, wherein the reflector is transparent to one or more infrared wavelengths and is positioned between the infrared camera and an aperture.

12. A method comprising:

rotating a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capturing an image of the first portion of the view by the image sensor;

rotating the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of a view of the external environment towards the image sensor when the reflector is in the second position;

capturing an image of the second portion of the view by the image sensor;

capturing an image of a third portion of the view of the external environment, the third portion including the first and second portions; and

combining the image of the first portion and the image of the second portion based on the image of the third portion of the view to form a combined image corresponding to the view of the external environment.

13. The method of claim 12 , wherein the second portion of the view has at least some overlap with the first portion of the view.

14. The method of claim 12 , wherein combining the image of the first portion and the image of the second portion to form a combined image comprises stitching the image of the first portion and the image of the second portion.

15. The method of claim 12 , wherein the reflector is relatively stationary during at least one of: the capturing of the image of the first portion of the view by the image sensor, or the capturing of the image of the second portion of the view by the image sensor.

16. The method of claim 12 , wherein the image of the third portion of the view is captured by a second image sensor that is physically separate from the image sensor.

17. A method comprising:

rotating a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

receiving motion data from a motion sensor, the motion data indicating motion of the image sensor relative to the view of the external environment;

responsive to determining the motion of the image sensor relative to the view of the external environment is above a threshold, modifying the first position of the reflector to compensate for the motion, the reflector at the modified first position directing light from the first portion of the view of the external environment towards the image sensor;

capturing an image of the first portion of the view by the image sensor;

rotating the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of a view of the external environment towards the image sensor when the reflector is in the second position;

capturing an image of the second portion of the view by the image sensor; and

combining the image of the first portion and the image of the second portion to form a combined image corresponding to the view of the external environment.

18. A computer system comprising:

at least one processor; and

a computer-readable storage medium comprising executable computer program code, the computer program code when executed cause the at least one processor to:

rotate a reflector about an axis to a first position relative to an image sensor, the reflector directing light from a first portion of a view corresponding to an external environment towards the image sensor when the reflector is in the first position;

capture an image of the first portion of the view by the image sensor;

rotate the reflector about the axis to a second position relative to the image sensor, the reflector directing light from a second portion of a view of the external environment towards the image sensor when the reflector is in the second position;

capture an image of the second portion of the view by the image sensor;

capture an image of a second view corresponding to the external environment, the second view including the first and second portions; and

combine the image of the first portion and the image of the second portion based on the image of the second view to form a combined image corresponding to the view of the external environment.

19. The computer system of claim 18 , wherein the second portion of the view has at least some overlap with the first portion of the view.

20. The computer system of claim 18 , wherein the image of the second view is captured by a second image sensor that is physically separate from the image sensor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2020
From: ATTAR, ZIV
To: GLASS IMAGING INC.
Reel/Frame 054659/0110 →
Continuity (3)
Provisional Application 62948200 · Dec 14, 2019
Provisional Application 62959884 · Jan 11, 2020
Related Publication 20210185198A1 · Jun 17, 2021
Cited By (1)
US 12,382,198