IP Library Granted Patent US 8,817,066
Granted Patent B2
US 8,817,066 · App. 13/092,591 · Granted Aug 26, 2014

Systems and methods for panoramic imaging

Inventors: Gurunandan Krishnan (New York, NY); Shree K. Nayar (New York, NY)
Assignee: The Trustees of Columbia University in the City of New York
G02B13/06H04N5/2254H04N5/2259H04N5/23238
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,817,066
App. No.
13/092,591
Granted
Aug 26, 2014
Kind
B2
Abstract

A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image includes a mirror for optically coupling to a fisheye lens having a first field of view, the mirror configured for reflecting an image of a second field of view through the fisheye lens. A housing has a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system. When the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image and a second portion of the panoramic image, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image.

Claims (23)

1. A mirror assembly adapted for use in a panoramic imaging system for capturing a panoramic image, comprising:

a mirror having a mirror field of view and being for optically coupling to a fisheye lens having a direct field of view, the mirror configured for reflecting an image of the mirror field of view through the fisheye lens;

a housing having a first end and a second end, the mirror being secured proximate to the first end, and the second end having an engagement portion for securing the mirror assembly to the panoramic imaging system,

wherein, when the mirror assembly is secured to the panoramic imaging system, the mirror is optically coupled to the fisheye lens and a detector for capturing a first portion of the panoramic image corresponding to the direct field of view and a second portion of the panoramic image corresponding to the mirror field of view, the first portion of the panoramic image having a portion overlapping the second portion of the panoramic image;

a processor for operatively coupling to the detector; and

the memory storing program instructions, and wherein, when the mirror assembly is secured to the panoramic imaging system, the program instructions being executed by the processor cause the processor to:

receive the captured first and second portions of the panoramic image from the detector,

combine the first and second of the panoramic image to form the panoramic image, and

smooth the overlapping portion of the first and second portions of the panoramic image by feathering.

2. The mirror assembly of claim 1 , wherein the mirror is a spherical mirror.

3. The mirror assembly of claim 1 , wherein a radius of curvature of the mirror and a width of the mirror are predetermined as a function of a position of the mirror with respect to the fisheye lens.

4. The mirror assembly of claim 1 , wherein the housing further comprises a cylindrical transparent wall disposed between the first end and the second end.

5. The mirror assembly of claim 1 , wherein the engagement portion comprises a screw thread.

6. The mirror assembly of claim 1 , wherein, when the mirror assembly is secured to the panoramic imaging system, the mirror is positioned coaxially with regard to the fisheye lens.

7. The mirror assembly of claim 1 , wherein, when the mirror assembly is secured to the panoramic imaging system, a lower angle of a panoramic field of view of the panoramic imaging system is less than or equal to a lower angle of the mirror field of view.

8. The mirror assembly of claim 1 , wherein, when the mirror assembly is secured to the panoramic imaging system, an angle of overlap between the direct field of view and the mirror field of view is equal to the difference between a lower angle of the direct field of view and an upper angle of the mirror field of view.

9. The mirror assembly of claim 1 , wherein the program instructions being executed by the processor cause the processor to utilize the detector to:

capture the first portion of the panoramic image corresponding to the direct field of view transmitted directly through the fisheye lens, and

capture the second portion of the panoramic image corresponding to the mirror field of view reflected from the mirror through the fisheye lens.

10. The mirror assembly of claim 9 , wherein the combining of the first portion of the panoramic image and the second portion of the panoramic image is performed utilizing a scale-invariant feature transform algorithm.

11. The mirror assembly of claim 9 , wherein the memory stores program instructions that when executed by the processor, further cause the processor to calibrate the system.

12. The mirror assembly of claim 11 , wherein calibrating the system comprises calibrating the mirror by determining the center of curvature and orientation of the mirror.

13. The mirror assembly of claim 9 , wherein the memory stores program instructions that, when executed by the processor, further cause the processor generate a table of correspondence between pixel locations on the first portion of the panoramic image and pixel locations on the second portion of the panoramic image.

Assignments (1)
CONFIRMATORY LICENSE Recorded Jul 6, 2017
From: COLUMBIA UNIVERSITY
To: NAVY, SECRETARY OF THE UNITED STATES OF AMERICA
Reel/Frame 043157/0188 →
Continuity (4)
Continuation 12726029 · Mar 17, 2010
Continuation PCTUS2008077258 · Sep 22, 2008
Provisional Application 60974338 · Sep 21, 2007
Related Publication 20110211039A1 · Sep 1, 2011