IP Library Granted Patent US 7,123,777
Granted Patent B2
US 7,123,777 · App. 10/256,743 · Granted Oct 17, 2006

System and method for panoramic imaging

Assignee: EyeSee360, Inc.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,123,777
App. No.
10/256,743
Granted
Oct 17, 2006
Kind
B2
Abstract

The present invention provides a system for processing panoramic photographic images. The system includes a mirror for reflecting an image of a scene, a mounting assembly for mounting the mirror on an axis, a camera for capturing the image reflected by the mirror, a digital converter device for producing pixel data representative of the captured image, and means for radially linearly mapping the pixel data into a viewable image. The mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape. Methods for processing images in accordance with the system are also provided.

Claims (192)

1. A system for processing images, the system comprising:

a mirror for reflecting an image of a scene;

a mounting assembly for mounting the mirror on an axis, wherein the mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape;

a camera for capturing the image reflected by the minor;

a digital conveder device for producing pixel data representative of the captured image; and

means for radially linearly mapping the pixel data into a viewable image comprising:

means for retrieving a source image file including the pixel data of the captured image;

a processor for creating a destination image file buffer, for mapping the pixel data of the captured image to the destination image file buffer, and for outputting pixel data from the destination image file buffer as a destination image file; and

means for displaying a viewable image defined by the destination file, wherein the destination image file comprises one of: a cylindrical panoramic projection image file, a perspective panoramic projection image file, an equi-rectangular panoramic projection image file, and an equi-angular panoramic projection image file.

2. The system of claim 1 , wherein the minor has a compensated equi-angular shape described by the equation:

r

(

θ

+

A

α

)

=

r

cot

(

k

tan

(

θ

+

A

α

)

+

π

2

)

where θ is the angle that a light ray makes with the axis as it reflects off of a point on the surface of the mirror and into the lens of the camera, r is the length of a light ray between the lens of the camera and a point on the surface of the minor, α is a constant defining the gain, and k is a constant defined by (−1−α)/2.

3. The system of claim 1 , wherein the processor further serves as means for:

defining a first set of coordinates of pixels in the destination image file;

defining a second set of coordinates of pixels in the source image file;

identifying coordinates of the second set that correspond to coordinates of the first set; and

inserting pixel data for pixel locations corresponding to the second set of coordinates into pixel locations corresponding to the first set of coordinates.

4. The system of claim 1 , wherein the processor further serves as means for interpolating the source image pixel data to produce pixel data for the destination image file buffer.

5. The system of claim 1 , wherein the source image file comprises a panoramic projection image file.

6. The system of claim 3 , wherein the first set of coordinates are spherical coordinates and the second set of coordinates are rectangular coordinates.

7. The system of claim 5 , wherein the panoramic projection image file comprises a partial equi-rectangular projection.

8. The system of claim 5 , wherein the panoramic projection image file comprises a modified partial equi-rectangular projection.

9. The system of claim 1 , further comprising a target apparatus attached to the mirror.

10. The system of claim 1 , further comprising:

means for transmitting the pixel data of the captured image to a server computer; and

means for processing the pixel data of the captured image on the server computer to obtain the viewable image.

11. A system for processing images, the system comprising:

a mirror for reflecting an image of a scene;

means for mounting the mirror on an axis, wherein the mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape;

means for capturing the image reflected by the mirror;

means for producing pixel data representative of the captured image; and

means for radially linearly mapping the pixel data into a viewable image comprising:

means for retrieving a source image file including the pixel data of the captured image;

a processor for creating a destination image file buffer, for mapping the pixel data of the captured image to the destination image file buffer, and for outputting pixel data from the destination image file buffer as a destination image file; and

means for displaying a viewable image defined by the destination file, wherein the destination image file comprises one of: a cylindrical panoramic projection image file, a perspective panoramic projection image file, an equi-rectangular panoramic projection image file, and an equi-angular panoramic projection image file.

12. The system of claim 11 , wherein the mirror has a compensated equi-angular shape described by the equation:

r

(

θ

+

A

α

)

=

r

cot

(

k

tan

(

θ

+

A

α

)

+

π

2

)

where θ is the angle that a light ray makes with the axis as it reflects off of a point on the surface of the mirror and into the lens of the camera, r is the length of a light ray between the lens of the camera and a point on the surface of the mirror, α is a constant defining the gain, and k is a constant defined by (−1−α)/2.

13. The system of claim 11 , wherein the processor further serves as means for:

defining a first set of coordinates of pixels in the destination image file;

defining a second set of coordinates of pixels in the source image file;

identifying coordinates of the second set that correspond to coordinates of the first set; and

inserting pixel data for pixel locations corresponding to the second set of coordinates into pixel locations corresponding to the first set of coordinates.

14. The system of claim 11 , wherein the processor further serves as means for interpolating the source image pixel data to produce pixel data for the destination image file buffer.

15. The system of claim 11 , wherein the source image file comprises a panoramic projection image file.

16. The system of claim 13 , wherein the first set of coordinates are spherical coordinates and the second set of coordinates are rectangular coordinates.

17. The system of claim 15 , wherein the panoramic projection image file comprises a partial equi-rectangular projection.

18. The system of claim 15 , wherein the panoramic projection image file comprises a modified partial equi-rectangular projection.

19. The system of claim 11 , further comprising a target apparatus attached to the mirror.

20. The system of claim 11 , further comprising:

means for transmitting the pixel data of the captured image to a server computer; and

means for processing the pixel data of the captured image on the server computer to obtain the viewable image.

21. A method of processing images, the method comprising the steps of:

providing a mirror for reflecting an image of a scene;

mounting the mirror on an axis, wherein the mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape;

capturing the image reflected by the mirror;

producing pixel data representative of the captured image; and

radially linearly mapping the pixel data into a viewable image comprising:

retrieving a source image file including the pixel data of the captured image;

creating a destination image file buffer; mapping the pixel data from the source image file to the destination image file buffer; outputting pixel data from the destination image file buffer as a destination image file; and

displaying a viewable image defined by the destination file, wherein the destination image file comprises one of: a cylindrical panoramic projection image file, a perspective panoramic projection image file, an equi-rectangular panoramic projection image file, and an equi-angular panoramic protection image file.

22. The method of claim 21 , wherein the mirror has a compensated equi-angular shape described by the equation:

r

(

θ

+

A

α

)

=

r

cot

(

k

tan

(

θ

+

A

α

)

+

π

2

)

where θ is the angle that a light ray makes with the axis as it reflects off of a point on the surface of the mirror and into the lens of the camera, r is the length of a light ray between the lens of the camera and a point on the surface of the mirror, α is a constant defining the gain, and k is a constant defined by (−1−α)/2.

23. The method of claim 21 , wherein the step of mapping pixel data from the source image file to the destination image file buffer comprises the steps of:

defining a first set of coordinates of pixels in the destination image file;

defining a second set of coordinates of pixels in the source image file;

identifying coordinates of the second set that correspond to coordinates of the first set;

inserting pixel data for pixel locations corresponding the second set of coordinates into pixel locations corresponding to the first set of coordinates.

24. The method of claim 21 , wherein the step of mapping the pixel data from the source image file to the destination image file buffer includes the step of:

interpolating the source image pixel data to produce pixel data for the destination image file buffer.

25. The method of claim 21 , wherein the source image file comprises a panoramic projection image file.

26. The method of claim 23 , wherein the first set of coordinates are spherical coordinates and the second set of coordinates are rectangular coordinates.

27. The method of claim 25 , wherein the panoramic projection image file comprises a partial equi-rectangular projection.

28. The method of claim 25 , wherein the panoramic projection image file comprises a modified partial equi-rectangular projection.

29. The method of claim 21 , further comprising the steps of:

transmitting the pixel data of the captured image to a server computer; and

processing the pixel data of the captured image on the server computer to obtain the viewable image.

30. A system for processing images, the system comprising:

a minor for reflecting an image of a scene;

means for mounting the mirror on an axis, wherein the mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape;

means for capturing the image reflected by the mirror;

means for producing pixel data representative of the captured image; and

means for radially linearly mapping the pixel data into a viewable image comprising:

means for retrieving a source image file including the pixel data of the captured image;

a processor for creating a destination image file buffer, for mapping the pixel data of the captured image to the destination image file buffer, and for outputting pixel data from the destination image file buffer as a destination image file, wherein the processor further serves as means for interpolating the source image pixel data to produce pixel data for the destination image file buffer; and

means for displaying a viewable image defined by the destination file.

31. A method of processing images, the method comprising the steps of:

providing a minor for reflecting an image of a scene;

mounting the minor on an axis, wherein the mirror includes a convex reflective surface defined by rotating around the axis: an equi-angular shape or a compensated equi-angular shape;

capturing the image reflected by the minor;

producing pixel data representative of the captured image; and

radially linearly mapping the pixel data into a viewable image comprising:

retrieving a source image file including the pixel data of the captured image, wherein the source image file comprises a panoramic projection image file;

creating a destination image file buffer; mapping the pixel data from the source image file to the destination image file buffer; outputting pixel data from the destination image file buffer as a destination image file; and

displaying a viewable image defined by the destination file.

Assignments (5)
SALE Recorded Jul 2, 2019
From: 360FLY, INC.
To: VOXX INTERNATIONAL CORPORATION
Reel/Frame 049670/0167 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2019
From: VOXX INTERNATIONAL CORPORATION
To: 360AI SOLUTIONS LLC
Reel/Frame 049670/0290 →
SECURITY INTEREST Recorded Jun 16, 2017
From: 360FLY, INC.
To: HYDRA VENTURES B.V., AS COLLATERAL AGENT
Reel/Frame 042859/0928 →
CHANGE OF NAME Recorded Mar 29, 2016
From: EYESEE360, INC.
To: 360FLY, INC.
Reel/Frame 038278/0584 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 2, 2002
From: RONDINELLI, MICHAEL; HERMAN, HERMAN; SINGH, SANJIV
To: EYESEE360, INC.
Reel/Frame 013539/0361 →
Continuity (7)
Continuation In Part 1022713600 · Aug 23, 2002
Continuation In Part 1008083400 · Feb 22, 2002
Continuation In Part 1008143300 · Feb 22, 2002
Continuation In Part 1008154500 · Feb 22, 2002
Provisional Application 6034671700 · Jan 7, 2002
Provisional Application 6032601300 · Sep 27, 2001
Related Publication 20030068098A1 · Apr 10, 2003