IP Library Granted Patent US 11,856,297
Granted Patent B1
US 11,856,297 · App. 16/372,302 · Granted Dec 26, 2023

Cylindrical panorama hardware

Inventor: Yashket Gupta (Santa Clara, CA)
Assignee: GN AUDIO A/S
H04N23/698G06F9/3004G06T7/73H04N23/45
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,856,297
App. No.
16/372,302
Granted
Dec 26, 2023
Kind
B1
Abstract

A panoramic video camera comprises a plurality of image sensors which are configured to capture a plurality of frames at a time; an image processing circuitry configured to generate a frame read signal to read the plurality of frames generated by the plurality of camera sensors, apply a cylindrical mapping function to map the plurality of frames to a cylindrical image plane and stitch the cylindrically mapped plurality of frames together in the cylindrical image plane based on a plurality of projection parameters.

Claims (23)

1. A panoramic video camera, comprising:

a plurality of image sensors configured to capture a plurality of frames at a time;

a processor configured to:

generate a frame read signal to read the plurality of frames generated by the plurality of camera sensors;

apply a cylindrical mapping function to map the plurality of frames to a cylindrical image plane;

correct parallax artifacts in the plurality of frames from the camera sensors, calculating a new alignment parameter as a target alignment parameter for each pair of sensors to be used in stitching images from the sensors and

stitch the cylindrically mapped plurality of frames together in the cylindrical image plane based on a plurality of projection parameters and the target alignment parameter calculated for each pair of sensors; wherein for a given target alignment parameter beginning stitching with a horizontal overlap based on the factory alignment parameter for the current frame; and subsequently adjusting said horizontal overlap for each successive frame over a plurality of frames wherein the horizontal overlap is progressively increased or decreased to be nearer to the target alignment parameter until for the final frame of said plurality of frames, the horizontal overlap is equal to the target alignment parameter.

2. The panoramic video camera of claim 1 , wherein the frame read signal is initialized by a switch.

3. The panoramic video camera of claim 2 , wherein the switch is controlled by a sensor control interface by broadcasting a control signal to the plurality of sensors.

4. The panoramic video camera of claim 1 , wherein the plurality of projection parameters is determined based on factory calibration and runtime calibration.

5. The panoramic video camera of claim 4 , wherein the factory calibration includes a plurality of overlap parameters and a plurality of cylindrical warp parameters.

6. The panoramic video camera of claim 5 , wherein the plurality of overlap parameters and the plurality of cylindrical warp parameters include the horizontal overlap width defined as a horizontal overlap in pixels between adjacent imager for each of the plurality of camera sensors.

7. The panoramic video camera of claim 5 , wherein the plurality of overlap parameters and the plurality of cylindrical warp parameters include a vertical offset in pixels for each of the plurality of camera sensors.

8. The panoramic video camera of claim 7 , wherein the overlap parameters are determined using phase correlation.

9. The panoramic video camera of claim 8 , wherein the plurality of cylindrical warp parameters are determined based on a scale by matching a left overlap region with the right overlap region for each of the plurality of imagers.

10. The panoramic video camera of claim 9 , wherein the scale is converted to a cylindrical radius factor which modulates the plurality of cylindrical warp parameters for each of the plurality of frames.

11. The panoramic video camera of claim 10 , the image processors is further configured to re-align the plurality of factory calibration parameters.

12. A non-transitory computer readable storage medium, having stored thereon, a set of computer-executable instructions that causes a computer to perform the steps comprising:

capturing a plurality of frames from a plurality of image sensors at a time;

generating a frame read signal to read the plurality of frames generated by the plurality of image sensors;

applying a cylindrical mapping function to map the plurality of frames to a cylindrical image plane;

correct parallax artifacts in the plurality of frames from the camera sensors, calculating a new alignment parameter as a target alignment parameter for each pair of sensors to be used in stitching images from the sensors; and

stitch the cylindrically mapped plurality of frames together in the cylindrical image plane based on a plurality of projection parameters and the target alignment parameter calculated for each pair of sensors; wherein for a given target alignment parameter beginning stitching with a horizontal overlap based on the factory alignment parameter for the current frame; and subsequently adjusting said horizontal overlap for each successive frame over a plurality of frames wherein the horizontal overlap is progressively increased or decreased to be nearer to the target alignment parameter until for the final frame said plurality of frames, the horizontal overlap is equal to the target alignment parameter.

Assignments (2)
MERGER Recorded Mar 30, 2026
From: GN AUDIO A/S
To: GN HEARING A/S
Reel/Frame 075299/0225 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 12, 2022
From: ALTIA SYSTEMS, INC.
To: GN AUDIO A/S
Reel/Frame 058995/0604 →