IP Library Granted Patent US 10,529,050
Granted Patent B2
US 10,529,050 · App. 15/427,530 · Granted Jan 7, 2020

Method and apparatus for processing wide angle image

Inventors: Chang Hee Song (Changwon-si, KR); Kyoung Jeon Jeong (Changwon-si, KR); Dae Hwan Kim (Changwon-si, KR)
Assignee: HANWHA TECHWIN CO., LTD
G06T3/0018G06T1/20G06T7/10G06T2207/20104G06T2210/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,529,050
App. No.
15/427,530
Granted
Jan 7, 2020
Kind
B2
Abstract

A method of processing a wide angle image including receiving an original image captured by a wide angle camera, receiving a user input selecting a plurality of regions of interest (ROIs) from the original image, generating in parallel a plurality of dewarping maps corresponding to the plurality of ROIs, and rendering in parallel a plurality of corrected images by correcting distortion of the plurality of ROIs based on the plurality of dewarping maps. Apparatus for carrying out the processing method also is disclosed.

Claims (45)

1. A method of processing a wide angle image, the method comprising:

receiving an original image captured by a wide angle camera;

receiving a user input selecting a plurality of regions of interest (ROIs) from the original image;

generating in parallel a plurality of dewarping maps corresponding to the plurality of ROIs;

rendering in parallel a plurality of corrected images by correcting distortion of the plurality of ROIs based on the plurality of dewarping maps;

receiving a user input selecting a supplemental ROI, the supplemental ROI being in addition to the plurality of ROIs;

generating a second dewarping map corresponding to the supplemental ROI; and

rendering a second corrected image by correcting distortion of the supplemental ROI based on the second dewarping map;

assigning priorities to the plurality of corrected images; and

deleting a first dewarping map corresponding to a first corrected image having a lowest priority among the plurality of corrected images in response to the user input selecting the supplemental ROI.

2. The method of claim 1 , further comprising:

receiving a user input deleting a first ROI of the plurality of ROIs; and

deleting a first dewarping map corresponding to the first ROI.

3. The method of claim 1 , further comprising:

receiving a user input replacing a first ROI that is one of the plurality of ROIs with a second ROI that is not one of the plurality of ROIs;

deleting a first dewarping map corresponding to the first ROI and generating a second dewarping map corresponding to the second ROI; and

rendering a second corrected image by correcting distortion of the second ROI based on the second dewarping map.

4. The method of claim 1 , wherein the wide angle camera is a fisheye camera.

5. The method of claim 1 , wherein the step of generating in parallel a plurality of dewarping maps includes mapping, for at least one of the plurality of dewarping maps, position values of original pixels for the corresponding ROI with position values of corrected pixels constituting a corrected image.

6. The method of claim 5 , wherein the position values of the original pixels of the corresponding ROI comprise pan angles, tilt angles, and zoom magnifications, and

the position values of the corrected pixels constituting the corrected image comprise X-coordinate values and Y-coordinate values.

7. The method of claim 1 , wherein the step of rendering in parallel the plurality of corrected images comprises:

measuring a frame rate of the original image;

determining whether the frame rate is lower than a reference frame rate; and

when the frame rate is lower than the reference frame rate, rendering the images except for at least a portion of at least one of the corrected images.

8. The method of claim 7 , further comprising the step of assigning priorities to the plurality of corrected images,

wherein the at least one of the corrected images comprises a first corrected image having a lowest priority among the plurality of corrected images.

9. An apparatus for processing a wide angle image, the apparatus comprising:

a communication interface configured to receive an original image from a wide angle camera;

a user interface configured to receive a user input selecting a plurality of ROIs from the original image;

a processor configured to generate in parallel a plurality of dewarping maps corresponding to the plurality of ROIs and configured to render in parallel a plurality of corrected images by correcting distortion of the plurality of ROIs based on the plurality of dewarping maps; and

a memory configured to store the plurality of dewarping maps,

wherein:

the user interface is configured to receive a user input selecting a supplemental ROI, the supplemental ROI being in addition to the plurality of ROIs;

the processor is configured to generate a second dewarping map corresponding to the supplemental ROI and configured to render a second corrected image by correcting distortion of the supplemental ROI based on the second dewarping map;

the memory is further configured to store the second dewarping map; and

the processor is configured to assign priorities to the plurality of corrected images and, in response to the user input selecting the supplemental ROI, to delete a first dewarping map corresponding to a first corrected image having a lowest priority among the plurality of corrected images from the memory.

10. The apparatus of claim 9 , wherein the user interface is configured to receive a user input deleting a first ROI of the plurality of ROIs, and

the processor is configured to delete from the memory a first dewarping map corresponding to the first ROI.

11. The apparatus of claim 9 , wherein the user interface is configured to receive a user input replacing a first ROI that is one of the plurality of ROIs with a second ROI that is not one of the plurality of ROIs, and

the processor is configured to delete a first dewarping map corresponding to the first ROI from the memory, generate a second dewarping map corresponding to the second ROI, and render a second corrected image by correcting distortion of the second ROI based on the second dewarping map.

12. The apparatus of claim 9 , wherein the processor is configured to map, for at least one of the plurality of dewarping maps, position values of original pixels for the corresponding ROI with position values of corrected pixels constituting a corrected image,

the position values of the original pixels of the corresponding ROI comprise pan angles, tilt angles, and zoom magnifications, and

the position values of the corrected pixels constituting the corrected image comprise X-coordinate values and Y-coordinate values.

13. The apparatus of claim 9 , wherein the processor is configured to assign priorities to the plurality of corrected images, to measure a frame rate of the original image, to determine whether the frame rate is lower than a reference frame rate, and when the frame rate is lower than the reference frame rate, to render the images except for at least a portion of a first corrected image having a lowest priority among the plurality of corrected images.

Assignments (5)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: HANWHA AEROSPACE CO., LTD.
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 049013/0723 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NUMBER 10/853,669. IN ADDITION PLEASE SEE EXHIBIT A PREVIOUSLY RECORDED ON REEL 046927 FRAME 0019. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jan 17, 2019
From: HANWHA TECHWIN CO., LTD.
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 048496/0596 →
CHANGE OF NAME Recorded Aug 24, 2018
From: HANWHA TECHWIN CO., LTD
To: HANWHA AEROSPACE CO., LTD.
Reel/Frame 046927/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2017
From: SONG, CHANG HEE; JEONG, KYOUNG JEON; KIM, DAE HWAN
To: HANWHA TECHWIN CO., LTD.
Reel/Frame 041203/0631 →