IP Library › Granted Patent US 11,025,845
Granted Patent B2
US 11,025,845 · App. 15/782,159 · Granted Jun 1, 2021

Method, apparatus, and recording medium for processing image

Inventors: Jae-yun Jeong (Suwon-si, KR); Byeong-doo Choi (Suwon-si, KR); Jae-kyeong Lee (Yongin-si, KR); Eric Yip (Seoul, KR); Jae-eun Kang (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
H04N5/3572H04N5/23238G02B13/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,025,845
App. No.
15/782,159
Granted
Jun 1, 2021
Kind
B2
Abstract

A method, performed by a device, of processing an image, may include obtaining a circular image generated by photographing a target space through a fisheye lens; generating metadata including lens shading compensation information for correcting color information of the obtained circular image; and transmitting the obtained circular image and the metadata to a terminal.

Claims (35)

1. A method of processing an image by an electronic device, the method comprising:

obtaining a plurality of circular images captured by at least one fisheye lens and fisheye information including camera parameters of the at least one fisheye lens and lens shading compensation information including coefficients of a polynomial function for each of RGB colors of the plurality of circular images and a number of the coefficients;

obtaining lens shading compensation values for the RGB colors of the plurality of circular images based on the obtained lens shading compensation information;

performing compensation of the plurality of the circular images based on the obtained lens shading compensation values; and

rendering the plurality of compensated circular images using the fisheye information,

wherein the polynomial function represents relation between the lens shading compensation values for the plurality of circular images and a distance from a center of an image of the plurality of circular images, and

wherein the polynomial function is w=Σ i=1 N p i-1 ·r i-1 , where w is a lens shading compensation value for one of the RGB colors, N is the number of the coefficients, p i-1 is a coefficient and r is the distance from the center of the image.

2. The method of claim 1 , wherein the performing of the compensation comprises correcting color information of each of a plurality of regions in the circular image based on the determined lens shading compensation values for the plurality of regions.

3. The method of claim 1 , wherein the coefficients indicate a correspondence between a plurality of regions in the circular image, identified based on the distance from the center of the image.

4. A device of processing an image, the device comprising:

a photographing unit;

a communicator; and

a processor coupled with the communicator and the photographing unit and configured to:

obtain a plurality of circular images via at least one fisheye lens of the photographing unit;

obtain fisheye information including field of view and camera parameters of the at least one fisheye lens and lens shading compensation information including coefficients of a polynomial function for each of RGB colors of the plurality of circular images and a number of the coefficients; and

transmit, via the communicator, the obtained circular images and the lens shading compensation information to a terminal,

wherein the polynomial function represents relation between the lens shading compensation values for the plurality of circular images and a distance from a center of an image of the plurality of circular images,

wherein the polynomial function is w=Σ i=1 N p i-1 ·r i-1 , where w is a lens shading compensation value for one of the RGB colors, N is the number of the coefficients, p i-1 is a coefficient and r is the distance from the center of the image,

wherein the plurality of the circular images are compensated based on the lens shading compensation values, and

wherein the compensated circular images are rendered using the fisheye information.

5. The device of claim 4 , wherein color information of each of a plurality of regions in the image is corrected based on the lens shading compensation values for the plurality of regions.

6. The device of claim 4 , wherein the coefficients indicate a correspondence between a plurality of regions in the circular image, identified based on the distance from the center of the image.

7. An electronic device of processing an image, the electronic device comprising:

a communicator; and

a processor coupled with the communicator and configured to:

obtain a plurality of circular images captured by at least one fisheye lens and fisheye information including camera parameters of the at least one fisheye lens and lens shading compensation information including coefficients of a polynomial function for each of RGB colors of the plurality of circular images and a number of the coefficients,

obtain the lens shading compensation values for the RGB colors of the plurality of circular images based on the obtained lens shading compensation information,

perform compensation of the plurality of the circular images based on the obtained lens shading compensation values, and

render the compensated circular images using the fisheye information,

wherein the polynomial function represents relation between the lens shading compensation values for the plurality of circular images and a distance from a center of an image of the plurality of circular images, and

wherein the polynomial function is w=Σ i=1 N p i-1 ·r i-1 , where w is a lens shading compensation value for one of the RGB colors, N is the number of the coefficients, p i-1 is a coefficient and r is the distance from the center of the image.

8. The electronic device of claim 7 , wherein the processor is further configured to:

correct color information of each of a plurality of regions in the circular image based on the determined lens shading compensation values for the plurality of regions.

9. The electronic device of claim 7 , wherein the coefficients indicate a correspondence between a plurality of regions in the circular image, identified based on the distance from the center of the image.

10. A non-transitory computer-readable recording medium having recorded thereon instructions for executing the method of claim 1 on a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 12, 2017
From: JEONG, JAE-YUN; CHOI, BYEONG-DOO; LEE, JAE-KYEONG; YIP, ERIC; KANG, JAE-EUN
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 044203/0992 →
Priority Claims (1)
KR 10-2017-0067633 · May 31, 2017 · national
Continuity (2)
Provisional Application 62407090 · Oct 12, 2016
Related Publication 20180103219A1 · Apr 12, 2018