IP Library › Granted Patent US 10,796,419
Granted Patent B2
US 10,796,419 · App. 16/002,232 · Granted Oct 6, 2020

Electronic apparatus and controlling method of thereof

Inventors: Dosik Hwang (Seoul, KR); Kihun Bang (Seoul, KR); Hanbyol Jang (Seoul, KR); Jinseong Jang (Seoul, KR); Min-su Cheon (Seoul, KR); Young-o Park (Seoul, KR); Sun-young Jeon (Anyang-si, KR)
Assignees: SAMSUNG ELECTRONICS CO., LTD.; INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
G06T5/009H04N9/646H04N9/77G06T2207/10024G06T2207/20081G06T2207/20208
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,796,419
App. No.
16/002,232
Granted
Oct 6, 2020
Kind
B2
Abstract

An electronic apparatus includes a memory configured to store a predetermined conversion relation, and a processor configured to obtain first luminance information indicating luminance values of respective pixels included in a first image, and obtain first color information indicating color values of the respective pixels, obtain a first cumulative distribution function indicating a relation between a cumulative pixel count and each luminance level based on the first luminance information, obtain a second cumulative distribution function by applying the predetermined conversion relation to the first cumulative distribution function, calculate second luminance information indicating converted luminance values of the respective pixels by using the first cumulative distribution function and the second cumulative distribution function, and generate a second image based on the first color information and the second luminance information.

Claims (53)

1. An electronic apparatus, comprising:

a memory; and

a processor configured to:

control the memory to store a predetermined conversion relation,

obtain first luminance information indicating luminance values of respective pixels included in a first image, and obtain first color information indicating color values of the respective pixels;

obtain a first cumulative distribution function indicating a relation between a cumulative pixel count and each luminance level among a plurality of luminance levels based on the first luminance information;

obtain a second cumulative distribution function by applying the predetermined conversion relation to the first cumulative distribution function;

identify a cumulative pixel count corresponding to a first luminance value in the first cumulative distribution function;

identify a second luminance value corresponding to the identified cumulative pixel count in the second cumulative distribution function;

identify second luminance information indicating converted luminance values of the respective pixels by using the identified second luminance value; and

generate a second image based on the first color information and the second luminance information.

2. The electronic apparatus as claimed in claim 1 , wherein a dynamic range of the second image is wider than a dynamic range of the first image.

3. The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to obtain the converted luminance values corresponding to the respective pixels based on the luminance values of the respective pixels by using histogram matching between the first cumulative distribution function and the second cumulative distribution function.

4. The electronic apparatus as claimed in claim 1 , wherein the first cumulative distribution function is obtained by accumulating a number of pixels having a luminance value less than or equal to the first luminance value and identifying a first cumulative pixel count corresponding to the first luminance value, and by accumulating a number of pixels having a luminance value less than or equal to the second luminance value greater than the first luminance value and identifying a second cumulative pixel count corresponding to the second luminance value.

5. The electronic apparatus as claimed in claim 1 , wherein the predetermined conversion relation is a relation obtained by training a process of converting a Low Dynamic Range (LDR) training image into a High Dynamic Range (HDR) training image through deep-learning.

6. The electronic apparatus as claimed in claim 1 , wherein the first and second images are RGB domain images, and

wherein the processor is further configured to generate the second image by obtaining the first luminance information and the first color information by converting the first image into a Lab domain image, and converting a Lab domain image based on the first color information and the second luminance information into an RGB domain image.

7. The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to:

identify each of the first image and the second image by a plurality of pixel areas,

generate a first frame by alternately arranging a pixel area of the first image and a pixel area of the second image, and

generate a second frame by arranging the pixel area of the second image on the pixel area of the first image and the pixel area of the first image on the pixel area of the second image, based on the first frame.

8. The electronic apparatus as claimed in claim 7 , further comprising:

a display;

wherein the processor is further configured to control the display to alternately display the first frame and the second frame.

9. A controlling method for an electronic apparatus that stores a predetermined conversion relation, the method comprising:

obtaining first luminance information indicating luminance values of respective pixels included in a first image and, obtaining first color information indicating color values of the respective pixels;

obtaining a first cumulative distribution function indicating a relation between a cumulative pixel count and each luminance level among a plurality of luminance levels based on the first luminance information;

obtaining a second cumulative distribution function by applying the predetermined conversion relation to the first cumulative distribution function;

identifying a cumulative pixel count corresponding to a first luminance value in the first cumulative distribution function;

identifying a second luminance value corresponding to the identified cumulative pixel count in the second cumulative distribution function;

identifying second luminance information indicating converted luminance values of the respective pixels by using the identified second luminance value; and

generating a second image based on the first color information and the second luminance information.

10. The electronic apparatus as claimed in claim 9 , wherein a dynamic range of the second image is wider than a dynamic range of the first image.

11. The method as claimed in claim 9 , wherein the identifying of the second luminance information comprises obtaining the converted luminance values corresponding to the respective pixels based on the luminance values of the respective pixels by using histogram matching between the first cumulative distribution function and the second cumulative distribution function.

12. The method as claimed in claim 9 , wherein the first cumulative distribution function is obtained by accumulating a number of pixels having a luminance value less than or equal to the first luminance value and identifying a first cumulative pixel count corresponding to the first luminance value, and by accumulating a number of pixels having a luminance value less than or equal to the second luminance value greater than the first luminance value and identifying a second cumulative pixel count corresponding to the second luminance value.

13. The method as claimed in claim 9 , wherein the predetermined conversion relation is a relation obtained by training a process of converting a Low Dynamic Range (LDR) training image into a High Dynamic Range (HDR) training image through deep-learning.

14. The method as claimed in claim 9 , wherein the first and second images are RGB domain images, and

wherein the generating of the second image comprises:

obtaining the first luminance information and the first color information by converting the first image into a Lab domain image; and

converting a Lab domain image based on the first color information and the second luminance information into an RGB domain image.

15. The method as claimed in claim 9 , further comprising:

identifying each of the first image and the second image by a plurality of pixel areas; and

generating a first frame by alternately arranging a pixel area of the first image and a pixel area of the second image, and generating a second frame by arranging the pixel area of the second image on the pixel area of the first image and the pixel area of the first image on the pixel area of the second image, based on the first frame.

16. The method as claimed in claim 15 , further comprising:

displaying the first frame and the second frame alternately.

17. A non-transitory computer readable medium that stores one or more instructions that, when executed, cause an electronic apparatus to perform:

obtaining first luminance information indicating luminance values of respective pixels included in a first image, and obtaining first color information indicating color values of the respective pixels;

obtaining a first cumulative distribution function indicating a relation between a cumulative pixel count and each luminance level based on the first luminance information;

obtaining a second cumulative distribution function by applying a predetermined conversion relation to the first cumulative distribution function;

identifying a cumulative pixel count corresponding to a first luminance value in the first cumulative distribution function;

identifying a second luminance value corresponding to the identified cumulative pixel count in the second cumulative distribution function;

identifying second luminance information indicating converted luminance values of the respective pixels by using the identified second luminance value; and

generating a second image based on the first color information and the second luminance information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2018
From: HWANG, DOSIK; BANG, KIHUN; JANG, HANBYOL; JANG, JINSEONG; CHEON, MIN-SU; PARK, YOUNG-O; JEON, SUN-YOUNG
To: SAMSUNG ELECTRONICS CO., LTD.; INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY
Reel/Frame 046013/0557 →
Priority Claims (1)
KR 10-2018-0008988 · Jan 24, 2018 · national
Continuity (1)
Related Publication 20190228510A1 · Jul 25, 2019