IP Library Granted Patent US 12,236,861
Granted Patent B2
US 12,236,861 · App. 18/498,023 · Granted Feb 25, 2025

Electronic device that compensates for light passing through a display

Inventors: Jaebum Cho (Seoul, KR); Daewook Kim (Hwaseong-si, KR); Seungin Baek (Seongnam-si, KR); Jewon Yoo (Seoul, KR); Sang-Gu Lee (Yongin-si, KR); Hyung Uk Cho (Seongnam-si, KR)
Assignee: Samsung Display Co., Ltd.
G09G3/3225G09G3/3406H04N23/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,861
App. No.
18/498,023
Granted
Feb 25, 2025
Kind
B2
Abstract

A method for driving an electronic device may include receiving light passing through a display panel, generating an image signal based on the light, compensating the image signal with a compensation algorithm to generate a compensated image signal, wherein the compensation algorithm is trained with training data including a first comparison image and a second comparison image, and displaying, on the display panel, a compensated image based on the compensated image signal, wherein the first comparison image is a target restoration image and the second comparison image is a composite image.

Claims (41)

1. An electronic device comprising:

a display panel comprising a first display region, and a second display region;

a camera module under the display panel and overlapping the second display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal by a compensation algorithm, wherein the compensation algorithm is trained with training data comprising a first comparison image and a second comparison image,

wherein each of the first comparison image and the second comparison image is a composite image,

wherein based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region,

wherein the first comparison image is the composite image synthesized based on a first processed image, for restoration,

wherein the second comparison image is generated by compositing a second processed image formed based on light that does not pass through the display panel with a third processed image, and

wherein each of the first processed image and the second processed image is obtained by processing a first image.

2. The electronic device of claim 1 , wherein the second display region has a lower pixel density than that of the first display region.

3. The electronic device of claim 1 , wherein the second display region has a higher transmittance than that of the first display region.

4. The electronic device of claim 1 , wherein the second display region is at least partially surrounded by the first display region.

5. The electronic device of claim 1 , wherein the second display region has a lower resolution than that of the first display region.

6. The electronic device of claim 1 , wherein the second display region comprises a transmissive region in which pixels are not disposed.

7. The electronic device of claim 1 , wherein the first comparison image is a target restoration image.

8. The electronic device of claim 1 , wherein the third processed image is an artificial light source image.

9. The electronic device of claim 1 , wherein the third processed image is a measured image captured based on a light passing through the display panel.

10. The electronic device of claim 1 , wherein the first display region includes first unit pixel regions,

wherein the second display region includes second unit pixel regions, and

wherein a number of the first unit pixel regions disposed per unit region is greater than a number of the second unit pixel regions disposed per unit region.

11. The electronic device of claim 1 , wherein the second display region includes a unit pixel region in which a light-emitting element is disposed and a non-unit pixel region in which the light-emitting element is not disposed, and a transmittance of the non-unit pixel region is higher than a transmittance of the unit pixel region.

12. The electronic device of claim 11 , wherein the unit pixel region and the non-unit pixel region are alternately arranged.

13. An electronic device comprising:

a display panel comprising a first display region, and a second display region;

a camera module under the display panel and overlapping the second display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal by a compensation algorithm, wherein the compensation algorithm is trained with training data comprising a first comparison image and a second comparison image,

wherein the first comparison image is a composite image synthesized based on a first processed image, for restoration,

wherein the second comparison image comprises a simulation image reproducing an image that is generated by light passing through the display panel, the simulation image being generated by compositing a second processed image formed based on light that does not pass through the display panel either with an artificial light source or with a first measured image captured based on the light passing through the display panel,

wherein each of the first processed image and the second processed image is obtained by processing a first image, and

wherein based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region.

14. An electronic device comprising:

a display panel comprising a display region to display an image;

a camera module under the display panel, overlapping the display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal through a compensation algorithm,

wherein the compensation algorithm is trained by using a target image and a simulation image that is generated to reproduce an image captured based on light passing through the display panel,

wherein the target image is a composite image synthesized based on a first processed image, for restoration,

wherein the simulation image is generated by compositing a second processed image either with an artificial light source or with a first measured image captured based on the light passing through the display panel,

wherein each of the first processed image and the second processed image is obtained by processing a first image,

wherein the first image comprises an image generated through light that does not pass through the display panel,

wherein the display panel comprises a first display region non-overlapping with the camera module, and a second display region overlapping with the camera module, and

wherein based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 8, 2024
From: CHO, JAEBUM; KIM, DAEWOOK; BAEK, SEUNGIN; YOO, JEWON; LEE, SANG-GU; CHO, HYUNG UK
To: SAMSUNG DISPLAY CO., LTD.
Reel/Frame 068230/0994 →
Priority Claims (1)
KR 10-2021-0068447 · May 27, 2021 · national
Continuity (2)
Continuation 17588034 · Jan 28, 2022
Related Publication 20240062719A1 · Feb 22, 2024
References Cited (25)
US 9100563B2 · Choi et al. · 2015 [cited by applicant]
US 9842549B2 · Musgrave et al. · 2017 [cited by applicant]
US 10529057B2 · Hayasaka et al. · 2020 [cited by applicant]
US 11100622B2 · Hamada et al. · 2021 [cited by applicant]
US 20110221888A1 · Choi et al. · 2011 [cited by applicant]
US 20160093029A1 · Micovic et al. · 2016 [cited by applicant]
US 20170116932A1 · Musgrave et al. · 2017 [cited by applicant]
US 20180253869A1 · Yumer · 2018 [cited by examiner]
US 20190213719A1 · Hiasa · 2019 [cited by applicant]
US 20190340462A1 · Pao et al. · 2019 [cited by applicant]
US 20210012462A1 · Kim et al. · 2021 [cited by applicant]
US 20210152735A1 · Zhou · 2021 [cited by examiner]
US 20210365729A1 · Hu et al. · 2021 [cited by applicant]
US 20220159162A1 · Sun · 2022 [cited by examiner]
US 20220210369A1 · Wan · 2022 [cited by examiner]
CN 112925141A · 2021 [cited by examiner]
EP 3611656A1 · 2020 [cited by applicant]
JP 2016208438A · 2016 [cited by applicant]
KR 101640456B1 · 2016 [cited by applicant]
KR 1020180136973A · 2018 [cited by applicant]
WO WO2021147374A1 · 2021 [cited by examiner]
Sundar, V., et al. “Deep Atrous Guided Filter for Image Restoration in Under Display Cameras,” and Supplementary Material, arXiv preprint arXiv:2008.06229v2, Sep. 1, 2020, 23 pages. [cited by applicant]
Wikipedia, “High-dynamic-range imaging,” https://en.wikipedia.org/wiki/High-dynamic-range_imaging, Aug. 30, 2021, pp. 1-11. [cited by applicant]
Harmeling et al., Space-Variant Single-Image Blind Deconvolution for Removing Camera Shake, 2010, Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 201… [cited by applicant]
Yuqian Zhou et al., Image Restoration for Under-Display Camera, University of Illinois at Urbana-Champaign, University of California, Berkeley, Microsoft Corporation, arXIV:2003.04857v1[sc.CV] Mar. 10, 2020 (Year: 2020). [cited by applicant]