IP Library Granted Patent US 12,725,573
Granted Patent B2
US 12,725,573 · App. 19/030,961 · Granted Sep 1, 2026

Electronic device that compensates for an image generated through light passing through a display, and driving method for the same

Inventors: Jaebum Cho (Seoul, KR); Daewook Kim (Hwaseong-si, KR); Seungin Baek (Seongnam-si, KR); Jewon Yoo (Seoul, KR); Sang-Gu Lee (Yongin-si, KR); Hyung Uk Cho (Seongnam-si, KR)
Assignee: Samsung Display Co., Ltd.
G09G3/3225G09G3/3406H04N23/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,725,573
App. No.
19/030,961
Granted
Sep 1, 2026
Kind
B2
Abstract

A method for driving an electronic device may include receiving light passing through a display panel, generating an image signal based on the light, compensating the image signal with a compensation algorithm to generate a compensated image signal, wherein the compensation algorithm is trained with training data including a first comparison image and a second comparison image, and displaying, on the display panel, a compensated image based on the compensated image signal, wherein the first comparison image is a target restoration image and the second comparison image is a composite image.

Claims (51)

1 . An electronic device comprising:

a display panel comprising a first display region, and a second display region;

an electronic module under the display panel, overlapping the second display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal by a compensation algorithm,

wherein the compensation algorithm is trained with training data comprising a first comparison image and a second comparison image,

wherein the first comparison image is a composite image synthesized based on a first processed image, for restoration,

wherein the second comparison image comprises a simulation image reproducing an image that is generated by light passing through the display panel, the simulation image being generated by compositing a second processed image, formed based on light that does not pass through the display panel, with an additionally synthesized artificial light source,

wherein the simulation image implements a diffraction pattern generated by the artificial light source using a point spread function,

wherein the simulation image is an image with no information loss, and

wherein each of the first processed image and the second processed image is obtained by processing a first image.

2 . The electronic device of claim 1 , wherein, based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region.

3 . The electronic device of claim 1 , wherein the second display region has a lower pixel density than that of the first display region.

4 . The electronic device of claim 1 , wherein the second display region has a lower resolution than that of the first display region.

5 . The electronic device of claim 1 , wherein the second display region comprises a transmissive region in which pixels are not disposed.

6 . An electronic device comprising:

a display panel comprising a first display region, and a second display region;

an electronic module under the display panel and overlapping the second display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal by a compensation algorithm, wherein the compensation algorithm is trained with training data comprising a first comparison image and a second comparison image,

wherein each of the first comparison image and the second comparison image is a composite image,

wherein the second display region has a higher light transmittance than that of the first display region,

wherein the first comparison image is the composite image synthesized based on a first processed image, for restoration,

wherein the second comparison image is a simulation image that is generated by compositing a second processed image, formed based on light that does not pass through the display panel, with an additionally synthesized artificial light source,

wherein the simulation image implements a diffraction pattern generated by the artificial light source using a point spread function,

wherein the simulation image is an image with no information loss, and

wherein each of the first processed image and the second processed image is obtained by processing a first image.

7 . The electronic device of claim 6 , wherein, based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region.

8 . The electronic device of claim 6 , wherein the second display region has a lower pixel density than that of the first display region.

9 . The electronic device of claim 6 , wherein the second display region has a lower resolution than that of the first display region.

10 . The electronic device of claim 6 , wherein the second display region comprises a transmissive region in which pixels are not disposed.

11 . The electronic device of claim 6 , wherein the first comparison image is a target restoration image.

12 . The electronic device of claim 6 , wherein the second display region includes a unit pixel region in which a light-emitting element is disposed, and a non-unit pixel region in which the light-emitting element is not disposed, and

wherein a transmittance of the non-unit pixel region is higher than a transmittance of the unit pixel region.

13 . The electronic device of claim 12 , wherein the unit pixel region and the non-unit pixel region are alternately arranged.

14 . An electronic device comprising:

a display panel comprising a display region to display an image;

an electronic module under the display panel, overlapping the display region, and configured to output an image signal; and

a compensator configured to generate a compensated image signal by compensating the image signal through a compensation algorithm,

wherein the compensation algorithm is trained by using a target image and a simulation image that is generated to reproduce an image captured based on light passing through the display panel,

wherein the target image is a composite image synthesized based on a first processed image, for restoration,

wherein the simulation image is generated by compositing a second processed image with an additionally synthesized artificial light source,

wherein each of the first processed image and the second processed image is obtained by processing a first image,

wherein the first image comprises an image generated through light that does not pass through the display panel,

wherein the display panel comprises a first display region non-overlapping with the electronic module, and a second display region overlapping with the electronic module,

wherein the second display region comprises a transmissive region in which pixels are not disposed,

wherein the simulation image implements a diffraction pattern generated by the artificial light source using a point spread function, and

wherein the simulation image is an image with no information loss.

15 . The electronic device of claim 14 , wherein based on a same area, a number of pixels arranged in the first display region is greater than a number of pixels arranged in the second display region.

16 . The electronic device of claim 14 , wherein the second display region has a lower pixel density than that of the first display region.

17 . The electronic device of claim 14 , wherein the second display region has a lower resolution than that of the first display region.

18 . The electronic device of claim 14 , wherein the second display region further comprises a unit pixel region in which a light-emitting element is disposed, and

wherein the unit pixel region and the transmissive region are alternately arranged.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 6, 2025
From: CHO, JAEBUM; KIM, DAEWOOK; BAEK, SEUNGIN; YOO, JEWON; LEE, SANG-GU; CHO, HYUNG UK
To: SAMSUNG DISPLAY CO., LTD.
Reel/Frame 070134/0186 →
Priority Claims (1)
KR 10-2021-0068447 · May 27, 2021 · national
Continuity (3)
Continuation 18498023 · Oct 30, 2023
Continuation 17588034 · Jan 28, 2022
Related Publication 20250166562A1 · May 22, 2025
References Cited (30)
US 9100563B2 · Choi et al. · 2015 [cited by applicant]
US 9842549B2 · Musgrave et al. · 2017 [cited by applicant]
US 10529057B2 · Hayasaka et al. · 2020 [cited by applicant]
US 11100622B2 · Hamada et al. · 2021 [cited by applicant]
US 11341699B1 · Gottlieb · 2022 [cited by examiner]
US 20110221888A1 · Choi et al. · 2011 [cited by applicant]
US 20160093029A1 · Micovic et al. · 2016 [cited by applicant]
US 20170116932A1 · Musgrave et al. · 2017 [cited by applicant]
US 20170316542A1 · Shibata · 2017 [cited by examiner]
US 20180253869A1 · Yumer · 2018 [cited by examiner]
US 20190213719A1 · Hiasa · 2019 [cited by examiner]
US 20190340462A1 · Pao et al. · 2019 [cited by applicant]
US 20210012462A1 · Kim et al. · 2021 [cited by applicant]
US 20210152735A1 · Zhou · 2021 [cited by examiner]
US 20210365729A1 · Hu et al. · 2021 [cited by applicant]
US 20220159162A1 · Sun et al. · 2022 [cited by applicant]
US 20220210369A1 · Wan · 2022 [cited by examiner]
US 20220398698A1 · Li · 2022 [cited by examiner]
CN 112925141A · 2021 [cited by examiner]
EP 3611656A1 · 2020 [cited by applicant]
JP 2016208438A · 2016 [cited by applicant]
JP 2019121252A · 2019 [cited by applicant]
KR 101640456B1 · 2016 [cited by applicant]
KR 1020180136973A · 2018 [cited by applicant]
KR 1020190100833A · 2019 [cited by applicant]
WO WO2021147374A1 · 2021 [cited by examiner]
Sundar, V., et al. “Deep Atrous Guided Filter for Image Restoration in Under Display Cameras,” and Supplementary Material, arXiv preprint arXiv:2008.06229v2, Sep. 1, 2020, 23 pages. [cited by applicant]
Wikipedia, “High-dynamic-range imaging,” https://en.wikipedia.org/wiki/High-dynamic-range_imaging, Aug. 30, 2021, pp. 1-11. [cited by applicant]
Harmeling et al., Space-Variant Single-Image Blind Deconvolution for Removing Camera Shake, 2010, Advances in Neural Information Processing Systems 23: 24th Annual Conference on Neural Information Processing Systems 201… [cited by applicant]
Yuqian Zhou et al., Image Restoration for Under-Display Camera, University of Illinois at Urbana-Champaign, University of California, Berkeley, Microsoft Corporation, arXiV:2003.04857v1[sc.CV] Mar. 10, 2020 (Year: 2020). [cited by applicant]