IP Library Granted Patent US 12,406,613
Granted Patent B2
US 12,406,613 · App. 17/977,059 · Granted Sep 2, 2025

Electronic device including display and camera and method controlling thereof

Inventors: Seungeun Lee (Gyeonggi-do, KR); Chakyum Kim (Gyeonggi-do, KR); Minseok Kang (Gyeonggi-do, KR); Byeungwoong Han (Gyeonggi-do, KR); Changryong Heo (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd.
G09G3/2096G06F1/181G06F3/04817G06F3/04845G06F3/04886G09G3/035H04N23/90G09G2340/0464G09G2340/14G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,613
App. No.
17/977,059
Granted
Sep 2, 2025
Kind
B2
Abstract

An electronic device and method are disclosed. The electronic device includes a first camera; a first display panel including multiple pixels and disposed to overlap the first camera, in at least a partial region thereof; and a processor. The processor implements the method, including: displaying, on a first display panel, a graphic user interface; activating, via at least one processor, a first camera, wherein the first display panel includes multiple pixels, and is disposed to overlap the first camera in at least a partial region thereof; deactivating, via the at least one processor, at least one pixel disposed within a first region of the first display panel, wherein the first region is included in the partial region; and changing the graphic user interface to be displayed at least in part to a second region of the first display panel, wherein the second region is in contact with the first region.

Claims (65)

1. An electronic device, comprising:

a first camera;

a first display panel including multiple pixels and disposed to overlap the first camera, the first display panel including a first region overlapping a field of view of the first camera and a second region which is outside of the first region; and

a processor,

wherein the processor is configured to:

display a graphic user interface comprising at least a partial of a first object overlapping the first region and a second object on the second region of the first display panel,

control to activate the first camera in response to an input by a user while displaying the graphic user interface,

deactivate at least one pixel, among the multiple pixels, corresponding to the first region, and

change the graphic user interface by moving, the first object overlapping the field of view of the first camera in a direction toward the second object into the second region and rearranging with the second object on the first display panel.

2. The electronic device of claim 1 , wherein the first region of the first display panel includes a first transmittance, at least partially overlaps the first camera, and is disposed within a field-of-view region corresponding to a field-of-view of the first camera, and

wherein the second region includes a second transmittance that is lower than the first transmittance.

3. The electronic device of claim 1 , wherein the graphic user interface includes the first object, and

wherein the processor is configured to:

determine a position at which the first object is displayed on the first display panel, and

change the graphic user interface, based on the determined position in which the first object is displayed, and a position of the first region.

4. The electronic device of claim 3 , wherein changing the graphic user interface includes moving the position of the first object.

5. The electronic device of claim 3 , wherein the graphic user interface is changed when the position at which the first object is displayed overlaps with the position of the first region.

6. The electronic device of claim 3 , wherein changing the graphic user interface includes moving a display position of the second object, based on detecting the second object disposed within a predesignated distance of the first region.

7. The electronic device of claim 1 , wherein the processor is further configured to change the graphic user interface, based on a configuration of the second region.

8. The electronic device of claim 1 , wherein the processor is further configured to:

execute a first application, and

control the first display panel to display a first graphic user interface of the first application, including at least one object.

9. The electronic device of claim 8 , wherein the processor is further configured to:

determine whether to change the first graphic user interface, based on a configuration of the first application.

10. The electronic device of claim 9 , wherein the processor is further configured to maintain the first graphic user interface in an absence of change, when a configuration of the first application includes a video playback function.

11. The electronic device of claim 8 , wherein the processor is further configured to:

execute a second application simultaneously with the first application,

control the first display panel to display, a second graphic user interface of the second application simultaneously with the first graphic user interface,

determine whether any portion of the first graphic user interface or the second graphic user interface overlaps the first region, and

change the first graphic user interface and/or the second graphic user interface based on detecting a respective overlap with the first region.

12. The electronic device of claim 1 , further comprising a second camera disposed in a non-display region of the electronic device,

wherein the processor is further configured to:

detect activation of one of the first camera and the second camera, and

determine whether the first camera is activated based on the detected activation,

wherein the at least one pixel is deactivated and the graphic user interface is changed based on determining that the first camera is activated.

13. The electronic device of claim 12 , further comprising:

a housing structure, including a hinge,

a first housing connected to the hinge and including a first surface and a second surface facing a direction opposite to a direction faced by the first surface, and

a second housing connected to the hinge and including a third surface and a fourth surface facing a direction opposite to a direction faced by the third surface,

wherein the first housing and the second housing are foldable along a folding axis defined by the hinge,

wherein the first surface and the third surface face a same direction in an unfolded first state, and

wherein the first surface faces the third surface in a folded second state, and

a second display panel visually exposed to an exterior environment through at least a part of the fourth surface; and

a second camera disposed in the third surface or the fourth surface, and

wherein the first display panel includes a flexible display spanning across the first surface and the third surface.

14. A method of changing a graphic user interface by an electronic device comprising a first camera and a first display panel disposed to overlap the first camera, the first display panel comprising a first region which has a first transmittance and at least partially overlaps the first camera, and a second region which is outside of the first region,

the method comprising:

displaying the graphic user interface comprising at least a partial of a first object overlapping the first region and a second object on the second region of the first display panel;

controlling to activate the first camera in response to an input by a user while displaying the graphic user interface;

deactivating at least one pixel, among multiple pixels, corresponding to the first region; and

changing the graphic user interface by moving, the first object overlapping a field of view of the first camera in a direction toward the second object into the second region and rearranging with the second object on the first display panel.

15. The method of claim 14 , wherein the graphic user interface includes the first object, the method further comprising:

determining a position at which the first object is displayed on the first display panel, and

changing the graphic user interface, based on the determined position in which the first object is displayed, and a position of the first region.

16. The method of claim 15 , wherein changing the graphic user interface includes moving a display position of the second object, based on detecting the second object disposed within a predesignated distance of the first region.

17. The method of claim 14 , further comprising changing the graphic user interface, based on a configuration of the second region.

18. The method of claim 14 , further comprising:

executing a first application; and

controlling the first display panel to display a first graphic user interface of the first application, including at least one object.

19. The method of claim 18 , comprising:

determining whether to change the first graphic user interface, based on a configuration of the first application.

20. The method of claim 14 , wherein the electronic device further comprises a second camera disposed in a non-display region of the electronic device,

the method further comprising:

detecting activation of one of the first camera and the second camera; and

determining whether the first camera is activated based on the detected activation, wherein the at least one pixel is deactivated and the graphic user interface is changed based on determining that the first camera is activated.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2022
From: LEE, SEUNGEUN; KIM, CHAKYUM; KANG, MINSEOK; HAN, BYEUNGWOONG; HEO, CHANGRYONG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 061591/0867 →
Priority Claims (2)
KR 10-2021-0105186 · Aug 10, 2021 · national
KR 10-2022-0005759 · Jan 14, 2022 · national
Continuity (2)
Continuation PCTKR2022011918 · Aug 10, 2022
Related Publication 20230054033A1 · Feb 23, 2023
References Cited (29)
US 8723824B2 · Myers et al. · 2014 [cited by applicant]
US 10019940B2 · Rappoport et al. · 2018 [cited by applicant]
US 10416843B2 · Hong et al. · 2019 [cited by applicant]
US 10482309B2 · Zhang et al. · 2019 [cited by applicant]
US 10733931B2 · Jung et al. · 2020 [cited by applicant]
US 11158230B2 · Lee et al. · 2021 [cited by applicant]
US 11233923B2 · Nicholson et al. · 2022 [cited by applicant]
US 11283971B2 · Moon et al. · 2022 [cited by applicant]
US 11412146B2 · Miao · 2022 [cited by applicant]
US 20160132192A1 · Sutton et al. · 2016 [cited by applicant]
US 20190130822A1 · Jung · 2019 [cited by examiner]
US 20200183450A1 · Jang · 2020 [cited by examiner]
US 20200329178A1 · Moon et al. · 2020 [cited by applicant]
US 20200342800A1 · Li et al. · 2020 [cited by applicant]
US 20220182549A1 · Zhang · 2022 [cited by applicant]
CN 112311998A · 2021 [cited by applicant]
EP 3859724A1 · 2021 [cited by applicant]
JP 2021508855A · 2021 [cited by applicant]
KR 1020160062414A · 2016 [cited by applicant]
KR 1020170113066A · 2017 [cited by applicant]
KR 101800669B1 · 2017 [cited by applicant]
KR 1020190101148A · 2019 [cited by applicant]
KR 1020200119639A · 2020 [cited by applicant]
KR 102397044B1 · 2022 [cited by applicant]
WO 2019154072A1 · 2019 [cited by applicant]
WO 2020209646A1 · 2020 [cited by applicant]
WO 2019/154072 (Eng Translation) publihsed on Aug. 15, 2019. [cited by examiner]
International Search Report dated Nov. 22, 2022. [cited by applicant]
Extended European Search Report dated Sep. 5, 2024. [cited by applicant]