IP Library › Granted Patent US 12,504,639
Granted Patent B2
US 12,504,639 · App. 18/967,871 · Granted Dec 23, 2025

Electronic apparatus and controlling method thereof

Inventor: Hyeryoung Choi (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G02B27/022G02B5/08G02B26/02G02B27/0093G06F3/002G06F3/017G06F3/16G09G3/2092G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,504,639
App. No.
18/967,871
Granted
Dec 23, 2025
Kind
B2
Abstract

An electronic apparatus including a mirror display, a sensor, memory storing one or more instructions, and one or more processors connected to the mirror display, the sensor and the memory to control the electronic apparatus. The one or more processors are configured to, by executing the one or more instructions, based identifying that a user's face approaches the mirror display within a predetermined distance based on first data obtained via the sensor when the mirror display is in a mirror state and that the user exhales based on second data obtained via the sensor, control the mirror display to enter a drawing state by processing an area of the mirror display to be opaque based on the second data, and control the mirror display so that reflectivity of an area corresponding to a user gesture input in the opaque area increases.

Claims (84)

1 . An apparatus comprising:

a mirror display;

one or more sensors;

one or more memories storing one or more instructions; and

one or more processors configured to, by executing the one or more instructions:

while the mirror display is in a mirror state in which the mirror display performs a mirror function,

based on a distance between the mirror display and a user being less than a predetermined value identified from first data obtained via one or more sensors of the one or more sensors, and breath of the user detected from second data obtained via one or more sensors of the one or more sensors,

control the mirror display so that an area of the mirror display is in an opaque drawing state in which the area is processed to be opaque and a drawing function is performable by the mirror display in the area, and

control the mirror display to adjust a degree of opacity of an area corresponding to a gesture input of the user in the area that is in the opaque drawing state, to thereby perform the drawing function.

2 . The apparatus as claimed in claim 1 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data; and

the one or more processors are configured to, by executing the one or more instructions:

identify intensity of the breath from the second data, and

control the mirror display to adjust a degree of opacity of the area that is in the opaque drawing state based on the intensity of the breath.

3 . The apparatus as claimed in claim 2 , wherein the one or more processors are configured to, by executing the one or more instructions:

based on detecting the breath, identify an area corresponding to a mouth of the user based on an image of the user, and

control the mirror display so that the degree of opacity decreases, based on the intensity of the breath, as opacity extends outwardly from the area corresponding to the mouth.

4 . The apparatus as claimed in claim 2 , wherein the one or more processors are configured to, by executing the one or more instructions:

based on detecting the breath, identify an area corresponding to a mouth of the user based on sound received through a microphone, and

control the mirror display so that the degree of opacity decreases, based on the intensity of the breath, as opacity extends outwardly from the area corresponding to the mouth.

5 . The apparatus as claimed in claim 1 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data, and

the one or more processors are configured to, by executing the one or more instructions:

identify intensity of the breath based on the second data, and

control the mirror display to adjust a size of the area that is in the opaque drawing state based on the intensity of the breath.

6 . The apparatus as claimed in claim 1 , wherein the one or more processors are configured to, by executing the one or more instructions:

control the mirror display so that reflectivity of the area corresponding to the gesture input in the area that is in the opaque drawing state is the same as reflectivity of an area of the mirror display that is outside of the area that is in the opaque drawing state and not controlled to be opaque.

7 . The apparatus as claimed in claim 1 , wherein the one or more processors are configured to, by executing the one or more instructions:

control the mirror display to terminate the opaque drawing state by returning the area that is in the opaque drawing state to an original state after different time periods according to intensities of the breath, respectively.

8 . The apparatus as claimed in claim 1 , wherein the one or more processors are configured to, by executing the one or more instructions:

identify an object based on a drawing shape indicated by the gesture input, and

control the mirror display to display a graphic object corresponding to the object based on a location of the user reflected on the mirror display.

9 . The apparatus as claimed in claim 8 , wherein the one or more processors are configured to, by executing the one or more instructions:

identify a relationship with the user based on a type of the identified object, and

control the mirror display to display a graphic object corresponding to the object based on the relationship with the user and the location of the user reflected on the mirror display.

10 . The apparatus as claimed in claim 1 , wherein

the mirror display includes a plurality of pixel areas,

each pixel area of the plurality of pixel areas is configured so that a display element is positioned in a center of the pixel area and a mirror element is positioned at a border of the pixel area, and

the one or more processors are configured to, by executing the one or more instructions:

process the area that is in the opaque drawing state to be opaque by controlling at least one display element of at least one pixel area in the area that is in the opaque drawing state of the plurality of pixel areas to display a first color, and

control at least one display element of at least one pixel area in the area that is in the opaque drawing state of the plurality of pixel areas to display a second color or to be turned off so that reflectivity of the area corresponding to the gesture input increases.

11 . A method of an apparatus including a mirror display and one or more sensors, the method comprising:

while the mirror display is in a mirror state in which the mirror display performs a mirror function,

based on a distance between the mirror display and a user being less than a predetermined value identified from first data obtained via one or more sensors of the one or more sensors, and breath of the user detected from second data obtained via one or more sensors of the one or more sensors,

controlling the mirror display so that an area of the mirror display is in an opaque drawing state in which the area is processed to be opaque and a drawing function is performable by the mirror display in the area, and

controlling the mirror display to adjust a degree of opacity of an area corresponding to a gesture input of the user in the area that is in the opaque drawing state, to thereby perform the drawing function.

12 . The method as claimed in claim 11 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data; and

the method further comprises:

identifying intensity of the breath based on the second data; and

adjusting a degree of opacity of the area that is in the opaque drawing state based on the intensity of the breath.

13 . The method as claimed in claim 12 , further comprising:

based on detecting the breath, identifying an area corresponding to a mouth of the user based on an image of the user; and

controlling the mirror display so that the degree of opacity decreases, based on the intensity of the breath, as opacity extends outwardly from the area corresponding to the mouth.

14 . The method as claimed in claim 11 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data, and

the method further comprises:

identifying intensity of the breath based on the second data; and

adjusting a size of the area that is in the opaque drawing state based on the intensity of the breath.

15 . A non-transitory computer-readable medium storing computer instructions that, when executed by one or more processors of an apparatus that includes a mirror display and one or more sensors, cause the apparatus to:

while the mirror display is in a mirror state in which the mirror display performs a mirror function,

based on a distance between the mirror display and a user being less than a predetermined value identified from first data obtained via one or more sensors of the one or more sensors, and breath of the user detected from second data obtained via one or more sensors of the one or more sensors, breath of the user,

control the mirror display so that an area of the mirror display is in an opaque drawing state in which the area is processed to be opaque and a drawing function is performable by the mirror display in the area, and

control the mirror display to adjust a degree of opacity of an area corresponding to a gesture input of the user in the area that is in the opaque drawing state, to thereby perform the drawing function.

16 . The non-transitory computer-readable medium as claimed in claim 15 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data; and

the instructions cause the apparatus to:

identify intensity of the breath based on the second data; and

adjust a degree of opacity of the area that is in the opaque drawing state based on the intensity of the breath.

17 . The non-transitory computer-readable medium as claimed in claim 16 , wherein

the instructions cause the apparatus to:

based on detecting the breath, identify an area corresponding to a mouth of the user based on sound received through a microphone, and

control the mirror display so that the degree of opacity decreases, based on the intensity of the breath, as opacity extends outwardly from the area corresponding to the mouth.

18 . The non-transitory computer-readable medium as claimed in claim 15 , wherein

the one or more sensors include at least one of a camera, a microphone, a CO2 sensor, or a barometric pressure sensor, that obtains the second data, and

the instructions cause the apparatus to:

identify intensity of the breath based on the second data; and

adjust a size of the area that is in the opaque drawing state based on the intensity of the breath.

19 . The non-transitory computer-readable medium as claimed in claim 15 , wherein

the instructions cause the apparatus to:

based on detecting the breath, identify an area corresponding to a mouth of the user based on an image of the user; and

control the mirror display so that the degree of opacity decreases, based on the intensity of the breath, as opacity extends outwardly from the area corresponding to the mouth.

20 . The non-transitory computer-readable medium as claimed in claim 15 , wherein the instructions cause the apparatus to:

control the mirror display so that reflectivity of the area corresponding to the gesture input in the area that is in the opaque drawing state is the same as reflectivity of an area of the mirror display that is outside of the area that is in the opaque drawing state and not controlled to be opaque.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 4, 2024
From: CHOI, HYERYOUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 069486/0662 →
Priority Claims (1)
KR 10-2023-0134534 · Oct 10, 2023 · national
Continuity (2)
Continuation PCTKR2024096260 · Oct 10, 2024
Related Publication 20250116871A1 · Apr 10, 2025
References Cited (24)
US 9689603B2 · Roh et al. · 2017 [cited by applicant]
US 10222888B2 · Nam et al. · 2019 [cited by applicant]
US 10365888B2 · Lee et al. · 2019 [cited by applicant]
US 10440319B2 · Han et al. · 2019 [cited by applicant]
US 11403848B2 · Choi et al. · 2022 [cited by applicant]
US 20130108229A1 · Starner · 2013 [cited by examiner]
US 20130215347A1 · Tsukio · 2013 [cited by examiner]
US 20140351761A1 · Bae · 2014 [cited by examiner]
US 20170082850A1 · Shim · 2017 [cited by examiner]
US 20180059774A1 · Lee et al. · 2018 [cited by applicant]
JP 2014238434 · 2014 [cited by applicant]
KR 1020140120516 · 2014 [cited by applicant]
KR 101464431 · 2014 [cited by applicant]
KR 1020160062375 · 2016 [cited by applicant]
KR 1020170004160 · 2017 [cited by applicant]
KR 1020180023609 · 2018 [cited by applicant]
KR 102128886 · 2020 [cited by applicant]
KR 102263154 · 2021 [cited by applicant]
KR 1020220044467 · 2022 [cited by applicant]
KR 102473669 · 2022 [cited by applicant]
KR 102556965 · 2023 [cited by applicant]
KR 102570009 · 2023 [cited by applicant]
International Search Report, PCT/ISA/210, dated Jan. 9, 2025, in PCT Application No. PCT/KR2024/096260. [cited by applicant]
Written Opinion, PCT/ISA/237, dated Jan. 9, 2025, in PCT Application No. PCT/KR2024/096260. [cited by applicant]