IP Library Granted Patent US 12,737,097
Granted Patent B2
US 12,737,097 · App. 18/387,268 · Granted Sep 15, 2026

Electronic apparatus and control method thereof

Inventors: Sungjun Hwang (Suwon-si, KR); Jiyeon Ma (Suwon-si, KR); Jingun Jung (Suwon-si, KR); Euijun Kim (Suwon-si, KR); Youngah Lee (Suwon-si, KR); Chad Philip Hall (Seattle, WA); Marine Au Yeung (Seattle, WA); Felix Yushin Chang (Seattle, WA); Carolyn Yuen Ming Yip (Seattle, WA)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06F3/04842G06F3/14G06V10/25G06V40/172G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,737,097
App. No.
18/387,268
Granted
Sep 15, 2026
Kind
B2
Abstract

An electronic apparatus includes a display, a camera, a communication interface, a memory configured to store information, and a one or more processor configured to, based on the specific object being identified from an image obtained through the camera, identify a preset zone with respect to the identified specific object, based on a user being identified from the image obtained through the camera, identify whether the identified user is located within the preset zone, and based on a signal corresponding to a user interaction being received by the communication interface while the user is located in the preset zone, control the display to display a user interface screen corresponding to a type of the user interaction.

Claims (75)

1 . An electronic apparatus comprising:

a display;

a camera;

a communication interface;

a memory configured to store information; and

one or more processors configured to:

based on a specific object being identified from a captured image obtained through the camera, identify a preset zone with respect to the specific object,

based on a user being identified from the captured image, identify whether the user is located within the preset zone,

based on the user being located in the preset zone, control the display to display a guide user interface (UI) corresponding to an input of a user interaction,

based on a signal corresponding to a user interaction being received by the communication interface and identifying that the user is located in the preset zone, control the display to display a UI screen corresponding to a type of the user interaction; and

based on the signal corresponding to a tap input on a user terminal, control the display of the electronic apparatus to display a user terminal image being displayed on the user terminal.

2 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to:

control the display to display an image including the specific object,

control the display to display a UI screen to set a preset zone on the displayed image including the specific object, and

identify the preset zone based on a user command input through the UI screen.

3 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to, based on identifying that the user is located in the preset zone for a predetermined amount of time, identify that the user is located in the preset zone.

4 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to:

control the display to display an image including a plurality of specific objects,

control the display to display a UI screen to set preset zones corresponding to the plurality of specific objects from the displayed image including the specific object, and

identify the preset zones corresponding to the plurality of specific objects based on a user command input through the UI screen.

5 . The electronic apparatus of claim 4 , wherein the one or more processors is further configured to:

control the display to display a UI screen representing a region based on each of the plurality of specific objects, and

identify at least one region that is selected based on a user command, from among regions identified based on each of the plurality of specific objects, as the preset zone.

6 . The electronic apparatus of claim 4 , wherein the one or more processors is further configured to:

store, in the memory, information about a plurality of preset zones mapped to face information of a plurality of users,

based on the face information of a first user being identified from the captured image obtained through the camera, obtain information about the plurality of preset zones mapped to the face information of the first user among the face information of the plurality of users, and

identify whether the first user is located in the plurality of preset zones mapped to the face information of the first user.

7 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to:

identify a control command corresponding to the type of the user interaction, and

based on the control command being a command to control a UI screen provided by the user terminal, transmit, to the user terminal through the communication interface, a control signal to provide the UI screen corresponding to content displayed on the display in the user terminal.

8 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to:

identify whether the user terminal is located in the preset zone based on received signal strength indication (RSSI) size information of a signal that is received from the user terminal, and

based on identifying that the user terminal is located in the preset zone, identify that the user is located within the preset zone.

9 . The electronic apparatus of claim 1 , wherein the one or more processors is further configured to:

based on the specific object being identified from a first image obtained through the camera, identify a preset zone with respect to the specific object, and store, in the memory, information about the preset zone, and

based on the user being identified from a second image obtained through the camera, identify whether the user is located within the preset zone based on information about the preset zone stored in the memory.

10 . The electronic apparatus of claim 1 , wherein the UI screen corresponding to the type of the user interaction is the UI screen for providing a multi device experience.

11 . A method for controlling an electronic apparatus, the method comprising:

based on a specific object being identified from a captured image obtained through a camera, identifying a preset zone with respect to the specific object;

based on a user being identified from the captured image, identifying whether the user is located within the preset zone;

based on the user being located in the preset zone, displaying a guide user interface (UI) corresponding to an input of a user interaction;

based on a signal corresponding to the user interaction being received by the electronic apparatus while the user is located in the preset zone, displaying a UI screen corresponding to a type of the user interaction; and

based on the signal corresponding to a tap input on a user terminal, displaying on a display of the electronic apparatus a user terminal image being displayed on the user terminal.

12 . The method of claim 11 , wherein the identifying the preset zone comprises:

displaying an image including the specific object;

displaying a UI screen to set a preset zone on the displayed image including the specific object; and

identifying the preset zone based on a user command input through the UI screen.

13 . The method of claim 11 , wherein the identifying the preset zone comprises, based on identifying that the user is located in the preset zone for a predetermined amount of time, identifying that the user is located in the preset zone.

14 . The method of claim 11 , wherein the identifying the preset zone comprises:

displaying an image including a plurality of specific objects;

displaying a UI screen to set preset zones corresponding to the plurality of specific objects from the displayed image including the plurality of specific objects; and

identifying the preset zones corresponding to the plurality of specific objects based on a user command input through the UI screen.

15 . The method of claim 14 , wherein the displaying the UI screen comprises:

displaying a UI screen representing a region based on each of the plurality of specific objects, and

wherein the identifying the preset zone corresponding to each of the plurality of specific objects comprises identifying at least one region that is selected based on a user command, from among regions identified based on each of the plurality of specific objects, as the preset zone.

16 . An electronic apparatus comprising:

a memory configured to store information; and

one or more processors configured to:

based on a specific object being identified from a captured image, identify a preset zone with respect to the specific object,

based on a user being identified from the captured image, identify whether the user is located within the preset zone,

based on the user being located in the preset zone, control to display a guide user interface (UI) corresponding to an input of a user interaction;

based on a signal corresponding to the user interaction being received while the user is located in the preset zone, control to display a UI screen corresponding to a type of the user interaction; and

based on the signal corresponding to a tap input on a user terminal, control to display a user terminal image being displayed on the user terminal.

17 . The electronic apparatus of claim 16 , wherein the one or more processors is further configured to:

control to display an image including the specific object,

control to display a UI screen to set a preset zone on the displayed image including the specific object, and

identify the preset zone based on a user command input through the UI screen.

18 . The electronic apparatus of claim 16 , wherein the one or more processors is further configured to, based on identifying that the user is present in the preset zone for a predetermined amount of time, identify that the user is located in the preset zone.

19 . The electronic apparatus of claim 16 , wherein the one or more processors is further configured to:

control to display an image including a plurality of specific objects,

control to display a UI screen to set preset zones, each preset zone corresponding to a respective specific object of the plurality of specific objects from the displayed image including the plurality of specific objects, and

identify the preset zones corresponding to each of the plurality of specific objects based on a user command input through the UI screen.

20 . The electronic apparatus of claim 19 , wherein the one or more processors is further configured to:

control to display a UI screen representing a region based on each of the plurality of specific objects, and

identify at least one region that is selected based on a user command, from among regions identified based on each of the plurality of specific objects, as the preset zone.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 6, 2023
From: HWANG, SUNGJUN; MA, JIYEON; JUNG, JINGUN; KIM, EUIJUN; LEE, YOUNGAH; HALL, CHAD PHILIP; AU YEUNG, MARINE; CHANG, FELIX YUSHIN; YIP, CAROLYN YUEN MING
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 065475/0503 →
Priority Claims (2)
KR 10-2022-0043058 · Apr 6, 2022 · national
KR 10-2022-0065432 · May 27, 2022 · national
Continuity (2)
Continuation PCTKR2023003528 · Mar 16, 2023
Related Publication 20240069703A1 · Feb 29, 2024
References Cited (39)
US 8472665B2 · Hildreth · 2013 [cited by applicant]
US 9400562B2 · Takazawa · 2016 [cited by applicant]
US 10015739B2 · Yoon et al. · 2018 [cited by applicant]
US 11228815B2 · Lee · 2022 [cited by applicant]
US 20080273755A1 · Hildreth · 2008 [cited by applicant]
US 20120054178A1 · Tran et al. · 2012 [cited by applicant]
US 20130024116A1 · Kitatani · 2013 [cited by applicant]
US 20140198030A1 · Takazawa · 2014 [cited by examiner]
US 20140310739A1 · Ricci · 2014 [cited by examiner]
US 20170046374A1 · Fletcher · 2017 [cited by examiner]
US 20170069071A1 · Jung · 2017 [cited by applicant]
US 20190087646A1 · Goulden · 2019 [cited by examiner]
US 20190378476A1 · Jeon · 2019 [cited by examiner]
US 20200012901A1 · Yu · 2020 [cited by examiner]
US 20200387709A1 · Baykaner · 2020 [cited by examiner]
US 20210365232A1 · Jin et al. · 2021 [cited by applicant]
US 20220113395A1 · Lee et al. · 2022 [cited by applicant]
US 20220300753A1 · Bapat · 2022 [cited by examiner]
US 20230171467A1 · Liu · 2023 [cited by examiner]
US 20250191452A1 · Sedouram · 2025 [cited by examiner]
JP 5453246B2 · 2014 [cited by applicant]
JP 2014138257A · 2014 [cited by applicant]
KR 1020120021245A · 2012 [cited by applicant]
KR 1020120052669A · 2012 [cited by applicant]
KR 1020130027643A · 2013 [cited by applicant]
KR 1020150046594A · 2015 [cited by applicant]
KR 1020150096075A · 2015 [cited by applicant]
KR 1020160060972A · 2016 [cited by applicant]
KR 101940718B1 · 2019 [cited by applicant]
KR 1020190045501A · 2019 [cited by applicant]
KR 1020190102507A · 2019 [cited by applicant]
KR 102192051B1 · 2020 [cited by applicant]
KR 1020210000974A · 2021 [cited by applicant]
KR 1020210003515A · 2021 [cited by applicant]
KR 1020210088400A · 2021 [cited by applicant]
International Search Report (PCT/ISA/210) issued by the International Searching Authority on Jun. 27, 2023 in International Application No. PCT/KR2023/003528. [cited by applicant]
Written Opinion (PCT/ISA/237) issued by the International Searching Authority on Jun. 27, 2023 in International Application No. PCT/KR2023/003528. [cited by applicant]
Communication issued Apr. 9, 2025 by the European Patent Office in European Patent Application No. 23784878.3. [cited by applicant]
Communication issued on May 20, 2026 by the Korean Ministry of Intellectual Property in Korean Patent Application No. 10-2022-0065432. [cited by applicant]