IP Library › Granted Patent US 12704898
Granted Patent B2
US 12704898 · App. 19/050,548 · Granted Aug 11, 2026

Device and method for controlling nearby apparatus in consideration of user intent

Inventor: Moon Yong Jeong (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/011G16Y40/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12704898
App. No.
19/050,548
Granted
Aug 11, 2026
Kind
B2
Abstract

A device and a method of controlling a nearby apparatus by a control device are provided. The method includes connecting, by the control device, communication with a control target apparatus, receiving, by the control device, input information, and when an execution command corresponding to the input information exists in an operation database, transmitting, by the control device, the execution command corresponding to the input information to the control target apparatus.

Claims (64)

1 . A method of controlling a nearby apparatus by a control device, the method comprising:

connecting, by the control device, communication with a control target apparatus;

selecting an interaction mode corresponding to the control target apparatus, wherein the interaction mode corresponds to a type of the control target apparatus;

receiving, by the control device, input information;

when an execution command corresponding to the input information exists in an operation database according to the interaction mode, transmitting, by the control device, the execution command corresponding to the input information to the control target apparatus; and

verifying whether the interaction mode is capable of being changed when an execution command corresponding to the input information does not exist in an operation database according to the interaction mode.

2 . The method of claim 1 , further comprising:

changing the interaction mode when it is possible to change the interaction mode, and when an execution command corresponding to the input information exists in the operation database according to the interaction mode, executing the execution command corresponding to the input information; and

outputting related notification information when it is impossible to change the interaction mode.

3 . The method of claim 2 , wherein the selecting of the interaction mode corresponding to the control target apparatus comprises selecting one of:

a mobile mode,

an Internet of things (IoT) mode, or

a display mode according to the control target apparatus.

4 . The method of claim 3 , wherein the selecting of the interaction mode corresponding to the control target apparatus comprises selecting a mode with a higher priority by assigning priorities in order of a mobile mode, an IoT mode, and a display mode when the control target apparatus is provided in plurality and a plurality of control target apparatuses has different interaction modes.

5 . The method of claim 1 , further comprising:

outputting a result of executing the execution command corresponding to the input information through the control target apparatus or the control device.

6 . The method of claim 5 , wherein the outputting of the result of executing the execution command corresponding to the input information through the control target apparatus or the control device comprises:

receiving the result of executing the execution command from the control target apparatus; and

outputting the result of executing.

7 . The method of claim 1 , wherein the input information comprises at least one of:

pupil-tracking input information;

hand-tracking input information;

head-tracking input information;

voice input information;

an operation status of the control target apparatus; or

characteristic information of the control target apparatus.

8 . The method of claim 7 , wherein the operation status of the control target apparatus comprises at least one of:

application information being executed by the control target apparatus, which is received from the control target apparatus;

application information executable by the control target apparatus, which is received from the control target apparatus; or

application information executable by the control target apparatus and interoperable with the control device, which is received from the control target apparatus.

9 . The method of claim 8 , wherein the characteristic information of the control target apparatus comprises at least one of:

state information of the control target apparatus, which is received from the control target apparatus;

setting information of the control target apparatus, which is received from the control target apparatus; or

sensing information measured by the control target apparatus, which is received from the control target apparatus.

10 . The method of claim 1 , further comprising:

searching for a nearby apparatus;

obtaining information of an unconnected nearby apparatus;

estimating a distance and a direction with respect to the nearby apparatus; or

selecting the control target apparatus by considering the distance to the nearby apparatus and the direction of the nearby apparatus.

11 . The method of claim 10 , wherein the selecting of the control target apparatus by considering the distance to the nearby apparatus and the direction of the nearby apparatus comprises selecting the nearby apparatus as the control target apparatus when the distance to the nearby apparatus is in a preset effective distance corresponding to the nearby apparatus and the direction of the nearby apparatus is in a preset angle range of the control device.

12 . The method of claim 11 , wherein the estimating of the distance and the direction with respect to the nearby apparatus comprises estimating the distance and the direction with respect to the nearby apparatus using at least one of a short-range detection sensor, an image sensor, a light detection and ranging (Lidar) sensor, or ultra-wideband (UWB) communication.

13 . One or more non-transitory computer-readable storage media storing one or more programs including computer executable instructions that, when executed by one or more processors of a control device individually or collectively, cause the control device to perform operations, the operations comprising:

connecting, by the control device, communication with a control target apparatus;

selecting an interaction mode corresponding to the control target apparatus, wherein the interaction mode corresponds to a type of the control target apparatus;

receiving, by the control device, input information;

when an execution command corresponding to the input information exists in an operation database according to the interaction mode, transmitting, by the control device, the execution command corresponding to the input information to the control target apparatus; and

verifying whether the interaction mode is capable of being changed when an execution command corresponding to the input information does not exist in an operation database according to the interaction mode.

14 . A control device for controlling a nearby apparatus, the control device comprising:

a communicator configured to connect communication with a control target apparatus;

an inputter configured to receive input information; and

memory storing one or more computer programs,

wherein the one or more computer programs include computer-executable instructions that, when executed by one or more processors individually or collectively, cause the control device to:

select an interaction mode corresponding to the control target apparatus, wherein the interaction mode corresponds to a type of the control target apparatus,

receive the input information,

when an execution command corresponding to the input information exists in an operation database according to the interaction mode, control the execution command corresponding to the input information to be transmitted to the control target apparatus, and

verify whether the interaction mode is capable of being changed when an execution command corresponding to the input information does not exist in an operation database according to the interaction mode.

15 . The control device of claim 14 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the control device to:

change the interaction mode when it is possible to change the interaction mode, and when an execution command corresponding to the input information exists in the operation database according to the interaction mode, executing the execution command corresponding to the input information, and

output related notification information when it is impossible to change the interaction mode.

16 . The control device of claim 14 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the control device to:

output a result of executing the execution command corresponding to the input information through the control target apparatus or the control device.

17 . The control device of claim 16 , wherein the one or more computer programs further include computer-executable instructions that, when executed by the one or more processors individually or collectively, cause the control device to:

receive the result of executing the execution command from the control target apparatus, and

output the result of executing.