Granted Patent B2

US 12,614,550 · App. 18/538,632 · Granted Apr 28, 2026

Inventors: Kyunghak Hyun (Suwon-si, KR); Kyungtae Kim (Suwon-si, KR)

Assignee: SAMSUNG ELECTRONICS CO., LTD.

G10L15/22G02B27/017G06F3/013G06F3/017G06F3/04817G06F3/0488G02B2027/0178G10L2015/223

Abstract

Claims (65)

1 . An electronic device comprising:

a microphone;

a display;

memory storing at least one instruction; and

at least one processor configured to execute the at least one instruction,

wherein the at least one instruction, when executed by the at least one processor, causes the electronic device to:

display, via the display, a screen including a plurality of executable objects;

based on an executable object being focused on among the plurality of executable objects, display, via the display, at least one visual object indicating that the microphone is being used for receiving an input on the executable object being focused on;

based on a voice signal being obtained via the microphone while the at least one visual object is displayed:

identify a voice command registered in information for the executable object, and

compare, with the voice command, the voice signal obtained via the microphone while the at least one visual object is displayed; and

based on the voice signal being identified via the comparison as corresponding to the voice command,

execute a function of the executable object associated with the voice command.

2 . The electronic device of claim 1 ,

wherein the at least one visual object includes a visual object displayed as associated with the executable object, and

wherein the executable object associated with the visual object is visually highlighted with respect to at least another executable object among the plurality of executable objects.

3 . The electronic device of claim 2 ,

wherein the at least one visual object includes another visual object distinct from the visual object, and

wherein the other visual object indicates that the microphone is being used.

4 . The electronic device of claim 3 , wherein the visual object is displayed along a periphery of the executable object, and

wherein the other visual object is spaced apart from the visual object.

5 . The electronic device of claim 1 , wherein the information for the executable object comprises data regarding the function of the executable object associated with the voice command.

6 . The electronic device of claim 1 , wherein the at least one instruction, when executed by the at least one processor, further causes the electronic device to:

in response to displaying the at least one visual object, run a timer;

while the timer runs, identify whether the voice signal identified as corresponding to the voice command is obtained via the microphone and maintain the display of the at least one visual object; and

in response to an expiration of the timer, cease the display of the at least one visual object.

7 . The electronic device of claim 6 , wherein the timer is at least temporarily stopped in accordance with the voice signal being obtained while the at least one visual object is displayed and is restarted in response to completing to obtain the voice signal.

8 . The electronic device of claim 1 , wherein the at least one instruction, when executed by the at least one processor, further causes the electronic device to terminate recognizing the voice signal, based on the voice signal being identified via the comparison as distinct from the voice command.

9 . The electronic device of claim 1 , wherein the at least one instruction, when executed by the at least one processor, further causes the electronic device to:

identify that another executable object is focused on among the plurality of executable objects;

in response to the identification that the other executable object is focused on, display, via the display, the at least one visual object indicating that the microphone is being used to receive an input on the other executable object;

based on a voice signal being obtained via the microphone while the at least one visual object is displayed with respect to the other executable object:

identify another voice command registered in information for the other executable object, wherein the other voice command is distinct from the voice command, and

compare, with the other voice command, the voice signal obtained via the microphone while the at least one visual object is displayed with respect to the other executable object; and

based on the voice signal obtained via the microphone while the at least one visual object is displayed with respect to the other executable object being identified as corresponding to the other voice command, execute a function of the other executable object associated with the other voice command.

10 . The electronic device of claim 1 , wherein the voice signal is recognized for the comparison with the voice command.

11 . The electronic device of claim 1 , wherein the electronic device is an augmented reality (AR) glass, and

wherein the screen is displayed with an external object viewed via the display.

12 . The electronic device of claim 1 , wherein the electronic device is a video see-through (VST) device, and

wherein the screen is displayed with an image representing a field of view of a camera of the electronic device.

13 . The electronic device of claim 12 , wherein the executable object is focused on based on a pointer on the executable object.

14 . The electronic device of claim 1 , wherein the executable object is focused on, in response to the display of the screen.

15 . A method executed in an electronic device including a microphone and a display, the method comprising:

displaying, via the display, a screen including a plurality of executable objects;

based on an executable object being focused on among the plurality of executable objects, displaying, via the display, at least one visual object indicating that the microphone is being used for receiving an input on the executable object being focused on;

based on a voice signal being obtained via the microphone while the at least one visual object is displayed:

identifying a voice command registered in information for the executable object, and

comparing, with the voice command, the voice signal obtained via the microphone while the at least one visual object is displayed; and

based on the voice signal obtained via the microphone while the at least one visual object is displayed being identified via the comparing as corresponding to the voice command, executing a function of the executable object associated with the voice command.

16 . The method of claim 15 , wherein the at least one visual object includes a visual object displayed as associated with the executable object, and

wherein the executable object associated with the visual object is visually highlighted with respect to at least another executable object among the plurality of executable objects.

17 . The method of claim 16 , wherein the at least one visual object includes another visual object distinct from the visual object, and

wherein the other visual object indicates that the microphone is being used.

18 . The method of claim 17 , wherein the visual object is displayed along a periphery of the executable object, and

wherein the other visual object is spaced apart from the visual object.

19 . An electronic device comprising:

a microphone;

a display;

memory storing instructions; and

at least one processor,

wherein the instructions, when executed by the at least one processor, cause the electronic device to:

display, via the display, a screen including a plurality of executable objects;

based on an executable object among the plurality of executable objects being pointed at by a user input, display, via the display, at least one visual object with respect to the executable object;

based on a voice signal being obtained via the microphone while the at least one visual object is displayed with respect to the executable object, identify whether the voice signal corresponds to a voice command supported by the executable object; and

based on the voice signal being identified as corresponding to the voice command, execute a function of the executable object associated with the voice command.

Assignments (1)

Priority Claims (2)

Continuity (3)

References Cited (22)