IP Library › Granted Patent US 11,733,964
Granted Patent B2
US 11,733,964 · App. 15/937,145 · Granted Aug 22, 2023

Method for operating speech recognition service and electronic device supporting the same

Inventors: Young Min Yoon (Seoul, KR); Young II Oh (Gwacheon-si, KR); Hyun Woo Kang (Suwon-si, KR); Jin Yeol Kim (Seoul, KR); Ji Hyun Kim (Yongin-si, KR); Da Som Lee (Seoul, KR); Yong Joon Jeon (Hwaseong-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G06F3/167G06F3/0481G06F3/0484G10L15/22G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,733,964
App. No.
15/937,145
Granted
Aug 22, 2023
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a processor, and a memory, wherein the memory stores instructions that, when executed, cause the processor to receive a user input including a request for performing a first task that requires at least one parameter for execution and not including the entire at least one parameter, transmit first data related to the user input to an external server, receive a first sequence of states of the electronic device for performing the first task from the external server, perform not all but some of the first sequence of the states while displaying at least some of states changed in the first sequence, and after the performing of the some of the first sequence, display a GUI that is required for performing the first task and represents that a user is requested to provide at least one parameter omitted in the user input.

Claims (41)

1. An electronic device comprising:

a display;

a microphone;

a speaker;

a communication circuit;

a processor; and

a memory configured to store instructions and a first application program from a plurality of application programs,

wherein the instructions, when executed by the processor, cause the electronic device to:

receive a first user input through the microphone, wherein the first user input includes a request for performing a first task using the electronic device,

in response to the received first user input, transmit first data related to the first user input to an external server through the communication circuit,

in response to the received first user input, receive a path rule corresponding to an intent of the first user input from the external server through the communication circuit, wherein the path rule includes a plurality of para meters that correspond to a first sequence of states being performed by the first application program to perform the first task, the first user input omitting at least one parameter of the plurality of parameters,

perform a partial sequence of states including not all but some of the first sequence of states while displaying at least some of states changed by executing the first application program and performing a function within the first application program utilizing at least one of the plurality of parameters required for a specific state of the path rule, wherein the displaying of the at least some of the states changed includes displaying the performed function within the first application program as an execution screen of the first application program,

in response to determining that the first user input is omitting the at least one parameter for performing the first sequence of states, display a first graphical user interface (GUI) of the first application program for requesting a user to provide the omitted at least one parameter on the display,

based on a specific time elapsing from displaying the first GUI, instead of displaying the first GUI, display a second GUI including an icon and a button partially overlapping the icon, the button being deactivated,

after receiving a first touch input to the icon, receive a second user input including a value for the omitted at least one parameter via the second GUI,

in response to receiving the second user input, activate the button on the second GUI,

in response to a second touch input to the activated button, transmit the path rule, data related to the value of the second user input, and parameter information to the external server through the communication circuit,

receive a refined path rule corresponding to the second user input from the external server through the communication circuit, and

perform the first sequence of states based on the refined path rule, using the first application program.

2. The electronic device of claim 1 , wherein the parameter information includes information necessary for performing a specific unit operation in the path rule.

3. The electronic device of claim 1 , wherein the refined path rule is received after receiving the second touch input to the activated button.

4. The electronic device of claim 1 , wherein the processor is further configured to:

before displaying the second GUI, transmit second data related to a state of the electronic device that is a performance result of the partial sequence of the states to the external server through the communication circuit.

5. The electronic device of claim 1 , wherein the processor is further configured to remove the second GUI after receiving the second touch input to the activated button.

6. A method for operating a speech recognition service of an electronic device, the method comprising:

receiving a first user input through a microphone of the electronic device, wherein the first user input includes a request for performing a first task using the electronic device;

in response to the received first user input, transmitting first data related to the first user input to an external server through a communication circuit of the electronic device;

in response to the received first user input, receiving a path rule corresponding to an intent of the first user input from the external server through the communication circuit, wherein the path rule includes a plurality of para meters that correspond to a first sequence of states being performed by a first application program to perform the first task, the first user input omitting at least one parameter of the plurality of parameters;

performing a partial sequence of states including not all but some of the first sequence of states while displaying at least some of states changed by executing the first application program and performing a function within the first application program utilizing at least one of the plurality of parameters required for a specific state of the path rule, wherein the displaying of the at least some of the states changed includes displaying the performed function within the first application program as an execution screen of the first application program;

in response to determining that the first user input is omitting the at least one parameter for performing the first sequence of states, displaying a first graphical user interface (GUI) of the first application program for requesting a user to provide the omitted at least one parameter on the display;

based on a specific time elapsing from displaying the first GUI, instead of displaying the first GUI, displaying a second GUI including an icon and a button partially overlapping the icon, the button being deactivated;

after receiving a first input to the icon, receiving a second user input including a value for the omitted at least one parameter via the second GUI;

in response to receiving the second user input, activating the button on the second GUI;

in response to a second touch input to the activated button, transmitting the path rule, data related to the value of the second user input, and parameter information to the external server through the communication circuit;

receiving a refined path rule corresponding to the second user input from the external server through the communication circuit; and

performing the first sequence of states based on the refined path rule, using the first application program.

7. The method of claim 6 , wherein the parameter information includes information necessary for performing a specific unit operation in the path rule.

8. The method of claim 6 , wherein the refined path rule is received after receiving the second touch input to the activated button.

9. The method of claim 6 , further comprising:

before displaying the second GUI, transmitting second data related to a state of the electronic device that is a performance result of the partial sequence of the states to the external server.

10. The method of claim 6 , further comprising removing the second GUI after receiving the second touch input to the activated button.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2018
From: YOON, YOUNG MIN; OH, YOUNG IL; KANG, HYUN WOO; KIM, JIN YEOL; KIM, JI HYUN; LEE, DA SOM; JEON, YONG JOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 045368/0160 →
Priority Claims (1)
KR 10-2017-0039593 · Mar 28, 2017 · national
Continuity (1)
Related Publication 20180285070A1 · Oct 4, 2018