IP Library › Granted Patent US 10,811,008
Granted Patent B2
US 10,811,008 · App. 16/014,725 · Granted Oct 20, 2020

Electronic apparatus for processing user utterance and server

Inventors: Kyoung Gu Woo (Seoul, KR); Woo Up Kwon (Seoul, KR); Jin Woo Park (Gyeonggi-do, KR); Eun Taek Lim (Gyeonggi-do, KR); Joo Hyuk Jeon (Seoul, KR); Ji Hyun Kim (Gyeonggi-do, KR); Dong Ho Jang (Gyeonggi-do, KR)
Assignee: Samsung Electronics Co., Ltd
G10L15/22G06F3/167G10L15/265G10L2015/223G10L2015/228
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,811,008
App. No.
16/014,725
Granted
Oct 20, 2020
Kind
B2
Abstract

A system for processing a user utterance is provided. The system includes at least one network interface; at least one processor operatively connected to the at least one network interface; and at least one memory operatively connected to the at least one processor, wherein the at least one memory stores a plurality of specified sequences of states of at least one external electronic device, wherein each of the specified sequences is associated with a respective one of domains, wherein the at least one memory further stores instructions that, when executed, cause the at least one processor to receive first data associated with the user utterance provided via a first of the at least one external electronic device, wherein the user utterance includes a request for performing a task using the first of the at least one external device.

Claims (79)

1. A system for processing a user utterance, comprising:

at least one network interface;

at least one processor operatively connected to the at least one network interface; and

at least one memory operatively connected to the at the at least one processor,

wherein the at least one memory stores a plurality of specified sequences of states of at least one external electronic device, wherein each of the specified sequences is associated with a respective one of domains,

wherein the at least one memory further stores instructions that, when executed, cause the at least one processor to:

receive first data associated with the user utterance provided via a first of the at least one external electronic device, wherein the user utterance includes a request for performing a task using the first of the at least one external device, wherein the first of the at least one external device is configured to execute a plurality of application programs;

when the user utterance includes a name of at least one of the plurality of application programs, determine a domain, using the name of the at least one of the plurality of application programs,

when the user utterance does not include the name of the at least one of the plurality of application programs, determine a domain associated with the user utterance, based on the first data; and

determine a first sequence of states for the first of the at least one external device to sequentially perform the task according to the first sequence of states, based at least partly on the determined domain; and

provide the first sequence of states to the first of the at least one external device.

2. The system of claim 1 , wherein the instructions further cause the at least one processor to:

when the user utterance includes the name of the at least one of the plurality of application programs, and when a confidence level of the first sequence exceeds a specified value,

provide the first sequence to the first of the at least one external electronic device.

3. The system of claim 1 , wherein the instructions further cause the at least one processor to:

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is one of the specified sequences,

provide the first sequence to the first of the at least one external electronic device.

4. The system of claim 1 , wherein the instructions further cause the at least one processor to:

receive a status of the first of the at least one external device, and

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is one of the specified sequences,

determine whether to determine an intent associated with the user utterance, based at least partly on the status.

5. The system of claim 4 , wherein the instructions further cause the at least one processor to:

receive a status of an application program being executed in the first of the at least one external electronic device, and

when the first of the at least one external electronic device executes the application program,

determine the intent based at least partly on a domain associated with the application program being executed and the first data,

determine a second sequence based on the determined intent, and

provide the second sequence to the first of the at least one external electronic device instead of the first sequence.

6. The system of claim 4 , wherein the instructions further cause the at least one processor to:

receive a status of an application program being executed in the first of the at least one external electronic device;

when the first of the at least one external electronic device does not execute the application program, provide the first sequence to the first of the at least one external electronic device.

7. The system of claim 1 , wherein the instructions further cause the at least one processor to:

receive a status of the first of the at least one external device, and

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is one of the selected sequences,

determine an intent associated with the user utterance, based at least partly on the status,

determine a second sequence of states for the first of the at least one external device to perform the task, based at least partly on the intent, and

provide the second sequence to the first of the at least one external device.

8. The system of claim 1 , wherein the instructions further cause the at least one processor to:

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the sequence is not one of the specified sequences,

determine an intent associated with the user utterance, based at least partly on the first data.

9. The system of claim 8 , wherein the instructions further cause the at least one processor to:

receive a status of the first of the at least one external device, and

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is not one of the specified sequences,

determine another intent associated with the user utterance, based at least partly on the status,

determine a second sequence of states for the first of the at least one external device to perform the task, based at least partly on the other intent, and

select one of the first sequence or the second sequence.

10. The system of claim 1 , wherein the instructions further cause the at least one processor to:

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is not one of the specified sequences,

determine an intent based at least partly on the determined domain and the first data,

determine a third sequence of states of the first of the at least one external electronic device based at least partly on the determined intent, and

provide the third sequence to the first of the at least one external electronic device instead of the first sequence.

11. The system of claim 10 , wherein the instructions further cause the at least one processor to:

receive a status of the first of the at least one external device, and

when the user utterance does not include the name of the at least one of the plurality of application programs, and when the first sequence is not one of the specified sequences,

determine whether to determine another intent of the user utterance, which is associated with the user utterance, based at least partly on the status.

12. The system of claim 11 , wherein the instructions further cause the at least one processor to:

receive a status of an application program being executed in the first of the at least one external electronic device, and

when the first of the at least one external electronic device executes at least one application program of the plurality of application programs,

determine the other intent based at least partly on a domain associated with the at least one of the plurality of application program being executed and the first data,

determine a second sequence based on the other intent, and

provide the second sequence to the first of the at least one external electronic device instead of the first sequence or the third sequence.

13. The system of claim 11 , wherein the instructions further cause the at least one processor to:

receive a status of an application program being executed in the first of the at least one external electronic device, and

when the first of the at least one external electronic device does not execute at least one application program of the plurality of application programs,

provide the first sequence to the first of the at least one external electronic device.

14. A system for processing a user utterance, comprising:

at least one network interface;

at least one processor operatively connected to the at least one network interface; and

at least one memory operatively connected to the at least one processor,

wherein the at least one memory stores instructions that, when executed, cause the at least one processor to:

receive a status of a first of the at least one external electronic device, wherein the first of the at least one external device is configured to execute a plurality of application programs, and wherein the status is associated with at least one of the plurality of application programs,

receive first data associated with a user utterance provided via the first of the at least one external electronic device, wherein the user utterance includes a request for performing a task using the first of the at least one external device,

determine an intent associated with the user utterance, based at least partly on the first data and the status,

determine a sequence of states for the first of the at least one external device to sequentially perform the task according to the first sequence of states, based partly on the at least one of the plurality of application programs, and

provide the determined sequence of states to the first of the at least one external device.

15. The system of claim 14 , wherein the instructions further cause the at least one processor to:

determine a domain associated with the user utterance when a confidence level of the determined sequence does not exceed a value.

16. The system of claim 14 , wherein the instructions further cause the at least one processor to:

receive a status of an application program being executed in the first of the at least one external electronic device, and

when the first of the at least one external electronic device executes an application program, determine an intent of the user utterance based on the first data and a domain associated with the application program being executed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2018
From: WOO, KYOUNG GU; KWON, WOO UP; PARK, JIN WOO; LIM, EUN TAEK; JEON, JOO HYUK; KIM, JI HYUN; JANG, DONG HO
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 046224/0677 →
Priority Claims (3)
KR 10-2017-0078829 · Jun 21, 2017 · national
KR 10-2017-0091217 · Jul 18, 2017 · national
KR 10-2017-0106326 · Aug 22, 2017 · national
Continuity (1)
Related Publication 20180374482A1 · Dec 27, 2018
Cited By (1)
US 12,688,053