IP Library Granted Patent US 10,657,963
Granted Patent B2
US 10,657,963 · App. 15/969,394 · Granted May 19, 2020

Method and system for processing user command to provide and adjust operation of electronic device by analyzing presentation of user speech

Inventors: Seijin Cha (Seongnam-si, KR); Eonjoung Choi (Seongnam-si, KR)
Assignees: NAVER Corporation; LINE Corporation
G10L15/22G10L25/63G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,657,963
App. No.
15/969,394
Granted
May 19, 2020
Kind
B2
Abstract

Provided is a user command processing method and system to provide and adjust an operation of a device by analyzing a presentation of a user speech. The user command processing method includes managing at least one pre-defined operation to be performed according to a user command, a plurality of options being preset in relation to each of the at least one pre-defined operation, receiving a user command at least including a voice input received from a user, selecting an operation corresponding to a keyword extracted from the voice input, determining at least one option corresponding to the extracted keyword among a plurality of options preset in relation to the selected operation, according to a presentation of the voice input, and performing the selected operation in association with the determined at least one option.

Claims (64)

1. A non-transitory computer-readable recording medium storing instructions that, when executed by a processor of an electronic device, cause the processor to perform a user command processing method comprising:

managing at least one pre-defined operation to be performed according to a user command and a plurality of options preset in relation to each of the at least one pre-defined operation for modifying a corresponding pre-defined operation, wherein the corresponding pre-defined operation modified by one of the plurality of options performs a different operation than the corresponding pre-defined operation modified by another of the plurality of options;

receiving the user command including at least a voice input received from a user;

selecting an operation from the at least one pre-defined operation corresponding to a keyword extracted from the voice input;

determining at least one option according to a presentation of the voice input; and

performing the selected operation as modified by the determined at least one option.

2. The non-transitory computer-readable recording medium of claim 1 , wherein the determining of the at least one option comprises:

outputting information to receive, from the user, a selection of at least one option among the plurality of options, when the at least one option is indeterminable according to the presentation of the voice input; and

determining the at least one option among the plurality of options according to an additional voice input received in response to the output information.

3. The non-transitory computer-readable recording medium of claim 1 , wherein the performing of the selected operation comprises:

outputting information to receive, from the user, a confirmation on whether to continue performing the selected operation as modified by the determined at least one option;

receiving a first additional voice input in response to the output information; and

performing the selected operation as modified by the determined at least one option, when an answer for continuation consent is extracted from the first additional voice input.

4. The non-transitory computer-readable recording medium of claim 3 , wherein the performing of the selected operation comprises:

outputting information to receive, from the user, a selection of at least one other option among the plurality of options, when an answer for continuation refusal is extracted from the first additional voice input;

determining at least one other option among the plurality of options according to a second additional voice input received in response to the output information; and

performing the selected operation as modified by the determined at least one other option.

5. The non-transitory computer-readable recording medium of claim 1 , wherein the presentation of the voice input includes an expression representing a social relationship between a person associated with the selected operation and the user, and

the determining of the at least one option comprises determining from among the plurality of options based on the social relationship with the user which is analyzed according to the expression.

6. The non-transitory computer-readable recording medium of claim 5 , wherein the plurality of options corresponds to a plurality of devices interoperating with the electronic device,

the determining of the at least one option comprises determining at least one device associated with a person selected based on the social relationship with the user among the plurality of devices, and

the performing of the selected operation comprises performing the selected operation in association with the determined at least one device.

7. The non-transitory computer-readable recording medium of claim 5 , wherein the plurality of options corresponds to messenger accounts or phone numbers of other users having a personal relationship with the user,

the determining of the at least one option comprises determining a messenger account or phone number of another user selected based on the personal relationship with the user among the messenger accounts or phone numbers, and

the performing of the selected operation comprises performing the selected operation in association with the determined messenger account or phone number.

8. The non-transitory computer-readable recording medium of claim 1 , wherein the presentation of the voice input includes at least one of an urgency of a user command and a user emotion analyzed based on at least one of a manner of speaking and a tone of the user obtained through the voice input, and

the determining of the at least one option comprises determining from among the plurality of options based on at least one of the urgency of the user command and the user emotion.

9. The non-transitory computer-readable recording medium of claim 8 , wherein the plurality of options corresponds to characteristic classifications of contents to be associated with the selected operation or schemes of providing information related to the contents,

the determining of the at least one option comprises determining at least one classification among the characteristic classifications of the contents to be associated with the selected operation or determining at least one scheme among the schemes of providing information related to the contents based on at least one of the urgency of the user command and the user emotion, and

the performing of the selected operation comprises performing the selected operation in associated with the contents according to the determined at least one classification or the determined at least one scheme.

10. The non-transitory computer-readable recording medium of claim 1 , wherein the determining of the at least one option comprises determining the at least one option among the plurality of options by further utilizing situation data of the user, and

the situation data includes at least one of an instant message sent and received in association with a phone number of the user or a messenger account of the user and a facial expression of the user recognized through a camera included in the electronic device.

11. The non-transitory computer-readable recording medium of claim 1 , wherein the electronic device includes an artificial intelligence (AI) speaker configured to control devices included in a smart home by interoperating with the devices or provide contents according to the user command through the Internet.

12. The non-transitory computer-readable recording medium of claim 1 , wherein the user command processing method further comprises:

transmitting the voice input to a cloud AI platform connected to the electronic device through an interface connect; and

receiving, from the cloud AI platform, information related to at least one of the keyword extracted from the voice input, an operation recommended based on the extracted keyword, the option corresponding to the extracted keyword, and the option determined according to the presentation of the voice input.

13. A user command processing method, comprising:

managing at least one pre-defined operation to be performed according to a user command and a plurality of options preset in relation to each of the at least one pre-defined operation for modifying a corresponding pre-defined operation, wherein the corresponding pre-defined operation modified by one of the plurality of options performs a different operation than the corresponding pre-defined operation modified by another of the plurality of options;

receiving the user command including at least a voice input received from a user;

selecting an operation from the at least one pre-defined operation corresponding to a keyword extracted from the voice input;

determining at least one option according to a presentation of the voice input; and

performing the selected operation as modified by the determined at least one option.

14. The user command processing method of claim 13 , wherein the presentation of the voice input includes an expression representing a social relationship between a person associated with the selected operation and the user, and

the determining of the at least one option comprises determining from among the plurality of options based on the social relationship with the user which is analyzed according to the expression.

15. The user command processing method of claim 14 , wherein the plurality of options corresponds to a plurality of devices interoperating with an electronic device,

the determining of the at least one option comprises determining at least one device associated with a person selected based on the social relationship with the user among the plurality of devices, and

the performing of the selected operation comprises performing the selected operation in association with the determined at least one device.

16. The user command processing method of claim 13 , wherein the presentation of the voice input includes at least one of an urgency of a user command and a user emotion analyzed based on at least one of a manner of speaking and a tone of the user obtained through the voice input, and

the determining of the at least one option comprises determining from among the plurality of options based on at least one of the urgency of the user command and the user emotion.

17. The user command processing method of claim 16 , wherein the plurality of options corresponds to characteristic classifications of contents to be associated with the selected operation or schemes of providing information related to the contents,

the determining of the at least one option comprises determining at least one classification among the characteristic classifications of the contents to be associated with the selected operation or determining at least one scheme among the schemes of providing information related to the contents based on at least one of the urgency of the user command and the user emotion, and

the performing of the selected operation comprises performing the selected operation in associated with the contents according to the determined at least one classification or the determined at least one scheme.

18. A user command processing system, comprising:

at least one processor implemented to execute computer-readable instructions,

wherein the at least one processor is configured to:

manage at least one pre-defined operation to be performed according to a user command and a plurality of options preset in relation to each of the at least one pre-defined operation for modifying a corresponding pre-defined operation, wherein the corresponding pre-defined operation modified by one of the plurality of options performs a different operation than the corresponding pre-defined operation modified by another of the plurality of options,

receive the user command including at least a voice input received from a user,

select an operation from the at least one pre-defined operation corresponding to a keyword extracted from the voice input,

determine at least one option according to a presentation of the voice input, and

perform the selected operation as modified by the determined at least one option.

19. The user command processing system of claim 18 , wherein the presentation of the voice input includes an expression representing a social relationship between a person associated with the selected operation and the user, and

the at least one processor is configured to determine the at least one option among the plurality of options based on the social relationship with the user which is analyzed according to the expression.

20. The user command processing system of claim 18 , wherein the presentation of the voice input includes at least one of an urgency of a user command and a user emotion analyzed based on at least one of a manner of speaking and a tone of the user obtained through the voice input, and

the at least one processor is configured to determine the at least one option among the plurality of options based on at least one of the urgency of the user command and the user emotion.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2024
From: Z INTERMEDIATE GLOBAL CORPORATION
To: LY CORPORATION
Reel/Frame 067091/0109 →
CHANGE OF NAME Recorded Apr 10, 2024
From: LINE CORPORATION
To: Z INTERMEDIATE GLOBAL CORPORATION
Reel/Frame 067069/0467 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF THE ASSIGNEES CITY IN THE ADDRESS SHOULD BE TOKYO, JAPAN PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0303. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 062401/0490 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE CITY SHOULD BE SPELLED AS TOKYO PREVIOUSLY RECORDED AT REEL: 058597 FRAME: 0141. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 17, 2023
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 062401/0328 →
CHANGE OF NAME Recorded Dec 28, 2021
From: LINE CORPORATION
To: A HOLDINGS CORPORATION
Reel/Frame 058597/0141 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: A HOLDINGS CORPORATION
To: LINE CORPORATION
Reel/Frame 058597/0303 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2018
From: CHA, SEIJIN; CHOI, EONJOUNG
To: NAVER CORPORATION; LINE CORPORATION
Reel/Frame 045696/0891 →
Priority Claims (1)
KR 10-2017-0056128 · May 2, 2017 · national
Continuity (1)
Related Publication 20180322872A1 · Nov 8, 2018
Cited By (1)
US 12,346,977