IP Library Granted Patent US 11,532,305
Granted Patent B2
US 11,532,305 · App. 16/913,310 · Granted Dec 20, 2022

Electronic apparatus and control method thereof

Inventors: Eunji Lee (Suwon-si, KR); Hyeonmok Ko (Suwon-si, KR); Kyenghun Lee (Suwon-si, KR); Saebom Jang (Suwon-si, KR); Pureum Jung (Suwon-si, KR); Sungja Choi (Suwon-si, KR); Changho Paeon (Suwon-si, KR); Jiyeon Hong (Suwon-si, KR); Inchul Hwang (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G10L15/183G10L15/1815G10L15/30G10L15/1822G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,532,305
App. No.
16/913,310
Granted
Dec 20, 2022
Kind
B2
Abstract

An electronic apparatus is provided. The electronic apparatus includes: a memory configured to store at least one instruction; and a processor configured to execute the at least one instruction to: obtain usage information on an application installed in the electronic apparatus, obtain a natural language understanding model, among a plurality of natural language understanding models, corresponding to the application based on the usage information, perform natural language understanding of a user voice input related to the application based on the natural language understanding model corresponding to the application, and perform an operation of the application based on the preformed natural language understanding.

Claims (67)

1. An electronic apparatus comprising:

a memory configured to store at least one instruction;

a communication interface; and

a processor configured to execute the at least one instruction to:

obtain usage information on an application installed in the electronic apparatus, the usage information including at least one of a user input information related to the application and operation information of the application according to a user input,

obtain a natural language understanding model, among a plurality of natural language understanding models, corresponding to the application based on the usage information,

perform natural language understanding of a user voice input related to the application based on the natural language understanding model corresponding to the application, and

perform an operation of the application based on the preformed natural language understanding,

wherein the user input information related to the application comprises a number of executions of the application, and the operation information of the application comprises an execution time of the application, and

wherein the processor is further configured to execute the at least one instruction to:

control the communication interface to transmit the obtained usage information to an external server,

receive the natural language understanding model corresponding to the application, among the plurality of natural language understanding models corresponding to a plurality of applications, from the external server via the communication interface, and

store the natural language understanding model in the memory.

2. The electronic apparatus as claimed in claim 1 , wherein the natural language understanding model corresponding to the application is received from the external server, based on the number of executions of the application included in the usage information being greater than or equal to a threshold number, or based on the execution time of the application being greater than or equal to a threshold time.

3. The electronic apparatus as claimed in claim 1 , wherein:

the application includes resource information that matches information on a predetermined voice utterance and operation information corresponding to the predetermined voice utterance; and

the processor is further configured to execute the at least one instruction to, based on the usage information on the application satisfying a predetermined condition, generate the natural language understanding model corresponding to the application according to the information on the predetermined voice utterance and the operation information corresponding to the predetermined voice utterance.

4. The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to execute the at least one instruction to request a first user voice input corresponding to an operation of the application that is determined, based on the usage information, to be performed for greater than or equal to a threshold number of times or for greater than or equal to a threshold time.

5. The electronic apparatus as claimed in claim 4 , wherein the processor is further configured to execute the at least one instruction to:

determine whether the first user voice input conflicts with a user voice input stored in the memory, based on the first user voice input being input according to the request;

request a second user voice input different from the first user voice input, based on determining that the first user voice input conflicts with the stored user voice input; and

store, in the memory, the first user voice input in correspondence with the operation of the application, based on determining that the first user voice input does not conflict with the stored user voice input.

6. The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to execute the at least one instruction to request, from an external server, the natural language understanding model corresponding to the application, based on the application being installed in the electronic apparatus.

7. The electronic apparatus as claimed in claim 1 , wherein:

the natural language understanding model includes at least one of a personal model generated based on a voice utterance of a user using the electronic apparatus and a public model generated based on a voice utterance of a public user; and

the processor is further configured to execute the at least one instruction to:

perform the natural language understanding of the user voice input in the personal model,

perform the natural language understanding of the user voice input in the public model, based on the natural language understanding of the user voice input being unsuccessful in the personal model, and

transmit the user voice input to an external server to perform the natural language understanding of the user voice input, based on the natural language understanding of the user voice input being unsuccessful in the public model.

8. The electronic apparatus as claimed in claim 1 , wherein the processor is further configured to execute the at least one instruction to remove the obtained natural language understanding model, based on the user voice input not being input for greater than or equal to a threshold number of times or for greater than or equal to a threshold period of time.

9. A control method of an electronic apparatus, the control method comprising:

obtaining usage information on an application installed in the electronic apparatus, the usage information including at least one of a user input information related to the application and operation information of the application according to a user input;

obtaining, based on the usage information, a natural language understanding model, among a plurality of natural language understanding models, corresponding to the application;

performing natural language understanding of a user voice input related to the application based on the natural language understanding model corresponding to the application; and

performing an operation of the application based on the performed natural language understanding,

wherein the user input information related to the application comprises a number of executions of the application and the operation information of the application comprises an execution time of the application, and

wherein the obtaining the natural language understanding model comprises:

transmitting the obtained usage information to an external server,

receiving the natural language understanding model corresponding to the application, among the plurality of natural language understanding models corresponding to a plurality of applications, from the external server, and

storing the natural language understanding model in the electronic device.

10. The control method as claimed in claim 9 , wherein the natural language understanding model corresponding to the application is received from the external server, based on the number of executions of the application included in the usage information being greater than or equal to a threshold number, or based on the execution time of the application being greater than or equal to a threshold time.

11. The control method as claimed in claim 9 , wherein:

the application includes resource information that matches information on a predetermined voice utterance and operation information corresponding to the predetermined voice utterance; and

the obtaining the natural language understanding model comprises, based on the usage information on the application satisfying a predetermined condition, generating the natural language understanding model corresponding to the application according to the information on the predetermined voice utterance and the operation information corresponding to the predetermined voice utterance.

12. The control method as claimed in claim 9 , further comprising requesting a first user voice input corresponding to an operation of the application that is determined, based on the usage information, to be performed for greater than or equal to a threshold number of times or for greater than or equal to a threshold time.

13. The control method as claimed in claim 9 , further comprising:

determining whether that the first user voice input conflicts with a input user voice stored in the electronic device, based on the first user voice input being input according to the request;

requesting a second user voice input different from the first user voice input, based on determining that the first user voice input conflicts with the stored user voice input; and

storing, in the electronic device, the first user voice input in correspondence with the operation of the application, based on determining that the first user voice input does not conflict with the stored user voice input.

14. The control method as claimed in claim 9 , further comprising requesting, from an external server, the natural language understanding model corresponding to the application, based on the application being installed in the electronic apparatus.

15. The control method as claimed in claim 9 , wherein:

the natural language understanding model includes at least one of a personal model generated based on a voice utterance of a user using the electronic apparatus and a public model generated based on a voice utterance of a public user; and

the performing the natural language understanding of the user voice input comprises:

performing the natural language understanding of the user voice input in the personal model,

performing the natural language understanding of the user voice input in the public model, based on the natural language understanding of the user voice input being unsuccessful in the personal model, and

transmitting the user voice input to an external server to perform the natural language understanding of the user voice input, based on the natural language understanding of the user voice input being unsuccessful in the public model.

16. The control method as claimed in claim 9 , further comprising removing the obtained natural language understanding model, based on the user voice input not being input for greater than or equal to a threshold number of times or for greater than or equal to a threshold period of time.

17. A non-transitory computer-readable recording medium having recorded thereon instructions executable by at least one processor to perform a control method of an electronic apparatus, the control method comprising:

obtaining usage information on an application installed in the electronic apparatus, the usage information including at least one of a user input information related to the application and operation information of the application according to a user input;

obtaining, based on the usage information, a natural language understanding model, among a plurality of natural language understanding models, corresponding to the application;

performing natural language understanding of a user voice input related to the application based on the natural language understanding model corresponding to the application; and

performing an operation of the application based on the performed natural language understanding,

wherein the user input information related to the application comprises a number of executions of the application and the operation information of the application comprises an execution time of the application; and

wherein the obtaining the natural language understanding model comprises:

transmitting the obtained usage information to an external server,

receiving the natural language understanding model corresponding to the application, among the plurality of natural language understanding models corresponding to a plurality of applications, from the external server, and

storing the natural language understanding model in the electronic device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 26, 2020
From: LEE, EUNJI; KO, HYEONMOK; LEE, KYENGHUN; JANG, SAEBOM; JUNG, PUREUM; CHOI, SUNGJA; PAEON, CHANGHO; HONG, JIYEON; HWANG, INCHUL
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053051/0493 →
Priority Claims (2)
KR 10-2019-0179747 · Dec 31, 2019 · national
KR 10-2020-0041470 · Apr 6, 2020 · national
Continuity (3)
Provisional Application 62889229 · Aug 20, 2019
Provisional Application 62866716 · Jun 26, 2019
Related Publication 20200411002A1 · Dec 31, 2020
Cited By (1)
US 12,676,148