IP Library › Granted Patent US 12,417,768
Granted Patent B2
US 12,417,768 · App. 18/108,859 · Granted Sep 16, 2025

Electronic device and utterance processing method thereof

Inventors: Suneung Park (Suwon-si, KR); Sanghee Kim (Suwon-si, KR); Hyunju Seo (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G10L15/1815G10L15/30H04R3/00G10L2015/088G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,768
App. No.
18/108,859
Granted
Sep 16, 2025
Kind
B2
Abstract

An electronic device and an utterance processing method of the electronic device are provided. The electronic device includes a microphone that receives a first and a second utterance of a user, the second utterance being generated at a later point in time than the first utterance, a memory storing instructions, and at least one processor. The at least one processor may be configured to execute the instructions to extract a first domain corresponding to the first utterance and a first intent corresponding to the first utterance, determine a correlation between the first utterance and the second utterance, and determine whether to process the second utterance based on the correlation.

Claims (56)

1. An electronic device comprising:

a microphone configured to receive a first utterance of a user and a second utterance of the user, the first utterance comprising a wakeup word and additional words after the wakeup word, and the second utterance being generated at a later point in time than the first utterance;

a memory configured to store instructions; and

at least one processor configured to execute the instructions to:

extract a first domain corresponding to the first utterance and a first intent corresponding to the first utterance based on the first utterance;

execute an action corresponding to the additional words of the first utterance;

provide a response to the user regarding a result of executing the action corresponding to the additional words of the first utterance;

determine, based on the first domain and the first intent, a first correlation between the first utterance and the second utterance; and

determine, based on the first correlation, whether to process the second utterance,

wherein the second utterance does not comprise the wakeup word, and the second utterance is received from the user after the response is provided.

2. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to:

based on a result of executing an action corresponding to the first domain and the first intent, generate a context corresponding to the first utterance; and

generate, based on the context, an intent set corresponding to the first correlation.

3. The electronic device of claim 2 , wherein the at least one processor is further configured to execute the instructions to:

determine a second correlation between the context and a second domain corresponding to the second utterance based on one of a degree of relationship between pre-trained domains or a usage history of the user.

4. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to:

extract a second domain corresponding to the second utterance; and

determine the first correlation based on a context corresponding to the first utterance and the second domain.

5. The electronic device of claim 2 , wherein the at least one processor is further configured to execute the instructions to generate the intent set based on a predefined continuous utterance support policy.

6. The electronic device of claim 2 , wherein the at least one processor is further configured to execute the instructions to update the intent set based on a determination of whether to process the second utterance.

7. The electronic device of claim 2 , wherein the at least one processor is further configured to execute the instructions to generate the intent set using an intent comprised in the first domain and an intent comprised in a third domain different from the first domain.

8. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to determine whether to activate the microphone based on a determination of whether to process the second utterance.

9. The electronic device of claim 1 , wherein the at least one processor is further configured to execute the instructions to:

based on determining that the second utterance is to be processed, activate the microphone for a predetermined time; and

based on determining that the second utterance is not to be processed, deactivate the microphone.

10. An electronic device comprising:

a microphone configured to receive a first utterance of a user and a second utterance of the user, the first utterance comprising a wakeup word and additional words after the wakeup word, and the second utterance being generated at a later point in time than the first utterance;

a memory storing instructions; and

at least one processor configured to execute the instructions to:

execute an action corresponding to the additional words of the first utterance;

provide a response to the user regarding a result of executing the action corresponding to the additional words of the first utterance;

receive a correlation list correlated with a first domain corresponding to the first utterance;

determine a first correlation between a second domain corresponding to the second utterance and the first utterance based on the correlation list; and

determine whether to process the second utterance based on a result of determining the first correlation,

wherein the second utterance does not comprise the wakeup word, and the second utterance is received from the user after the response is provided.

11. The electronic device of claim 10 , wherein the correlation list comprises a plurality of domains or plurality of intents based on the first correlation.

12. The electronic device of claim 10 , wherein the at least one processor is further configured to execute the instructions to:

based on a result of executing an action corresponding to the first domain and a first intent corresponding to the first utterance, generate a context corresponding to the first utterance; and

determine the first correlation based on the correlation list and the context.

13. The electronic device of claim 10 , wherein the at least one processor is further configured to execute the instructions to:

extract the second domain corresponding to the second utterance; and

determine the first correlation based on the correlation list and the second domain.

14. The electronic device of claim 10 , wherein the at least one processor is further configured to execute the instructions to update the correlation list based on a determination of whether to process the second utterance.

15. The electronic device of claim 10 , wherein the correlation list is generated based on one of a degree of relationship between pre-trained domains or a usage history of the user.

16. The electronic device of claim 10 , wherein the at least one processor is further configured to execute the instructions to determine whether to activate the microphone based on a result of determining whether to process the second utterance.

17. The electronic device of claim 10 , wherein the at least one processor is further configured to execute the instructions to:

based on determining that the second utterance is to be processed, activate the microphone for a predetermined time; and

based on determining that the second utterance is not to be processed, deactivate the microphone.

18. An utterance processing method of an electronic device, the utterance processing method comprising:

receiving a first utterance of a user and a second utterance of the user, the first utterance comprising a wakeup word and additional words after the wakeup word, and the second utterance being generated at a later point in time than the first utterance;

extracting, based on the first utterance, a first domain corresponding to the first utterance and a first intent corresponding to the first utterance;

executing an action corresponding to the additional words of the first utterance;

providing a response to the user regarding a result of executing the action corresponding to the additional words of the first utterance;

determining, based on the first domain and the first intent, a correlation between the first utterance and the second utterance; and

determining, based on the correlation, whether to process the second utterance,

wherein the second utterance does not comprise the wakeup word, and the second utterance is received from the user after the response is provided.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 13, 2023
From: PARK, SUNEUNG; KIM, SANGHEE; SEO, HYUNJU
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 062676/0344 →
Priority Claims (2)
KR 10-2022-0019892 · Feb 18, 2022 · national
KR 10-2022-0033557 · Mar 17, 2022 · national
Continuity (2)
Continuation PCTKR2022020209 · Dec 13, 2022
Related Publication 20230267929A1 · Aug 24, 2023
References Cited (62)
US 6871179B1 · Kist · 2005 [cited by examiner]
US 8326637B2 · Baldwin · 2012 [cited by examiner]
US 8688453B1 · Joshi · 2014 [cited by examiner]
US 8838456B2 · Lee · 2014 [cited by examiner]
US 9953645B2 · Bak et al. · 2018 [cited by applicant]
US 10068567B1 · Hermush · 2018 [cited by examiner]
US 10515637B1 · Devries · 2019 [cited by examiner]
US 10614800B1 · McMahon · 2020 [cited by examiner]
US 10706848B1 · Greene · 2020 [cited by examiner]
US 11450315B2 · Kim et al. · 2022 [cited by applicant]
US 20070244629A1 · Hirayama · 2007 [cited by examiner]
US 20080167914A1 · Ikeda · 2008 [cited by examiner]
US 20080243498A1 · Poi · 2008 [cited by examiner]
US 20080243499A1 · Poi · 2008 [cited by examiner]
US 20100217604A1 · Baldwin · 2010 [cited by examiner]
US 20130173267A1 · Washio · 2013 [cited by examiner]
US 20160336024A1 · Choi · 2016 [cited by examiner]
US 20170011742A1 · Jing · 2017 [cited by examiner]
US 20170178626A1 · Gruber · 2017 [cited by examiner]
US 20180096680A1 · Lee · 2018 [cited by examiner]
US 20180233147A1 · Tukka et al. · 2018 [cited by applicant]
US 20180261216A1 · Leeb · 2018 [cited by examiner]
US 20180315427A1 · Kwon · 2018 [cited by examiner]
US 20190206405A1 · Gillespie · 2019 [cited by examiner]
US 20190318724A1 · Chao · 2019 [cited by examiner]
US 20190318735A1 · Chao · 2019 [cited by examiner]
US 20190371329A1 · D'Souza · 2019 [cited by examiner]
US 20200125603A1 · Ha · 2020 [cited by examiner]
US 20200175973A1 · Bender · 2020 [cited by examiner]
US 20200251098A1 · Metallinou · 2020 [cited by examiner]
US 20200279555A1 · Shapiro · 2020 [cited by examiner]
US 20200380985A1 · Gada · 2020 [cited by examiner]
US 20210004443A1 · Sapugay · 2021 [cited by examiner]
US 20210037067A1 · Lee · 2021 [cited by examiner]
US 20210056962A1 · McMahon · 2021 [cited by examiner]
US 20210082397A1 · Kennewick · 2021 [cited by examiner]
US 20210097989A1 · Lee · 2021 [cited by examiner]
US 20210104232A1 · Lee · 2021 [cited by examiner]
US 20210264909A1 · Reece · 2021 [cited by examiner]
US 20210264921A1 · Reece · 2021 [cited by examiner]
US 20220020358A1 · Song et al. · 2022 [cited by applicant]
US 20220051463A1 · Edwards · 2022 [cited by examiner]
US 20220058347A1 · Singaraju · 2022 [cited by examiner]
US 20220093097A1 · Jin et al. · 2022 [cited by applicant]
US 20220171003A1 · Kröll · 2022 [cited by examiner]
US 20220172722A1 · Kim · 2022 [cited by examiner]
US 20230267929A1 · Park · 2023 [cited by examiner]
US 20240185857A1 · Burakov · 2024 [cited by examiner]
JP 2020118842A · 2020 [cited by applicant]
JP 2020148805A · 2020 [cited by applicant]
JP 2021076818A · 2021 [cited by applicant]
KR 1020140074229A · 2014 [cited by applicant]
KR 1020180084392A · 2018 [cited by applicant]
KR 1020190066116A · 2019 [cited by applicant]
KR 1020200023518A · 2020 [cited by applicant]
KR 1020200047853A · 2020 [cited by applicant]
KR 1020200082137A · 2020 [cited by applicant]
KR 1020200119531A · 2020 [cited by applicant]
KR 1020210001082A · 2021 [cited by applicant]
KR 1020210079004A · 2021 [cited by applicant]
International Search Report (PCT/ISA/210) issued by the International Searching Authority on Mar. 20, 2023 in International Patent Application No. PCT/KR2022/020209. [cited by applicant]
Communication dated Jan. 8, 2025, issued by the European Patent Office in European Application No. 22927472.5. [cited by applicant]