IP Library Granted Patent US 12,236,949
Granted Patent B2
US 12,236,949 · App. 17/854,450 · Granted Feb 25, 2025

Electronic device and control method thereof

Inventors: Kyoungchoon Park (Suwon-si, KR); Keehwan Ka (Suwon-si, KR); Jongyoub Ryu (Suwon-si, KR); Minjin Song (Suwon-si, KR); Jeongwon Lee (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G10L15/08G10L15/16G10L25/60G10L2015/088G10L2015/223G10L25/78G10L25/84G10L25/93G10L2025/937
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,949
App. No.
17/854,450
Granted
Feb 25, 2025
Kind
B2
Abstract

An electronic device including a memory storing signal information corresponding to a trigger speech; a microphone; a communication interface; and a processor configured to identify whether a first speech signal received through the microphone corresponds to the trigger speech, obtain a first speech sharpness value of the first speech signal, obtain a second speech sharpness value from the at least one external device through the communication interface, based on the first speech sharpness value being greater than the second speech sharpness value, identify a speech command included in the second speech signal received through the microphone by entering a speech recognition mode, and control the electronic device based on the identifying of the speech command. Based on the speech command being unidentified, the processor controls the communication interface to transmit a control signal to the at least one external device based on the second speech sharpness value.

Claims (64)

1. An electronic device comprising:

a memory to store signal information corresponding to a trigger speech;

a microphone;

a communication interface; and

a processor configured to:

identify whether a first speech signal received through the microphone corresponds to the trigger speech based on the signal information,

obtain a first speech sharpness value of the first speech signal based on the first speech signal being identified as corresponding to the trigger speech,

obtain a second speech sharpness value from at least one external device through the communication interface,

based on the first speech sharpness value being greater than the second speech sharpness value, identify a speech command included in a second speech signal received through the microphone by entering a speech recognition mode, and

control the electronic device based on the speech command identified from the second speech signal,

wherein the processor is further configured to, based on the speech command being unidentified from the second speech signal, control the communication interface to transmit a control signal to the at least one external device based on the second speech sharpness value,

wherein the control signal comprises at least one of a signal to cause the at least one external device to enter a speech recognition mode.

2. The electronic device of claim 1 , wherein the processor is further configured to:

obtain a second speech sharpness value corresponding to each of a plurality of external devices including the at least one external device through the communication interface,

based on the speech command being unidentified from the second speech signal, control the communication interface to transmit the control signal to an external device corresponding to a greatest value among a plurality of second speech sharpness values, and

wherein the control signal comprises at least one of a signal the second speech signal, or a text corresponding to the second speech signal.

3. The electronic device of claim 2 , wherein the processor is further configured to, based on a signal indicating that the external device receiving the control signal fails to identify the speech command included in the second speech signal through the communication interface, sequentially transmit the control signal to a remaining external device among the plurality of external devices based on the plurality of second speech sharpness values.

4. The electronic device of claim 1 , wherein the memory is configured to store identification information corresponding to the at least one external device and a first neural network model,

wherein the processor is further configured to:

based on the speech command being unidentified from the second speech signal, identify a first external device enabled to identify the speech command among the at least one external device by inputting the second speech signal to the first neural network model, and

control the communication interface to transmit the control signal to the identified first external device.

5. The electronic device of claim 4 , wherein the processor is further configured to:

based on a plurality of external devices being enabled to identify the speech command among the at least one external device, transmit the control signal to the first external device corresponding to a greatest value among a plurality of second speech sharpness values corresponding to each of the plurality of identified external devices, and

based on an external device, among the plurality of external devices, being enabled to identify the speech command unidentified, output feedback information indicative of error occurrence.

6. The electronic device of claim 1 , wherein the memory is configured to store identification information corresponding to the at least one external device and a second neural network model,

wherein the processor is further configured to:

based on the speech command being unidentified from the second speech signal, identify a function corresponding to a speech command included in the second speech signal and a first external device enabled to perform the function by inputting the second speech signal to the second neural network model,

control the communication interface to transmit the control signal to the identified first external device, and

wherein the control signal is a signal to control the first external device to perform a function corresponding to the speech command.

7. The electronic device of claim 1 , wherein the processor is further configured to, based on receiving a third speech signal through the microphone after the control signal is transmitted to the at least one external device, transmit at least one of the third speech signal or a text corresponding to the third speech signal to the at least one external device.

8. The electronic device of claim 1 , wherein the processor is further configured to:

control the communication interface to transmit the first speech sharpness value to the at least one external device, and

wherein the electronic device does not enter the speech recognition mode based on the first speech sharpness value being less than the second speech sharpness value.

9. The electronic device of claim 8 , wherein the processor is further configured to, based on receiving a control signal from the at least one external device through the communication interface, enter the speech recognition mode or perform a function corresponding to a speech signal included in the control signal based on the control signal.

10. The electronic device of claim 1 , wherein the trigger speech corresponding to the electronic device and the trigger speech corresponding to the at least one external device are identical.

11. A method of controlling an electronic device, the method comprising:

receiving a first speech signal;

identifying whether the first speech signal corresponds to a trigger speech based on signal information corresponding to the trigger speech;

obtaining a first speech sharpness value of the first speech signal based on the first speech signal being identified as corresponding to the trigger speech;

obtaining a second speech sharpness value from at least one external device;

receiving a second speech signal;

based on the first speech sharpness value being greater than the second speech sharpness value, identifying a speech command included in the second speech signal by entering a speech recognition mode; and

controlling the electronic device based on the speech command identified from the second speech signal,

wherein the controlling the electronic device comprises, based on the speech command being unidentified from the second speech signal, transmitting a control signal to the at least one external device based on the second speech sharpness value,

wherein the control signal comprises at least one of a signal to cause the at least one external device to enter a speech recognition mode.

12. The method of claim 11 , wherein the obtaining the second sharpness value comprises obtaining a second speech sharpness value corresponding to each of a plurality of external devices including the at least one external device,

wherein the controlling the electronic device comprises, based on the speech command being unidentified from the second speech signal, transmitting the control signal to an external device corresponding to a greatest value among a plurality of second speech sharpness values,

wherein the control signal comprises at least one of the second speech signal, or a text corresponding to the second speech signal.

13. The method of claim 12 , wherein the controlling the electronic device comprises, based on a signal indicating that the external device receiving the control signal fails to identify the speech command included in the second speech signal, sequentially transmitting the control signal to a remaining external device among the plurality of external devices based on the plurality of second speech sharpness values.

14. The method of claim 11 , wherein the controlling the electronic device comprises:

based on the speech command being unidentified from the second speech signal, identifying a first external device being enabled to identify the speech command among the at least one external device by inputting the second speech signal to a first neural network model; and

transmitting the control signal to the identified first external device.

15. The method of claim 14 , wherein the controlling the electronic device comprises:

based on a plurality of external devices being enabled to identify the speech command among the at least one external device, transmitting the control signal to the first external device corresponding to a greatest value among a plurality of second speech sharpness values corresponding to each of the plurality of identified external devices; and

based on an external being enabled to identify the speech command being unidentified among the at least one external device, outputting feedback information indicative of error occurrence.

16. The method of claim 11 , wherein the controlling the electronic device comprises:

based on the speech command being unidentified from the second speech signal, identifying a function corresponding to a speech command included in the second speech signal and a first external device enabled to perform the function by inputting the second speech signal to a second neural network model; and

transmitting the control signal to the identified first external device, and

wherein the control signal is a signal to control the first external device to perform a function corresponding to the speech command.

17. The method of claim 11 , wherein the method further comprises, based on receiving a third speech signal through a microphone after the control signal is transmitted to the at least one external device, transmitting at least one of the third speech signal or a text corresponding to the third speech signal to the external device.

18. The method of claim 11 , wherein the method further comprises transmitting the first speech sharpness value to the external device, and

wherein the electronic device does not enter the speech recognition mode based on the first speech sharpness value being less than the second speech sharpness value.

19. The method of claim 18 , wherein the method further comprises, based on receiving a control signal from the at least one external device through a communication interface, entering the speech recognition mode or perform a function corresponding to a speech signal included in the control signal based on the control signal.

20. The method of claim 11 , wherein the trigger speech corresponding to the electronic device and the trigger speech corresponding to the at least one external device are identical.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2022
From: PARK, KYOUNGCHOON; KA, KEEHWAN; RYU, JONGYOUB; SONG, MINJIN; LEE, JEONGWON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 060370/0490 →
Priority Claims (1)
KR 10-2021-0126592 · Sep 24, 2021 · national
Continuity (2)
Continuation PCTKR2022008266 · Jun 13, 2022
Related Publication 20230095334A1 · Mar 30, 2023
References Cited (43)
US 8340975B1 · Rosenberger · 2012 [cited by examiner]
US 9818407B1 · Secker-Walker · 2017 [cited by examiner]
US 9875081B2 · Meyers et al. · 2018 [cited by applicant]
US 10026399B2 · Gopalan et al. · 2018 [cited by applicant]
US 10069976B1 · Gunther · 2018 [cited by examiner]
US 10147425B2 · Yang · 2018 [cited by examiner]
US 11031008B2 · Kim · 2021 [cited by applicant]
US 11069355B2 · Lee · 2021 [cited by applicant]
US 11189268B2 · Park et al. · 2021 [cited by applicant]
US 11393465B2 · Lee et al. · 2022 [cited by applicant]
US 11636867B2 · Woo et al. · 2023 [cited by applicant]
US 11651771B2 · Lee · 2023 [cited by applicant]
US 11721334B2 · Chae et al. · 2023 [cited by applicant]
US 20110074796A1 · Choi et al. · 2011 [cited by applicant]
US 20140006825A1 · Shenhav · 2014 [cited by examiner]
US 20140214429A1 · Pantel · 2014 [cited by examiner]
US 20170025124A1 · Mixter · 2017 [cited by examiner]
US 20180233142A1 · Koishida · 2018 [cited by examiner]
US 20190311713A1 · Talwar · 2019 [cited by examiner]
US 20190355365A1 · Kim et al. · 2019 [cited by applicant]
US 20190385630A1 · Sivaraman · 2019 [cited by examiner]
US 20200035235A1 · Lee · 2020 [cited by applicant]
US 20200168223A1 · Choi · 2020 [cited by examiner]
US 20200273451A1 · Kim · 2020 [cited by examiner]
US 20200342869A1 · Lee et al. · 2020 [cited by applicant]
US 20200349947A1 · Kim et al. · 2020 [cited by applicant]
US 20200395014A1 · Song et al. · 2020 [cited by applicant]
US 20210110837A1 · Woo et al. · 2021 [cited by applicant]
US 20210241771A1 · Yun · 2021 [cited by applicant]
US 20210304763A1 · Lee · 2021 [cited by applicant]
US 20210366472A1 · Lee et al. · 2021 [cited by applicant]
KR 1020180083587 · 2018 [cited by applicant]
KR 1020190090424A · 2019 [cited by applicant]
KR 102025566 · 2019 [cited by applicant]
KR 1020200074680A · 2020 [cited by applicant]
KR 1020200122981 · 2020 [cited by applicant]
KR 102228549B1 · 2021 [cited by applicant]
KR 1020210044509 · 2021 [cited by applicant]
KR 1020210069977 · 2021 [cited by applicant]
KR 1020210098250 · 2021 [cited by applicant]
International Search Report dated Sep. 26, 2022 in International Patent Application No. PCT/KR2022/008266 (3 pages; 3 pages English translation). [cited by applicant]
Written Opinion dated Sep. 26, 2022 in International Patent Application No. PCT/KR2022/008266 (4 pages). [cited by applicant]
Extended European Search Report issued Sep. 26, 2024 for European Patent Application No. 22873065.1. [cited by applicant]