IP Library Granted Patent US 11,636,867
Granted Patent B2
US 11,636,867 · App. 17/012,708 · Granted Apr 25, 2023

Electronic device supporting improved speech recognition

Inventors: Kyounggu Woo (Suwon-si, KR); Yoonju Lee (Suwon-si, KR); Hoseon Shin (Suwon-si, KR); Chulmin Lee (Suwon-si, KR); Taegu Kim (Suwon-si, KR); Jaeyung Yeo (Suwon-si, KR)
Assignee: Samsung Electronics Co., Ltd.
G10L21/0208G10L15/08G10L15/30G10L2015/088
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,636,867
App. No.
17/012,708
Granted
Apr 25, 2023
Kind
B2
Abstract

An electronic device is provided. The electronic device includes a microphone, a processor operatively connected to the microphone, and a memory operatively connected to the processor, wherein the memory, when executed, stores instructions for causing the processor to receive first speech data through the microphone, recognize a user input to call a voice assistant from the first speech data, convert the user input into a first wakeup score, determine the electronic device as a first reference device at least based on the first wakeup score that exceeds a designated threshold value, configure a first noise reduction space based on location information of the first reference device, determine at least one of one or more electronic devices, located in the first noise reduction space, as a first noise reduction device to perform a noise reduction operation, and control the noise reduction operation of the first noise reduction device.

Claims (114)

1. An electronic device comprising:

a microphone;

a processor operatively connected to the microphone;

a communication circuit operatively connected to the processor; and

a memory operatively connected to the processor, the memory configured to store instructions,

wherein the stored instructions, when executed, cause the processor to:

receive first speech data through the microphone,

recognize a user input to call a voice assistant from the first speech data,

convert the user input into a first wakeup score,

receive a second wakeup score from an external electronic device through the communication circuit,

determine the electronic device as a first reference device among the electronic device and the external electronic device at least based on the first wakeup score exceeding a designated threshold value and the second wakeup score being below the threshold value,

configure a first noise reduction space based on location information of the first reference device,

determine at least one of one or more electronic devices, located in the first noise reduction space, as a first noise reduction device to perform a noise reduction operation, and

control the noise reduction operation of the first noise reduction device, and

wherein the determining of the at least one of the one or more electronic devices, located in the first noise reduction space, as the first noise reduction device comprises:

identifying a noise source by identifying at least one of: kinds of devices located in the first noise reduction space, specifications of devices located in the first noise reduction space, and capability information of devices located in the first noise reduction space, and

determining the identified noise source as the first noise reduction device, wherein the stored instructions, when executed, cause the processor to:

calculate a first value, indicating a strength of the user input,

calculate a second value, indicating a ratio of the strength of the user input to strength of a noise included in the user input,

determine a third value, which is a combination of the first value and the second value, and

determine a fourth value, obtained by combining a value indicating a performance of the microphone with the third value, as the first wakeup score.

2. The electronic device of claim 1 ,

wherein the stored instructions, when executed, cause the processor to:

perform the noise reduction operation of the electronic device based on the electronic device being included in the first noise reduction device, and

transmit a control signal for performing the noise reduction operation, to an external electronic device through the communication circuit, based on the external electronic device being included in the first noise reduction device.

3. The electronic device of claim 1 ,

wherein the stored instructions, when executed, cause the processor to:

acquire the location information of the first reference device from a server through the communication circuit,

store the location information of the first reference device in the memory of the electronic device, and acquire the location information of the first reference device from the memory, or

obtain a distance between external electronic devices and the electronic device by performing positioning communication with the external electronic devices using the communication circuit, and acquire the distance as the location information of the first reference device.

4. The electronic device of claim 1 ,

wherein the stored instructions, when executed, cause the processor to:

identify a space, in which the first reference device is located, based on the location information of the first reference device,

determine the identified space as the first noise reduction space, and

identify at least one external electronic device, located in the first noise reduction space, using the communication circuit based on location information of the external electronic devices.

5. The electronic device of claim 4 , wherein the stored instructions, when executed, cause the processor to:

select the at least one identified external electronic device as a noise reduction candidate,

acquire operation status information of the noise reduction candidate from the noise reduction candidate or a server through the communication circuit,

identify at least one external electronic device, which is generating a noise among the noise reduction candidates, based on the acquired operation status information, and

determine the identified external electronic device, which is generating the noise, as the first noise reduction device.

6. The electronic device of claim 4 , wherein the stored instructions, when executed, cause the processor to:

acquire the location information of the external electronic devices from a server through the communication circuit,

acquire the location information of the external electronic devices from the memory of the electronic device, or

obtain a distance between external electronic devices and the electronic device by performing positioning communication with the external electronic devices using the communication circuit, and acquire the distance as the location information of the external electronic devices.

7. The electronic device of claim 1 , wherein the stored instructions, when executed, cause the processor to:

drive a timer with a start of the noise reduction operation, and end the noise reduction operation based on an expiration of a configured time of the timer,

end the noise reduction operation based on an endpoint of a user's utterance that is detected from second speech data received through the microphone, or

end the noise reduction operation based on an operation in accordance with the second speech data that is completely performed.

8. The electronic device of claim 1 ,

wherein the stored instructions, when executed, cause the processor to:

receive identification information from external electronic devices through the communication circuit, and identify a movable device among the external electronic devices based on the identification information of the external electronic devices,

obtain a distance between the movable device and the electronic device by performing positioning communication with the movable device using the communication circuit, and

determine the movable device as the first noise reduction device based on the distance.

9. The electronic device of claim 1 , wherein the stored instructions, when executed, cause the processor to:

identify a noise source designated among external electronic devices based on identification information of the external electronic devices, and

determine the noise source as the first noise reduction device.

10. The electronic device of claim 1 , wherein the stored instructions, when executed, cause the processor to:

identify a noise source designated among external electronic devices based on identification information of the external electronic devices,

determine that the noise source is generating a noise, based on operation status information of the noise source, and

determine the noise source as the first noise reduction device based on the noise source that is determined to be generating the noise.

11. The electronic device of claim 1 , wherein the stored instructions, when executed, cause the processor to determine the electronic device as the first reference device based on a source of the user input that is another source that is not the first speech data.

12. An electronic device comprising:

a microphone;

a communication circuit;

a processor operatively connected to the communication circuit and the microphone; and

a memory operatively connected to the processor, the memory configured to store instructions,

wherein the stored instructions, when executed, cause the processor to:

receive first speech data through the microphone,

recognize a user input to call a voice assistant from the first speech data,

convert the user input into a first wakeup score,

receive a second wakeup score from an external electronic device through the communication circuit,

determine the external electronic device as a reference device among the electronic device and the external electronic device, at least based on the first wakeup score being below a designated threshold value and the second wakeup score exceeding the threshold value,

configure a noise reduction space based on location information of the reference device,

determine at least one of one or more electronic devices, located in the noise reduction space, as a noise reduction device to perform a noise reduction operation, and

control the noise reduction operation of the noise reduction device, and

wherein the determining of the at least one of the one or more electronic devices, located in the noise reduction space, as the noise reduction device comprises:

identifying a noise source by identifying at least one of: kinds of devices located in the noise reduction space, specifications of devices located in the noise reduction space, and capability information of devices located in the noise reduction space, and

determining the identified noise source as a first noise reduction device, and wherein the stored instructions, when executed, further cause the processor to:

calculate a first value, indicating a strength of the user input,

calculate a second value, indicating a ratio of the strength of the user input to strength of a noise included in the user input,

determine a third value, which is a combination of the first value and the second value, and

determine a fourth value, obtained by combining a value indicating a performance of the microphone with the third value, as the first wakeup score.

13. The electronic device of claim 12 , wherein the stored instructions, when executed, cause the processor to:

identify a space, in which the reference device is located, based on the location information of the reference device,

determine the identified space as the noise reduction space, and

identify at least one external electronic device located in the noise reduction space, based on location information of external electronic devices.

14. The electronic device of claim 13 , wherein the stored instructions, when executed, cause the processor to:

select the at least one identified external electronic device as a noise reduction candidate,

acquire operation status information of the noise reduction candidate from the noise reduction candidate or a server through the communication circuit,

identify at least one external electronic device, which is generating a noise among the noise reduction candidates, based on the acquired operation status information, and

determine the identified external electronic device, which is generating the noise, as the noise reduction device.

15. The electronic device of claim 12 , wherein the stored instructions, when executed, cause the processor to:

identify a noise source designated among external electronic devices based on identification information of the external electronic device, and

determine the noise source as the noise reduction device.

16. The electronic device of claim 12 , wherein the stored instructions, when executed, cause the processor to:

identify a noise source designated among external electronic devices based on identification information of the external electronic devices,

determine that the noise source is generating a noise, based on operation status information of the noise source, and

determine the noise source as the noise reduction device based on the noise source that is determined to be generating the noise.

17. A method for operating an electronic device, comprising:

receiving speech data through a microphone of the electronic device;

recognizing a user input to call a voice assistant from the speech data;

acquiring a first wakeup score based on the user input;

receiving a second wakeup score from an external electronic device through a communication circuit of the electronic device;

determining the electronic device as a reference device among the electronic device and the external electronic device at least based on the first wakeup score exceeding a designated threshold value and the second wakeup score being below the threshold value;

configuring a noise reduction space based on location information of the reference device;

determining at least one of one or more electronic devices, located in the noise reduction space, as a noise reduction device to perform a noise reduction operation; and

controlling the noise reduction operation of the noise reduction device,

wherein the determining of the at least one of the one or more electronic devices, located in the noise reduction space, as the noise reduction device comprises:

identifying a noise source by identifying at least one of: kinds of devices located in the noise reduction space, specifications of devices located in the noise reduction space, and capability information of devices located in the noise reduction space; and

determining the identified noise source as a first noise reduction device, and wherein the acquiring of the first wakeup score comprises:

calculating a first value, indicating a strength of the user input,

calculating a second value, indicating a ratio of the strength of the user input to strength of a noise included in the user input,

determining a third value, which is a combination of the first value and the second value, and

determining a fourth value, obtained by combining a value indicating a performance of the microphone with the third value, as the first wakeup score.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 4, 2020
From: WOO, KYOUNGGU; LEE, YOONJU; SHIN, HOSEON; LEE, CHULMIN; KIM, TAEGU; YEO, JAEYUNG
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 053696/0910 →
Priority Claims (1)
KR 10-2019-0127757 · Oct 15, 2019 · national
Continuity (1)
Related Publication 20210110837A1 · Apr 15, 2021
Cited By (1)
US 12,236,949