IP Library › Granted Patent US 10,997,973
Granted Patent B2
US 10,997,973 · App. 16/073,864 · Granted May 4, 2021

Voice recognition system having expanded spatial range

Inventors: Myoung-soon Choi (Hwaseong-si, KR); Jong-hyuk Lee (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G10L15/08G10L15/30G10L2015/088G10L2015/223H04R3/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,997,973
App. No.
16/073,864
Granted
May 4, 2021
Kind
B2
Abstract

Disclosed is a voice recognition apparatus connected via a network and sharing a voice recognition function. The voice recognition apparatus includes: a microphone configured to receive a voice signal from a user's speech; a communicator configured to communicate with at least one external voice recognition apparatus; a voice recognizer configured to determine a wake-up word involved in the voice signal; and a controller configured to transmit the voice signal to the external voice recognition apparatus corresponding to the determined wake-up word. Thus, it is possible to overcome a limited voice recognition distance caused by a physical characteristic of a microphone and expand a spatial range where voice recognition is possible, thereby providing various voice recognition services to a user in more places.

Claims (124)

1. A voice recognition apparatus comprising:

a microphone;

a communicator configured to communicate with a plurality of external voice recognition apparatuses;

a display;

a storage; and

a processor configured to:

control the communicator to transmit information on a display capability of the voice recognition apparatus and receive information on a display capability of the plurality of external voice recognition apparatuses, and store the received information in the storage;

receive, through the microphone, a voice signal from a user;

obtain a wake-up word from the voice signal;

identify, from among the plurality of external voice recognition apparatuses, an external voice recognition apparatus corresponding to the wake-up word obtained from the voice signal;

control the communicator to transmit the voice signal to the identified external voice recognition apparatus;

receive, through the communicator from the identified external voice recognition apparatus, an external recognition result which corresponds to the voice signal recognized by the identified external voice recognition apparatus, the external recognition result regarding content which is identified to correspond to a quality of the image of the content to be displayed on the display based on the transmitted information on the display capability of the voice recognition apparatus; and

control the display to display the image having the quality based on the received external recognition result,

wherein the processor is further configured to:

based on the obtained wake-up word corresponding to the voice recognition apparatus, recognize the voice signal, identify a recognition result based on the recognized voice signal and perform a function corresponding to the identified recognition result among a plurality of functions providable by the voice recognition apparatus,

based on the identified external voice recognition apparatus being a refrigerator, control the communicator to transmit the voice signal to the refrigerator so that the refrigerator:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a refrigerator command for at least one of adjusting a temperature of a refrigerator compartment, turning on/off the refrigerator compartment or providing information on a recipe and food to buy,

performs a function corresponding to the refrigerator command based on the external recognition result identified by the refrigerator, and

transmits information on the function performed by the refrigerator to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the refrigerator,

based on the identified external voice recognition apparatus being a television, control the communicator to transmit the voice signal to the television so that the television:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a television command for at least one of displaying a broadcast channel, search content, controlling a function of the television or scheduling a broadcasting program,

performs a function corresponding to the television command based on the external recognition result identified by the television, and

transmits information on the function performed by the television to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the television,

based on the identified external voice recognition apparatus being a smart phone, control the communicator to transmit the voice signal to the smart phone so that the smart phone:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a smart phone command for at least one of making a phone call, providing weather information, searching a news article, setting an alarm or playing music,

performs a function corresponding to the smart phone command based on the external recognition result identified by the smart phone, and

transmits information on the function performed by smart phone to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the smart phone, and

based on the identified external voice recognition apparatus being an acoustic service device, control the communicator to transmit the voice signal to the acoustic service device so that the acoustic service device:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising an acoustic service command for at least one of playing music, reading an audio book or knowledge search,

performs a function corresponding to the acoustic service command based on the external recognition result identified by the acoustic service device, and

transmits information on the function performed by acoustic service device to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the acoustic service device.

2. The voice recognition apparatus according to claim 1 , wherein the processor is configured to receive, through the communicator, a voice signal for requesting a service from at least one external voice recognition apparatus.

3. The voice recognition apparatus according to claim 2 , wherein the processor is configured to process the requested service based on the voice signal received from the at least one external voice recognition apparatus.

4. The voice recognition apparatus according to claim 3 , wherein the processor is configured to control the communicator to transmit a result of processing the requested service to the at least one external voice recognition apparatus that transmitted the voice signal.

5. The voice recognition apparatus according to claim 4 , wherein the processor is configured to control the communicator to transmit the result of processing the requested service suitable for a display capability of the at least one external voice recognition apparatus.

6. The voice recognition apparatus according to claim 2 , wherein the processor is configured to control the communicator to transmit the voice signal to a server and receive, through the communicator, information about the requested service based on the voice signal or a result of processing the requested service from the server when the voice recognizer cannot determine information about the requested service based on the voice signal.

7. The voice recognition apparatus according to claim 1 , wherein the plurality of external voice recognition apparatuses are connected via Internet of things (IoT).

8. The voice recognition apparatus according to claim 1 , wherein the storage is configured to store service domain information of the plurality of external voice recognition apparatuses, and

wherein the processor is configured to:

identify the external voice recognition apparatus capable of processing a service requested by the voice signal based on the service domain information, and

control the communicator to transmit the voice signal to the identified external voice recognition apparatus.

9. The voice recognition apparatus according to claim 1 , wherein:

the processor is configured to:

control the communicator to transmit the voice signal to the identified external voice recognition apparatus when a service is not determinable from the voice signal.

10. A voice recognition system comprising:

a plurality of voice recognition apparatuses formed as a network cluster for sharing information on a display capability of the plurality of external voice recognition apparatuses, wherein

a first voice recognition apparatus among the plurality of voice recognition apparatuses:

receives a voice signal from a user,

obtains a wake-up word from the voice signal,

identifies, from the plurality of external voice recognition apparatuses, a second external voice recognition apparatus corresponding to the wake-up word obtained from the voice signal, and

transmits the voice signal to the second voice recognition apparatus, and

the second voice recognition apparatus among the plurality of voice recognition apparatuses:

recognizes the voice signal transmitted from the first voice recognition apparatus so that an external recognition result of the voice signal regards a content which is identified to correspond to a quality of an image of the content to be displayed on a display of the first voice recognition apparatus based on the information on the display capability of the first voice recognition apparatus, and

transmits the external recognition result to the first voice recognition apparatus which receives the external recognition result and controls the display to display the image having the quality based on the received external recognition result,

wherein the first voice recognition apparatus:

based on the obtained wake-up word corresponding to the first voice recognition apparatus, recognizes the voice signal, identifies a recognition result based on the recognized voice signal, and performs a function corresponding to the identified recognition result among a plurality of functions providable by the first voice recognition apparatus,

based on the second external voice recognition apparatus being a refrigerator, transmits the voice signal to the refrigerator so that the refrigerator:

identifies the external recognition result based on the voice signal transmitted from the first voice recognition apparatus, the external recognition result comprising a refrigerator command for at least one of adjusting a temperature of a refrigerator compartment, turning on/off the refrigerator compartment or providing information on a recipe and food to buy,

performs a function corresponding to the refrigerator command based on the external recognition result identified by the refrigerator, and

transmits information on the function performed by the refrigerator to the first voice recognition apparatus so that the first voice recognition apparatus displays the information on the function performed by the refrigerator,

based on the second external voice recognition apparatus being a television, transmits the voice signal to the television so that the television:

identifies the external recognition result based on the voice signal transmitted from the first voice recognition apparatus, the external recognition result comprising a television command for at least one of displaying a broadcast channel, search content, controlling a function of the television or scheduling a broadcasting program,

performs a function corresponding to the television command based on the external recognition result identified by the television, and

transmits information on the function performed by the television to the first voice recognition apparatus so that the first voice recognition apparatus displays the information on the function performed by the television,

based on the second external voice recognition apparatus being a smart phone, transmits the voice signal to the smart phone so that the smart phone:

identifies the external recognition result based on the voice signal transmitted from the first voice recognition apparatus, the external recognition result comprising a smart phone command for at least one of making a phone call, providing weather information, searching a news article, setting an alarm or playing music,

performs a function corresponding to the smart phone command based on the external recognition result identified by the smart phone, and

transmits information on the function performed by smart phone to the first voice recognition apparatus so that the first voice recognition apparatus displays the information on the function performed by the smart phone, and

based on the second external voice recognition apparatus being an acoustic service device, transmits the voice signal to the acoustic service device so that the acoustic service device:

identifies the external recognition result based on the voice signal transmitted from the first voice recognition apparatus, the external recognition result comprising an acoustic service command for at least one of playing music, reading an audio book or knowledge search,

performs a function corresponding to the acoustic service command based on the external recognition result identified by the acoustic service device, and

transmits information on the function performed by acoustic service device to the first voice recognition apparatus so that the first voice recognition apparatus displays the information on the function performed by the acoustic service device.

11. A control method of a voice recognition apparatus, the control method comprising:

transmitting information on a display capability of the voice recognition apparatus and receiving information on a display capability of a plurality of external voice recognition apparatuses, and storing the received information;

receiving a voice signal from a user;

obtaining a wake-up word from the voice signal;

identifying, from among the plurality of external voice recognition apparatuses, an external voice recognition apparatus corresponding to the wake-up word obtained from the voice signal;

transmitting the voice signal to the identified of external voice recognition apparatus;

receiving from the identified external voice recognition apparatus, an external-a recognition result which corresponds to the voice signal recognized by the identified external voice recognition apparatus, the external recognition result regarding content which is identified to correspond to a quality of an image of the content to be displayed on a display based on the transmitted information on the display capability of the voice recognition apparatus; and

displaying the image having the quality based on the received external recognition result,

the control method further comprising:

based on the obtained wake-up word corresponding to the voice recognition apparatus, recognizing, by the voice recognition apparatus, the voice signal, identifying a recognition result based on the recognized voice signal and performing a function corresponding to the identified recognition result among a plurality of functions providable by the voice recognition apparatus, and

based on the identified external voice recognition apparatus being a refrigerator, transmitting the voice signal to the refrigerator so that the refrigerator:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a refrigerator command for at least one of adjusting a temperature of a refrigerator compartment, turning on/off the refrigerator compartment or providing information on a recipe and food to buy,

performs a function corresponding to the refrigerator command based on the external recognition result identified by the refrigerator, and

transmits information on the function performed by the refrigerator to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the refrigerator, based on the identified external voice recognition apparatus being a television, transmitting the voice signal to the television so that the television:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a television command for at least one of displaying a broadcast channel, search content, controlling a function of the television or scheduling a broadcasting program,

performs a function corresponding to the television command based on the external recognition result identified by the television, and

transmits information on the function performed by the television to the voice recognition apparatus so that the voice recognition apparatus displays the information on the performed function by the television,

based on the identified external voice recognition apparatus being a smart phone, transmitting the voice signal to the smart phone so that the smart phone:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a smart phone command for at least one of making a phone call, providing weather information, searching a news article, setting an alarm or playing music,

performs a function corresponding to the smart phone command based on the external recognition result identified by the smart phone, and

transmits information on the function performed by smart phone to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the smart phone, and

based on the identified external voice recognition apparatus being an acoustic service device, transmitting the voice signal to the acoustic service device so that the acoustic service device:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising an acoustic service command for at least one of playing music, reading an audio book or knowledge search,

performs a function corresponding to the acoustic service command based on the external recognition result identified by the acoustic service device, and

transmits information on the function performed by acoustic service device to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the acoustic service device.

12. A non-transitory computer-readable recording medium storing program code, which when executed by one or more computers of a voice recognition apparatus, cause the computers to execute:

controlling a communicator to transmit information on a display capability of a voice recognition apparatus and receive information on a display capability of a plurality of external voice recognition apparatuses;

storing the received information,

receiving a voice signal from a user;

obtaining a wake-up word from the voice signal;

identifying, from among the plurality of external voice recognition apparatuses, an external voice recognition apparatus corresponding to the wake-up word obtained from the voice signal;

controlling the communicator to transmit the voice signal to the identified external voice recognition apparatus;

controlling the communicator to receive, from the identified external voice recognition apparatus, an external recognition result which corresponds to the voice signal recognized by the identified external voice recognition apparatus, the external recognition result regarding content which is identified to correspond to a quality of an image of the content to be displayed on a display of the voice recognition apparatus based on the transmitted information on the display capability of the voice recognition apparatus; and

control the display to display the image having the quality based on the received external recognition result,

the program code causing the computers to further execute:

based on the obtained wake-up word corresponding to the voice recognition apparatus, recognizing, the voice signal, identifying a recognition result based on the recognized voice signal and performing a function corresponding to the identified recognition result among a plurality of functions providable by the voice recognition apparatus, and

based on the identified external voice recognition apparatus being a refrigerator, controlling the communicator to transmit the voice signal to the refrigerator so that the refrigerator:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a refrigerator command for at least one of adjusting a temperature of a refrigerator compartment, turning on/off the refrigerator compartment or providing information on a recipe and food to buy,

performs a function corresponding to the refrigerator command based on the external recognition result identified by the refrigerator, and

transmits information on the function performed by the refrigerator to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the refrigerator,

based on the identified external voice recognition apparatus being a television, controlling the communicator to transmit the voice signal to the television so that the television:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a television command for at least one of displaying a broadcast channel, search content, controlling a function of the television or scheduling a broadcasting program,

performs a function corresponding to the television command based on the external recognition result identified by the television, and

transmits information on the function performed by the television to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the television,

based on the identified external voice recognition apparatus being a smart phone, controlling the communicator to transmit the voice signal to the smart phone so that the smart phone:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising a smart phone command for at least one of making a phone call, providing weather information, searching a news article, setting an alarm or playing music,

performs a function corresponding to the smart phone command based on the external recognition result identified by the smart phone, and

transmits information on the function performed by smart phone to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the smart phone, and

based on the identified external voice recognition apparatus being an acoustic service device, transmitting the voice signal to the acoustic service device so that the acoustic service device:

identifies the external recognition result based on the voice signal transmitted from the voice recognition apparatus, the external recognition result comprising an acoustic service command for at least one of playing music, reading an audio book or knowledge search,

performs a function corresponding to the acoustic service command based on the external recognition result identified by the acoustic service device, and

transmits information on the function performed by acoustic service device to the voice recognition apparatus so that the voice recognition apparatus displays the information on the function performed by the acoustic service device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 30, 2018
From: CHOI, MYOUNG-SOON; LEE, JONG-HYUK
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 046498/0167 →
Priority Claims (1)
KR 10-2016-0015280 · Feb 5, 2016 · national
Continuity (1)
Related Publication 20190035398A1 · Jan 31, 2019
Cited By (2)
US 12,205,593 US 12,603,089