IP Library Granted Patent US 11,900,930
Granted Patent B2
US 11,900,930 · App. 17/113,572 · Granted Feb 13, 2024

Method and apparatus for managing voice-based interaction in Internet of things network system

Inventors: Vijaya Kumar Tukka (Bangalore, IN); Deepraj Prabhakar Patkar (Bangalore, IN); Rakesh Kumar (Samastipur, IN); Sujay Mohan (Chikkaballapur, IN); Vinay Kumar (Bangalore, IN)
Assignee: Samsung Electronics Co., Ltd.
G10L15/22G06F3/167G10L15/1815G10L15/30G10L17/00H04L67/025H04L67/12G10L2015/223H04L67/52H04W4/02H04W4/70H04W64/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,900,930
App. No.
17/113,572
Granted
Feb 13, 2024
Kind
B2
Abstract

A method for managing voice-based interaction in an Internet of things (IoT) network system is provided. The method includes identifying a first voice utterance from a first IoT device among a plurality of IoT devices in the IoT network system. Further, the method includes identifying at least one second voice utterance from at least one second IoT device among the plurality of IoT devices in the IoT network system. Further, the method includes determining a voice command by combining the first voice utterance and the at least one second voice utterance. Furthermore, the method includes triggering at least one IoT device among the plurality of IoT devices in the IoT network system to perform at least one action corresponding to the voice command.

Claims (66)

1. A method for operating an electronic device managing voice-based interaction in an Internet of things (IoT) network system, the method comprising:

identifying a first voice utterance of a user from a first IoT device among a plurality of IoT devices in the IoT network system, wherein the first voice utterance is generated at a first time and includes a first query;

identifying at least one second voice utterance of the user from at least one second IoT device among the plurality of IoT devices in the IoT network system, wherein the second voice utterance is generated at a second time and includes a second query different from the first query;

identifying a user identification (ID) by comparing pre-stored voice information with extracted voice information from at least one voice utterance among the first voice utterance and the at least one second voice utterance;

sending a trigger signal to wake another IoT device, among the plurality of IoT devices in the IoT network system, the IoT device in a direction the user is moving in order to capture a next utterance of the user using the other IoT device;

determining a time interval at which voice utterances are received with same user ID;

determining whether the time interval between the first time and the second time is less than a threshold interval;

based on identifying that the time interval is less than the threshold interval, generating a voice command by combining the first voice utterance and the at least one second voice utterance;

determining, by a wearable device of the user, that no IoT device is in proximity of the user and transmitting voice data of the user by Bluetooth low energy (BLE) to an IoT device based on the determination; and

triggering at least one IoT device among the plurality of IoT devices in the IoT network system to perform at least one action corresponding to the voice command.

2. The method of claim 1 ,

wherein the first IoT device is located at a first location in the IoT network system, and the at least one second IoT device is located at a second location in the IoT network system, and

wherein the first location is different than the second location in the IoT network system.

3. The method of claim 1 , wherein the first voice utterance of the user is identified in a first time period and the at least one second voice utterance of the user is identified in a second time period.

4. The method of claim 1 , wherein the at least one action corresponding to the voice command is determined by:

dynamically detecting an intent from the voice command; and

determining the at least one action corresponding to the voice command based on the intent.

5. The method of claim 1 , wherein the generating of the voice command by combining the first voice utterance and the at least one second voice utterance comprises:

recognizing the first voice utterance and the at least one second voice utterance;

determining a confidence level to combine the first voice utterance with the at least one second voice utterance; and

combining the first voice utterance with the at least one second voice utterance based on the confidence level.

6. The method of claim 5 , wherein the determining of the confidence level to combine the first voice utterance with the at least one second voice utterance comprises:

determining confidence parameters associated with the first voice utterance and the at least one second voice utterance; and

determining the confidence level of the first voice utterance to combine with the at least one second voice utterance based on the confidence parameters.

7. The method of claim 1 , further comprising:

controlling the at least one second IoT device to present a message comprising the first voice utterance based on a distance between the user and the at least one second IoT device.

8. The method of claim 7 , wherein the message further comprises an inquiry message for inquiring whether to merge the first voice utterance and the at least one second voice utterance, further comprising:

receiving a response for the inquiry message; and

merging the first voice utterance and the at least one second voice utterance according to the response.

9. An electronic device for managing voice-based interaction in an Internet of things (IoT) network system, the electronic device comprising:

at least one processor configured to:

identify a first voice utterance of a user from a first IoT device among a plurality of IoT devices in the IoT network system, wherein the first voice utterance is generated at a first time and includes a first query;

identify at least one second voice utterance of the user from at least one second IoT device among the plurality of IoT devices in the IoT network system, wherein the second voice utterance is generated at a second time and includes a second query different from the first query;

identify a user identification (ID) by comparing pre-stored voice information with extracted voice information from at least one voice utterance among the first voice utterance and the at least one second voice utterance;

send a trigger signal to wake another IoT device, among the plurality of IoT devices in the IoT network system, the IoT device in a direction the user is moving in order to capture a next utterance of the user using the other IoT device;

determine a time interval at which voice utterances are received with same user ID;

determine whether the time interval between the first time and the second time is less than a threshold interval;

based on identifying that the time interval is less than the threshold interval, generate a voice command by combining the first voice utterance and the at least one second voice utterance;

determine, by a wearable device of the user, that no IoT device is in proximity of the user and transmitting voice data of the user by Bluetooth low energy (BLE) to an IoT device based on the determination; and

triggering at least one IoT device among the plurality of IoT devices in the IoT network system to perform at least one action corresponding to the voice command.

10. The electronic device of claim 9 ,

wherein the first IoT device is located at a first location in the IoT network system, and the at least one second IoT device is located at a second location in the IoT network system, and

wherein the first location is different than the second location in the IoT network system.

11. The electronic device of claim 9 , wherein the first voice utterance of the user is identified in a first time period and the at least one second voice utterance of the user is identified in a second time period.

12. The electronic device of claim 9 , wherein the at least one action corresponding to the voice command is determined by:

dynamically detecting an intent from the voice command; and

determining the at least one action corresponding to the voice command based on the intent.

13. The electronic device of claim 9 , wherein the at least one processor, in order to generate the voice command by combining the first voice utterance and the at least one second voice utterance, is further configured to:

recognize the first voice utterance and the at least one second voice utterance;

determine a confidence level to combine the first voice utterance with the at least one second voice utterance; and

combine the first voice utterance with the at least one second voice utterance based on the confidence level.

14. The electronic device of claim 13 , wherein the at least one processor, in order to determine the confidence level to combine the first voice utterance with the at least one second voice utterance, is further configured to:

determine confidence parameters associated with the first voice utterance and the at least one second voice utterance; and

determine the confidence level of the first voice utterance to combine with the at least one second voice utterance based on the confidence parameters.

15. The electronic device of claim 9 , wherein the at least one processor is further configured to:

control the at least one second IoT device to present a message comprising the first voice utterance based on a distance between the user and the at least one second IoT device.

16. The electronic device of claim 15 ,

wherein the message further comprises an inquiry message for inquiring whether to merge the first voice utterance and the at least one second voice utterance, and

wherein the at least one processor is further configured to:

receive a response for the inquiry message; and

merge the first voice utterance and the at least one second voice utterance according to the response.

17. The electronic device of claim 15 ,

wherein the message further comprises an inquiry message for inquiring whether to merge the first voice utterance and the at least one second voice utterance, and

wherein the at least one processor is further configured to:

receive a touch input as a response for the inquiry message; and

refraining from merging the first voice utterance and the at least one second voice utterance according to the touch input received as the response.

Priority Claims (2)
IN 201741004892 · Feb 10, 2017 · national
IN 2017 41004892 · Dec 28, 2017 · national
Continuity (2)
Continuation 15893011 · Feb 9, 2018
Related Publication 20210090567A1 · Mar 25, 2021