IP Library › Granted Patent US 12,417,769
Granted Patent B2
US 12,417,769 · App. 18/231,660 · Granted Sep 16, 2025

Method and voice assistance apparatus for providing an intelligence response

Inventors: Vinay Vasanth Patage (Bengaluru, IN); Sourabh Tiwari (Bengaluru, IN); Ravibhushan B. Tayshete (Bengaluru, IN)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G10L15/22G10L15/08G10L15/30G10L21/0208G10L2015/223G10L2015/226
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,769
App. No.
18/231,660
Granted
Sep 16, 2025
Kind
B2
Abstract

Provided are a method and an apparatus for providing an intelligent voice response at a voice assistant device. The method includes obtaining, by a voice assistant device, a voice input from a user, identifying non-speech input while obtaining the voice input, determining a correlation between the voice input and the non-speech input, and generating, based on the correlation, a response comprising an action related to the correlation or a suggestion related to the correlation.

Claims (34)

1. A method for providing an intelligent response, the method comprising:

obtaining, by a voice assistant device, a voice input comprising a speech signal including a partial voice command of a user;

extracting a non-speech signal from the obtained voice input;

determining a correlation between the speech signal and the non-speech signal;

determining an intent corresponding to the partial voice command based on the correlation; and

generating, based on the correlation and the determined intent, a response to the partial voice command.

2. The method of claim 1 , further comprising:

mapping the non-speech signal into at least one event occurring in an ambience of the user.

3. The method of claim 2 , wherein the at least one event comprises at least one of an event indicating a presence of a human other than the user, a domestic sound event, an outdoor sound event, or an event indicating a mood.

4. The method of claim 2 , further comprising identifying the at least one event based on a profile of the user.

5. The method of claim 2 , wherein the determining the correlation comprises:

extracting one or more context parameters from the voice input, wherein the one or more context parameters is used to identify a natural language processing (NLP) domain capable of handling the voice input; and

mapping the at least one event to the NLP domain using a predefined correlation matrix.

6. The method of claim 5 , wherein the predefined correlation matrix represents correlations between a plurality of predefined events related to a plurality of non-speech inputs and NLP domains related to the voice assistant device.

7. The method of claim 5 , wherein the predefined correlation matrix is generated based on at least one of a profile of the user, a location of the voice assistant device, and a type of devices connected to the voice assistant device.

8. The method of claim 1 , wherein the response comprises a natural language response.

9. The method of claim 1 , wherein the response comprises a suggestion of launching at least one application installed in a device of the user.

10. The method of claim 9 , wherein the at least one application comprises a booking application related to the correlation.

11. The method of claim 9 , wherein the suggestion is generated based on data included in the at least one application or generated in the at least one application.

12. The method of claim 1 , wherein suggestion comprises an advertisement content related to the non-speech signal.

13. The method of claim 12 , wherein the advertisement content is generated based on a profile of the user and metadata received from a database.

14. An apparatus of providing an intelligent response, the apparatus comprising:

a receiver which obtains a voice input comprising a speech signal including a partial voice command of a user;

a processor configured to extract a non-speech signal from the obtained voice input, determine a correlation between the speech signal and the non-speech signal, determine an intent corresponding to the partial voice command based on the correlation, and generate a response to the partial voice command based on the correlation and the determined intent.

15. The apparatus of claim 14 , wherein the processor is configured to map the non-speech signal into at least one event occurring in an ambience of the user.

16. The apparatus of claim 15 , wherein the processor is configured to determine the correlation based on extracting one or more context parameters from the voice input, wherein the one or more context parameters is used to identify a natural language processing (NLP) domain capable of handling the voice input and mapping the at least one event to the NLP domain using a predefined correlation matrix.

17. The apparatus of claim 16 , wherein the predefined correlation matrix represents correlations between a plurality of predefined events related to a plurality of non-speech inputs and NLP domains related to the apparatus.

18. The apparatus of claim 16 , wherein the predefined correlation matrix is generated based on at least one a profile of the user, a location of the apparatus, and a type of devices connected to the apparatus.

19. A non-transitory computer readable storage medium having a computer readable instructions stored therein, when executed by at least one processor, the at least one processor controls to perform a method for providing an intelligent response, the method comprising:

obtaining a voice input comprising a speech signal including a partial voice command of a user;

extracting a non-speech signal from the obtained voice input;

determining a correlation between the speech signal and the non-speech signal;

determining an intent corresponding to the partial voice command based on the correlation; and

generating, based on the correlation and the determined intent, a response to the partial voice command.

Priority Claims (1)
IN 202041006037 · Feb 12, 2020 · national
Continuity (2)
Continuation 17173878 · Feb 11, 2021
Related Publication 20230386463A1 · Nov 30, 2023
References Cited (34)
US 6334103B1 · Surace · 2001 [cited by examiner]
US 6741963B1 · Badt et al. · 2004 [cited by applicant]
US 7212969B1 · Bennett · 2007 [cited by examiner]
US 8326634B2 · Di Cristo et al. · 2012 [cited by applicant]
US 9002835B2 · Sharifi · 2015 [cited by applicant]
US 9116962B1 · Pance · 2015 [cited by applicant]
US 9361885B2 · Ganong, III et al. · 2016 [cited by applicant]
US 9786279B2 · Sharifi et al. · 2017 [cited by applicant]
US 9947333B1 · David · 2018 [cited by examiner]
US 10284695B1 · Gejji · 2019 [cited by examiner]
US 10380208B1 · Brahmbhatt et al. · 2019 [cited by applicant]
US 11114089B2 · Chapman · 2021 [cited by examiner]
US 11741954B2 · Patage · 2023 [cited by examiner]
US 20070050191A1 · Weider · 2007 [cited by examiner]
US 20130173519A1 · Antebi · 2013 [cited by examiner]
US 20150162000A1 · Di Censo et al. · 2015 [cited by applicant]
US 20180233139A1 · Finkelstein · 2018 [cited by examiner]
US 20190066670A1 · White · 2019 [cited by examiner]
US 20190385600A1 · Kim · 2019 [cited by applicant]
US 20200074993A1 · Lee et al. · 2020 [cited by applicant]
US 20210125610A1 · Cheung et al. · 2021 [cited by applicant]
CN 105009203A · 2015 [cited by applicant]
CN 105355201A · 2016 [cited by applicant]
CN 108257596A · 2018 [cited by applicant]
JP 3697177B2 · 2005 [cited by applicant]
KR 1020050005604A · 2005 [cited by applicant]
KR 1020110017559A · 2011 [cited by applicant]
KR 1020180071931A · 2018 [cited by applicant]
WO 2014159581A1 · 2014 [cited by applicant]
WO 2019172946A1 · 2019 [cited by applicant]
International Search Report dated May 25, 2021 issued by the International Searching Authority in International Application No. PCT/KR2021/001848 (PCT/ISA/210). [cited by applicant]
Office Action issued in parent U.S. Appl. No. 17/173,878 mailed Nov. 22, 2022. [cited by applicant]
Notice of Allowance issued in parent U.S. Appl. No. 17/173,878 mailed Apr. 5, 2023. [cited by applicant]
Office Action dated Oct. 26, 2021, issued by the Indian Patent Office in Indian Patent Application No. 202041006037. [cited by applicant]