IP Library Granted Patent US 11,704,900
Granted Patent B2
US 11,704,900 · App. 17/666,439 · Granted Jul 18, 2023

Predictive injection of conversation fillers for assistant systems

Inventors: Emmanouil Koukoumidis (Kirkland, WA); Michael Robert Hanson (Los Altos, CA); Mohsen M Agsen (Honolulu, HI)
Assignee: Meta Platforms, Inc.
G06V10/82G06F3/011G06F3/013G06F3/017G06F3/167G06F7/14G06F9/453G06F16/176G06F16/2255G06F16/2365G06F16/243G06F16/248G06F16/24552G06F16/24575G06F16/24578G06F16/338G06F16/3323G06F16/3329G06F16/3344G06F16/904G06F16/9038G06F16/90332G06F16/90335G06F16/951G06F16/9535G06F18/2411G06F40/205G06F40/295G06F40/30G06F40/40G06N3/006G06N3/08G06N7/01G06N20/00G06Q50/01G06V10/764G06V20/10G06V40/28G10L15/02G10L15/063G10L15/07G10L15/16G10L15/183G10L15/187G10L15/1815G10L15/1822G10L15/22G10L15/26G10L17/06G10L17/22H04L12/2816H04L41/20H04L41/22H04L43/0882H04L43/0894H04L51/02H04L51/18H04L51/216H04L51/52H04L67/306H04L67/535H04L67/5651H04L67/75H04W12/08G06F2216/13G10L13/00G10L13/04G10L2015/223G10L2015/225H04L51/046H04L67/10H04L67/53
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,704,900
App. No.
17/666,439
Granted
Jul 18, 2023
Kind
B2
Abstract

In one embodiment, a method includes, by a client system, receiving, at the client system, a first user input, processing by the client system, the first user input to provide an initial response by identifying one or more entities referenced by the first user input and providing, by the client system, the initial response, where the initial response includes a conversational filler referencing at least one of the one or more identified entities, processing the first user input to provide a complete response by identifying, by the client system, one or more intents and one or more slots associated with the first user input based on a semantic analysis by a natural-language understanding module, and providing, by the client system, the complete response subsequent to the initial response, where the complete response is based on the one or more intents and the one or more slots.

Claims (55)

1. A method comprising, by a client system:

receiving, at the client system, a first user input;

processing, by the client system, the first user input to provide an initial response by:

identifying one or more entities referenced by the first user input; and

providing, by the client system, the initial response, wherein the initial response comprises a conversational filler referencing at least one of the one or more identified entities;

processing the first user input to provide a complete response by:

identifying, by the client system, one or more intents and one or more slots associated with the first user input based on a semantic analysis by a natural-language understanding module; and

providing, by the client system, the complete response subsequent to the initial response, wherein the complete response is based on the one or more intents and the one or more slots.

2. The method of claim 1 , further comprising:

determining a classification of the first user input based on a machine-learning classifier model;

generating a plurality of candidate conversational fillers based on the classification of the first user input and the one or more identified entities, wherein each candidate conversational filler references at least one of the one or more identified entities; and

prior to providing the initial response, selecting the conversational filler from the plurality of candidate conversational fillers.

3. The method of claim 2 , wherein the candidate conversational fillers are based on conversational filler templates stored in a database of conversational filler templates, and wherein the conversational filler templates are pre-generated filler templates.

4. The method of claim 2 , wherein the candidate conversational fillers are based on conversational filler templates stored in a database of conversational filler templates, wherein the filler templates are based on content extracted from comments associated with a plurality of entities.

5. The method of claim 4 , wherein generating the plurality of candidate conversational fillers comprises selecting one or more general comments associated with the one or more identified entities from the database of general comments.

6. The method of claim 2 , wherein the classification of the first user input comprises one or more of an opinion query, a fact-based query, or a command query.

7. The method of claim 2 , wherein the classification is determined from a plurality of classifications, and wherein each classification of the plurality of classifications is associated with a set of n-grams relevant to the respective classification, wherein the first user input comprises one or more n-grams, and wherein the classification of the first user input is further based on a comparison between the one or more n-grams of the first user input to the sets of n-grams associated with the plurality of classifications.

8. The method of claim 2 , further comprising:

ranking, by the one or more computing systems, the candidate conversational fillers based on a relevancy of the candidate conversational filler to the first user input and a recency of previously used candidate conversational fillers,

wherein ranking of the candidate conversational fillers is further based on a user profile of the first user, wherein a language register associated with the first user is stored in the user profile of the first user, and wherein the ranking of the candidate conversational fillers is further based on which candidate conversational fillers match the language register associated with the first user.

9. The method of claim 2 , further comprising:

identifying a query associated with the first user input responsive to receiving the first user input; and

determining a time period to process the first user input based on the query associated with the first user input.

10. The method of claim 9 , further comprising:

ranking, by the one or more computing systems, the candidate conversational fillers based on a relevancy of the candidate conversational filler to the first user input and a recency of previously used candidate conversational fillers,

wherein ranking of each of the candidate conversational fillers is further based on a comparison between the time period to process the query and a time period to respond with the respective candidate filler.

11. The method of claim 9 , further comprising:

identifying one or more search results corresponding to the query; and

generating the complete response based on the one or more search results.

12. The method of claim 2 , further comprising:

performing, for each candidate conversational filler, a logical consistency check of the candidate conversational filler with respect to the one or more identified entities.

13. The method of claim 12 , further comprising:

ranking, by the one or more computing systems, the candidate conversational fillers based on a relevancy of the candidate conversational filler to the first user input and a recency of previously used candidate conversational fillers,

wherein ranking the candidate conversational fillers is further based on the logical consistency checks.

14. The method of claim 12 , wherein generating the plurality of candidate conversational fillers comprises filtering one or more candidate conversational fillers based on the logical consistency checks.

15. The method of claim 2 , further comprising:

ranking, by the one or more computing systems, the candidate conversational fillers based on a relevancy of the candidate conversational filler to the first user input and a recency of previously used candidate conversational fillers,

wherein information associated with the recency of previously used candidate conversational fillers provides information associated with a time period of each of the plurality of candidate conversational fillers that have been previously presented as the initial response to the first user.

16. The method of claim 15 , wherein ranking the candidate conversational fillers based on the recency of previously used candidate conversational fillers comprises filtering out one or more candidate conversational fillers that have been previously presented as the initial response to the first user within a threshold time period.

17. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

receive, at a client system, a first user input;

process, by the client system, the first user input to provide an initial response by:

identify one or more entities referenced by the first user input; and

provide, by the client system, the initial response, wherein the initial response comprises a conversational filler referencing at least one of the one or more identified entities;

process the first user input to provide a complete response by:

identify, by the client system, one or more intents and one or more slots associated with the first user input based on a semantic analysis by a natural-language understanding module; and

provide, by the client system, the complete response subsequent to the initial response, wherein the complete response is based on the one or more intents and the one or more slots.

18. A system comprising: one or more processors; and a non-transitory memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:

receive, at a client system, a first user input;

process, by the client system, the first user input to provide an initial response by:

identify one or more entities referenced by the first user input; and

provide, by the client system, the initial response, wherein the initial response comprises a conversational filler referencing at least one of the one or more identified entities;

process the first user input to provide a complete response by:

identify, by the client system, one or more intents and one or more slots associated with the first user input based on a semantic analysis by a natural-language understanding module; and

provide, by the client system, the complete response subsequent to the initial response, wherein the complete response is based on the one or more intents and the one or more slots.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2024
From: KOUKOUMIDIS, EMMANOUIL; HANSON, MICHAEL ROBERT; AGSEN, MOHSEN M.
To: FACEBOOK, INC.
Reel/Frame 066677/0284 →
Cited By (1)
US 12,699,844