IP Library Granted Patent US 11,263,407
Granted Patent B1
US 11,263,407 · App. 17/246,495 · Granted Mar 1, 2022

Determining topics and action items from conversations

Inventors: Toshish Arun Jawale (Seattle, WA); Ansup Babu (Balangir, IN); Sekhar Vallath (Pune, IN)
Assignee: Rammer Technologies, Inc.
G06F40/35G06F3/0481G06F3/04842G06F40/166G06F40/253G06F40/268G06F40/279G06F40/289G06N5/04G06N20/00G10L15/1815G10L15/22G10L15/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,263,407
App. No.
17/246,495
Granted
Mar 1, 2022
Kind
B1
Abstract

Embodiments are directed to organizing conversation information. Two or more machine learning (ML) models and a plurality of sentences provided from a conversation may be employed to generate insight scores for each sentence such that each insight score correlates to a probability that its sentence includes one or more of an action or a question. In response to one or more sentences having insight scores that exceed a threshold value an information score and a definiteness score may be determined for the one or more sentences. And one or more insights associated with the conversation may be generated based on the one or more sentences. A report may be generated that associates the one or more insights with one or more portions of the conversation that include the one or more sentences that are associated with the insights.

Claims (118)

1. A method for organizing conversation information over a network using one or more network computers that include one or more processors to perform actions, comprising:

employing two or more machine learning (ML) models and a plurality of sentences provided from a conversation to generate an insight score for each of the plurality of sentences, wherein each insight score is based on two or more partial insight scores that each correspond to an ML model, and wherein each insight score correlates to a probability that its sentence includes one or more of an action or a question;

in response to one or more of the plurality of sentences being associated with one or more insight scores that exceed a threshold value, performing further actions, including:

determining an information score for each of the one or more of the plurality of sentences based on a number of included object words, a number of included subject words, a number of included insight words, and one or more included grammatical features;

determining a definiteness score for each of the one or more of the plurality of sentences based on decision-making words included in the one or more of the plurality of sentences, wherein each sentence that includes an amount of words associated with conclusive decision-making words are scored higher than each other sentence that includes another amount of words associated with conclusive decision-making words that is less than the amount of words associated with conclusive decision-making words;

generating one or more insights associated with the conversation based on the one or more of the plurality of sentences, the determined information score for each of the one or more of the plurality of sentences, and the determined definiteness score for each of the one or more of the plurality of sentences; and

generating a report that associates the one or more insights with one or more portions of the conversation that include the one or more of the plurality of sentences and that are associated with the one or more insights.

2. The method of claim 1 , further comprising:

determining the two or more ML models based on one or more of locale information, subject matter of the conversation, or user preferences, wherein each ML model is paired with an adversarial ML model.

3. The method of claim 1 , further comprising:

determining one or more dominant portions of the conversation based on a conversation digest that corresponds to the conversation;

determining one or more key subjects that respectively correspond to each of the one or more dominant portions of the conversation, wherein each of the one or more key subjects is a dominant subject in a respective dominant portion of the conversation; and

generating one or more topics of the conversation based on the one or more key subjects.

4. The method of claim 1 , wherein generating the one or more insights further comprises:

determining one or more action insights that include one or more of an open action item, an unclaimed action item, a closed action item, a follow-up, a task, an idea, or an appointment; and

determining one or more question insights that include one or more of an unanswered question, an answered question, or a request.

5. The method of claim 1 , wherein generating the one or more insights further comprises:

determining one or more insight models based on the conversation, wherein each insight model defines a set of one or more rules for generating the one or more insights;

executing each set of one or more rules to identify one or more words that are included in the one or more of the plurality of sentences and that are associated with one or more actions or one or more questions;

modifying the one or more identified words by one or more of removing a superfluous word, correcting grammar, or correcting punctuation; and

generating the one or more insights based on the modified one or more identified words.

6. The method of claim 1 , wherein generating the report further comprises:

generating, based on the one or more insights, one or more of a task, an appointment, a reminder, or a notification;

providing the one or more of the task, the appointment, the reminder, or the notification to one or more external calendar services.

7. The method of claim 1 , wherein generating the report further comprises:

generating a user interface that displays an interactive outline of the conversation, wherein one or more descriptions or one or more labels associated with the one or more insights are displayed as one or more outline headings; and

in response to a user selecting one or more of the one or more outline headings, displaying one or more portions of the conversation that are associated with one or more insights that are associated with the selected one or more outline headings.

8. A system for organizing conversation information over a network, comprising:

a network computer, comprising:

a memory that stores at least instructions; and

one or more processors that are configured to execute instructions to perform actions, wherein the actions include:

employing two or more machine learning (ML) models and a plurality of sentences provided from a conversation to generate an insight score for each of the plurality of sentences, wherein each insight score is based on two or more partial insight scores that each correspond to an ML model, and wherein each insight score correlates to a probability that its sentence includes one or more of an action or a question;

in response to one or more of the plurality of sentences being associated with one or more insight scores that exceed a threshold value, performing further actions, including:

determining an information score for each of the one or more of the plurality of sentences based on a number of included object words, a number of included subject words, a number of included insight words, and one or more included grammatical features;

determining a definiteness score for each of the one or more of the plurality of sentences based on decision-making words included in the one or more of the plurality of sentences, wherein each sentence that includes an amount of words associated with conclusive decision-making words are scored higher than each other sentence that includes another amount of words associated with conclusive decision-making words that is less than the amount of words associated with conclusive decision-making words;

generating one or more insights associated with the conversation based on the one or more of the plurality of sentences, the determined information score for each of the one or more of the plurality of sentences, and the determined definiteness score for each of the one or more of the plurality of sentences; and

generating a report that associates the one or more insights with one or more portions of the conversation that include the one or more of the plurality of sentences and that are associated with the one or more insights; and

a client computer, comprising:

another memory that stores at least instructions; and

one or more other processors that are configured to execute instructions to perform other actions, wherein the other actions include:

providing the plurality of sentences to the network computer; and

displaying the report.

9. The system of claim 8 , wherein the one or more processors of the network computer are further configured to execute instructions to perform at least one additional action, wherein the at least one additional action includes:

determining the two or more ML models based on one or more of locale information, subject matter of the conversation, or user preferences, wherein each ML model is paired with an adversarial ML model.

10. The system of claim 8 , wherein the one or more processors of the network computer are further configured to execute instructions to perform additional actions, wherein the additional actions include:

determining one or more dominant portions of the conversation based on a conversation digest that corresponds to the conversation;

determining one or more key subjects that respectively correspond to each of the one or more dominant portions of the conversation, wherein each of the one or more key subjects is a dominant subject in a respective dominant portion of the conversation; and

generating one or more topics of the conversation based on the one or more key subjects.

11. The system of claim 8 , wherein generating the one or more insights further comprises:

determining one or more action insights that include one or more of an open action item, an unclaimed action item, a closed action item, a follow-up, a task, an idea, or an appointment; and

determining one or more question insights that include one or more of an unanswered question, an answered question, or a request.

12. The system of claim 8 , wherein generating the one or more insights further comprises:

determining one or more insight models based on the conversation, wherein each insight model defines a set of one or more rules for generating the one or more insights;

executing each set of one or more rules to identify one or more words that are included in the one or more of the plurality of sentences and that are associated with one or more actions or one or more questions;

modifying the one or more identified words by one or more of removing a superfluous word, correcting grammar, or correcting punctuation; and

generating the one or more insights based on the modified one or more identified words.

13. The system of claim 8 , wherein generating the report further comprises:

generating, based on the one or more insights, one or more of a task, an appointment, a reminder, or a notification;

providing the one or more of the task, the appointment, the reminder, or the notification to one or more external calendar services.

14. The system of claim 8 , wherein generating the report further comprises:

generating a user interface that displays an interactive outline of the conversation, wherein one or more descriptions or one or more labels associated with the one or more insights are displayed as one or more outline headings; and

in response to a user selecting one or more of the one or more outline headings, displaying one or more portions of the conversation that are associated with one or more insights that are associated with the selected one or more outline headings.

15. A processor readable non-transitory storage medium that includes instructions for organizing conversation information over a network, wherein execution of the instructions by one or more hardware processors causes actions to be performed, wherein the actions comprise:

employing two or more machine learning (ML) models and a plurality of sentences provided from a conversation to generate an insight score for each of the plurality of sentences, wherein each insight score is based on two or more partial insight scores that each correspond to an ML model, and wherein each insight score correlates to a probability that its sentence includes one or more of an action or a question;

in response to one or more of the plurality of sentences being associated with one or more insight scores that exceed a threshold value, performing further actions, including:

determining an information score for each of the one or more of the plurality of sentences based on a number of included object words, a number of included subject words, a number of included insight words, and one or more included grammatical features;

determining a definiteness score for each of the one or more of the plurality of sentences based on decision-making words included in the one or more of the plurality of sentences, wherein each sentence that includes an amount of words associated with conclusive decision-making words are scored higher than each other sentence that includes another amount of words associated with conclusive decision-making words that is less than the amount of words associated with conclusive decision-making words;

generating one or more insights associated with the conversation based on the one or more of the plurality of sentences, the determined information score for each of the one or more of the plurality of sentences, and the determined definiteness score for each of the one or more of the plurality of sentences; and

generating a report that associates the one or more insights with one or more portions of the conversation that include the one or more of the plurality of sentences and that are associated with the one or more insights.

16. The medium of claim 15 , wherein execution of the instructions by the one or more hardware processors causes at least one additional action to be performed, wherein the at least one additional action includes:

determining the two or more ML models based on one or more of locale information, subject matter of the conversation, or user preferences, wherein each ML model is paired with an adversarial ML model.

17. The medium of claim 15 , wherein execution of the instructions by the one or more hardware processors causes additional actions to be performed, wherein the additional actions include:

determining one or more dominant portions of the conversation based on a conversation digest that corresponds to the conversation;

determining one or more key subjects that respectively correspond to each of the one or more dominant portions of the conversation, wherein each of the one or more key subjects is a dominant subject in a respective dominant portion of the conversation; and

generating one or more topics of the conversation based on the one or more key subjects.

18. The medium of claim 15 , wherein generating the one or more insights further comprises:

determining one or more action insights that include one or more of an open action item, an unclaimed action item, a closed action item, a follow-up, a task, an idea, or an appointment; and

determining one or more question insights that include one or more of an unanswered question, an answered question, or a request.

19. The medium of claim 15 , wherein generating the one or more insights further comprises:

determining one or more insight models based on the conversation, wherein each insight model defines a set of one or more rules for generating the one or more insights;

executing each set of one or more rules to identify one or more words that are included in the one or more of the plurality of sentences and that are associated with one or more actions or one or more questions;

modifying the one or more identified words by one or more of removing a superfluous word, correcting grammar, or correcting punctuation; and

generating the one or more insights based on the modified one or more identified words.

20. The medium of claim 15 , wherein generating the report further comprises:

generating, based on the one or more insights, one or more of a task, an appointment, a reminder, or a notification;

providing the one or more of the task, the appointment, the reminder, or the notification to one or more external calendar services.

21. The medium of claim 15 , wherein generating the report further comprises:

generating a user interface that displays an interactive outline of the conversation, wherein one or more descriptions or one or more labels associated with the one or more insights are displayed as one or more outline headings; and

in response to a user selecting one or more of the one or more outline headings, displaying one or more portions of the conversation that are associated with one or more insights that are associated with the selected one or more outline headings.

22. A network computer for organizing conversation information over a network, comprising:

a memory that stores at least instructions; and

one or more processors that are configured to execute instructions to perform actions, wherein the actions include:

employing two or more machine learning (ML) models and a plurality of sentences provided from a conversation to generate an insight score for each of the plurality of sentences, wherein each insight score is based on two or more partial insight scores that each correspond to an ML model, and wherein each insight score correlates to a probability that its sentence includes one or more of an action or a question;

in response to one or more of the plurality of sentences being associated with one or more insight scores that exceed a threshold value, performing further actions, including:

determining an information score for each of the one or more of the plurality of sentences based on a number of included object words, a number of included subject words, a number of included insight words, and one or more included grammatical features;

determining a definiteness score for each of the one or more of the plurality of sentences based on decision-making words included in the one or more of the plurality of sentences, wherein each sentence that includes an amount of words associated with conclusive decision-making words are scored higher than each other sentence that includes another amount of words associated with conclusive decision-making words that is less than the amount of words associated with conclusive decision-making words;

generating one or more insights associated with the conversation based on the one or more of the plurality of sentences, the determined information score for each of the one or more of the plurality of sentences, and the determined definiteness score for each of the one or more of the plurality of sentences; and

generating a report that associates the one or more insights with one or more portions of the conversation that include the one or more of the plurality of sentences and that are associated with the one or more insights.

23. The network computer of claim 22 , wherein the one or more processors execute the instructions to perform at least one additional action, wherein the at least one additional action includes:

determining the two or more ML models based on one or more of locale information, subject matter of the conversation, or user preferences, wherein each ML model is paired with an adversarial ML model.

24. The network computer of claim 22 , wherein the one or more processors execute the instructions to perform additional actions, wherein the additional actions include:

determining one or more dominant portions of the conversation based on a conversation digest that corresponds to the conversation;

determining one or more key subjects that respectively correspond to each of the one or more dominant portions of the conversation, wherein each of the one or more key subjects is a dominant subject in a respective dominant portion of the conversation; and

generating one or more topics of the conversation based on the one or more key subjects.

25. The network computer of claim 22 , wherein generating the one or more insights further comprises:

determining one or more action insights that include one or more of an open action item, an unclaimed action item, a closed action item, a follow-up, a task, an idea, or an appointment; and

determining one or more question insights that include one or more of an unanswered question, an answered question, or a request.

26. The network computer of claim 22 , wherein generating the one or more insights further comprises:

determining one or more insight models based on the conversation, wherein each insight model defines a set of one or more rules for generating the one or more insights;

executing each set of one or more rules to identify one or more words that are included in the one or more of the plurality of sentences and that are associated with one or more actions or one or more questions;

modifying the one or more identified words by one or more of removing a superfluous word, correcting grammar, or correcting punctuation; and

generating the one or more insights based on the modified one or more identified words.

27. The network computer of claim 22 , wherein generating the report further comprises:

generating, based on the one or more insights, one or more of a task, an appointment, a reminder, or a notification;

providing the one or more of the task, the appointment, the reminder, or the notification to one or more external calendar services.

28. The network computer of claim 22 , wherein generating the report further comprises:

generating a user interface that displays an interactive outline of the conversation, wherein one or more descriptions or one or more labels associated with the one or more insights are displayed as one or more outline headings; and

in response to a user selecting one or more of the one or more outline headings, displaying one or more portions of the conversation that are associated with one or more insights that are associated with the selected one or more outline headings.

Assignments (6)
RELEASE OF SECURITY INTEREST Recorded Oct 31, 2025
From: FIRST-CITIZENS BANK & TRUST COMPANY
To: RAMMER TECHNOLOGIES, INC.
Reel/Frame 072752/0079 →
NUNC PRO TUNC ASSIGNMENT Recorded Jul 8, 2025
From: RAMMER TECHNOLOGIES, INC.
To: INVOCA, INC.
Reel/Frame 071629/0933 →
SECURITY INTEREST Recorded Aug 19, 2024
From: RAMMER TECHNOLOGIES, INC.
To: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 068328/0499 →
SECURITY INTEREST Recorded Jun 7, 2024
From: RAMMER TECHNOLOGIES, INC.
To: SILICON VALLEY BANK, A DIVISION OF FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 067650/0542 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SECOND ASSIGNOR'S LAST NAME PREVIOUSLY RECORDED AT REEL: 056104 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT . Recorded May 7, 2021
From: JAWALE, TOSHISH ARUN; BABU, ANSUP; VALLATH, SEKHAR
To: RAMMER TECHNOLOGIES, INC.
Reel/Frame 056179/0485 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: JAWALE, TOSHISH ARUN; ANSUP, ANSUP; VALLATH, SEKHAR
To: RAMMER TECHNOLOGIES, INC.
Reel/Frame 056104/0554 →
Continuity (1)
Provisional Application 63073317 · Sep 1, 2020
Cited By (4)
US 12,355,827 US 12,407,637 US 12,526,366 US 12,718,435