IP Library Granted Patent US 12,204,867
Granted Patent B2
US 12,204,867 · App. 17/655,875 · Granted Jan 21, 2025

Process mining asynchronous support conversation using attributed directly follows graphing

Inventors: Sampath Dechu (Bangalore, IN); Monika Gupta (Gurugram, IN); Prerna Agarwal (New Delhi, IN); Renuka Sindhgatta Rajan (Bengaluru, IN); Naveen Eravimangalath Purushothaman (Thrissur, IN)
Assignee: International Business Machines Corporation
G06F40/35G06F16/65G06F40/117G06F40/166G06F40/279
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,204,867
App. No.
17/655,875
Granted
Jan 21, 2025
Kind
B2
Abstract

Provided is a computer-implemented method, system, and computer program product for process mining asynchronous support conversations using attributed directly follows graphing. A processor may collect a plurality of conversation threads from an asynchronous data stream. The processor may label each utterance of a plurality of utterances from the plurality of conversation threads with an event label. The processor may analyze the event label for each utterance of the plurality of utterances. The processor may generate, based on the analyzing of the event label for each utterance, an attributed directly follows graph (DFG).

Claims (69)

1. A computer-implemented method comprising:

collecting a plurality of conversation threads related to a task from an asynchronous data stream;

labeling each utterance of a plurality of utterances from the plurality of conversation threads with an event label;

analyzing the event labels for each utterance of the plurality of utterances;

generating, based on the analyzing, an attributed directly follows graph (DFG), wherein the DFG transforms the plurality of conversation threads into domain-specific, attributed-activity trace instances with rationalized edges and nodes, and wherein the DFG includes a minimized edge and node frequency based on an edge/node rationalization;

identifying a cause of a process bottleneck or task failure in one or more digital assistants based on the attributed DFG; and

modifying one or more algorithms in the one or more digital assistants that resolve the cause; and

completing the task using the one or more modified algorithms in the one or more digital assistants.

2. The computer-implemented method of claim 1 , wherein analyzing the event labels for each utterance of the plurality of utterances further comprises:

generating, for each thread of the plurality of conversation threads, a role-specific ordered list of users within the thread; and

classifying each utterance of the plurality utterances that are associated with each user of each thread to identify a type of utterance.

3. The computer-implemented method of claim 2 , wherein classifying each utterance of the plurality of utterances that are associated with each user to identify the type of utterance comprises:

classifying a given utterance of the plurality of utterances as the type selected from a group of utterance types consisting of an acknowledgement, a status query, an information query, an action, and a handover.

4. The computer-implemented method of claim 3 , further comprising:

filtering one or more utterances that failed to be classified.

5. The computer-implemented method of claim 2 , further comprising:

merging two or more utterances of the plurality of utterances that have a temporal proximity from a same user within the thread.

6. The computer-implemented method of claim 2 , further comprising:

marking, based on the event labels, a classification transition beyond a time proximity threshold as a turn boundary in a conversation thread.

7. The computer-implemented method of claim 1 , further comprising:

analyzing the attributed DFG to identify one or more incomplete conversations within the plurality of conversation threads; and

identifying, based on the analyzing, a digital assistant has failed to complete a task associated with a conversation thread.

8. The computer-implemented method of claim 7 , further comprising:

evaluating the digital assistant that has failed to complete the task; and

updating the digital assistant in order to complete the task.

9. A system comprising:

a processor; and

a computer-readable storage medium communicatively coupled to the processor and storing program instructions which, when executed by the processor, cause the processor to perform a method comprising:

collecting a plurality of conversation threads related to a task from an asynchronous data stream;

labeling each utterance of a plurality of utterances from the plurality of conversation threads with an event label;

analyzing the event labels for each utterance of the plurality of utterances;

generating, based on the analyzing, an attributed directly follows graph (DFG), wherein the DFG transforms the plurality of conversation threads into domain-specific, attributed-activity trace instances with rationalized edges and nodes, and wherein the DFG includes a minimized edge and node frequency based on an edge/node rationalization;

identifying a cause of a process bottleneck or task failure in one or more digital assistants based on the attributed DFG; and

modifying one or more algorithms in the one or more digital assistants that resolve the cause; and

completing the task using the one or more modified algorithms in the one or more digital assistants.

10. The system of claim 9 , wherein analyzing the event labels for each utterance of the plurality of utterances:

generating, for each thread of the plurality of conversation threads, a role-specific ordered list of users within the thread; and

classifying each utterance of the plurality utterances that are associated with each user of each thread to identify a type of utterance.

11. The system of claim 10 , wherein classifying each utterance of the plurality of utterances that are associated with each user to identify the type of utterance comprises:

classifying a given utterance of the plurality of utterances as the type selected from a group of utterance types consisting of an acknowledgement, a status query, an information query, an action, and a handover.

12. The system of claim 11 , wherein the method performed by the processor further comprises:

filtering one or more utterances that failed to be classified.

13. The system of claim 10 , wherein the method performed by the processor further comprises:

merging two or more utterances of the plurality of utterances that have a temporal proximity from a same user within the thread.

14. The system of claim 9 , wherein the method performed by the processor further comprises:

analyzing the attributed DFG to identify one or more incomplete conversations within the plurality of conversation threads; and

identifying, based on the analyzing, a digital assistant has failed to complete a task associated with a conversation thread.

15. A computer program product comprising a computer-readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform a method comprising:

collecting a plurality of conversation threads related to a task from an asynchronous data stream;

labeling each utterance of a plurality of utterances from the plurality of conversation threads with an event label;

analyzing the event labels for each utterance of the plurality of utterances;

generating, based on the analyzing, an attributed directly follows graph (DFG), wherein the DFG transforms the plurality of conversation threads into domain-specific, attributed-activity trace instances with rationalized edges and nodes, and wherein the DFG includes a minimized edge and node frequency based on an edge/node rationalization;

identifying a cause of a process bottleneck or task failure in one or more digital assistants based on the attributed DFG; and

modifying one or more algorithms in the one or more digital assistants that resolve the cause; and

completing the task using the one or more modified algorithms in the one or more digital assistants.

16. The computer program product of claim 15 , wherein analyzing the event labels for each utterance of the plurality of utterances:

generating, for each thread of the plurality of conversation threads, a role-specific ordered list of users within the thread; and

classifying each utterance of the plurality utterances that are associated with each user of each thread to identify a type of utterance.

17. The computer program product of claim 16 , wherein the method performed by the processor further comprises:

classifying a given utterance of the plurality of utterances as the type selected from a group of utterance types consisting of an acknowledgement, a status query, an information query, an action, and a handover; and

filtering one or more utterances that failed to be classified.

18. The computer program product of claim 15 , wherein the method performed by the processor further comprises:

merging two or more utterances of the plurality of utterances that have a temporal proximity from a same user within the thread.

19. The computer program product of claim 15 , wherein the method performed by the processor further comprises:

analyzing the attributed DFG to identify one or more incomplete conversations within the plurality of conversation threads; and

identifying, based on the analyzing, a digital assistant has failed to complete a task associated with a conversation thread.

20. The computer program product of claim 19 , wherein the method performed by the processor further comprises:

evaluating the digital assistant that has failed to complete the task; and

updating the digital assistant in order to complete the task.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2022
From: DECHU, SAMPATH; GUPTA, MONIKA; AGARWAL, PRERNA; SINDHGATTA RAJAN, RENUKA; ERAVIMANGALATH PURUSHOTHAMAN, NAVEEN
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 059341/0439 →
Continuity (1)
Related Publication 20230306204A1 · Sep 28, 2023
References Cited (14)
US 11056107B2 · Nahamoo · 2021 [cited by examiner]
US 11081110B2 · Kwak · 2021 [cited by examiner]
US 11151578B2 · Amittai · 2021 [cited by examiner]
US 11501776B2 · Wei · 2022 [cited by examiner]
US 20130211880A1 · Kannan et al. · 2013 [cited by applicant]
US 20200193094A1 · Topol · 2020 [cited by applicant]
US 20210374356A1 · He · 2021 [cited by examiner]
US 20230126821A1 · Gao · 2023 [cited by examiner]
WO 2020219203A1 · 2020 [cited by applicant]
Svitlana Vakulenko, Kate Revoredo, Claudio Di Ciccio, Maarten de Rijke, QRFQ: A Data-driven model of Information-seeking dialogues, arXiv: 1812.10720v1 [cs.IR] Dec. 27, 2018 (Year: 2018). [cited by examiner]
G. Alan Wang, Harry Jiannan Wang, Jiexun Li, Weiguo Fan, Mining Knowledge Sharing Processes in online Discussion Forums, IEEE, 2014, pp. 3898-3907 (Year: 2014). [cited by examiner]
Jalali, A. “Graph-based process mining,” https://arxiv.org/abs/2007.09352, Jul. 18, 2020, 14 pgs. [cited by applicant]
Legg, et al., “Visual analytics for collaborative human-machine confidence in human-centric active learning tasks,” https://hcis-journal.springeropen.com/articles/10.1186/s13673-019-0167-8, Hum. Cent. Comput. Inf. Sci. … [cited by applicant]
Mell et al., “The NIST Definition of Cloud Computing,” Recommendations of the National Institute of Standards and Technology, U.S. Department of Commerce, Special Publication 800-145, Sep. 2011, 7 pgs. [cited by applicant]