IP Library Granted Patent US 12,335,220
Granted Patent B2
US 12,335,220 · App. 18/590,402 · Granted Jun 17, 2025

Techniques for supervising communications from multiple communication modalities

Inventors: John Onusko (Garden Valley, CA); Gopalakrishnan Ramanujam (San Ramon, CA); Jonathan Rudolph (Parsippany, NJ)
Assignee: Actiance, LLC
H04L51/42G06F16/24562H04L51/216H04L51/224H04L51/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,335,220
App. No.
18/590,402
Granted
Jun 17, 2025
Kind
B2
Abstract

Disclosed herein is a computing device and data store for use in the storage and retrieval of communication objects. The computing device can receive a first communication sent using a first communication modality. The computing device can receive a second communication sent using a second communication modality. The computing device can determine that the first communication and the second communication correspond to a single interaction. The computing device can generate a communication object comprising the first communication and the second communication. A structure of the communication object can be consistent across different communication modalities. The computing device can add the communication object to a first queue for review. The computing device can move the communication object to a second queue in response to a first review of the communication object.

Claims (46)

1. A method comprising:

receiving, via one of one or more computing devices, a first communication sent using a first communication modality;

receiving, via one of the one or more computing devices, a second communication sent using a second communication modality;

determining, via one of the one or more computing devices, that the first communication and the second communication correspond to a single interaction;

generating, via one of the one or more computing devices, a communication object comprising the first communication and the second communication, wherein a structure of the communication object is consistent across different communication modalities;

adding, via one of the one or more computing devices, the communication object to a first queue for review; and

in response to a first review of the communication object, moving, via one of the one or more computing devices, the communication object to a second queue.

2. The method of claim 1 , wherein moving the communication object to the second queue comprises escalating the communication object for review by a second reviewer.

3. The method of claim 1 , wherein moving the communication object to the second queue comprises deescalating the communication object for review by a second reviewer.

4. The method of claim 1 , further comprising:

receiving a comment from a first reviewer of the first review; and

storing the comment for review by a second reviewer.

5. The method of claim 1 , wherein the first queue and the second queue correspond to different levels of review.

6. The method of claim 1 , further comprising tracking an escalation history associated with the communication object.

7. A system, comprising:

a data store; and

at least one computing device in communication with the data store, wherein the at least one computing device is configured to:

receive a first communication sent using a first communication modality;

receive a second communication sent using a second communication modality;

determine that the first communication and the second communication correspond to a single interaction;

generate a communication object comprising the first communication and the second communication, wherein a structure of the communication object is consistent across different communication modalities;

add the communication object to a first queue for review; and

in response to a first review of the communication object, move the communication object to a second queue.

8. The system of claim 7 , wherein the at least one computing device is further configured to:

determine that a user selected the communication object from the first queue; and

in response to the user selecting the communication object, show one or more additional communication related to the communication object.

9. The system of claim 7 , wherein the at least one computing device is further configured to: receive an indication that a particular user is responsible for reviewing the communication object in the first queue.

10. The system of claim 7 , wherein the first queue comprises communication objects that are associated with a common attribute.

11. The system of claim 7 , further comprising a plurality of queue levels, wherein the first queue is assigned to a first level of the plurality of queue levels and the second queue is assigned to a second level of the plurality of queue levels.

12. The system of claim 7 , wherein the at least one computing device is further configured to generate a user interface indicating the communication object in the first queue.

13. The system of claim 7 , wherein the at least one computing device is further configured to output a representation of the communication object from the first queue by reconstructing portions of the first communication and the second communication from the single interaction in a viewable form.

14. A non-transitory computer-readable medium embodying a program that, when executed by at least one computing device, causes the at least one computing device to:

receive a first communication sent using a first communication modality;

receive a second communication sent using a second communication modality;

determine that the first communication and the second communication correspond to a single interaction;

generate a communication object comprising the first communication and the second communication, wherein a structure of the communication object is consistent across different communication modalities;

add the communication object to a first queue for review; and

in response to a first review of the communication object, move the communication object to a second queue.

15. The non-transitory computer-readable medium of claim 14 , wherein the program further causes the at least one computing device to generate a user interface indicating the communication object in the second queue.

16. The non-transitory computer-readable medium of claim 14 , wherein the program further causes the at least one computing device to

determine at least one additional communication object based on the communication object; and

add the at least one additional communication object to the first queue.

17. The non-transitory computer-readable medium of claim 14 , wherein the program further causes the at least one computing device to store a comment from a reviewer with the communication object in the first queue.

18. The non-transitory computer-readable medium of claim 14 , wherein the program further causes the at least one computing device to perform a determination to review the communication object based upon a policy file, wherein the communication object is added to the first queue based on the determination.

19. The non-transitory computer-readable medium of claim 14 , wherein moving the communication object to a second queue comprises the program further causing the at least one computing device to add a reference for the communication object to the second queue.

20. The non-transitory computer-readable medium of claim 14 , wherein moving the communication object to a second queue comprises the program further causing the at least one computing device to add a flag to the communication object indicative of a cause of the communication object being moved to the second queue.

Assignments (2)
CHANGE OF NAME Recorded Oct 22, 2025
From: ACTIANCE, INC.
To: ACTIANCE, LLC
Reel/Frame 073169/0762 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2024
From: ONUSKO, JOHN; RAMANUJAM, GOPALAKRISHNAN; RUDOLPH, JONATHAN
To: ACTIANCE, INC.
Reel/Frame 066818/0817 →
Continuity (5)
Continuation 17744111 · May 13, 2022
Continuation 17113681 · Dec 7, 2020
Continuation 15799993 · Oct 31, 2017
Provisional Application 62415461 · Oct 31, 2016
Related Publication 20240205183A1 · Jun 20, 2024
References Cited (84)
US 6564263B1 · Bergman et al. · 2003 [cited by applicant]
US 7058699B1 · Chiou et al. · 2006 [cited by applicant]
US 7143091B2 · Charnock et al. · 2006 [cited by applicant]
US 7761471B1 · Lee et al. · 2010 [cited by applicant]
US 8041675B1 · McCain · 2011 [cited by applicant]
US 8881304B2 · Vrielink et al. · 2014 [cited by applicant]
US 9021027B2 · Patel · 2015 [cited by examiner]
US 9589043B2 · Onusko · 2017 [cited by applicant]
US 20030182310A1 · Charnock et al. · 2003 [cited by applicant]
US 20030188264A1 · Nawathe et al. · 2003 [cited by applicant]
US 20030220917A1 · Copperman et al. · 2003 [cited by applicant]
US 20030229900A1 · Reisman · 2003 [cited by applicant]
US 20040025110A1 · Hu · 2004 [cited by applicant]
US 20040034834A1 · Pirie et al. · 2004 [cited by applicant]
US 20040064430A1 · Klein et al. · 2004 [cited by applicant]
US 20050060220A1 · Beringer · 2005 [cited by applicant]
US 20050193102A1 · Horvitz · 2005 [cited by examiner]
US 20050216503A1 · Charlot et al. · 2005 [cited by applicant]
US 20050278340A1 · Rehberg et al. · 2005 [cited by applicant]
US 20060143034A1 · Rothermel et al. · 2006 [cited by applicant]
US 20070022050A1 · Cornaby et al. · 2007 [cited by applicant]
US 20070150253A1 · Dougherty et al. · 2007 [cited by applicant]
US 20080010629A1 · Berg et al. · 2008 [cited by applicant]
US 20080065471A1 · Reynolds et al. · 2008 [cited by applicant]
US 20080118051A1 · Odinak et al. · 2008 [cited by applicant]
US 20080172446A1 · Donovan · 2008 [cited by examiner]
US 20080195576A1 · Sande et al. · 2008 [cited by applicant]
US 20090254572A1 · Redlich et al. · 2009 [cited by applicant]
US 20090265329A1 · Korupolu et al. · 2009 [cited by applicant]
US 20090287665A1 · Prahlad et al. · 2009 [cited by applicant]
US 20100138756A1 · Saund et al. · 2010 [cited by applicant]
US 20100250497A1 · Redlich et al. · 2010 [cited by applicant]
US 20100257140A1 · Davis et al. · 2010 [cited by applicant]
US 20110010761A1 · Doyle · 2011 [cited by applicant]
US 20110119730A1 · Eldar · 2011 [cited by examiner]
US 20110122866A1 · Vasamsetti et al. · 2011 [cited by applicant]
US 20110184935A1 · Marlin · 2011 [cited by applicant]
US 20110202947A1 · Gupta et al. · 2011 [cited by applicant]
US 20110208816A1 · Chavez · 2011 [cited by applicant]
US 20110302025A1 · Hsiao et al. · 2011 [cited by applicant]
US 20120047483A1 · Amit et al. · 2012 [cited by applicant]
US 20120079099A1 · Dhara et al. · 2012 [cited by applicant]
US 20120197871A1 · Mandel et al. · 2012 [cited by applicant]
US 20120200567A1 · Mandel et al. · 2012 [cited by applicant]
US 20120221638A1 · Edamadaka · 2012 [cited by examiner]
US 20120330869A1 · Durham · 2012 [cited by applicant]
US 20130024492A1 · Graff et al. · 2013 [cited by applicant]
US 20130080547A1 · Levien et al. · 2013 [cited by applicant]
US 20130080961A1 · Levien · 2013 [cited by examiner]
US 20130132886A1 · Mangini · 2013 [cited by examiner]
US 20130173284A1 · Hyde et al. · 2013 [cited by applicant]
US 20130173305A1 · Hyde et al. · 2013 [cited by applicant]
US 20130179188A1 · Hyde et al. · 2013 [cited by applicant]
US 20130203038A1 · Kumar et al. · 2013 [cited by applicant]
US 20130254226A1 · Read · 2013 [cited by applicant]
US 20130262420A1 · Edelstein et al. · 2013 [cited by applicant]
US 20130331071A1 · Statler et al. · 2013 [cited by applicant]
US 20140032500A1 · Wibbeler et al. · 2014 [cited by applicant]
US 20140040264A1 · Varadan et al. · 2014 [cited by applicant]
US 20140100128A1 · Narain et al. · 2014 [cited by applicant]
US 20140113548A1 · Camulli · 2014 [cited by examiner]
US 20140143018A1 · Nies et al. · 2014 [cited by applicant]
US 20140214524A1 · Senaratna et al. · 2014 [cited by applicant]
US 20140278663A1 · Samuel et al. · 2014 [cited by applicant]
US 20140279588A1 · Fitzgerald et al. · 2014 [cited by applicant]
US 20140343973A1 · Ruszala et al. · 2014 [cited by applicant]
US 20150012490A1 · Forsythe · 2015 [cited by applicant]
US 20150033139A1 · Thiel · 2015 [cited by examiner]
US 20150039565A1 · Lucas · 2015 [cited by applicant]
US 20150046565A1 · Otus et al. · 2015 [cited by applicant]
US 20150046989A1 · Oberheide et al. · 2015 [cited by applicant]
US 20150074579A1 · Gladstone et al. · 2015 [cited by applicant]
US 20150081579A1 · Brown · 2015 [cited by examiner]
US 20150205770A1 · Shershevsky et al. · 2015 [cited by applicant]
US 20150271188A1 · Call · 2015 [cited by applicant]
US 20150339370A1 · Onusko et al. · 2015 [cited by applicant]
US 20160050565A1 · Benoit et al. · 2016 [cited by applicant]
US 20160100531A1 · Ascherman · 2016 [cited by applicant]
US 20160110284A1 · Athalye et al. · 2016 [cited by applicant]
US 20160219084A1 · Abiezzi · 2016 [cited by applicant]
US 20190306094A1 · Liu et al. · 2019 [cited by applicant]
Bunt H., et al., “Fusion and Coordination for Multimodal Interactive Information Presentation,” Roadmap, Architecture, Tools, Semantics, Multimodal Intelligent Information Presentation, Kluwer Academic Publishers, Print… [cited by applicant]
Mekhaldi D., “Multimodal Document Alignment: Towards a Fully-Indexed Multimedia Archive,” SIGIR'07, Amsterdam, The Netherlands, Copyright 2007 ACM—Multimedia Information Retrieval Workshop, rgcl.wlv.ac.uk, Jul. 23-27, 2… [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/744,111, mailed Jan. 10, 2024, 10 Pages. [cited by applicant]