IP Library Granted Patent US 12,288,088
Granted Patent B2
US 12,288,088 · App. 18/662,677 · Granted Apr 29, 2025

Systems and methods for automated process discovery

Inventors: George Peter Nychis (Somerville, MA); Abdul Qadir (Bangalore, IN); Aakash Hasija (Delhi, IN); Rohan Narayana Murty (Bangalore, IN); Arjun Narayanaswamy (Bangalore, IN); Kirby Scott Files (Milton, MA); Vageesh Hoskere (Bangalore, IN)
Assignee: Soroco India Private Limited
G06F9/453
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,288,088
App. No.
18/662,677
Granted
Apr 29, 2025
Kind
B2
Abstract

A method, comprising: receiving, by a computing device, a user indication to start a teaching mode in which the user can teach an instance of a process; configuring the computing device to start the teaching mode in response to receiving the indication; capturing, when in the teaching mode, first information corresponding to a first stream of events captured by the computing device during performance of a first plurality of actions by the user when interacting with the computing device to perform the process; generating, using the first information, a first visualization of at least some of the first plurality of actions; and displaying the first visualization on a graphical user interface of the computing device.

Claims (50)

1. A method of analyzing process discovery results associated with a process that was performed by a user of a computing device, the method comprising:

accessing a stored signature for the process, the stored signature generated based on a plurality of instances of the process taught in a teaching mode;

capturing a first stream of events during performance of a first plurality of actions by the user of the computing device;

discovering, using the stored signature, the process in the first stream of events captured during performance of the first plurality of actions by the user, to obtain process discovery results, the discovering comprising determining a similarity between the stored signature and a subset of events in the first stream of events; and

generating a graphical user interface for displaying the process discovery results, the generating comprising:

generating a graphical user interface (GUI) including at least some of the process discovery results and one or more GUI elements corresponding to one or more controls for filtering the process discovery results in the GUI; and

displaying the GUI.

2. The method of claim 1 , further comprising:

for each instance of the plurality of instances of the process:

capturing, when in the teaching mode, information corresponding to a respective stream of events captured by the computing device during performance of a respective plurality of actions by the user when interacting with the computing device to perform the process.

3. The method of claim 2 , further comprising:

generating the stored signature for the process in the teaching mode from information captured by the computing device during performance of the process by multiple users.

4. The method of claim 1 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on a matching confidence threshold.

5. The method of claim 4 , further comprising:

setting the matching confidence threshold in response to receiving user selection, via the first GUI element, of the matching confidence threshold; and

filtering the process discovery results to include the process when the determined similarity is above the matching confidence threshold.

6. The method of claim 1 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on a threshold amount of time it takes to complete performance of the process.

7. The method of claim 6 , further comprising:

setting a lower bound for the threshold amount of time in response to receiving user selection, via the GUI element, of the lower bound for the threshold amount of time.

8. The method of claim 6 , further comprising:

setting an upper bound for the threshold amount of time in response to receiving user selection, via the GUI element, of the upper bound for the threshold amount of time.

9. The method of claim 1 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more users performing the process.

10. The method of claim 1 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more applications or universal resource locators (URLs) used when performing the process.

11. The method of claim 1 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more locations where the process is performed.

12. A system comprising:

at least one computing device; and

at least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by the at least one computing device, cause the at least one computing device to perform a method of analyzing process discovery results associated with a process that was performed by a user of the at least one computing device, the method comprising:

accessing a stored signature for the process, the stored signature generated based on a plurality of instances of the process taught in a teaching mode;

capturing a first stream of events during performance of a first plurality of actions by the user of the at least one computing device;

discovering, using the stored signature, the process in the first stream of events captured during performance of the first plurality of actions by the user, to obtain process discovery results, the discovering comprising determining a similarity between the stored signature and a subset of events in the first stream of events; and

generating a graphical user interface for displaying the process discovery results, the generating comprising:

generating a graphical user interface (GUI) including at least some of the process discovery results and one or more GUI elements corresponding to one or more controls for filtering the process discovery results in the GUI; and

displaying the GUI.

13. The system of claim 12 , wherein the method further comprises:

for each instance of the plurality of instances of the process:

capturing, when in the teaching mode, information corresponding to a respective stream of events captured by the at least one computing device during performance of a respective plurality of actions by the user when interacting with the at least one computing device to perform the process.

14. The system of claim 13 , wherein the method further comprises:

generating the stored signature for the process in the teaching mode from information captured by the at least one computing device during performance of the process by one or multiple users.

15. The system of claim 12 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on a matching confidence threshold.

16. The system of claim 12 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on a threshold amount of time it takes to complete performance of the process.

17. The system of claim 12 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more users performing the process.

18. The system of claim 12 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more applications or universal resource locators (URLs) used when performing the process.

19. The system of claim 12 , wherein the one or more GUI elements includes a GUI element corresponding to a control for filtering the process discovery results based on one or more locations where the process is performed.

20. At least one non-transitory computer-readable storage medium having stored thereon instructions which, when executed by at least one computing device, cause the at least one computing device to perform a method of analyzing process discovery results associated with a process that was performed by a user of the at least one computing device, the method comprising:

accessing a stored signature for the process, the stored signature generated based on a plurality of instances of the process taught in a teaching mode;

capturing a first stream of events during performance of a first plurality of actions by the user of the at least one computing device;

discovering, using the stored signature, the process in the first stream of events captured during performance of the first plurality of actions by the user, to obtain process discovery results, the discovering comprising determining a similarity between the stored signature and a subset of events in the first stream of events; and

generating a graphical user interface for displaying the process discovery results, the generating comprising:

generating a graphical user interface (GUI) including at least some of the process discovery results and one or more GUI elements corresponding to one or more controls for filtering the process discovery results in the GUI; and

displaying the GUI.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: SOROCO AMERICAS PRIVATE LIMITED
To: SOROCO INDIA PRIVATE LIMITED
Reel/Frame 070538/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: MURTY, ROHAN
To: SOROCO PRIVATE LIMITED
Reel/Frame 070538/0736 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: SOROCO PRIVATE LIMITED
To: SOROCO INDIA PRIVATE LIMITED
Reel/Frame 070538/0752 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: QADIR, ABDUL; HASIJA, AAKASH; NARAYANASWAMY, ARJUN; ASHOK, AAKANKSHA; RAO, ANOOSHA M.; HOSKERE, VAGEESH
To: SOROCO INDIA PRIVATE LIMITED
Reel/Frame 070538/0773 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2025
From: NYCHIS, GEORGE PETER; FILES, KIRBY SCOTT
To: SOROCO AMERICAS PRIVATE LIMITED
Reel/Frame 070539/0035 →
Continuity (3)
Continuation 17711775 · Apr 1, 2022
Provisional Application 63170434 · Apr 2, 2021
Related Publication 20240303100A1 · Sep 12, 2024
References Cited (94)
US 7234126B2 · Catthoor et al. · 2007 [cited by applicant]
US 7346629B2 · Kapur et al. · 2008 [cited by applicant]
US 7421654B2 · Wugoski · 2008 [cited by applicant]
US 7756272B2 · Kocher et al. · 2010 [cited by applicant]
US 7975239B2 · Bellotti et al. · 2011 [cited by applicant]
US 7996913B2 · Kocher et al. · 2011 [cited by applicant]
US 8209702B1 · Roytman et al. · 2012 [cited by applicant]
US 8433733B2 · Sayed et al. · 2013 [cited by applicant]
US 9047147B2 · Francis · 2015 [cited by applicant]
US 9053299B2 · Wieder · 2015 [cited by applicant]
US 9384121B2 · Jackson et al. · 2016 [cited by applicant]
US 9465679B2 · Stanley-Marbell et al. · 2016 [cited by applicant]
US 9465806B2 · Baker et al. · 2016 [cited by applicant]
US 9471778B1 · Seo et al. · 2016 [cited by applicant]
US 9477333B2 · Townsend et al. · 2016 [cited by applicant]
US 9542004B1 · Hu · 2017 [cited by applicant]
US 9602495B2 · Wyn-Harris · 2017 [cited by applicant]
US 10083159B1 · Bekmambetov et al. · 2018 [cited by applicant]
US 10120653B2 · Kim et al. · 2018 [cited by applicant]
US 10195531B2 · Osman et al. · 2019 [cited by applicant]
US 10430212B1 · Bekmambetov et al. · 2019 [cited by applicant]
US 10575231B2 · Gay · 2020 [cited by examiner]
US 10613838B2 · Kim et al. · 2020 [cited by applicant]
US 10642375B2 · Lee · 2020 [cited by applicant]
US 10698661B2 · Kim et al. · 2020 [cited by applicant]
US 10710239B2 · Safary · 2020 [cited by examiner]
US 10831450B2 · Kim et al. · 2020 [cited by applicant]
US 10891112B2 · Kim et al. · 2021 [cited by applicant]
US 11816112B1 · Nychis et al. · 2023 [cited by applicant]
US 20020006603A1 · Peterson et al. · 2002 [cited by applicant]
US 20030126050A1 · Theiss et al. · 2003 [cited by applicant]
US 20030158855A1 · Farnham · 2003 [cited by examiner]
US 20040104939A1 · Locke et al. · 2004 [cited by applicant]
US 20060184410A1 · Ramamurthy et al. · 2006 [cited by applicant]
US 20070299631A1 · Macbeth et al. · 2007 [cited by applicant]
US 20090106262A1 · Fallen et al. · 2009 [cited by applicant]
US 20090172534A1 · Budreau et al. · 2009 [cited by applicant]
US 20090172535A1 · Cheng et al. · 2009 [cited by applicant]
US 20110179046A1 · Paull · 2011 [cited by examiner]
US 20130055268A1 · Amershi et al. · 2013 [cited by applicant]
US 20130304906A1 · Yavilevich et al. · 2013 [cited by applicant]
US 20140129961A1 · Zubarev et al. · 2014 [cited by applicant]
US 20140132571A1 · Zeng et al. · 2014 [cited by applicant]
US 20140157288A1 · Wong · 2014 [cited by applicant]
US 20140215495A1 · Enrich et al. · 2014 [cited by applicant]
US 20140237033A1 · Shang · 2014 [cited by applicant]
US 20150135198A1 · Pack, III et al. · 2015 [cited by applicant]
US 20150339033A1 · Arnold et al. · 2015 [cited by applicant]
US 20160034274A1 · Diao et al. · 2016 [cited by applicant]
US 20160055040A1 · Treat et al. · 2016 [cited by applicant]
US 20160101522A1 · Hiruma et al. · 2016 [cited by applicant]
US 20160132600A1 · Woodhead et al. · 2016 [cited by applicant]
US 20160182657A1 · Mukherjee et al. · 2016 [cited by applicant]
US 20160229052A1 · Touma et al. · 2016 [cited by applicant]
US 20160240094A1 · Yan · 2016 [cited by applicant]
US 20160313939A1 · Andrews et al. · 2016 [cited by applicant]
US 20160378291A1 · Pokrzywka · 2016 [cited by applicant]
US 20170109601A1 · Gurwicz et al. · 2017 [cited by applicant]
US 20170124531A1 · McCormack · 2017 [cited by applicant]
US 20170190052A1 · Jaekel et al. · 2017 [cited by applicant]
US 20170277396A1 · Chung et al. · 2017 [cited by applicant]
US 20170300564A1 · Feng et al. · 2017 [cited by applicant]
US 20170364576A1 · Chesla et al. · 2017 [cited by applicant]
US 20180027006A1 · Zimmermann et al. · 2018 [cited by applicant]
US 20180034657A1 · Brown et al. · 2018 [cited by applicant]
US 20180101466A1 · O'Dowd · 2018 [cited by examiner]
US 20180113780A1 · Kim et al. · 2018 [cited by applicant]
US 20180113781A1 · Kim et al. · 2018 [cited by applicant]
US 20180181377A1 · Kim et al. · 2018 [cited by applicant]
US 20180322004A1 · Jain et al. · 2018 [cited by applicant]
US 20190034173A1 · Kim et al. · 2019 [cited by applicant]
US 20190179290A1 · Yoshida et al. · 2019 [cited by applicant]
US 20200147791A1 · Safary · 2020 [cited by examiner]
US 20200183656A1 · Kim et al. · 2020 [cited by applicant]
US 20200206920A1 · Ma et al. · 2020 [cited by applicant]
US 20200233707A1 · Ramamurthy et al. · 2020 [cited by applicant]
US 20200358796A1 · Kundu et al. · 2020 [cited by applicant]
US 20210117232A1 · Sriharsha et al. · 2021 [cited by applicant]
US 20210149641A1 · Kim et al. · 2021 [cited by applicant]
US 20210158268A1 · Berg et al. · 2021 [cited by applicant]
US 20220188283A1 · Jamieson et al. · 2022 [cited by applicant]
Extended European Search Report for European Application No. 17864947.1 dated Jun. 2, 2020. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/US2017/58603 mailed Jan. 5, 2018. [cited by applicant]
Communication pursuant to Article 94(3) EPC for European Application No. 17864947.1 dated Oct. 28, 2021. [cited by applicant]
Clapp et al., Minimizing GUI Event Traces. Stanford Univeristy. FSE' 2016:422-34. [cited by applicant]
Lü et al., Gesture studio: authoring multi-touch interactions through demonstration and declaration. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM. Apr. 27, 2013:257-266. [cited by applicant]
Oh et al., Audio-based feedback techniques for teaching touchscreen gestures. ACM Transactions on Accessible Computing (TACCESS). Nov. 14, 2015;7(3):29 pages. [cited by applicant]
Zhang et al., Panappticon: Event-based Tracing to Measure Mobile Application and Platform Performance. IEEE. 2013:10 pages. [cited by applicant]
*U.S. Appl. No. 17/117,369, filed Dec. 10, 2020, Kim et al. [cited by applicant]
*U.S. Appl. No. 17/711,775, filed Apr. 1, 2022, Nychis et al. [cited by applicant]
*U.S. Appl. No. 18/450,561, filed Aug. 16, 2023, Nychis et al. [cited by applicant]
PCT/US2017/58603, Jan. 5, 2018, International Search Report and Written Opinion**. [cited by applicant]
EP 17864947.1, Jun. 2, 2020, Extended European Search Report**. [cited by applicant]
EP 17864947.1, Oct. 28, 2021, Communication Pursuant to Article 94(3) EPC**. [cited by applicant]
Cited By (1)
US 12,455,888