IP Library Granted Patent US 12,292,960
Granted Patent B2
US 12,292,960 · App. 17/988,660 · Granted May 6, 2025

Automation of workloads involving applications employing multi-factor authentication

Inventors: Anoop Tripathi (Saratoga, CA); Kazuya Tanikawa (Tokyo, JP); Abhijit Kakhandiki (San Jose, CA)
Assignee: Automation Anywhere, Inc.
G06F21/45G06F21/31G06F8/60G06F2221/2115
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,292,960
App. No.
17/988,660
Granted
May 6, 2025
Kind
B2
Abstract

A robotic process automation (RPA) system provides bots that interact with and provide user credentials to applications, such as for multi-factor authentication (MFA). First user credentials associated with MFA are retrieved by the bots from credential storage. Second user credentials that correspond to questions posed to a user of an application are retrieved from credential storage. Second user credentials that correspond to a one-time password are generated by the RPA system. The second user credentials may also be generated by a third-party authentication service that provides the credentials via a secondary channel such as email or SMS, which are then retrieved for presentation to the application.

Claims (48)

1. A computer-implemented method for executing automation tasks, the method comprising:

storing a first user credential, for accessing a first application, to a credential storage, the first user credential corresponding to an initial credential required for a multi-factor authentication protocol implemented by the first application for a user to access the first application;

storing, for a robotic process automation system via at least one network, a bot that is configured to perform one or more programmed tasks, at least one or more of the programmed tasks including accessing the first application using the first user credential and a second user credential, and including interacting with the first application on behalf of the user;

deploying the bot to a client computing device via the at least one network, wherein the bot is configured to operate on the client computing device and initiate interaction with the first application;

receiving, from the bot operating on the client computing device, a first request for the first user credential;

responding to the first request from the bot by retrieving the first user credential from the credential storage and providing the first user credential to the bot;

subsequently receiving, from the bot operating on the client computing device, a second request for the second user credential; and

responding to the second request from the bot by obtaining the second user credential from the credential storage or a third party service, and providing the second user credential to the bot.

2. The computer-implemented method of claim 1 wherein the responding to the second request from the bot comprises retrieving the second user credential from the credential storage.

3. The computer-implemented method of claim 1 wherein the responding to the second request from the bot comprises generating a time-based one-time password from a key stored in the credential storage, wherein the time-based one-time password corresponds to the second user credential.

4. The computer-implemented method of claim 1 wherein the responding to the second request from the bot comprises retrieving the second user credential from a second application which has received the second user credential from the third party service.

5. The computer-implemented method of claim 4 wherein the method further comprises:

providing the second user credential to a mobile device associated with the first user wherein the second application executes on the mobile device to receive the second user credential from the third party service.

6. The computer-implemented method of claim 1 wherein the second user credential comprises an answer to a question posed by the first application.

7. The computer-implemented method of claim 1 wherein the responding to the second request from the bot comprises obtaining a time-based one-time code, wherein the time-based one-time password corresponds to the second user credential.

8. The computer-implemented method of claim 1 wherein the responding to the second request from the bot comprises obtaining the second user credential from the third party service.

9. The computer-implemented method of claim 8 wherein the third party service is an access management service.

10. A robotic process automation system, comprising:

data storage for storing at least:

a set of task processing instructions operable to interact at a user level with one or more user level applications, wherein the set of task processing instructions is encoded to interact with a multi-factor authentication provider; and

credentials, wherein at least some of the credentials are used to satisfy multi-factor authentication protocols required by the one or more user level applications;

a server processor operatively coupled to the data storage and configured to execute instructions that when executed cause the server processor to at least:

respond to a request to deploy the set of task processing instructions by deploying the set of task processing instructions;

respond to a first request from the set of task processing instructions operating on the client computing device to provide a first credential associated with a user to enable the set of task processing instructions to login to a first application, by retrieving from the data storage the first credential associated with the user that corresponds to the first application and providing the first credential to the set of task processing instructions; and

after responding to the first request, respond to a second request from the set of task processing instructions operating on the client computing device to provide a second credential associated with the user to enable the set of task processing instructions to login to the first application, by retrieving the second credential associated with the user that correspond to the first application and providing the second credential to the set of task processing instructions.

11. The robotic process automation system of claim 10 wherein the server processor responds to a second request by retrieving the second credential associated with the user that corresponds to the first application from the data storage and providing the second credential associated with the user to the set of task processing instructions.

12. The robotic process automation system of claim 10 wherein the server processor responds to a second request by retrieving the second credential from a second application which has received the second credential from a third party application and providing the second credential associated with the user to the set of task processing instructions.

13. The robotic process automation system of claim 12 wherein the server processor provides the second application to a mobile device associated with the user wherein the second application executes on the mobile device associated with the user to receive the second credential from the third party application.

14. The robotic process automation system of claim 12 wherein the retrieving the second credential from a second application comprises:

retrieving a user credential from the data storage;

accessing the second application with the user credential; and

retrieving the second user credential from the second application.

15. The robotic process automation system of claim 14 wherein the second application comprises an e-mail application.

16. The robotic process automation system of claim 14 wherein the second user credential comprises an answer to a question posed by the first application.

17. A non-transitory tangible storage medium, having stored thereupon one or more program modules comprising computer-executable instructions for execution on a computer system, the computer-executable instructions causing the computer system to:

operate a bot on a client computing device;

access, via the bot, a first application on behalf of a user, the first application configured to operate on the client computing device;

receive, from the bot operating on the client computing device, a first request from the first application for a first user credential of the user;

respond to the first request from the first application for a first user credential of the user by requesting the first user credential of the user that corresponds to the first application to be provided from a credential storage that securely stores user credentials for a plurality of users, and then providing the first user credential to the first application;

subsequently receive, from the bot operating on the client computing device, a second request from the first application for a second user credential; and

respond to second request from the first application for a second user credential of the user by requesting the second user credential of the user to be provided, and then providing the second user credential to the first application.

18. The non-transitory tangible storage medium of claim 17 wherein the second user credential is acquired by a second application, and then provided to the first application.

19. The non-transitory tangible storage medium of claim 17 wherein the first user credential and the second user credential together provide multi-factor authentication of the user to the first application.

20. The non-transitory tangible storage medium of claim 17 wherein the second credential corresponds to a one-time password.

21. The non-transitory tangible storage medium of claim 17 wherein the second user credential is acquired by a multi-factor authentication provider.

22. The non-transitory tangible storage medium of claim 21 wherein the second credential corresponds to a code transmitted via email by the multi-factor authentication provider to an email account associated with the first user, wherein the second application corresponds to an email application that operates the email account associated with the first user.

23. The non-transitory tangible storage medium of claim 21 wherein the second credential corresponds to a code transmitted via SMS by the multi-factor authentication provider to a mobile device associated with the first user, wherein the second application corresponds to a listener application executing on the mobile device associated with the user that recognizes an SMS message from the multi-factor authentication provider and extracts the second credential from the SMS message.

24. The non-transitory tangible storage medium of claim 21 wherein the multi-factor authentication provider is a network-based access management service provider.

Assignments (1)
SECURITY INTEREST Recorded Dec 5, 2024
From: AUTOMATION ANYWHERE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 069498/0193 →
Continuity (2)
Continuation 16779117 · Jan 31, 2020
Related Publication 20230082185A1 · Mar 16, 2023
References Cited (355)
US 5949999A · Song et al. · 1999 [cited by applicant]
US 5983001A · Boughner et al. · 1999 [cited by applicant]
US 6118939A · Nack · 2000 [cited by applicant]
US 6133917A · Feigner et al. · 2000 [cited by applicant]
US 6226407B1 · Zabih et al. · 2001 [cited by applicant]
US 6389592B1 · Ayres et al. · 2002 [cited by applicant]
US 6427234B1 · Chambers et al. · 2002 [cited by applicant]
US 6473794B1 · Guheen et al. · 2002 [cited by applicant]
US 6496979B1 · Chen et al. · 2002 [cited by applicant]
US 6640244B1 · Bowman-Amuah · 2003 [cited by applicant]
US 6704873B1 · Underwood · 2004 [cited by applicant]
US 6898764B2 · Kemp · 2005 [cited by applicant]
US 6954747B1 · Wang et al. · 2005 [cited by applicant]
US 6957186B1 · Guheen et al. · 2005 [cited by applicant]
US 7091898B2 · Arling et al. · 2006 [cited by applicant]
US 7246128B2 · Jordahl · 2007 [cited by applicant]
US 7398469B2 · Kisamore et al. · 2008 [cited by applicant]
US 7441007B1 · Kirkpatrick et al. · 2008 [cited by applicant]
US 7533096B2 · Rice et al. · 2009 [cited by applicant]
US 7568109B2 · Powell et al. · 2009 [cited by applicant]
US 7571427B2 · Wang et al. · 2009 [cited by applicant]
US 7765525B1 · Davidson et al. · 2010 [cited by applicant]
US 7783135B2 · Gokturk · 2010 [cited by applicant]
US 7805317B2 · Khan et al. · 2010 [cited by applicant]
US 7805710B2 · North · 2010 [cited by applicant]
US 7810070B2 · Nasuti et al. · 2010 [cited by applicant]
US 7846023B2 · Evans et al. · 2010 [cited by applicant]
US 8028269B2 · Bhatia et al. · 2011 [cited by applicant]
US 8056092B2 · Allen et al. · 2011 [cited by applicant]
US 8095910B2 · Nathan et al. · 2012 [cited by applicant]
US 8132156B2 · Malcolm · 2012 [cited by applicant]
US 8209738B2 · Nicol et al. · 2012 [cited by applicant]
US 8234622B2 · Meijer et al. · 2012 [cited by applicant]
US 8245215B2 · Extra · 2012 [cited by applicant]
US 8352464B2 · Fotev · 2013 [cited by applicant]
US 8365147B2 · Grechanik · 2013 [cited by applicant]
US 8396890B2 · Lim · 2013 [cited by applicant]
US 8438558B1 · Adams · 2013 [cited by applicant]
US 8443291B2 · Ku et al. · 2013 [cited by applicant]
US 8464240B2 · Fritsch et al. · 2013 [cited by applicant]
US 8498473B2 · Chong et al. · 2013 [cited by applicant]
US 8504803B2 · Shukla · 2013 [cited by applicant]
US 8631458B1 · Banerjee · 2014 [cited by applicant]
US 8682083B2 · Kumar et al. · 2014 [cited by applicant]
US 8713003B2 · Fotev · 2014 [cited by applicant]
US 8724907B1 · Sampson et al. · 2014 [cited by applicant]
US 8769482B2 · Batey et al. · 2014 [cited by applicant]
US 8819241B1 · Washbum · 2014 [cited by applicant]
US 8819253B2 · Simeloff · 2014 [cited by examiner]
US 8832048B2 · Lim · 2014 [cited by applicant]
US 8874685B1 · Hollis et al. · 2014 [cited by applicant]
US 8943493B2 · Schneider · 2015 [cited by applicant]
US 8965905B2 · Ashmore et al. · 2015 [cited by applicant]
US 8966458B2 · Asai · 2015 [cited by applicant]
US 9032314B2 · Mital et al. · 2015 [cited by applicant]
US 9104294B2 · Forstall et al. · 2015 [cited by applicant]
US 9171359B1 · Lund · 2015 [cited by applicant]
US 9213625B1 · Schrage · 2015 [cited by applicant]
US 9251413B2 · Meler · 2016 [cited by applicant]
US 9278284B2 · Ruppert et al. · 2016 [cited by applicant]
US 9444844B2 · Edery et al. · 2016 [cited by applicant]
US 9462042B2 · Shukla et al. · 2016 [cited by applicant]
US 9571332B2 · Subramaniam et al. · 2017 [cited by applicant]
US 9600519B2 · Schoning et al. · 2017 [cited by applicant]
US 9621584B1 · Schmidt et al. · 2017 [cited by applicant]
US 9934063B2 · Kaina · 2018 [cited by applicant]
US 9934129B1 · Budurean · 2018 [cited by applicant]
US 9946233B2 · Brun et al. · 2018 [cited by applicant]
US 9965139B2 · Nychis · 2018 [cited by applicant]
US 9990347B2 · Raskovic et al. · 2018 [cited by applicant]
US 10015503B1 · Ahammad · 2018 [cited by applicant]
US 10043255B1 · Pathapati et al. · 2018 [cited by applicant]
US 10282280B1 · Gouskova · 2019 [cited by applicant]
US 10489682B1 · Kumar et al. · 2019 [cited by applicant]
US 10542030B2 · Oberheide · 2020 [cited by examiner]
US 10552540B2 · Marascu et al. · 2020 [cited by applicant]
US 10592738B2 · Northrup · 2020 [cited by applicant]
US 10643246B1 · Suprasadachandran · 2020 [cited by applicant]
US 10654166B1 · Hall · 2020 [cited by applicant]
US 10706218B2 · Milward et al. · 2020 [cited by applicant]
US 10706228B2 · Buisson · 2020 [cited by applicant]
US 10713068B1 · Zohar · 2020 [cited by applicant]
US 10857786B2 · Korthuis · 2020 [cited by applicant]
US 10936807B1 · Walters · 2021 [cited by applicant]
US 10963731B1 · Sarkar · 2021 [cited by applicant]
US 10970109B1 · Berenstein · 2021 [cited by applicant]
US 11099972B2 · Puszkiewicz · 2021 [cited by applicant]
US 11176443B1 · Selva · 2021 [cited by applicant]
US 11182178B1 · Singh et al. · 2021 [cited by applicant]
US 11182604B1 · Methaniya · 2021 [cited by applicant]
US 11243803B2 · Anand et al. · 2022 [cited by applicant]
US 11263391B2 · Potts · 2022 [cited by applicant]
US 11348353B2 · Sundell et al. · 2022 [cited by applicant]
US 11494227B2 · George · 2022 [cited by applicant]
US 11500952B1 · Gupta · 2022 [cited by examiner]
US 11513670B2 · Tripathi · 2022 [cited by applicant]
US 11614731B2 · Anand et al. · 2023 [cited by applicant]
US 11642783B2 · Han et al. · 2023 [cited by applicant]
US 11775321B2 · Singh et al. · 2023 [cited by applicant]
US 11775339B2 · Anand et al. · 2023 [cited by applicant]
US 11775814B1 · Anand et al. · 2023 [cited by applicant]
US 11782734B2 · Ginoya et al. · 2023 [cited by applicant]
US 11820020B2 · Goyal et al. · 2023 [cited by applicant]
US 12002245B2 · Srivastava · 2024 [cited by applicant]
US 20020029232A1 · Bobrow et al. · 2002 [cited by applicant]
US 20020129039A1 · Majewsku · 2002 [cited by applicant]
US 20030033590A1 · Leherbauer · 2003 [cited by applicant]
US 20030101245A1 · Srinivasan et al. · 2003 [cited by applicant]
US 20030114959A1 · Sakamoto · 2003 [cited by applicant]
US 20030159089A1 · DiJoseph · 2003 [cited by applicant]
US 20040083472A1 · Rao et al. · 2004 [cited by applicant]
US 20040122906A1 · Goodman · 2004 [cited by examiner]
US 20040153649A1 · Rhoads · 2004 [cited by applicant]
US 20040172526A1 · Tann et al. · 2004 [cited by applicant]
US 20040210885A1 · Wang et al. · 2004 [cited by applicant]
US 20040243994A1 · Nasu · 2004 [cited by applicant]
US 20050033777A1 · Moraes · 2005 [cited by applicant]
US 20050188357A1 · Derks et al. · 2005 [cited by applicant]
US 20050204343A1 · Kisamore et al. · 2005 [cited by applicant]
US 20050257214A1 · Moshir et al. · 2005 [cited by applicant]
US 20060095276A1 · Axelrod et al. · 2006 [cited by applicant]
US 20060150188A1 · Roman et al. · 2006 [cited by applicant]
US 20060218110A1 · Simske et al. · 2006 [cited by applicant]
US 20070030528A1 · Quaeler et al. · 2007 [cited by applicant]
US 20070089101A1 · Romanovskiy · 2007 [cited by applicant]
US 20070101291A1 · Forstall et al. · 2007 [cited by applicant]
US 20070112574A1 · Greene · 2007 [cited by applicant]
US 20070156677A1 · Szabo · 2007 [cited by applicant]
US 20070172063A1 · Biggs · 2007 [cited by examiner]
US 20070233741A1 · Shen · 2007 [cited by applicant]
US 20080005086A1 · Moore · 2008 [cited by applicant]
US 20080027769A1 · Eder · 2008 [cited by applicant]
US 20080028392A1 · Chen et al. · 2008 [cited by applicant]
US 20080133052A1 · Jones · 2008 [cited by applicant]
US 20080209392A1 · Able et al. · 2008 [cited by applicant]
US 20080222454A1 · Kelso · 2008 [cited by applicant]
US 20080263024A1 · Landschaft et al. · 2008 [cited by applicant]
US 20080310625A1 · Vanstone · 2008 [cited by applicant]
US 20090037509A1 · Parekh et al. · 2009 [cited by applicant]
US 20090103769A1 · Milov et al. · 2009 [cited by applicant]
US 20090116071A1 · Mantell · 2009 [cited by applicant]
US 20090172814A1 · Khosravi et al. · 2009 [cited by applicant]
US 20090199160A1 · Vaitheeswaran et al. · 2009 [cited by applicant]
US 20090217309A1 · Grechanik et al. · 2009 [cited by applicant]
US 20090249297A1 · Doshi et al. · 2009 [cited by applicant]
US 20090313229A1 · Fellenstein et al. · 2009 [cited by applicant]
US 20090320002A1 · Peri-Glass et al. · 2009 [cited by applicant]
US 20100023602A1 · Martone · 2010 [cited by applicant]
US 20100023933A1 · Bryant et al. · 2010 [cited by applicant]
US 20100077475A1 · Deschenes · 2010 [cited by applicant]
US 20100100605A1 · Allen et al. · 2010 [cited by applicant]
US 20100106671A1 · Li et al. · 2010 [cited by applicant]
US 20100138015A1 · Colombo et al. · 2010 [cited by applicant]
US 20100235433A1 · Ansari et al. · 2010 [cited by applicant]
US 20100251163A1 · Keable · 2010 [cited by applicant]
US 20110022578A1 · Fotev · 2011 [cited by applicant]
US 20110055484A1 · Eichenberger · 2011 [cited by applicant]
US 20110106284A1 · Catoen · 2011 [cited by applicant]
US 20110145807A1 · Molinie et al. · 2011 [cited by applicant]
US 20110197121A1 · Kletter · 2011 [cited by applicant]
US 20110258195A1 · Welling · 2011 [cited by applicant]
US 20110267490A1 · Goktekin · 2011 [cited by applicant]
US 20110276568A1 · Fotev · 2011 [cited by applicant]
US 20110276946A1 · Pletter · 2011 [cited by applicant]
US 20110302570A1 · Kurimilla et al. · 2011 [cited by applicant]
US 20120011458A1 · Xia et al. · 2012 [cited by applicant]
US 20120042281A1 · Green · 2012 [cited by applicant]
US 20120124062A1 · Macbeth et al. · 2012 [cited by applicant]
US 20120131456A1 · Lin et al. · 2012 [cited by applicant]
US 20120143941A1 · Kim · 2012 [cited by applicant]
US 20120266149A1 · Lebert · 2012 [cited by applicant]
US 20120324333A1 · Lehavi · 2012 [cited by applicant]
US 20120330940A1 · Caire et al. · 2012 [cited by applicant]
US 20130145006A1 · Tammam · 2013 [cited by applicant]
US 20130173648A1 · Tan et al. · 2013 [cited by applicant]
US 20130227535A1 · Kannan · 2013 [cited by applicant]
US 20130236111A1 · Pintsov · 2013 [cited by applicant]
US 20130290318A1 · Shapira et al. · 2013 [cited by applicant]
US 20130301935A1 · Xue · 2013 [cited by applicant]
US 20140036290A1 · Miyagawa · 2014 [cited by applicant]
US 20140045484A1 · Kim et al. · 2014 [cited by applicant]
US 20140075371A1 · Carmi · 2014 [cited by applicant]
US 20140181705A1 · Hey et al. · 2014 [cited by applicant]
US 20140189576A1 · Carmi · 2014 [cited by applicant]
US 20140282125A1 · Duneau · 2014 [cited by applicant]
US 20140379666A1 · Bryon · 2014 [cited by applicant]
US 20150082280A1 · Betak et al. · 2015 [cited by applicant]
US 20150206139A1 · Lea · 2015 [cited by applicant]
US 20150235193A1 · Cummings · 2015 [cited by applicant]
US 20150290795A1 · Oleynik · 2015 [cited by applicant]
US 20150301926A1 · Giannelos · 2015 [cited by applicant]
US 20150310268A1 · He · 2015 [cited by applicant]
US 20150347284A1 · Hey et al. · 2015 [cited by applicant]
US 20160019049A1 · Kakhandiki et al. · 2016 [cited by applicant]
US 20160034441A1 · Nguyen et al. · 2016 [cited by applicant]
US 20160055376A1 · Koduru · 2016 [cited by applicant]
US 20160063269A1 · Liden · 2016 [cited by applicant]
US 20160078366A1 · Kakhandiki · 2016 [cited by applicant]
US 20160078368A1 · Kakhandiki et al. · 2016 [cited by applicant]
US 20170091615A1 · Liu · 2017 [cited by applicant]
US 20170221032A1 · Mazed · 2017 [cited by examiner]
US 20170270431A1 · Hosabettu · 2017 [cited by applicant]
US 20170352041A1 · Ramamurthy · 2017 [cited by applicant]
US 20180113781A1 · Kim · 2018 [cited by applicant]
US 20180144042A1 · Sheng · 2018 [cited by applicant]
US 20180176416A1 · Ewans · 2018 [cited by applicant]
US 20180210824A1 · Kochura · 2018 [cited by applicant]
US 20180218429A1 · Guo et al. · 2018 [cited by applicant]
US 20180267885A1 · Budurean · 2018 [cited by applicant]
US 20180275835A1 · Prag · 2018 [cited by applicant]
US 20180276462A1 · Davis · 2018 [cited by applicant]
US 20180321955A1 · Liu · 2018 [cited by applicant]
US 20180322403A1 · Ron · 2018 [cited by applicant]
US 20180349730A1 · Dixon · 2018 [cited by applicant]
US 20180370029A1 · Hall · 2018 [cited by applicant]
US 20190005050A1 · Proux · 2019 [cited by applicant]
US 20190026215A1 · Agarwal · 2019 [cited by applicant]
US 20190028587A1 · Unitt · 2019 [cited by applicant]
US 20190034041A1 · Nychis · 2019 [cited by applicant]
US 20190066012A1 · Abell · 2019 [cited by examiner]
US 20190075169A1 · Behunin · 2019 [cited by examiner]
US 20190095440A1 · Chakra · 2019 [cited by applicant]
US 20190114370A1 · Cerino · 2019 [cited by applicant]
US 20190126463A1 · Purushothaman · 2019 [cited by applicant]
US 20190130094A1 · Votaw · 2019 [cited by examiner]
US 20190141596A1 · Gay · 2019 [cited by applicant]
US 20190188462A1 · Nishida · 2019 [cited by applicant]
US 20190205636A1 · Saraswat · 2019 [cited by applicant]
US 20190213822A1 · Jain · 2019 [cited by applicant]
US 20190250891A1 · Kumar · 2019 [cited by applicant]
US 20190266692A1 · Stach et al. · 2019 [cited by applicant]
US 20190317803A1 · Maheshwari · 2019 [cited by applicant]
US 20190324781A1 · Ramamurthy · 2019 [cited by applicant]
US 20190340240A1 · Duta · 2019 [cited by applicant]
US 20190377987A1 · Price et al. · 2019 [cited by applicant]
US 20200019767A1 · Porter et al. · 2020 [cited by applicant]
US 20200034976A1 · Stone et al. · 2020 [cited by applicant]
US 20200059441A1 · Viet · 2020 [cited by applicant]
US 20200065384A1 · Costello · 2020 [cited by applicant]
US 20200074070A1 · Boodaei · 2020 [cited by examiner]
US 20200097742A1 · Kumar et al. · 2020 [cited by applicant]
US 20200104350A1 · Allen · 2020 [cited by applicant]
US 20200125635A1 · Nuolf · 2020 [cited by applicant]
US 20200147791A1 · Safary · 2020 [cited by applicant]
US 20200151444A1 · Price et al. · 2020 [cited by applicant]
US 20200151591A1 · Li · 2020 [cited by applicant]
US 20200159647A1 · Puszkiewicz · 2020 [cited by applicant]
US 20200159648A1 · Ghare · 2020 [cited by applicant]
US 20200206920A1 · Ma · 2020 [cited by applicant]
US 20200249964A1 · Fernandes · 2020 [cited by applicant]
US 20200257764A1 · Reisswig · 2020 [cited by applicant]
US 20200273078A1 · Xu · 2020 [cited by applicant]
US 20200285353A1 · Rezazadeh Sereshkeh · 2020 [cited by applicant]
US 20200311210A1 · Nama · 2020 [cited by applicant]
US 20200334249A1 · Canim · 2020 [cited by applicant]
US 20200364291A1 · Bentabet · 2020 [cited by applicant]
US 20200410082A1 · Sharieh · 2020 [cited by examiner]
US 20210042516A1 · Panakkal · 2021 [cited by applicant]
US 20210049128A1 · Kernick · 2021 [cited by applicant]
US 20210067492A1 · Mastracci · 2021 [cited by applicant]
US 20210107140A1 · Singh · 2021 [cited by applicant]
US 20210141497A1 · Magureanu · 2021 [cited by applicant]
US 20210216334A1 · Barrett · 2021 [cited by applicant]
US 20210248153A1 · Sirangimoorthy · 2021 [cited by applicant]
US 20210279166A1 · Peng · 2021 [cited by applicant]
US 20210333983A1 · Singh · 2021 [cited by applicant]
US 20210391004A1 · Yudanov · 2021 [cited by applicant]
US 20220038445A1 · LeClair · 2022 [cited by examiner]
US 20220245936A1 · Valk · 2022 [cited by applicant]
US 20220405094A1 · Farquhar · 2022 [cited by applicant]
US 20220413997A1 · Shi · 2022 [cited by applicant]
US 20230052190A1 · Goyal et al. · 2023 [cited by applicant]
US 20230053260A1 · Goyal et al. · 2023 [cited by applicant]
US 20230214239A1 · Singh · 2023 [cited by applicant]
US 20230419711A1 · Ramnath · 2023 [cited by applicant]
US 20240056479A1 · Senecal · 2024 [cited by examiner]
EP 3133539 · 2017 [cited by applicant]
EP 3675008 · 2020 [cited by applicant]
WO 2019092672A2 · 2019 [cited by applicant]
WO 2022076488 · 2022 [cited by applicant]
NPL Search Terms (Year: 2024). [cited by examiner]
Al Sallami, Load Balancing in Green Cloud Computation, Proceedings of the World Congress on Engineering 2013 vol. II, WCE 2013, 2013, pp. 1-5 (Year: 2013). [cited by applicant]
B.P. Kasper “Remote: A Means of Remotely Controlling and Storing Data from a HAL Quadrupole Gass Analyzer Using an IBM-PC Compatible Computer”, Nov. 15, 1995, Space and Environment Technology Center. [cited by applicant]
Bergen et al., RPC automation: making legacy code releant, May 2013, 6 pages. [cited by applicant]
Hu et al., Automating GUI testing for Android applications, May 2011, 7 pages. [cited by applicant]
Konstantinou et al., An architecture for virtual solution composition and deployment in infrastructure clouds, 9 pages (Year: 2009). [cited by applicant]
Nyulas et al., An Ontology-Driven Framework for Deploying JADE Agent Systems, 5 pages (Year: 2006). [cited by applicant]
Tom Yeh, Tsung-Hsiang Chang, and Robert C. Miller, Sikuli: Using GUI Screenshots for Search and Automation, Oct. 4-7, 2009, 10 pages. [cited by applicant]
Yu et al., Deplying and managing Web services: issues, solutions, and directions, 36 pages (Year: 2008). [cited by applicant]
Zhifang et al., Test automation on moble device, May 2010, 7 pages. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/230,492, mailed Oct. 14, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/398,532, mailed Oct. 23, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/876,530, mailed Sep. 29, 2020. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/876,530, mailed Apr. 13, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/876,530, mailed Jul. 22, 2021. [cited by applicant]
Dai, Jifeng et al., “R-fcn: Object detectiom via region-based fully convolutional networks”, Advances in neural information processing systems 29 (2016). (Year: 2016). [cited by applicant]
“Ren, Shaoqing et al., Faster r-cnn: Towards real0time object detection with region proposal network.” Advances in neutral information processing systems 28 (2015). (Year: 2015). [cited by applicant]
Zhifang et al., Test automation on mobile device, May 2010, 7 pages. [cited by applicant]
International Search Report for PCT/US2021/053669, dated May 11, 2022. [cited by applicant]
Embley et al., “Table-processing paradigms: a research survey, International Journal on Document Analysis and Recognition”, vol. 8, No. 2-3, May 9, 2006, pp. 66-86. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/925,956, mailed Sep. 16, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/925,956, mailed Jan. 7, 2022. [cited by applicant]
Pre-Interview Office Action for U.S. Appl. No. 16/398,532, mailed Jul. 8, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/398,532, mailed Oct. 13, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/139,838, mailed Feb. 22, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/139,838, mailed Nov. 15, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/139,838, mailed Apr. 5, 2023. [cited by applicant]
International Search Report and Written Opinion for PCT/US2021/015691, mailed May 11, 2021. [cited by applicant]
A density-based algorithm for discovering clusters in large spatial databases with noise, Ester, Martin; Kriegel, Hans-Peter; Sander, Jorg; Xu, Xiaowei, Simoudis, Evangelos; Han, Jiawei; Fayyad, Usama M., eds., Proceedi… [cited by applicant]
Deep Residual Learning for Image Recognition, by K. He, X. Zhang, S. Ren, and J. Sun, arXiv: 1512.03385 (2015). [cited by applicant]
FaceNet: A Unified Embedding for Face Recognition and Clustering, by F. Schroff, D. Kalenichenko, J. Philbin, arXiv:1503.03832 (2015). [cited by applicant]
Luqman, et al. “Fuzzy multilevel graph embedding”, copyright 2012 Elsevier Ltd. [cited by applicant]
Sharma et al. Determining similarity in histological images using graph-theoretic description and matching methods for content-based image retrieval in medical diagnostics, Biomed Center, copyright 2012. [cited by applicant]
First Action Interview Pilot Program Pre-Interview communication for U.S. Appl. No. 16/779,462, mailed Dec. 3, 2021. [cited by applicant]
Reply under 37 CDT 1.111 to Pre-Interview Communication for U.S. Appl. No. 16/779,462, filed Jan. 25, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/779,462 mailed Feb. 9, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/131,674, mailed Jun. 22, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/731,044, mailed Jan. 25, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/731,044, mailed May 5, 2021. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/126,935, mailed Jul. 13, 2023. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/139,842, mailed Jul. 18, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/588,588, mailed Aug. 2, 2023. [cited by applicant]
Pre-Interview Office Action for U.S. Appl. No. 16/859,488, mailed Jan. 25, 2021. [cited by applicant]
First Action Interview for U.S. Appl. No. 16/859,488, mailed Mar. 22, 2021. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/859,488, mailed Jul. 8, 2021. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/859,488, mailed Mar. 30, 2022. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/463,494, mailed Sep. 6, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/160,080, mailed Sep. 11, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/534,443, mailed Sep. 11, 2023. [cited by applicant]
Final Office Action for U.S. Appl. No. 16/930,247 mailed Oct. 12, 2023. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/534,443 mailed Oct. 24, 2023. [cited by applicant]
International Search Report and Written Opinion for PCT/US2022/013026, mailed Sep. 21, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/126,935, mailed Jan. 10, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 18/215,126, mailed Jan. 25, 2024. [cited by applicant]
Advisory Action and After Final Pilot Decision for U.S. Appl. No. 17/160,080, mailed Jan. 29, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/160,082, mailed Feb. 15, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/206,029, mailed Feb. 28, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/160,080, mailed Mar. 13, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/160,084, mailed Mar. 15, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 16/779,117, mailed Jan. 12, 2022. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 16/779,117, mailed Aug. 10, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/094,305, mailed May 9, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/160,084, mailed May 16, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/218,009, mailed May 20, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 17/160,080, mailed Jun. 12, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/389,300, mailed Jun. 27, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/160,082, filed Jul. 24, 2024. [cited by applicant]
Final Office Action for U.S. Appl. No. 18/094,305, mailed Jul. 29, 2024. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 18/103,331, mailed Aug. 15, 2024. [cited by applicant]
Notice of Allowance for 16/458,139, mailed Sep. 11, 2024. [cited by applicant]
Notice of Allowance for 16/458,138, mailed Sep. 16, 2024. [cited by applicant]
Notice of Allowance for U.S. Appl. No. 17/160,082, mailed Sep. 18, 2024. [cited by applicant]
Notice of Allowance for 16/398,532, mailed Oct. 23, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/988,660, mailed Sep. 25, 2022. [cited by applicant]
Non-Final Office Action for U.S. Appl. No. 17/160,080, mailed Oct. 16, 2024. [cited by applicant]