IP Library Granted Patent US 12,536,045
Granted Patent B2
US 12,536,045 · App. 19/005,761 · Granted Jan 27, 2026

Distribution of tasks among microservices in a copilot

Inventors: Elaine Kelsey (Corvallis, OR); Sazzad Mahmud Nasir (Muncie, IN); Jeffrey Thomas Yarbro (Memphis, TN); Lauren Elizabeth Egerton (New York, NY); Elliot Nicholas Robson (Seoul, KR); Brendan Michael Kelly (Somerville, MA); Robert Oscar Robson (Corvallis, OR); Spencer Thomas Ward (Kent, WA)
Assignee: THIA ST CO.
G06F9/5027G06N3/0455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,536,045
App. No.
19/005,761
Granted
Jan 27, 2026
Kind
B2
Abstract

Recorded sessions of skilled personnel at work are used to train a first machine learning (ML) tool to extract workflow maps. These maps are used to train a second ML tool to emulate at least one workflow. The first ML tool is trained to predict an annotator's output. Either ML tool can be a copilot having a microservice network architecture. Further, complex sets of workflows can be subdivided for efficient support with small ML tools for (1) workflow map extraction and (2) emulation. Based on segment demarcation accompanying a recording, segments are assigned to specialized ML extraction tools for workflow map extraction. Extracted workflow maps are used to train workflow emulator(s). Similarly, specialized ML emulation tools can emulate respective tasks. A distribution microservice can identify a task to be emulated and can invoke the appropriate specialized ML tool. Similar microservice network architectures support both applications.

Claims (56)

1 . One or more non-transitory computer-readable media storing instructions executable by one or more hardware processors, wherein the instructions include:

a plurality of modules which, when executed, implement respective microservices among a weakly connected network of the microservices, which is configured as a copilot to one or more client applications;

wherein the network of microservices includes a distribution microservice and a plurality of task microservices, each task microservice comprising a respective trained machine learning (ML) tool;

wherein the task microservices, including at least distinct first and second task microservices, are trained to perform respective tasks, the tasks including at least distinct first and second tasks; and

wherein the distribution microservice is configured to:

receive input from a given one of the client applications indicating a particular task to be performed;

identify the particular task as one among the respective tasks;

in a first case for which the particular task is identified as the first task, forward the particular task toward the first task microservice, causing the first task microservice to perform the first task; and

in a second case for which the particular task is identified as the second task, forward the particular task toward the second task microservice, causing the second task microservice to perform the second task.

2 . The one or more non-transitory computer-readable media of claim 1 , wherein the instructions further comprise:

a training module configured to train, upon execution, the first task microservice using a plurality of training data records, each training data record comprising a workflow map corresponding to the first task, wherein the workflow map comprises a description of one or more procedures for accomplishing the first task.

3 . The one or more non-transitory computer-readable media of claim 2 , wherein the workflow map is an input workflow map, the first task is extraction of an output workflow map from a recorded session, and the each training data record further comprises:

the recorded session of one or more experts performing at least the first task.

4 . The one or more non-transitory computer-readable media of claim 2 , wherein the first task is emulation of a workflow associated with the workflow map.

5 . The one or more non-transitory computer-readable media of claim 1 , wherein the distribution microservice is another trained ML tool.

6 . The one or more non-transitory computer-readable media of claim 5 , wherein the instructions further comprise:

a training module configured to train, upon execution, the distribution microservice using a plurality of training data records, each training data record comprising:

a recorded session of one or more experts performing one or more among the tasks; and

an annotator's output identifying, for each of one or more segments of the recorded session, a respective task among the tasks.

7 . The one or more non-transitory computer-readable media of claim 1 , wherein the copilot further comprises an expansion microservice, a retrieval microservice, a core microservice, and an evaluation microservice.

8 . The one or more non-transitory computer-readable media of claim 1 , wherein a training corpus comprises distinct first and second segments of each of a plurality of interview scripts, and the instructions further include:

one or more first training modules configured to train, upon execution, the first task microservice using the first segments as training data records; and

one or more second training modules configured to train, upon execution, the second task microservice using the second segments as training data records.

9 . The one or more non-transitory computer-readable media of claim 1 , wherein a training corpus comprises distinct first and second segments of each of a plurality of recorded work sessions, and the instructions further include:

one or more first training modules configured to train, upon execution, the first task microservice using the first segments as training data records; and

one or more second training modules configured to train, upon execution, the second task microservice using the second segments as training data records.

10 . The one or more non-transitory computer-readable media of claim 1 , wherein the first task microservice is configured to transmit a result of performing the first task toward a receiver external to the copilot.

11 . The one or more non-transitory computer-readable media of claim 10 , wherein the receiver is a first receiver and the second task microservice, distinct from the first task microservice, is configured to transmit a result of performing the second task toward a second receiver within the copilot.

12 . A system comprising:

one or more hardware processors with memory coupled thereto; and

computer readable media storing instructions executable by the one or more hardware processors, wherein the instructions include:

a plurality of modules which, when executed, implement respective microservices among a weakly connected network of the microservices, which is configured as a copilot to one or more client applications;

wherein the network of microservices includes a distribution microservice and a plurality of task microservices, each task microservice comprising a respective trained machine learning (ML) tool;

wherein the task microservices, including at least distinct first and second task microservices, are trained to perform respective tasks, the tasks including at least distinct first and second tasks; and

wherein the distribution microservice is configured to:

receive input from a given one of the client applications indicating a particular task to be performed;

identify the particular task as one among the respective tasks;

in a first case for which the particular task is identified as the first task, forward the particular task toward the first task microservice, causing the first task microservice to perform the first task; and

in a second case for which the particular task is identified as the second task, forward the particular task toward the second task microservice, causing the second task microservice to perform the second task.

13 . The system of claim 12 , wherein the instructions further comprise:

a training module configured to train, upon execution, the first task microservice using a plurality of training data records, each training data record comprising a workflow map corresponding to the first task, wherein the workflow map comprises a description of one or more procedures for accomplishing the first task.

14 . The system of claim 13 , wherein the workflow map is an input workflow map, the first task is extraction of an output workflow map from a recorded session, and the each training data record further comprises:

the recorded session of one or more experts performing at least the first task.

15 . The system of claim 13 , wherein the first task is emulation of a workflow associated with the workflow map.

16 . The system of claim 12 , wherein the distribution microservice is another trained ML tool.

17 . The system of claim 16 , wherein the instructions further comprise:

a training module configured to train, upon execution, the distribution microservice using a plurality of training data records, each training data record comprising:

a recorded session of one or more experts performing one or more among the tasks; and

an annotator's output identifying, for each of one or more segments of the recorded session, a respective task among the tasks.

18 . The system of claim 12 , wherein a training corpus comprises distinct first and second segments of each of a plurality of interview scripts, and the instructions further include:

one or more first training modules configured to train, upon execution, the first task microservice using the first segments as training data records; and

one or more second training modules configured to train, upon execution, the second task microservice using the second segments as training data records.

19 . The system of claim 12 , wherein a training corpus comprises distinct first and second segments of each of a plurality of recorded work sessions, and the instructions further include:

one or more first training modules configured to train, upon execution, the first task microservice using the first segments as training data records; and

one or more second training modules configured to train, upon execution, the second task microservice using the second segments as training data records.

20 . The system of claim 12 , wherein the first task microservice is configured to transmit a result of performing the first task toward a receiver external to the copilot.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: KELSEY, ELAINE; NASIR, SAZZAD MAHMUD; YARBRO, JEFFREY THOMAS; EGERTON, LAUREN ELIZABETH; ROBSON, ELLIOT NICHOLAS; KELLY, BRENDAN MICHAEL; ROBSON, ROBERT OSCAR; WARD, SPENCER THOMAS
To: THIA ST CO.
Reel/Frame 069871/0410 →
Continuity (8)
Continuation PCTUS2024061934 · Dec 26, 2024
Continuation 18898502 · Sep 26, 2024
Provisional Application 63717151 · Nov 6, 2024
Provisional Application 63709258 · Oct 18, 2024
Provisional Application 63646613 · May 13, 2024
Provisional Application 63561654 · Mar 5, 2024
Provisional Application 63620329 · Jan 12, 2024
Related Publication 20250231807A1 · Jul 17, 2025
References Cited (73)
US 8442940B1 · Faletti et al. · 2013 [cited by applicant]
US 10802488B1 · Abeloe · 2020 [cited by applicant]
US 10803127B2 · Alexander et al. · 2020 [cited by applicant]
US 10992780B1 · Rudrappa Goniwada · 2021 [cited by examiner]
US 11379715B2 · Tang et al. · 2022 [cited by applicant]
US 11443102B1 · Wilson et al. · 2022 [cited by applicant]
US 11922121B2 · Wang · 2024 [cited by applicant]
US 12093658B1 · Silver · 2024 [cited by examiner]
US 12136043B1 · Davis et al. · 2024 [cited by applicant]
US 12210973B2 · Johnson · 2025 [cited by applicant]
US 20150199646A1 · Taylor et al. · 2015 [cited by applicant]
US 20160246824A1 · Furuhashi et al. · 2016 [cited by applicant]
US 20170262811A1 · Ovadya · 2017 [cited by applicant]
US 20170262949A1 · Jay · 2017 [cited by applicant]
US 20180089593A1 · Patel · 2018 [cited by examiner]
US 20190325353A1 · Aftab · 2019 [cited by examiner]
US 20200050946A1 · Lecue et al. · 2020 [cited by applicant]
US 20200057946A1 · Singaraju · 2020 [cited by examiner]
US 20200069208A1 · Keane · 2020 [cited by applicant]
US 20200234025A1 · Cohen et al. · 2020 [cited by applicant]
US 20200241944A1 · Derdak · 2020 [cited by examiner]
US 20200257733A1 · Mei et al. · 2020 [cited by applicant]
US 20200380254A1 · Zeng et al. · 2020 [cited by applicant]
US 20210035047A1 · Mossoba et al. · 2021 [cited by applicant]
US 20210073977A1 · Carter et al. · 2021 [cited by applicant]
US 20210089779A1 · Chan et al. · 2021 [cited by applicant]
US 20210142159A1 · Gupta et al. · 2021 [cited by applicant]
US 20210174347A1 · Rose · 2021 [cited by applicant]
US 20210201128A1 · Xu et al. · 2021 [cited by applicant]
US 20210233030A1 · Preuss et al. · 2021 [cited by applicant]
US 20210279566A1 · Lin et al. · 2021 [cited by applicant]
US 20210286831A1 · Girardi et al. · 2021 [cited by applicant]
US 20210295238A1 · Poon et al. · 2021 [cited by applicant]
US 20210312399A1 · Asokan et al. · 2021 [cited by applicant]
US 20210357705A1 · Sung et al. · 2021 [cited by applicant]
US 20210365782A1 · Huang et al. · 2021 [cited by applicant]
US 20220019729A1 · Sharma et al. · 2022 [cited by applicant]
US 20220067665A1 · Westerheide et al. · 2022 [cited by applicant]
US 20220232085A1 · Panikkar · 2022 [cited by examiner]
US 20220237892A1 · Anderton-Yang · 2022 [cited by applicant]
US 20220284312A1 · Brecque · 2022 [cited by applicant]
US 20220336060A1 · Koop et al. · 2022 [cited by applicant]
US 20230005248A1 · Julliard et al. · 2023 [cited by applicant]
US 20230133373A1 · McGonnell · 2023 [cited by applicant]
US 20230214192A1 · Makhija et al. · 2023 [cited by applicant]
US 20230214238A1 · Yitzhaki et al. · 2023 [cited by applicant]
US 20230289691A1 · Sabourin · 2023 [cited by examiner]
US 20230394803A1 · Delaitre et al. · 2023 [cited by applicant]
US 20240012842A1 · Kislal et al. · 2024 [cited by applicant]
US 20240037949A1 · Johnston et al. · 2024 [cited by applicant]
US 20240087743A1 · Grimm et al. · 2024 [cited by applicant]
US 20240095679A1 · Nowak et al. · 2024 [cited by applicant]
US 20240119383A1 · Bowers et al. · 2024 [cited by applicant]
US 20240176629A1 · Reddy · 2024 [cited by applicant]
US 20240202177A1 · Bandlamudi · 2024 [cited by examiner]
US 20240303569A1 · Yu · 2024 [cited by examiner]
US 20240362503A1 · Prasad et al. · 2024 [cited by applicant]
US 20250005288A1 · Amatriain-Rubio et al. · 2025 [cited by applicant]
US 20250069308A1 · Cameron et al. · 2025 [cited by applicant]
US 20250182636A1 · Subbu et al. · 2025 [cited by applicant]
Morisot, “Add a SideNet to your MainNet,” ArXiv:2007.13512v1, 15 pages (Jul. 2020). [cited by applicant]
Agarwal et al., “Knowledge graph based synthetic corpus generation for knowledge-enhanced language model pre-training,” ArXiv:2010.12688 v2 (Mar. 13, 2021). [cited by applicant]
Bodor et al., “From Development to Deployment: An Approach to MLOps Monitoring for Machine Learning Model,” 14th International Conference on Intelligent Systems: Theories and Applications, 7 pages (Nov. 2023). [cited by applicant]
Dorsch et al., “GraphGuard: Enhancing Data Quality in Knowledge Graph Pipelines,” SEMIIM, 14 pages, (Nov. 2023). [cited by applicant]
Feng et al., “Knowledge Card: Filling LLMs' Knowledge Gaps With Plug-in Specialized Language Models,” ArXiv:2305.09955v2, pp. 1-24 (Oct. 2023). [cited by applicant]
Jeong, “A Study on the Implementation of Generative AI Services Using an Enterprise Data-Based LLM Application Architecture,” ArXiv 2309.01105v1, pp. 1-26 (Sep. 2023). [cited by applicant]
Kaddour et al., “Challenges and Applications of Large Language Models,” ArXiv 2307.10169v1, pp. 1-72 (Jul. 2023). [cited by applicant]
Liang et al. “Modular Retrieval for Generalization and Interpretation,” ArXiv:2303.13419v1, pp. 1-15 (Mar. 2023). [cited by applicant]
Liu et al., “Multi-stage pre-training over simplified multimodal pre-training models,” ArXiv:2107.14596 (Jul. 22, 2021). [cited by applicant]
PCT/US2024/061299 Invitation to Pay Additional Fees, including Partial Search Report and Provisional Opinion, 15 pages (Apr. 9, 2025). [cited by applicant]
PCT/US2024/061934 Invitation to Pay Additional Fees, including Partial Search Report and Provisional Opinion, 20 pages (Apr. 4, 2025). [cited by applicant]
Roca et al., “Microservice chatbot architecture for chronic patient support,” Journal of Biomedical Informatics, pp. 1-19 (Oct. 2019). [cited by applicant]
Shao et al., “Enhancing Retrieval-Augmented Large Language Models with Iterative Retrieval-Generation Synergy,” ArXiv:2305.15294v1, pp. 1-12 (May 2023). [cited by applicant]