IP Library Granted Patent US 12,596,813
Granted Patent B2
US 12,596,813 · App. 19/283,194 · Granted Apr 7, 2026

Autonomous agent observation and control

Inventors: Manjit Rajaretnam (Irving, TX); Sofia Rahman (New York, NY); William Cameron (Jacksonville, FL); James Myers (Clearwater, FL); Ryan Bergeron (New York, NY)
G06F21/577G06F21/552
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,596,813
App. No.
19/283,194
Granted
Apr 7, 2026
Kind
B2
Abstract

Systems, methods, and devices that relate to monitoring and managing autonomous agents are disclosed. In one example aspect, the method includes receiving activity data from autonomous agents in an operational environment, deploying static and dynamic observing agents to monitor expected behavior and deviations, detecting a deviation by an autonomous agent, determining the cause through analysis, performing a mitigative action based on the cause, and executing a preventative action to block similar future deviations. The method may also involve configuring observing agents with different observation modalities, periodically modifying observation parameters unpredictably, facilitating direct communication between observing agents, resolving conflicts in observations, and updating observation policies. Mitigative actions can include disabling credentials, rerouting communications, and logging actions. Preventative measures may involve updating behavioral policies and adjusting agent parameters to disincentivize problematic behaviors.

Claims (85)

1 . One or more non-transitory, computer-readable storage medium comprising instructions recorded thereon, wherein the instructions, when executed by at least one data processor of a system, cause the system to:

receive, from a plurality of autonomous computing agents deployed within an operational environment, a plurality of activity data streams corresponding to (i) actions and inactions performed by the plurality of autonomous agents and (ii) environmental stimuli captured by the plurality of autonomous agents using a plurality of sensors associated with the operational environment;

deploy a plurality of observing agents, the plurality of observing agents comprising at least one static observing agent configured to monitor for expected agent behavior and at least one dynamic observing agent configured to detect deviations from the expected agent behavior;

detect, in real time using at least one observing agent of the plurality of observing agents, a deviation of an autonomous agent of the plurality of autonomous agents from the expected agent behavior;

identify, via a root-cause analysis, a decision path responsible for the deviation, wherein the decision path is associated with the autonomous agent;

execute, using the identified the decision path, a mitigative action comprising at least one of interrupting execution of the autonomous agent, suspending the autonomous agent, shutting down the autonomous agent, or isolating a subsystem of the autonomous agent; and

execute a preventative action to block future decision paths similar to the identified decision path by the autonomous agent or by other autonomous agents of the plurality of autonomous agents, wherein the preventative action is based on the deviation, the root-cause analysis, and the mitigative action.

2 . The one or more non-transitory, computer-readable storage medium of claim 1 , wherein the instructions further cause the system to:

configure each observing agent of the plurality of observing agents with a respective observation modality selected from a plurality of observation modalities, wherein at least two observing agents of the plurality of observing agents are configured with different observation modalities; and

periodically perform, for the at least one dynamic observing agent of the plurality of observing agents, modifications to an observation parameter set comprising at least one of sampling frequency, data-collection granularity, vantage point within the operational environment, and obfuscation level, such that each modification is unpredictable to the plurality of autonomous agents.

3 . The one or more non-transitory, computer-readable storage medium of claim 1 , wherein the instructions further cause the system to:

cause a first observing agent of the plurality of observing agents to transmit a first observation summary directly to a second observing agent of the plurality of observing agents, wherein the first observing agent is a static observing agent and the second observing agent is a dynamic observing agent;

compare, at the second observing agent, the first observation summary generated by the first observing agent with a second observation summary generated by the second observing agent to detect a conflict between the first observation summary and the second observation summary, the conflict regarding at least one of the plurality of autonomous agents;

based on detecting the conflict, apply, at the second observing agent, a conflict-resolution rule set comprising a precedence rule and a tie-breaking rule to generate a resolved determination for the conflict; and

update an observation policy for the plurality of observing agents based on the resolved determination.

4 . The one or more non-transitory, computer-readable storage medium of claim 1 , wherein the instructions for executing the mitigative action further cause the system to:

generate a revocation signal that disables at least one credential, token, or network route previously assigned to the autonomous agent associated with the decision path;

reroute all subsequent communications originating from or directed to the autonomous agent; and

store the mitigative action, a timestamp, and the decision path, on an auditable ledger.

5 . The one or more non-transitory, computer-readable storage medium of claim 1 , wherein the instructions for executing the preventative action further cause the system to:

update a behavioral policy to include a rule that blocks the decision path and similar decision paths matching the decision path within a similarity threshold;

adjust a parameter of the autonomous agent to disincentivize future selection of the decision path or the similar decision paths; and

transmit the updated behavioral policy to the plurality of autonomous agents.

6 . The one or more non-transitory, computer-readable storage medium of claim 1 , wherein the instructions for detecting the deviation further cause the system to:

employ the at least one dynamic observing agent to perform anomaly detection on the plurality of activity data streams by comparing current activity metrics to a learned baseline to identify unexpected actions or inactions;

employ the at least one static observing agent to compare the actions and the inactions of the autonomous agent to a predefined set of expected behavior patterns; and

detect the deviation based on (i) the at least one dynamic observing agent detecting an unexpected action or an unexpected inaction by the autonomous agent and (ii) the at least one static observing agent failing to identify a corresponding expected behavior pattern from the predefined set of expected behavior patterns.

7 . A computer-implemented method for deploying a distributed observing platform that enables comprehensive monitoring and control of autonomous AI agent behaviors, the method comprising:

receiving, from a plurality of autonomous agents operating within an operational environment, activity data descriptive of agent behavior and environmental conditions;

deploying a plurality of observing agents for monitoring the plurality of autonomous agents, the plurality of observing agents comprising at least one static observing agent configured to monitor for expected agent behavior and at least one dynamic observing agent configured to detect deviations from the expected agent behavior;

detecting, by at least one of the plurality of observing agents, a deviation of an autonomous agent from an expected behavior pattern;

determining, based on an analysis of the activity data, a cause of the deviation;

performing a mitigative action with respect to the autonomous agent based on the cause of the deviation; and

performing a preventative action to block future deviations similar to the deviation by the autonomous agent or by other autonomous agents of the plurality of autonomous agents, wherein the preventative action is based on the deviation, the analysis, and the mitigative action.

8 . The method of claim 7 , further comprising:

configuring each observing agent of the plurality of observing agents with a respective observation modality selected from a plurality of observation modalities, wherein at least two observing agents of the plurality of observing agents are configured with different observation modalities; and

periodically performing, for the at least one dynamic observing agent of the plurality of observing agents, modifications to an observation parameter set comprising at least one of sampling frequency, data-collection granularity, vantage point within the operational environment, and obfuscation level, such that each modification is unpredictable to the plurality of autonomous agents.

9 . The method of claim 7 , further comprising:

causing a first observing agent of the plurality of observing agents to transmit a first observation summary directly to a second observing agent of the plurality of observing agents, wherein the first observing agent is a static observing agent and the second observing agent is a dynamic observing agent;

comparing, at the second observing agent, the first observation summary generated by the first observing agent with a second observation summary generated by the second observing agent to detect a conflict between the first observation summary and the second observation summary, the conflict regarding at least one of the plurality of autonomous agents;

based on detecting the conflict, applying, at the second observing agent, a conflict-resolution rule set comprising a precedence rule and a tie-breaking rule to generate a resolved determination for the conflict; and

updating an observation policy for the plurality of observing agents based on the resolved determination.

10 . The method of claim 7 , wherein performing the mitigative action further comprises:

generating a revocation signal that disables at least one credential, token, or network route previously assigned to the autonomous agent associated with the cause of the deviation;

rerouting all subsequent communications originating from or directed to the autonomous agent; and

storing the mitigative action, a timestamp, and the cause, on an auditable ledger.

11 . The method of claim 7 , wherein executing the preventative action further comprises:

updating a behavioral policy to include a rule that blocks the cause and similar causes matching the cause within a similarity threshold;

adjusting a parameter of the autonomous agent to disincentivize future selection of the cause or the similar causes; and

transmitting the updated behavioral policy to the plurality of autonomous agents.

12 . The method of claim 7 , wherein detecting the deviation further comprises:

employing the at least one dynamic observing agent to perform anomaly detection on the activity data by comparing current activity metrics to a learned baseline to identify unexpected actions or inactions;

employing the at least one static observing agent to compare actions and inactions of the autonomous agent to a predefined set of expected behavior patterns; and

detecting the deviation based on (i) the at least one dynamic observing agent detecting an unexpected action or an unexpected inaction by the autonomous agent and (ii) the at least one static observing agent failing to identify a corresponding expected behavior pattern from the predefined set of expected behavior patterns.

13 . The method of claim 7 , wherein the mitigative action comprises at least one of interrupting execution of the autonomous agent, suspending the autonomous agent, shutting down the autonomous agent, or isolating a subsystem of the autonomous agent.

14 . A system comprising:

a storage device; and

one or more processors communicatively coupled to the storage device storing instructions thereon, that cause the one or more processors to:

receive, from a plurality of autonomous agents operating within an operational environment, activity data descriptive of agent behavior and environmental conditions;

deploy a plurality of observing agents for monitoring the plurality of autonomous agents, the plurality of observing agents comprising at least one static observing agent configured to monitor for expected agent behavior and at least one dynamic observing agent configured to detect deviations from the expected agent behavior;

detect, by at least one of the plurality of observing agents, a deviation of an autonomous agent from an expected behavior pattern;

determine, based on an analysis of the activity data, a cause of the deviation;

perform a mitigative action with respect to the autonomous agent based on the cause of the deviation; and

perform a preventative action to block future deviations similar to the deviation by the autonomous agent or by other autonomous agents of the plurality of autonomous agents, wherein the preventative action is based on the deviation, the analysis, and the mitigative action.

15 . The system of claim 14 , wherein the instructions further cause the one or more processors to:

configure each observing agent of the plurality of observing agents with a respective observation modality selected from a plurality of observation modalities, wherein at least two observing agents of the plurality of observing agents are configured with different observation modalities; and

periodically perform, for the at least one dynamic observing agent of the plurality of observing agents, modifications to an observation parameter set comprising at least one of sampling frequency, data-collection granularity, vantage point within the operational environment, and obfuscation level, such that each modification is unpredictable to the plurality of autonomous agents.

16 . The system of claim 14 , wherein the instructions further cause the one or more processors to:

cause a first observing agent of the plurality of observing agents to transmit a first observation summary directly to a second observing agent of the plurality of observing agents, wherein the first observing agent is a static observing agent and the second observing agent is a dynamic observing agent;

compare, at the second observing agent, the first observation summary generated by the first observing agent with a second observation summary generated by the second observing agent to detect a conflict between the first observation summary and the second observation summary, the conflict regarding at least one of the plurality of autonomous agents;

based on detecting the conflict, apply, at the second observing agent, a conflict-resolution rule set comprising a precedence rule and a tie-breaking rule to generate a resolved determination for the conflict; and

update an observation policy for the plurality of observing agents based on the resolved determination.

17 . The system of claim 14 , wherein the instructions for performing the mitigative action further cause the one or more processors to:

generate a revocation signal that disables at least one credential, token, or network route previously assigned to the autonomous agent associated with the cause of the deviation;

reroute all subsequent communications originating from or directed to the autonomous agent; and

store the mitigative action, a timestamp, and the cause, on an auditable ledger.

18 . The system of claim 14 , wherein the instructions for executing the preventative action further cause the one or more processors to:

update a behavioral policy to include a rule that blocks the cause and similar causes matching the cause within a similarity threshold;

adjust a parameter of the autonomous agent to disincentivize future selection of the cause or the similar causes; and

transmit the updated behavioral policy to the plurality of autonomous agents.

19 . The system of claim 14 , wherein the instructions for detecting the deviation further cause the one or more processors to:

employ the at least one dynamic observing agent to perform anomaly detection on the activity data by comparing current activity metrics to a learned baseline to identify unexpected actions or inactions;

employ the at least one static observing agent to compare actions and inactions of the autonomous agent to a predefined set of expected behavior patterns; and

detect the deviation based on (i) the at least one dynamic observing agent detecting an unexpected action or an unexpected inaction by the autonomous agent and (ii) the at least one static observing agent failing to identify a corresponding expected behavior pattern from the predefined set of expected behavior patterns.

20 . The system of claim 14 , wherein the mitigative action comprises at least one of interrupting execution of the autonomous agent, suspending the autonomous agent, shutting down the autonomous agent, or isolating a subsystem of the autonomous agent.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2026
From: BERGERON, RYAN
To: CITIBANK, N.A.
Reel/Frame 074012/0372 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 8, 2025
From: MYERS, JAMES; RAJARETNAM, MANJIT; RAHMAN, SOFIA; CAMERON, WILLIAM
To: CITIBANK, N.A.
Reel/Frame 072190/0933 →
Continuity (21)
Continuation In Part 19195642 · Apr 30, 2025
Continuation In Part 19182585 · Apr 18, 2025
Continuation In Part 18951366 · Nov 18, 2024
Continuation 18947102 · Nov 14, 2024
Continuation In Part 18782019 · Jul 23, 2024
Continuation In Part 18771876 · Jul 12, 2024
Continuation In Part 18762362 · Jul 2, 2024
Continuation In Part 18739111 · Jun 10, 2024
Continuation In Part 18661519 · May 10, 2024
Continuation In Part 18661532 · May 10, 2024
Continuation In Part 18653858 · May 2, 2024
Continuation In Part 18637362 · Apr 16, 2024
Continuation In Part 18633293 · Apr 11, 2024
Continuation 18624409 · Apr 2, 2024
Continuation 18624409 · Apr 2, 2024
Continuation In Part 18607141 · Mar 15, 2024
Continuation In Part 18399422 · Dec 28, 2023
Continuation 18327040 · May 31, 2023
Continuation In Part 18114194 · Feb 24, 2023
Continuation In Part 18098895 · Jan 19, 2023
Related Publication 20250356026A1 · Nov 20, 2025
References Cited (341)
US 8347147B2 · Adiyapatham et al. · 2013 [cited by applicant]
US 8380817B2 · Okada · 2013 [cited by applicant]
US 8387020B1 · Maclachlan et al. · 2013 [cited by applicant]
US 8959633B1 · Dokey · 2015 [cited by examiner]
US 9842045B2 · Heorhiadi et al. · 2017 [cited by applicant]
US 10324827B2 · Narayanan et al. · 2019 [cited by applicant]
US 10426442B1 · Schnorr · 2019 [cited by applicant]
US 10430581B2 · Lamothe-Brassard · 2019 [cited by examiner]
US 10620988B2 · Lauderdale et al. · 2020 [cited by applicant]
US 10671726B1 · Paithane · 2020 [cited by examiner]
US 10764150B1 · Hermoni et al. · 2020 [cited by applicant]
US 10902117B1 · Singh · 2021 [cited by examiner]
US 10902119B1 · Vashisht · 2021 [cited by examiner]
US 10943067B1 · Brown et al. · 2021 [cited by applicant]
US 10949337B1 · Yalla et al. · 2021 [cited by applicant]
US 10951485B1 · Hermoni et al. · 2021 [cited by applicant]
US 11042647B1 · Joyce et al. · 2021 [cited by applicant]
US 11106801B1 · Levine et al. · 2021 [cited by applicant]
US 11133942B1 · Griffin · 2021 [cited by applicant]
US 11153177B1 · Hermoni et al. · 2021 [cited by applicant]
US 11164078B2 · Jin et al. · 2021 [cited by applicant]
US 11227047B1 · Vashisht et al. · 2022 [cited by applicant]
US 11227187B1 · Weinberger · 2022 [cited by applicant]
US 11271822B1 · Hermoni et al. · 2022 [cited by applicant]
US 11290483B1 · Kannan et al. · 2022 [cited by applicant]
US 11328068B1 · Niedzwiedz et al. · 2022 [cited by applicant]
US 11410136B2 · Cook et al. · 2022 [cited by applicant]
US 11449798B2 · Olgiati et al. · 2022 [cited by applicant]
US 11470106B1 · Lin et al. · 2022 [cited by applicant]
US 11503075B1 · Sirianni et al. · 2022 [cited by applicant]
US 11516158B1 · Luzhnica et al. · 2022 [cited by applicant]
US 11516222B1 · Srinivasan et al. · 2022 [cited by applicant]
US 11521716B2 · Vianu et al. · 2022 [cited by applicant]
US 11573848B2 · Linck et al. · 2023 [cited by applicant]
US 11636027B2 · Sloane · 2023 [cited by applicant]
US 11652839B1 · Aloisio et al. · 2023 [cited by applicant]
US 11656852B2 · Mazurskiy · 2023 [cited by applicant]
US 11681811B1 · Dixit · 2023 [cited by applicant]
US 11683333B1 · Dominessy et al. · 2023 [cited by applicant]
US 11706241B1 · Cross et al. · 2023 [cited by applicant]
US 11720686B1 · Cross et al. · 2023 [cited by applicant]
US 11734418B1 · Epstein · 2023 [cited by applicant]
US 11741226B2 · Dixit · 2023 [cited by applicant]
US 11750717B2 · Walsh et al. · 2023 [cited by applicant]
US 11875123B1 · Ben David et al. · 2024 [cited by applicant]
US 11875130B1 · Bosnjakovic et al. · 2024 [cited by applicant]
US 11893341B2 · Itani · 2024 [cited by applicant]
US 11924027B1 · Mysore et al. · 2024 [cited by applicant]
US 11947435B2 · Boulineau et al. · 2024 [cited by applicant]
US 11960386B2 · Indani et al. · 2024 [cited by applicant]
US 11960515B1 · Pallakonda et al. · 2024 [cited by applicant]
US 11983806B1 · Ramesh et al. · 2024 [cited by applicant]
US 11990139B1 · Sandrew · 2024 [cited by applicant]
US 11995412B1 · Mishra · 2024 [cited by applicant]
US 12001462B1 · Madisetti et al. · 2024 [cited by applicant]
US 12001463B1 · Pallakonda et al. · 2024 [cited by applicant]
US 12026599B1 · Lewis et al. · 2024 [cited by applicant]
US 12028368B1 · Cohen et al. · 2024 [cited by applicant]
US 12061970B1 · Lo et al. · 2024 [cited by applicant]
US 12106205B1 · Jain et al. · 2024 [cited by applicant]
US 12107869B1 · Kannan et al. · 2024 [cited by applicant]
US 12111747B1 · Jain et al. · 2024 [cited by applicant]
US 12111754B1 · Mysore et al. · 2024 [cited by applicant]
US 12130914B1 · Bushner · 2024 [cited by examiner]
US 12135949B1 · Cameron et al. · 2024 [cited by applicant]
US 12147513B1 · Jain et al. · 2024 [cited by applicant]
US 12149553B1 · Fly et al. · 2024 [cited by applicant]
US 12149558B1 · Brown et al. · 2024 [cited by applicant]
US 12155781B1 · Helfgott et al. · 2024 [cited by applicant]
US 12182258B2 · Stokes et al. · 2024 [cited by applicant]
US 12198030B1 · Mysore et al. · 2025 [cited by applicant]
US 12375573B1 · Nanduri · 2025 [cited by examiner]
US 20030007178A1 · Jeyachandran et al. · 2003 [cited by applicant]
US 20040098454A1 · Trapp et al. · 2004 [cited by applicant]
US 20050166094A1 · Blackwell et al. · 2005 [cited by applicant]
US 20050204348A1 · Horning et al. · 2005 [cited by applicant]
US 20060095918A1 · Hirose · 2006 [cited by applicant]
US 20070067848A1 · Gustave et al. · 2007 [cited by applicant]
US 20070240215A1 · Flores · 2007 [cited by examiner]
US 20100275263A1 · Bennett et al. · 2010 [cited by applicant]
US 20100313189A1 · Beretta et al. · 2010 [cited by applicant]
US 20120161940A1 · Taylor · 2012 [cited by applicant]
US 20140137257A1 · Martinez et al. · 2014 [cited by applicant]
US 20140258998A1 · Adl-tabatabai et al. · 2014 [cited by applicant]
US 20140297954A1 · Clevenger · 2014 [cited by applicant]
US 20160103996A1 · Salajegheh et al. · 2016 [cited by applicant]
US 20160359890A1 · Deen · 2016 [cited by examiner]
US 20170061132A1 · Hovor et al. · 2017 [cited by applicant]
US 20170262164A1 · Jain et al. · 2017 [cited by applicant]
US 20170279826A1 · Mohanty et al. · 2017 [cited by applicant]
US 20170279839A1 · Vasseur · 2017 [cited by examiner]
US 20170295197A1 · Parimi et al. · 2017 [cited by applicant]
US 20180020021A1 · Gilmore et al. · 2018 [cited by applicant]
US 20180089252A1 · Long et al. · 2018 [cited by applicant]
US 20180095866A1 · Narayanan et al. · 2018 [cited by applicant]
US 20180239903A1 · Bodin et al. · 2018 [cited by applicant]
US 20180307894A1 · Lim et al. · 2018 [cited by applicant]
US 20180343114A1 · Ben-ari · 2018 [cited by applicant]
US 20190079854A1 · Lassance Oliveira E Silva et al. · 2019 [cited by applicant]
US 20190188706A1 · Mccurtis · 2019 [cited by applicant]
US 20190236661A1 · Hogg et al. · 2019 [cited by applicant]
US 20190286816A1 · Fu · 2019 [cited by applicant]
US 20200012493A1 · Sagy · 2020 [cited by applicant]
US 20200043164A1 · Fuchs et al. · 2020 [cited by applicant]
US 20200074470A1 · Deshpande et al. · 2020 [cited by applicant]
US 20200153855A1 · Kirti et al. · 2020 [cited by applicant]
US 20200219009A1 · Dao et al. · 2020 [cited by applicant]
US 20200233979A1 · Tahmasebi Maraghoosh et al. · 2020 [cited by applicant]
US 20200259852A1 · Wolff et al. · 2020 [cited by applicant]
US 20200309767A1 · Loo et al. · 2020 [cited by applicant]
US 20200310866A1 · Varadaraj et al. · 2020 [cited by applicant]
US 20200314191A1 · Madhavan et al. · 2020 [cited by applicant]
US 20200334326A1 · Zhang et al. · 2020 [cited by applicant]
US 20200349054A1 · Dai et al. · 2020 [cited by applicant]
US 20200349466A1 · Hoogerwerf et al. · 2020 [cited by applicant]
US 20200380118A1 · Miller et al. · 2020 [cited by applicant]
US 20200387608A1 · Miller et al. · 2020 [cited by applicant]
US 20210012486A1 · Huang et al. · 2021 [cited by applicant]
US 20210049288A1 · Li · 2021 [cited by applicant]
US 20210089941A1 · Chen et al. · 2021 [cited by applicant]
US 20210097433A1 · Olgiati et al. · 2021 [cited by applicant]
US 20210133182A1 · Anderson et al. · 2021 [cited by applicant]
US 20210185094A1 · Waplington et al. · 2021 [cited by applicant]
US 20210211431A1 · Albero et al. · 2021 [cited by applicant]
US 20210256125A1 · Miller et al. · 2021 [cited by applicant]
US 20210264547A1 · Li · 2021 [cited by applicant]
US 20210273957A1 · Boyer et al. · 2021 [cited by applicant]
US 20210390465A1 · Werder et al. · 2021 [cited by applicant]
US 20220004923A1 · Kamkar et al. · 2022 [cited by applicant]
US 20220050928A1 · Shukla et al. · 2022 [cited by applicant]
US 20220078210A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220086162A1 · Badawy et al. · 2022 [cited by applicant]
US 20220092953A1 · Krishnan et al. · 2022 [cited by applicant]
US 20220100332A1 · Haworth et al. · 2022 [cited by applicant]
US 20220101326A1 · Kim et al. · 2022 [cited by applicant]
US 20220109685A1 · Hankins et al. · 2022 [cited by applicant]
US 20220114251A1 · Guim Bernat et al. · 2022 [cited by applicant]
US 20220114399A1 · Castiglione et al. · 2022 [cited by applicant]
US 20220124013A1 · Chitalia · 2022 [cited by examiner]
US 20220124115A1 · Grabois et al. · 2022 [cited by applicant]
US 20220138327A1 · Panicker et al. · 2022 [cited by applicant]
US 20220147636A1 · Mahuli et al. · 2022 [cited by applicant]
US 20220147815A1 · Conwell et al. · 2022 [cited by applicant]
US 20220150275A1 · Mcnee et al. · 2022 [cited by applicant]
US 20220164732A1 · Brannon et al. · 2022 [cited by applicant]
US 20220166789A1 · Murray et al. · 2022 [cited by applicant]
US 20220179906A1 · Desai et al. · 2022 [cited by applicant]
US 20220188460A1 · Hadar et al. · 2022 [cited by applicant]
US 20220191224A1 · Ståhlberg · 2022 [cited by examiner]
US 20220191236A1 · Henderson · 2022 [cited by applicant]
US 20220198304A1 · Szczepanik et al. · 2022 [cited by applicant]
US 20220201042A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220210200A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220210202A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220222089A1 · Joshi et al. · 2022 [cited by applicant]
US 20220224702A1 · Dherange et al. · 2022 [cited by applicant]
US 20220224723A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220237565A1 · Dzierzanowski et al. · 2022 [cited by applicant]
US 20220263843A1 · Aslam et al. · 2022 [cited by applicant]
US 20220263855A1 · Engelberg et al. · 2022 [cited by applicant]
US 20220263860A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220278889A1 · Malleshaiah et al. · 2022 [cited by applicant]
US 20220286438A1 · Burke et al. · 2022 [cited by applicant]
US 20220286474A1 · Kuppa et al. · 2022 [cited by applicant]
US 20220294789A1 · Tikhomirov et al. · 2022 [cited by applicant]
US 20220294810A1 · Tyagi et al. · 2022 [cited by applicant]
US 20220303295A1 · Erlingsson et al. · 2022 [cited by applicant]
US 20220303300A1 · Egan · 2022 [cited by applicant]
US 20220303302A1 · Hwang et al. · 2022 [cited by applicant]
US 20220303352A1 · Herzog et al. · 2022 [cited by applicant]
US 20220311681A1 · Palladino et al. · 2022 [cited by applicant]
US 20220318654A1 · Lin et al. · 2022 [cited by applicant]
US 20220327620A1 · Ndoutoumou · 2022 [cited by applicant]
US 20220334818A1 · Mcfarland · 2022 [cited by applicant]
US 20220342846A1 · Kunchakarra et al. · 2022 [cited by applicant]
US 20220345457A1 · Jeffords et al. · 2022 [cited by applicant]
US 20220358023A1 · Moser et al. · 2022 [cited by applicant]
US 20220366140A1 · Saito et al. · 2022 [cited by applicant]
US 20220368728A1 · Murray et al. · 2022 [cited by applicant]
US 20220377093A1 · Crabtree et al. · 2022 [cited by applicant]
US 20220398149A1 · Mcfarland et al. · 2022 [cited by applicant]
US 20220400135A1 · Gamra · 2022 [cited by applicant]
US 20220405397A1 · Golan et al. · 2022 [cited by applicant]
US 20220414213A1 · Dixit · 2022 [cited by applicant]
US 20220414536A1 · M L et al. · 2022 [cited by applicant]
US 20220417274A1 · Madanahalli et al. · 2022 [cited by applicant]
US 20230007039A1 · Waplington · 2023 [cited by applicant]
US 20230009999A1 · Higuchi et al. · 2023 [cited by applicant]
US 20230018960A1 · Ardel · 2023 [cited by applicant]
US 20230019072A1 · Okunlola · 2023 [cited by applicant]
US 20230028339A1 · Sloane · 2023 [cited by applicant]
US 20230032686A1 · Williams et al. · 2023 [cited by applicant]
US 20230033317A1 · Lin et al. · 2023 [cited by applicant]
US 20230035321A1 · Vijayaraghavan · 2023 [cited by applicant]
US 20230039855A1 · Greene · 2023 [cited by applicant]
US 20230052608A1 · Wattiau et al. · 2023 [cited by applicant]
US 20230067128A1 · Engelberg et al. · 2023 [cited by applicant]
US 20230071264A1 · Hakala et al. · 2023 [cited by applicant]
US 20230076372A1 · Engelberg et al. · 2023 [cited by applicant]
US 20230076795A1 · Indani et al. · 2023 [cited by applicant]
US 20230077527A1 · Sarkar · 2023 [cited by applicant]
US 20230113621A1 · Griffin et al. · 2023 [cited by applicant]
US 20230114719A1 · Thomas et al. · 2023 [cited by applicant]
US 20230117962A1 · Kaimal et al. · 2023 [cited by applicant]
US 20230118388A1 · Crabtree et al. · 2023 [cited by applicant]
US 20230123314A1 · Crabtree et al. · 2023 [cited by applicant]
US 20230132703A1 · Marsenic et al. · 2023 [cited by applicant]
US 20230135660A1 · Chapman et al. · 2023 [cited by applicant]
US 20230148116A1 · Stokes et al. · 2023 [cited by applicant]
US 20230164158A1 · Fellows et al. · 2023 [cited by applicant]
US 20230169397A1 · Smith et al. · 2023 [cited by applicant]
US 20230171282A1 · Bollinger · 2023 [cited by applicant]
US 20230177441A1 · Durvasula et al. · 2023 [cited by applicant]
US 20230177613A1 · Crabtree et al. · 2023 [cited by applicant]
US 20230186175A1 · Usatov et al. · 2023 [cited by applicant]
US 20230205888A1 · Tyagi et al. · 2023 [cited by applicant]
US 20230205891A1 · Yellapragada et al. · 2023 [cited by applicant]
US 20230208855A1 · Sheriff · 2023 [cited by examiner]
US 20230208869A1 · Bisht et al. · 2023 [cited by applicant]
US 20230208870A1 · Yellapragada et al. · 2023 [cited by applicant]
US 20230208871A1 · Yellapragada et al. · 2023 [cited by applicant]
US 20230229542A1 · Watkins et al. · 2023 [cited by applicant]
US 20230252393A1 · Orzechowski et al. · 2023 [cited by applicant]
US 20230259860A1 · Sarkar · 2023 [cited by applicant]
US 20230269272A1 · Dambrot et al. · 2023 [cited by applicant]
US 20230274003A1 · Liu et al. · 2023 [cited by applicant]
US 20230274089A1 · Tunstall-pedoe et al. · 2023 [cited by applicant]
US 20230316003A1 · Friedman et al. · 2023 [cited by applicant]
US 20230359789A1 · Andre et al. · 2023 [cited by applicant]
US 20230362200A1 · Crabtree et al. · 2023 [cited by applicant]
US 20230379350A1 · Barton · 2023 [cited by examiner]
US 20230396641A1 · Hebbagodi et al. · 2023 [cited by applicant]
US 20230412635A1 · Binyamini et al. · 2023 [cited by applicant]
US 20240012734A1 · Lee et al. · 2024 [cited by applicant]
US 20240020538A1 · Socher et al. · 2024 [cited by applicant]
US 20240037245A1 · Kahan et al. · 2024 [cited by applicant]
US 20240054233A1 · Ohayon et al. · 2024 [cited by applicant]
US 20240054249A1 · Loubet Moundi et al. · 2024 [cited by applicant]
US 20240095077A1 · Singh et al. · 2024 [cited by applicant]
US 20240095463A1 · Leary et al. · 2024 [cited by applicant]
US 20240111960A1 · Earle et al. · 2024 [cited by applicant]
US 20240129345A1 · Kassam et al. · 2024 [cited by applicant]
US 20240144082A1 · Tarapov et al. · 2024 [cited by applicant]
US 20240146734A1 · Southgate et al. · 2024 [cited by applicant]
US 20240202442A1 · Saito et al. · 2024 [cited by applicant]
US 20240202539A1 · Poirier et al. · 2024 [cited by applicant]
US 20240242040A1 · Cogswell et al. · 2024 [cited by applicant]
US 20240256678A1 · Thompson · 2024 [cited by applicant]
US 20240273306A1 · Somaiya et al. · 2024 [cited by applicant]
US 20240323202A1 · Niv et al. · 2024 [cited by applicant]
US 20240330466A1 · Constable et al. · 2024 [cited by applicant]
US 20240333741A1 · Abdelrahman et al. · 2024 [cited by applicant]
US 20240333743A1 · Bazalgette et al. · 2024 [cited by applicant]
US 20240333753A1 · Cross et al. · 2024 [cited by applicant]
US 20240333768A1 · Shahrivar · 2024 [cited by examiner]
US 20240338387A1 · Iscen et al. · 2024 [cited by applicant]
US 20240340301A1 · Thompson · 2024 [cited by applicant]
US 20240340302A1 · Wang et al. · 2024 [cited by applicant]
US 20240346151A1 · Goswami et al. · 2024 [cited by applicant]
US 20240346283A1 · Ayachitula et al. · 2024 [cited by applicant]
US 20240356984A1 · Gamra · 2024 [cited by applicant]
US 20240356986A1 · Crabtree et al. · 2024 [cited by applicant]
US 20240364725A1 · Sinha et al. · 2024 [cited by applicant]
US 20240364749A1 · Crabtree et al. · 2024 [cited by applicant]
US 20240370476A1 · Madisetti et al. · 2024 [cited by applicant]
US 20240394401A1 · Agrawal · 2024 [cited by examiner]
US 20240403420A1 · Lal et al. · 2024 [cited by applicant]
US 20240403428A1 · Lal et al. · 2024 [cited by applicant]
US 20240403437A1 · Szigeti et al. · 2024 [cited by applicant]
US 20240403445A1 · Straub et al. · 2024 [cited by applicant]
US 20240406145A1 · Crabtree et al. · 2024 [cited by applicant]
US 20240411896A1 · Myers et al. · 2024 [cited by applicant]
US 20240414191A1 · Humphrey et al. · 2024 [cited by applicant]
US 20240414211A1 · Boyer et al. · 2024 [cited by applicant]
US 20250005167A1 · Millar et al. · 2025 [cited by applicant]
US 20250013753A1 · Conway · 2025 [cited by applicant]
US 20250021464A1 · Lang et al. · 2025 [cited by applicant]
US 20250301011A1 · Niemelä · 2025 [cited by examiner]
CN 106502890A · 2017 [cited by applicant]
CN 115796299A · 2023 [cited by applicant]
CN 116775837A · 2023 [cited by applicant]
CN 117391216A · 2024 [cited by applicant]
CN 117453915A · 2024 [cited by applicant]
CN 117633174B · 2024 [cited by applicant]
CN 118170874A · 2024 [cited by applicant]
WO 2021160499A1 · 2021 [cited by applicant]
WO 2022125803A1 · 2022 [cited by applicant]
WO 2022135973A1 · 2022 [cited by applicant]
WO 2023161630A1 · 2023 [cited by applicant]
WO 2024020416A1 · 2024 [cited by applicant]
AI Risk Management Framework NIST, retrieved on Jun. 17, 2024, https://www.nist.gov/itl/ai-risk-management-framework. [cited by applicant]
Coalition for Content Provenance and Authenticity, Contents Credentials C2PA Technological Specification, v2.1,Sep. 20, 2024. (Year: 2024). [cited by applicant]
Empower Your Team with a Compliance Co-Pilot, Sedric, retrieved on Sep. 25, 2024. https://www.sedric.ai/. [cited by applicant]
Independent analysis of AI language models and API providers. Artificial Analysis, retrieved on Jun. 13, 2024, https://artificialanalysis.ai/, 11 pages. [cited by applicant]
What is AI Verify?, AI Verify Foundation, Jun. 11, 2024, 3 pages, https://aiverifyfoundation.sg/. [cited by applicant]
Agarwal et al., How generative AI can help banks manage risk and compliance, McKinsey & Company, Mar. 2024; Total pp. 8 (Year: 2024). [cited by applicant]
Aka et al., Measuring Model Biases in the Absence of Ground Truth, AIES '21, May 19-21, 2021, Virtual Event, USA.; pp. 327-335 (Year: 2021). [cited by applicant]
Brown, D., et al., “The Great AI Challenge: We Test Five Top Bots on Useful, Everyday Skills,” The Wall Street Journal, published May 25, 2024. [cited by applicant]
Brown, Nik Bear, “Enhancing Trust in LLMs: Algorithms for Comparing and Interpreting LLMs”, ARXIV ID: 2406.01943 Publication Date: Jun. 3, 2024, pp. 1-58. (Year: 2024). [cited by applicant]
Chen, Kua, et at, Automated Domain Modeling with Large Language Models: A Comparative Study, 2023 ACM/IEEE 26th International Conference on Model Driven Engineering Languages and Systems (MODELS) (2023, pp. 162-172) (Ye… [cited by applicant]
Cranium, Adopt & Accelerate AI Safely, retrieved on Nov. 7, 2024, from https://cranium.ai/. [cited by applicant]
Dakhel et al, Apr. 2024, “Effective test generation using pre-trained Large Language Models and mutation testing” (Year: 2024). [cited by applicant]
Do et al, Apr. 3, 2024, “Automatic Prompt Selection for Large Language Models” (Year: 2024). [cited by applicant]
Dong, Y., et al., “Building Guardrails for Large Language Models,” https://ar5iv.labs.arxiv.org/html/2402.01822v1, published May 29, 2024, 20 pages. [cited by applicant]
Farris, K., A., et al., “VULCON: A System for Vulnerability Prioritization, Mitigation, and Management,” ACM Transactions on Privacy and Security, vol. 21, No. 4, Article 16. Publication date: Jun. 2018, 28 pages. [cited by applicant]
Futurism, “Sam Altman Admits That OpenAI Doesn't Actually Understand How Its AI Works”, Jun. 11, 2024, 4 pages, https://futurism.com/sam-altman-admits-openai-understand-ai. [cited by applicant]
Generative machine learning models; IPCCOM000272835D, Aug. 17, 2023. (Year: 2023). [cited by applicant]
Guldimann, P., et al. “COMPL-AI Framework: A Technical Interpretation and LLM Benchmarking Suite for the EU Artificial Intelligence Act,” arXiv:2410.07959v1 [cs.CL] Oct. 10, 2024, 38 pages. [cited by applicant]
Hu, Q., J., et al., “ROUTERBENCH: A Benchmark for Multi-LLM Routing System,” arXiv:2403.12031v2 [cs.LG] Mar. 28, 2024, 16 pages. [cited by applicant]
International Search Report and Written Opinion received in Application No. PCT/US24/47571, dated Dec. 9, 2024, 10 pages. [cited by applicant]
International Search Report and Written Opinion received in Application No. PCT/US25/24406, dated Jul. 18, 2025, 10 pages. [cited by applicant]
International Search Report and Written Opinion Received received in Application No. PCT/US23/85942, dated Feb. 15, 2024, 6 pages. [cited by applicant]
Kojima, Takeshi, et al. “Large Language Models are Zero-Shot Reasoners,” 36th Conference on Neural Information Processing Systems (NeurIPS 2022), arXiv:2205.11916 [cs.CL], Jan. 29, 2023, 42 pages. [cited by applicant]
Lai et al., Towards a Science of Human-AI Decision Making: A Survey of Empirical Studies, arXiv:2112.11471v1 [cs.AI] Dec. 21, 2021; Total pp. 36 (Year: 2021). [cited by applicant]
Malode, 2023, “Benchmarking public large language model” (Year: 2023). [cited by applicant]
Mathews, A. W., “What AI Can Do in Healthcare—and What It Should Never Do,” The Wall Street Journal, published on Aug. 21, 2024, retrieved on Sep. 5, 2024 https://www.wsj.com. [cited by applicant]
Mavrepis, P., et al., “XAI for All: Can Large Language Models Simplify Explainable AI?,” https://arxiv.org/abs/2401.13110, Jan. 23, 2024, 10 pages. [cited by applicant]
Mollick, E., “Latent Expertise: Everyone is in R&D,” One Useful Thing, published on Jun. 20, 2024, https://www.oneusefulthing.org/p/latent-expertise-everyone-is-in-r. [cited by applicant]
Nauta, M., et al., “From Anecdotal Evidence to Quantative Evaluation Methods: A Systematic Review of Evaluating Explainable AI” ACM Computing Surveys, vol. 55 No. 13s Article 295, 2023 [retrieved Jul. 3, 2024]. [cited by applicant]
Naveed et al, 2023, “A Comprehensive Overview of Large Language Models” (Year: 2023). [cited by applicant]
Peers, M., “What California Al Bill Could Mean,” The Briefing, published and retrieved Aug. 30, 2024, 8 pages, https://www.theinformation.com/articles/what-california-ai-bill-could-mean. [cited by applicant]
Schick et al., Toolformer: Language Models Can Teach Themselves to Use Tools, 37th Conference on Neural Information Processing Systems (NeurIPS 2023); Total pp. 13 (Year: 2023). [cited by applicant]
Stokes, et al. “Preventing Machine Learning Poisoning Attacks Using Authentication and Provenance”, MILCOM 2021—2021 IEEE Military Communications Conference (MILCOM), 2021, pp. 181-188. (Year: 2021). [cited by applicant]
Sumuk Shashidhar et al., ‘Democratizing LLMs: An Exploration of Cost-Performance Trade-offs in Self-Refined Open-Source Models’, arXiv:2310.07611v2, pp. 1-15, Oct. 2023. [cited by applicant]
Wang, Yudong, et al, “Exploring Activation Patterns of Parameters in Language Models”, ARXIV ID: 2405.17799 Publication Date: May 27, 2024, pp. 1-23. (Year: 2024). [cited by applicant]
Wei, Jason, et al. “Chain-of-Thought Prompting Elicits Reasoning in Large Language Models,” 36th Conference on Neural Information Processing Systems (NeurIPS 2022), arXiv:2201.11903 [cs.CL], Jan. 10, 2023, 43 pages. [cited by applicant]
Yang Liu et al., ‘Trustworthy Llms: a Survey and Guideline for Evaluating Large Language Models' Alignment’ , arXiv:2308.05374v2, pp. 1-81, Mar. 2024. [cited by applicant]
Yuan et al., R-Judge: Benchmarking Safety Risk Awareness for LLM Agents, arXiv:2401.10019v1 [cs.CL] Jan. 18, 2024; Total pp. 23 (Year: 2024). [cited by applicant]
Zhao, H., et al., “Explainability for Large Language Models: A Survey,” https://arxiv.org/abs/2309.01029, Nov. 28, 2024, 38 pages. [cited by applicant]
Zhou, Y., Liu, Y., Li, X., Jin, J., Qian, H., Liu, Z., Li, C., Dou, Z., Ho, T., & Yu, P. S. (2024). Trustworthiness in Retrieval-Augmented Generation Systems: A Survey. ArXiv./abs/2409.10102. [cited by applicant]
“Singapore launches Project Moonshot”, a generative Artificial Intelligence testing toolkit to address LLM safety and security challenges, https://www.imda.gov.sg/resources/press-releases-factsheets-and-speeches/press-r… [cited by applicant]
Aggarwal, Nitin, KPIs for gen AI: Why measuring your new AI is essential to its success, https://cloud.google.com/transform/kpis-for-gen-ai-why-measuring-your-new-ai-is-essential-to-its-success. [cited by applicant]
ANTHROP/C, Mapping the Mind of a Large Language Model, https://www.anthropic.com/research/mapping-mind-language-model, May 21, 2024. [cited by applicant]
Claburn, Thomas, OpenAI's GPT-4 can exploit real vulnerabilities by reading security advisories, The Register, https://www.theregister.com/2024/04/17/gpt4_can_exploit_real_vulnerabilities/?utm_source=tld rai, Apr. 17, 2… [cited by applicant]
Marshall, Andrew, Threat Modeling AI/ML Systems and Dependencies, Nov. 2, 2022, 27 pages. [cited by applicant]
Roose, Kevin, “A.I. Has a Measurement Problem”, The New York Times, Apr. 15, 2024, 5 pages. [cited by applicant]
Roose, Kevin, “A.I.'s Black Boxes Just Got a Little Less Mysterious”, The New York Times, May 21, 2024, 5 pages. [cited by applicant]
Shah, Harshay, Decomposing and Editing Predictions by Modeling Model Computation, arXiv:2404.11534v1 [cs.LG] Apr. 17, 2024. [cited by applicant]
Shankar, Ram, “Failure Modes in Machine Learning”, Nov. 2019, 14 pages. [cited by applicant]
International Search Report and Written Opinion Received in Application No. PCT/US25/24939, dated Jul. 30, 2025, 12 pages. [cited by applicant]
Meike Nauta et al., ‘From Anecdotal Evidence to Quantitative Evaluation Methods: A Systematic Review on Evaluating Explainable AI’, arXiv:2201.08164v3, pp. 1-43, Feb. 24, 2023. [cited by applicant]