Systems and methods for providing an ai-based computer-aided dispatch (cad) data interface at an emergency communication center (ECC)
An emergency response system is operable to provide artificial intelligence (AI)-based CAD interface (e.g., read/write/action), in accordance with aspects of the disclosure. The emergency response system includes an emergency response data system (ERDS) that hosts emergency management applications that are operable on ECC computing systems. Client-side components and/or back-end components work together in concert with agentic AI (e.g., an AI agent, one or more large language models (LLMs), machine learning (ML), etc.) to extract CAD data from a screenshot of a CAD user interface (UI) operating at an ECC. An AI agent and/or LLMs may be operable to condition (e.g., format) the data into, for example, a payload that may be used to: deliver the data to another CAD system, populate a protocol tool/form integrated into the emergency management application, and/or perform CAD dispatch operations from the emergency management application.
1 . A computer-implemented method for providing an artificial intelligence (AI)-based computer aided dispatch (CAD) data interface at an emergency communication center (ECC), comprising:
operating a browser extension on a web browser operating on the ECC computing system; and communicating a request, from the browser extension, to the image capture application to capture the image of a CAD UI;
capturing an image of a computer-aided dispatch (CAD) user interface (UI) of a CAD program operating by an ECC computing system;
wherein capturing an image of a CAD UI includes: operating an image capture application operating on the ECC computing system; and capturing a screenshot of the CAD UI, using the image capture application, to generate the image of the CAD UI;
transmitting image data from ECC computing system to a data processing server, the image data representing the image of the CAD UI;
providing the image data to an AI model for data extraction from the image;
providing instructions to the AI model to extract CAD data from the image, the CAD data representing data displayed by the CAD UI when the image was captured; and
receiving the CAD data from the AI model to facilitate response to an emergency incident.
2 . The computer-implemented method of claim 1 , wherein providing the image data to the AI model includes providing the image data to an AI agent having one or more AI models.
3 . The computer-implemented method of claim 2 , wherein the AI agent is operable to use one or more large language models (LLMs) or one or more machine learning algorithms.
4 . The computer-implemented method of claim 1 , wherein capturing an image of a CAD UI includes:
operating a browser extension on a web browser operating on the ECC computing system; and
capturing a screenshot of the CAD UI, using the browser extension, to generate the image of the CAD UI.
5 . The computer-implemented method of claim 1 , further comprising:
detecting a new incident received at the ECC; and
triggering capture of the image of the CAD UI based on the new incident.
6 . The computer-implemented method of claim 5 , wherein detecting the new incident is based on at least one of ANI (automatic number identification) data, ALI (automatic location identification) data; CDR (call detail record) data, or SIP (session initiation protocol) data.
7 . The computer-implemented method of claim 1 , further comprising:
providing an emergency management application operating on the ECC computing system to display an emergency management user interface (UI) at the ECC; and
transmitting the image data, with the emergency management application, from the ECC computing system to the data processing server.
8 . The computer-implemented method of claim 1 , wherein the CAD program is a first CAD program, wherein the ECC computing system is a first ECC computing system, the method further comprising:
transmitting the CAD data to a second CAD program operating by a second ECC computing system to enable CAD-to-CAD interoperability.
9 . The computer-implemented method of claim 1 , further comprising:
populating data fields of an intake procedure tool using at least part of the CAD data, wherein the intake procedure tool is integrated into an emergency management application operable by the ECC computing system and hosted by the data processing server.
10 . The computer-implemented method of claim 1 , wherein capturing the image data includes capturing the image data with an AI agent operating on the computing system.
11 . The computer-implemented method of claim 10 , wherein transmitting the image data includes transmitting the image data with the AI agent to the data processing server.
12 . A computer-implemented method for providing an artificial intelligence (AI)-based computer aided dispatch (CAD) data interface at an emergency communication center (ECC), comprising:
operating a browser extension on a web browser operating on the ECC computing system; and communicating a request, from the browser extension, to the image capture application to capture the image of a CAD UI;
capturing, with a first AI agent, an image of a computer-aided dispatch (CAD) user interface (UI) of a CAD program,
wherein capturing an image of a CAD UI includes: operating an image capture application operating on the ECC computing system; and capturing a screenshot of the CAD UI, using the image capture application, to generate the image of the CAD UI;
wherein the CAD UI is displayed by a first ECC computing system,
wherein the first AI agent is operated by the first ECC computing system,
wherein the CAD program is operated by a second ECC computing system;
extracting the CAD data from the CAD image using the first AI agent or a second AI agent, wherein the second AI agent is operated by a data processing server;
storing the CAD data with the data processing server; and populating a target application with at least part of the CAD data, wherein the target application is at least one of: an emergency response application operable by the first computing system, a second CAD program, or a protocol form to facilitate response to an emergency incident.
13 . The computer-implemented method of claim 12 , wherein first ECC computing system is communicatively coupled to the second ECC computing system with a remote desktop application, wherein the CAD UI is displayed by the first ECC computing system using the remote desktop application.
14 . The computer-implemented method of claim 12 , wherein the first AI agent is operable to use one or more large language models (LLMs) or one or more machine learning algorithms.
15 . A computer-implemented method for providing an artificial intelligence (AI)-based computer aided dispatch (CAD) data interface at an emergency communications center (ECC), comprising:
receiving, with a data processing server, emergency response data representative of a 911 call initiated with an emergency communications center (ECC);
providing an AI agent operable on an ECC computing system at the ECC;
providing the AI agent with access to the emergency response data; and
populating, with the AI agent, a target application with at least part of the emergency response data, wherein the target application is at least one of: an emergency response application operable by the ECC computing system, a CAD program, or a protocol form to facilitate response to an emergency incident; wherein the ECC computing system is a first ECC computing system, the method further comprising: executing, with the AI agent, keyboard commands operable on the first ECC computing system or on a second ECC computing system to populate the target application with the at least part of the emergency response data, wherein the CAD program is operated by the second ECC computing system; and
establishing peer-to-peer communications between the first ECC computing system and the second ECC computing system using hardware communications interfaces.
16 . The computer-implemented method of claim 15 , wherein the hardware communications interfaces include at least one of universal serial bus (USB) WiFi devices or USB Bluetooth devices, wherein a first of the hardware communications interfaces is coupled to the first ECC computing system and a second of the hardware communications interfaces is coupled to the second ECC computing system to support the peer-to-peer communications.
17 . The computer-implemented method of claim 15 , further comprising:
receiving live call audio for the 911 call; and
transcribing the live call audio to identify the emergency response data related to the 911 call.
18 . The computer-implemented method of claim 15 , further comprising:
storing at least part of the emergency response data in a data structure; and
providing access to the data structure to the AI agent to enable the AI agent to retrieve the emergency response data from the data structure.