IP Library Granted Patent US 12,602,274
Granted Patent B2
US 12,602,274 · App. 18/508,449 · Granted Apr 14, 2026

System for real-time overload detection using image processing analysis

Inventors: Maharaj Mukherjee (Poughkeepsie, NY); Carl M. Benda (Kannapolis, NC); Elvis Nyamwange (Little Elm, TX); Utkarsh Raj (Charlotte, NC); Suman Roy Choudhury (Berkeley Heights, NJ); Vidya Srikanth (Sunnyvale, CA); Colin Murphy (Charlotte, NC)
Assignee: BANK OF AMERICA CORPORATION
G06F11/0766G06F11/008G06F11/3433G06T7/0004G06V10/40G06T2207/20081G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,602,274
App. No.
18/508,449
Granted
Apr 14, 2026
Kind
B2
Abstract

Systems, computer program products, and methods are described herein for real-time overload detection using image processing analysis. The present disclosure is configured to receive a first set of images associated with a device, wherein the one or more images are associated with a resiliency status of the device; deploy, using a machine learning (ML) subsystem, a trained ML model on the first set of images of the device; determine, using the trained ML model, a change in the resiliency status of the device based on the first set of images; and generate a notification indicating the change in the resiliency status of the device; and transmit control signals configured to cause a first user input device to display the notification.

Claims (74)

1 . A system for real-time overload detection using image processing analysis, the system comprising:

a processing device;

a non-transitory storage device containing instructions that, when executed by the processing device, cause the processing device to:

periodically capture a resiliency status of a device;

transform the resiliency status of the device into a first set of images, wherein transforming further comprises:

comparing each performance parameter of the device to a corresponding performance threshold; and

mapping each performance parameter to a color spectrum in a heat map, wherein performance parameters that exceed their corresponding performance thresholds are mapped to warm colors in the color spectrum according to a value of the performance parameters relative to the corresponding performance thresholds, and performance parameters that do not exceed their corresponding performance thresholds are mapped to cool colors in the color spectrum according to the value of the performance parameters relative to the corresponding performance thresholds;

deploy, using a machine learning (ML) subsystem, a trained ML model on the first set of images of the device;

determine, using the trained ML model, a change in the resiliency status of the device based on the first set of images to preemptively identify instances of device malfunction;

generate a notification indicating the change in the resiliency status of the device; and

transmit control signals configured to cause a first user input device to display the notification, wherein the notification comprises one or more actions configured to cause a change in the resiliency status of the device, wherein the change comprises at least turning off the device.

2 . The system of claim 1 , wherein, the instructions, when executed, further cause the processing device to:

retrieve one or more sets of images associated with the device;

receive, from a second user input device, one or more known resiliency statuses of the device corresponding to the one or more sets of images associated with the device;

generate a first feature set using the one or more sets of images associated with the device and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the device; and

train an ML model using the first feature set to generate the trained ML model.

3 . The system of claim 2 , wherein, the instructions, when executed, further cause the processing device to:

retrieve one or more sets of images associated with one or more peer devices;

receive, from the second user input device, one or more known resiliency statuses of the one or more peer devices corresponding to the one or more sets of images associated with the one or more peer devices;

generate a second feature set using the one or more sets of images associated with one or more peer devices, and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the one or more peer devices; and

train the ML model using the second feature set to generate the trained ML model.

4 . The system of claim 3 , wherein, the instructions, when executed, further cause the processing device to:

train the ML model using the first feature set and the second feature set to generate the trained ML model.

5 . The system of claim 1 , wherein the first set of images are periodic snapshots representing performance telemetry of the device, wherein the first set of images are captured at period time intervals during a first time period.

6 . The system of claim 1 , wherein, the instructions, when executed, further cause the processing device to:

determine a first resiliency status of the device, wherein the first resiliency status indicates that the device is currently operational; and

determine, using the trained ML model, that resiliency status of the device has changed from the first resiliency status to a second resiliency status, wherein the second resiliency status indicates that the device is malfunctioning based on the first set of images.

7 . A computer program product for real-time overload detection using image processing analysis, the computer program product comprising a non-transitory computer-readable medium comprising code causing an apparatus to:

periodically capture a resiliency status of a device;

transform the resiliency status of the device into a first set of images, wherein transforming further comprises:

comparing each performance parameter of the device to a corresponding performance threshold; and

mapping each performance parameter to a color spectrum in a heat map, wherein performance parameters that exceed their corresponding performance thresholds are mapped to warm colors in the color spectrum according to a value of the performance parameters relative to the corresponding performance thresholds, and performance parameters that do not exceed their corresponding performance thresholds are mapped to cool colors in the color spectrum according to the value of the performance parameters relative to the corresponding performance thresholds;

deploy, using a machine learning (ML) subsystem, a trained ML model on the first set of images of the device;

determine, using the trained ML model, a change in the resiliency status of the device based on the first set of images to preemptively identify instances of device malfunction;

generate a notification indicating the change in the resiliency status of the device; and

transmit control signals configured to cause a first user input device to display the notification, wherein the notification comprises one or more actions configured to cause a change in the resiliency status of the device, wherein the change comprises at least turning off the device.

8 . The computer program product of claim 7 , wherein the code further causes the apparatus to:

retrieve one or more sets of images associated with the device;

receive, from a second user input device, one or more known resiliency statuses of the device corresponding to the one or more sets of images associated with the device;

generate a first feature set using the one or more sets of images associated with the device and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the device; and

train an ML model using the first feature set to generate the trained ML model.

9 . The computer program product of claim 8 , wherein the code further causes the apparatus to:

retrieve one or more sets of images associated with one or more peer devices;

receive, from the second user input device, one or more known resiliency statuses of the one or more peer devices corresponding to the one or more sets of images associated with the one or more peer devices;

generate a second feature set using the one or more sets of images associated with one or more peer devices, and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the one or more peer devices; and

train the ML model using the second feature set to generate the trained ML model.

10 . The computer program product of claim 9 , wherein the code further causes the apparatus to:

train the ML model using the first feature set and the second feature set to generate the trained ML model.

11 . The computer program product of claim 7 , wherein the first set of images are periodic snapshots representing performance telemetry of the device, wherein the first set of images are captured at period time intervals during a first time period.

12 . The computer program product of claim 7 , wherein the code further causes the apparatus to:

determine a first resiliency status of the device, wherein the first resiliency status indicates that the device is currently operational; and

determine, using the trained ML model, that resiliency status of the device has changed from the first resiliency status to a second resiliency status, wherein the second resiliency status indicates that the device is malfunctioning based on the first set of images.

13 . A method for real-time overload detection using image processing analysis, the method comprising:

periodically capturing a resiliency status of a device;

transforming the resiliency status of the device into a first set of images, wherein transforming further comprises:

comparing each performance parameter of the device to a corresponding performance threshold; and

mapping each performance parameter to a color spectrum in a heat map, wherein performance parameters that exceed their corresponding performance thresholds are mapped to warm colors in the color spectrum according to a value of the performance parameters relative to the corresponding performance thresholds, and performance parameters that do not exceed their corresponding performance thresholds are mapped to cool colors in the color spectrum according to the value of the performance parameters relative to the corresponding performance thresholds;

deploying, using a machine learning (ML) subsystem, a trained ML model on the first set of images of the device;

determining, using the trained ML model, a change in the resiliency status of the device based on the first set of images to preemptively identify instances of device malfunction;

generating a notification indicating the change in the resiliency status of the device; and

transmitting control signals configured to cause a first user input device to display the notification, wherein the notification comprises one or more actions configured to cause a change in the resiliency status of the device, wherein the change comprises at least turning off the device.

14 . The method of claim 13 , wherein the method further comprises:

retrieving one or more sets of images associated with the device;

receiving, from a second user input device, one or more known resiliency statuses of the device corresponding to the one or more sets of images associated with the device;

generating a first feature set using the one or more sets of images associated with the device and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the device; and

training an ML model using the first feature set to generate the trained ML model.

15 . The method of claim 14 , wherein the method further comprises:

retrieving one or more sets of images associated with one or more peer devices;

receiving, from the second user input device, one or more known resiliency statuses of the one or more peer devices corresponding to the one or more sets of images associated with the one or more peer devices;

generating a second feature set using the one or more sets of images associated with one or more peer devices, and the one or more known resiliency statuses corresponding to the one or more sets of images associated with the one or more peer devices; and

training the ML model using the second feature set to generate the trained ML model.

16 . The method of claim 15 , wherein the method further comprises:

training the ML model using the first feature set and the second feature set to generate the trained ML model.

17 . The method of claim 13 , wherein the first set of images are periodic snapshots representing performance telemetry of the device, wherein the first set of images are captured at period time intervals during a first time period.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 14, 2023
From: MUKHERJEE, MAHARAJ; BENDA, CARL M.; NYAMWANGE, ELVIS; RAJ, UTKARSH; CHOUDHURY, SUMAN ROY; SRIKANTH, VIDYA; MURPHY, COLIN
To: BANK OF AMERICA CORPORATION
Reel/Frame 065564/0706 →
Continuity (2)
Provisional Application 63425199 · Nov 14, 2022
Related Publication 20240160513A1 · May 16, 2024
References Cited (30)
US 4703439A · Lotz · 1987 [cited by applicant]
US 10929708B2 · Syeda-Mahmood · 2021 [cited by applicant]
US 10963674B2 · Tan · 2021 [cited by applicant]
US 11049233B2 · Kumar · 2021 [cited by examiner]
US 11308353B2 · Singh · 2022 [cited by applicant]
US 11494490B2 · Kashyap · 2022 [cited by applicant]
US 11494886B2 · Kumar · 2022 [cited by examiner]
US 11562500B2 · Zhang · 2023 [cited by applicant]
US 11656605B1 · Manley · 2023 [cited by examiner]
US 11796993B2 · Minisankar · 2023 [cited by applicant]
US 11798263B1 · Prabhudesai · 2023 [cited by examiner]
US 11805006B2 · Liu · 2023 [cited by applicant]
US 11893086B2 · Levi · 2024 [cited by applicant]
US 20080019595A1 · Eswaran · 2008 [cited by applicant]
US 20140358645A1 · Ehrman · 2014 [cited by applicant]
US 20170230297A1 · Park · 2017 [cited by applicant]
US 20200151481A1 · Yoo · 2020 [cited by applicant]
US 20200226377A1 · Campos Macias · 2020 [cited by examiner]
US 20210263728A1 · Farrier · 2021 [cited by examiner]
US 20220083864A1 · Laterre · 2022 [cited by applicant]
US 20220092464A1 · Wistuba · 2022 [cited by applicant]
US 20220292316A1 · Levi · 2022 [cited by applicant]
US 20220358751A1 · Liu · 2022 [cited by examiner]
US 20220400394A1 · Eleftheriadis · 2022 [cited by applicant]
US 20230095041A1 · Wang · 2023 [cited by applicant]
US 20230196096A1 · Milne · 2023 [cited by examiner]
US 20240144566A1 · Bagherinezhad · 2024 [cited by applicant]
US 20240160513A1 · Mukherjee · 2024 [cited by examiner]
US 20240394365A1 · Puhakainen · 2024 [cited by examiner]
WO 2022001489A1 · 2022 [cited by applicant]