IP Library Granted Patent US 12699941
Granted Patent B1
US 12699941 · App. 18/619,980 · Granted Aug 4, 2026

System and method of managing workflow for an observed event

Inventors: Bharat A. Saini (Mason, OH); Vivek B. Saini (Ridgewood, NY)
Assignee: Task Watch Corporation
G06Q10/0633G06Q10/063112G06V20/52
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12699941
App. No.
18/619,980
Granted
Aug 4, 2026
Kind
B1
Abstract

A system and method that monitors at a location and detects events in images taken by image capture apparatus and determines if there is a recognized event and monitors movement of the event through the location and assigns a concern level and a workflow for responding to the recognized event.

Claims (32)

1 . A system for tracking an event as the event moves through a location comprising:

a first image capture apparatus that captures one or more images at the location and transmits said captured images to a control unit, wherein said control unit has analysis software that monitors said captured images captured by said first capture apparatus to detect an event, if an event is detected, said analysis software then assigns an identification tag to said detected event (first tagged event);

a second image capture apparatus that captures one or more images at a location and transmits said captured images to said control unit, wherein said analysis software monitors said captured images captured by said second image capture apparatus to detect an event, if an event is detected, said analysis software uses attributes of said capture images captured by said first image capture apparatus and said capture images captured by said second image capture apparatus to determine if said first tagged event detected in said captured images captured by said first image capture apparatus is the same event detected in said captured images captured by said second capture apparatus, wherein if said analysis software determines that said first tagged event detected in said captured images captured by said first image capture apparatus is the same said event detected in said captured images captured by said second image capture apparatus, said event detected in said captured images captured by said second image capture apparatus is assigned the same identification tag (first tagged event) as the tagged event detected in said captured images captured by said first image capture apparatus, wherein if said analysis software determines that said tagged event detected in said captured images captured by said first image capture apparatus is not the same said event detected in said captured images captured by said second image capture apparatus, said event detected in said captured images captured by said second image capture apparatus is assigned a different identification tag (second tagged event); and

wherein for each detected tagged event, said analysis software determines if each said detected tagged event is a recognized event requiring a workflow and if said analysis software determines that a said detected tagged event is a recognized event, said recognized event is given a concern level and a required workflow, said analysis software then cooperates with response software to select a workflow and transmit said workflow to a qualified individual to perform said workflow or directs robotic or automatic equipment to perform said workflow;

wherein said analysis software determines changes in said attributes of a said recognized event and uses said changes to increase or decrease said concern level for said recognized event; and

wherein if said workflow is performed by said qualified individual, said qualified individual performs workflows based on the order of said concern level of workflows to be performed by said qualified individual.

2 . The system for tracking an event as it moves through a location of claim 1 , wherein said attributes are movement information and said analysis software uses said movement information of a said tagged event in determining if a said tagged event is a recognized event that requires a workflow.

3 . The system of claim 2 , wherein said recognized event is selected from a list of recognized events that correspond to a color change.

4 . The system of claim 2 , wherein said analysis software determine a color change in said recognized event and calculates surface area where changes in color occurs and uses said surface area in determining a concern level.

5 . The system for tracking an event as it moves through a location of claim 1 , wherein said analysis software identifies a concern level and workflows from a listing of recognized events and concern levels.

6 . The system for tracking an event as it moves through a location of claim 1 , wherein said captured images are color images.

7 . The system for tracking an event as it moves through a location of claim 1 , wherein said captured images are color images and wherein said analysis software determines if there is a color change in a said tagged event as it moves through the location and if said analysis software determines that there is a color change, said analysis software uses said color change in determining if said tagged event is a recognized event and if said tagged event is a recognized event, said analysis software assigns said concern level for said recognized event based on said color change and uses said concern level in determining if said recognized event requires a workflow.

8 . The system for tracking an event as it moves through a location of claim 1 , wherein said captured images captured by said first image capture apparatus and said captured images captured by said second image capture apparatus are color images and wherein if said tagged event detected in said captured images captured by said first image capture apparatus is the same said event detected in said captured images captured by said second image capture apparatus, said analysis software then compares said captured images captured by said first image capture apparatus of said tagged event and said captured images captured by said second image capture apparatus of said event to determine if there is a color change as it moves through the location and if said analysis software determines that there is a color change, said analysis software uses said color change in determining said concern value and said workflow.

9 . The system for tracking movement of an event through a location of claim 1 , wherein if said recognized event is in the form of a sequence of events and a first event has been detected and a second event has been detected in said sequence of events and said second event occurred after said first event, and in said sequence said second event was to occur prior to said first event, said analysis software identifies said concern level and said workflow from a listing of workflows and if an individual is needed to perform said workflow, said qualified individuals are selected from a listing of qualified individuals to perform said workflow.

10 . The system for tracking events moving through a location of claim 1 , wherein said captured images are color images, and wherein if said analysis software determines that said event detected in said captured images captured by said first image capture apparatus and said event detected in said captured images captured by said second image capture apparatus are the same event, said analysis software examines and compares color pixels and RGB values (color values) creating a portion of a captured image showing said event detected in said captured image captured by said first image capture apparatus to a portion of a captured image showing said event detected in said capture image captured by said second image capture apparatus and uses said comparison to detect any changes in said pixels and RGB values and uses said detected changes in determining if a workflow is required for responding to said event.

11 . The system of tracking movement of an event traveling through a location of claim 1 , wherein said captured images are colored images, and wherein said analysis software examines color pixels and RGB values (color values) and calculates an average RGB value creating said event detected in said captured images captured by said first image capture apparatus and examines color pixels and RGB values (color values) and calculates an average RGB value creating said event detected in said captured images captured by said second image capture apparatus and uses said average RGB values to detect any changes in said average RGB values to determine if there is a change in color between said captured images and said analysis software uses any said change in color in determining if an event detected is a recognized event.

12 . The system of tracking movement of an event traveling through a location of claim 11 , wherein if said event is a recognized event, said analysis software compares said change in said average RGB values with RGB reference thresholds for said recognized event and if said change in said average RGB values are below said RGB reference thresholds, wherein said analysis software continues to monitor said captured images, and wherein if said change in said average RGB values is equal to or above said RGB reference thresholds, said analysis software determines a concern value and directs said response software to determine a workflow for responding to said recognized event.

13 . The system of claim 12 , wherein said workflow is further selected based on degree or color change in the RGB values.

14 . The system of claim 1 , wherein said captured images are color images and if said analysis software determines that said event detected in said captured images captured by said first image apparatus and said event detected in said captured images captured by said second image capture apparatus are the same event, said analysis software identifies changes in color patterns between said event detected in said captured images captured by said first image capture apparatus and said event detected in said captured image captured by said second image capture apparatus and uses said change in said color patterns to determine if said event is a recognized event and uses said change in said color patterns to determine a concern level for said recognized event.

15 . The system of claim 1 , wherein if said recognized event detected in said capture images captured by said first image capture apparatus and said recognized event detected in said captured images captured by said second image capture apparatus are the same recognized event, said analysis software determines a time period between said captured images captured by said first image capture apparatus showing said recognized event and said captured images captured by said second image capture apparatus showing said recognized event, and wherein said analysis software uses said time period in determining a concern level.

16 . The system of claim 1 , wherein said analysis software uses attributes of said event detected in said captured images captured by said first image capture apparatus and said attributes of said event detected in said captured images captured by said second image capture apparatus to determine if said events are the same event and if said events are the same event, uses changes in said attributes to determine a concern level for said event.

17 . A system for tracking an event as the event moves through a location comprising:

a first image capture apparatus that captures one or more images at the location and transmits said one or more captured images to a control unit, wherein said control unit has analysis software that monitors said captured images captured by said first image capture apparatus to detect an event having attributes and uses said attributes to determine if said event is a recognized event, wherein if said event is a recognized event said analysis software assigns an identification tag to said recognized event and a concern level for said recognized event;

a second image capture apparatus that captures one or more images at a location and transmits said one or more captured images to said control unit, wherein said analysis software monitors said captured images captured by said second image capture apparatus to detect an event having attributes and uses said attributes to determine if said event is a recognized event;

wherein said analysis software determines if said recognized event detected in said captured images captured by said first image capture apparatus is the same recognized event detected in said captured images captured by said second image capture apparatus and, if said recognized events are the same recognized event, said analysis software assigns the same said identification tag to said recognized event detected in said captured images captured by said second image capture apparatus;

wherein if said recognized event detected in said captured images captured by said first image capture apparatus is the same said recognized event detected in said captured images captured by said second image capture apparatus, said analysis software then compares said captured images captured by said first image capture apparatus of said tagged event and said captured images captured by said second image capture apparatus of said event to determine if there is a change in attributes between said recognized event detected in said captured images captured by said first image capture apparatus and said recognized event detected in said captured images captured by said second capture apparatus and if said analysis software determines that there is a change is said attributes, said analysis software cooperates with response software to use said change in attributes in determining a concern value and a workflow for responding to said change in said attributes and transmits said concern level and workflow to one or more qualified individuals to perform said workflow or directs robotic or automated equipment to perform said workflow.

18 . A system for tracking an event as the event moves through a location comprising:

a first image capture apparatus that captures one or more images at the location and transmits said one or more captured images to a control unit, wherein said control unit has analysis software that monitors said captured images captured by said first image capture apparatus to detect an event having attributes and uses said attributes to determine if said event is a recognized event, wherein if said event is a recognized event said analysis software assigns an identification tag and a concern level to said recognized event;

a second image capture apparatus that captures one or more images at the location and transmits said one or more captured images to said control unit, wherein said analysis software monitors said captured images captured by said second image capture apparatus to detect an event having attributes and uses said attributes to determine if said event is a recognized event;

wherein said analysis software determines if said recognized event detected in said captured images captured by said first image capture apparatus is the same recognized event detected in said captured images captured by said second image capture apparatus and, if said recognized events are the same recognized event, said analysis software assigns the same said identification tag to said recognized event detected in said captured images captured by said second image capture apparatus;

wherein said analysis software compares the attributes of said recognized event to determine if said concern level should be increased or decreased and assigns the same or an increased or decreased concern level to said recognized event detected on said captured images captured by said second image capture apparatus; and

wherein said analysis software determines if said recognized event requires a workflow, and if said recognized event requires a workflow, said analysis software cooperates with response software to select a workflow and transmits said workflow to a qualified individual to perform said workflow or directs robotic or automated equipment to perform said workflow.