IP Library Granted Patent US 12,450,906
Granted Patent B2
US 12,450,906 · App. 18/161,476 · Granted Oct 21, 2025

System and method for tagging untagged events

Inventors: Michael Sutton (Petah Tikva, IL); Zvi Figov (Modiin, IL); Nir Naor (Ramat Hasharon, IL)
Assignee: Verint Americas Inc.
G06V20/44G06F16/7867G06V10/774
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,450,906
App. No.
18/161,476
Granted
Oct 21, 2025
Kind
B2
Abstract

A tagging system gathers all events (tagged and untagged) generated by remote sensors at a location or facility over time. Based on the gathered events the tagging system uses machine learning to train a model to learn the sensor layout of a facility or location and the timing between the triggering of sensors. Once trained, the model can predict the movement and location of individuals and objects throughout the facility based on a starting tagged event. Given a series of tagged and untagged events, the system can use the movement predictions of the model to tag the untagged events in the series with the identification of an individual or object that triggered the generation of the untagged event.

Claims (70)

1. A method for tagging untagged events, comprising:

receiving a first set of tagged events as a first set of tagged data sets and a second set untagged events as a first set of untagged data sets from a set of sensors in a sensor system;

transmitting the first set of tagged data sets and the first set of untagged data sets from the sensor system to a tagging system;

generating, by a training preprocessing component, one or more training data sets from the first set of tagged data sets and the first set of untagged data sets;

training, by a causality modeling component, an event prediction model with the one or more training data sets;

receiving a second set of tagged events as a second set of tagged data sets and a second set of untagged events as a second set of untagged data sets at a tagging application preprocessing component;

generating, by the tagging application preprocessing component, one or more data set groupings from the second set of tagged data sets and the second set of untagged data sets;

applying, by the causality modeling component, the trained event prediction model to each second tagged data set in the data set grouping;

generating, by the trained event prediction model, one or more predicted events for each second tagged data set in the data set grouping;

receiving the data set grouping and the one or more predicted events for each second tagged data set at a tagging component;

comparing, by the tagging component, each predicted event to each second tagged data set received to identify matching predicted events and second tagged data sets; and

tagging one or more second untagged data set by assigning an identification tag associated with the predicted event to the second tagged data set when the second untagged data set and the predicted event are identified as matching.

2. The method of claim 1 , wherein each tagged data set is a data structure including fields for a sensor identification, an event time, and an identification tag.

3. The method of claim 2 , wherein generating one or more training data sets comprises:

removing the identification tag from each tagged data set in the first set of tagged data sets;

ordering the first set of untagged data sets and the first set of tagged data sets by the event time associated with each tagged data set and an event time associated with each untagged data set; and

grouping the ordered first set of untagged data sets and first set of tagged data sets into training data sets.

4. The method of claim 1 , wherein the event prediction model is one of an unsupervised deep learning model, a statistical model, or a supervised deep learning model.

5. The method of claim 1 , wherein each of the tagged data sets in the second set of tagged data sets include a same identification tag associated with each tagged data set.

6. The method of claim 5 , wherein generating one or more data set groupings comprises:

ordering each tagged data set from the second set of tagged data sets and each untagged data set from the second set of untagged data sets based on an event time associated with each tagged data set and each untagged data set; and

grouping a first tagged data set from the ordered data sets with all subsequent untagged data sets from the ordered data sets with associated event times between the event time associated with the first tagged data set and the event time associated with a second tagged data set from the ordered data sets to generate a first data set grouping.

7. The method of claim 6 , wherein generating one or more data set groupings further comprises repeating grouping each subsequent tagged data set from the ordered data sets with all subsequent untagged data sets from the ordered data sets with associated event times between the event time associated with the subsequent tagged data set and the event time associated with a next tagged data set from the ordered data sets to generate a next data set grouping for each subsequent tagged data set.

8. A system for tagging untagged events, comprising:

a memory comprising computer readable instructions;

a processor configured to read the computer readable instructions that when executed causes the system to:

receive a first set of tagged events as a first set of tagged data sets and a second set untagged events as a first set of untagged data sets from a set of sensors in a sensor system;

transmit the first set of tagged data sets and the first set of untagged data sets from the sensor system to a tagging system;

generate, by a training preprocessing component, one or more training data sets from the first set of tagged data sets and the first set of untagged data sets;

train, by a causality modeling component, an event prediction model with the one or more training data sets;

receive a second set of tagged events as a second set of tagged data sets and a second set of untagged events as a second set of untagged data sets at a tagging application preprocessing component;

generate, by the tagging application preprocessing component, one or more data set groupings from the second set of tagged data sets and the second set of untagged data sets;

apply, by the causality modeling component, the trained event prediction model to each second tagged data set in the data set grouping;

generate, by the trained event prediction model, one or more predicted events for each second tagged data set in the data set grouping;

receive the data set grouping and the one or more predicted events for each second tagged data set at a tagging component;

compare, by the tagging component, each predicted event to each second tagged data set received to identify matching predicted events and second tagged data sets; and

tag one or more second untagged data set by assigning an identification tag associated with the predicted event to the second tagged data set when the second untagged data set and the predicted event are identified as matching.

9. The system of claim 8 , wherein each tagged data set is a data structure including fields for a sensor identification, an event time, and an identification tag.

10. The system of claim 9 , wherein generating one or more training data sets includes computer readable instructions that further cause the system to:

remove the identification tag from each tagged data set in the first set of tagged data sets;

order the first set of untagged data sets and the first set of tagged data sets by the event time associated with each tagged data set and an event time associated with each untagged data set; and

group the ordered first set of untagged data sets and first set of tagged data sets into training data sets.

11. The system of claim 8 , wherein the event prediction model is one of an unsupervised deep learning model, a statistical model, or a supervised deep learning model.

12. The system of claim 8 , wherein each of the tagged data sets in the second set of tagged data sets include a same identification tag associated with each tagged data set.

13. The system of claim 12 , wherein generating one or more data set groupings includes computer readable instructions that further cause the system to:

order each tagged data set from the second set of tagged data sets and each untagged data set from the second set of untagged data sets based on an event time associated with each tagged data set and each untagged data set; and

group a first tagged data set from the ordered data sets with all subsequent untagged data sets from the ordered data sets with associated event times between the event time associated with the first tagged data set and the event time associated with a second tagged data set from the ordered data sets to generate a first data set grouping.

14. The system of claim 13 , wherein generating one or more data set groupings further includes computer readable instructions that further cause the system to repeat grouping each subsequent tagged data set from the ordered data sets with all subsequent untagged data sets from the ordered data sets with associated event times between the event time associated with the subsequent tagged data set and the event time associated with a next tagged data set from the ordered data sets to generate a next data set grouping for each subsequent tagged data set.

15. A non-transitory computer readable medium comprising computer readable code to tag untagged events on a system that when executed by a processor, causes the system to:

receive a first set of tagged events as a first set of tagged data sets and a second set untagged events as a first set of untagged data sets from a set of sensors in a sensor system;

transmit the first set of tagged data sets and the first set of untagged data sets from the sensor system to a tagging system;

generate, by a training preprocessing component, one or more training data sets from the first set of tagged data sets and the first set of untagged data sets;

train, by a causality modeling component, an event prediction model with the one or more training data sets;

receive a second set of tagged events as a second set of tagged data sets and a second set of untagged events as a second set of untagged data sets at a tagging application preprocessing component;

generate, by the tagging application preprocessing component, one or more data set groupings from the second set of tagged data sets and the second set of untagged data sets;

apply, by the causality modeling component, the trained event prediction model to each second tagged data set in the data set grouping;

generate, by the trained event prediction model, one or more predicted events for each second tagged data set in the data set grouping;

receive the data set grouping and the one or more predicted events for each second tagged data set at a tagging component;

compare, by the tagging component, each predicted event to each second tagged data set received to identify matching predicted events and second tagged data sets; and

tag one or more second untagged data set by assigning an identification tag associated with the predicted event to the second tagged data set when the second untagged data set and the predicted event are identified as matching.

16. The non-transitory computer readable medium of claim 15 , wherein each tagged data set is a data structure including fields for a sensor identification, an event time, and an identification tag.

17. The non-transitory computer readable medium of claim 16 , wherein generating one or more training data sets includes causing the system to:

remove the identification tag from each tagged data set in the first set of tagged data sets;

order the first set of untagged data sets and the first set of tagged data sets by the event time associated with each tagged data set and an event time associated with each untagged data set; and

group the ordered first set of untagged data sets and first set of tagged data sets into training data sets.

18. The non-transitory computer readable medium of claim 15 , wherein the event prediction model is one of an unsupervised deep learning model, a statistical model, or a supervised deep learning model.

19. The non-transitory computer readable medium of claim 15 , wherein each of the tagged data sets in the second set of tagged data sets include a same identification tag associated with each tagged data set.

20. The non-transitory computer readable medium of claim 19 , wherein generating one or more data set groupings includes causing the system to:

order each tagged data set from the second set of tagged data sets and each untagged data set from the second set of untagged data sets based on an event time associated with each tagged data set and each untagged data set; and

group a first tagged data set from the ordered data sets with all subsequent untagged data sets from the ordered data sets with associated event times between the event time associated with the first tagged data set and the event time associated with a second tagged data set from the ordered data sets to generate a first data set grouping.

Assignments (2)
SECURITY INTEREST Recorded Dec 23, 2025
From: VERINT AMERICAS INC.
To: ALTER DOMUS (US) LLC, AS COLLATERAL AGENT
Reel/Frame 074034/0292 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 15, 2023
From: SUTTON, MICHAEL; FIGOV, ZVI; NAOR, NIR
To: VERINT AMERICAS INC.
Reel/Frame 062994/0059 →
Continuity (1)
Related Publication 20240257517A1 · Aug 1, 2024
References Cited (7)
US 11353327B2 · Chander · 2022 [cited by examiner]
US 20190043207A1 · Carranza · 2019 [cited by examiner]
US 20210056713A1 · Rangesh · 2021 [cited by examiner]
US 20220004775A1 · Flick · 2022 [cited by examiner]
US 20230177804A1 · Wuu · 2023 [cited by examiner]
US 20230339431A1 · Kuehner · 2023 [cited by examiner]
Styles, Olly, Tanaya Guha, and Victor Sanchez. “Multi-camera trajectory forecasting with trajectory tensors.” IEEE Transactions on Pattern Analysis and Machine Intelligence 44.11 (2021): 8482-8491. (Year: 2021). [cited by examiner]