IP Library Granted Patent US 10,096,235
Granted Patent B2
US 10,096,235 · App. 13/839,587 · Granted Oct 9, 2018

Alert directives and focused alert directives in a behavioral recognition system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,096,235
App. No.
13/839,587
Granted
Oct 9, 2018
Kind
B2
Abstract

Alert directives and focused alert directives allow a user to provide feedback to a behavioral recognition system to always or never publish an alert for certain events. Such an approach bypasses the normal publication methods of the behavioral recognition system yet does not obstruct the system's learning procedures.

Claims (35)

1. A method for processing events generated from an evaluation of a stream of video frames, the method comprising:

obtaining characteristic values for an observed event in a scene depicted by the stream of video frames;

updating a learned state of the scene based on the characteristic values, wherein the learned state provides a model of patterns of behavior generated from evaluating a plurality of foreground objects detected in the stream of video frames;

parsing a list of alert directives for a matching alert directive having ranges of criteria values, wherein the characteristic values are within the ranges of the criteria values and wherein the alert directive overrides a decision to either publish an alert or to not publish an alert for the observed event based on the updated learned state of the scene without changing the updated learned state of the scene; and

upon identifying the matching alert directive, either publishing the alert or not publishing the alert according to alert directive.

2. The method of claim 1 , wherein the observed event characteristic values are a pixel-height value, a pixel-width value, and an x- and y-coordinate center position of a foreground object.

3. The method of claim 1 , wherein the observed event characteristic values are a set of x- and y-coordinates corresponding to a foreground object trajectory.

4. The method of claim 1 , wherein the matching alert directive has a focus mask, the focus mask intersecting with a region in video frames of the scene where the observed event occurred.

5. The method of claim 1 , wherein the criteria values may be adjusted in a graphical editor.

6. The method of claim 1 , wherein publishing the alert regarding the observed event comprises generating one or more alerts based on the matching alert directive.

7. The method of claim 1 , wherein parsing a list of alert directives for a matching alert directive comprises matching a first alert directive with an object type associated with a foreground object associated with the observed event and a behavior associated with the observed event.

8. A computer-readable storage medium storing instructions, which, when executed on a processor, performs an operation for processing events generated by a video analytics system evaluating a stream of video frames alerting a user to behavior corresponding to an alert directive, the operation comprising:

obtaining characteristic values for an observed event in a scene, depicted by the stream of video frames;

updating a learned state of the scene based on the characteristic values, wherein the learned state provides a model of patterns of behavior generated from evaluating a plurality of foreground objects detected in the stream of video frames;

parsing a list of alert directives for a matching alert directive having ranges of criteria values, wherein the characteristic values are within the ranges of the criteria values and wherein the alert directive overrides a decision to either publish an alert or to not publish an alert for the observed event based on the updated learned state of the scene without changing the updated learned state of the scene; and

upon identifying the matching alert directive, either publishing the alert or not publishing the alert regarding the observed event according to alert directive.

9. The computer-readable storage medium of claim 8 , wherein the observed event characteristic values are a pixel-height value, a pixel-width value, and an x- and y-coordinate center position of a foreground object.

10. The computer-readable storage medium of claim 8 , wherein the observed event characteristic values are a set of x- and y-coordinates corresponding to a foreground object trajectory.

11. The computer-readable storage medium of claim 8 , wherein the matching alert directive has a focus mask, the focus mask intersecting with a region in video frames of the scene where the observed event occurred.

12. The computer-readable storage medium of claim 8 , wherein the criteria values may be adjusted in a graphical editor.

13. The computer-readable storage medium of claim 8 , wherein publishing the alert for the observed event comprises generating one or more alerts based on the matching alert directive.

14. The computer-readable storage medium of claim 8 , wherein parsing a list of alert directives for a matching alert directive comprises matching a first alert directive with an object type associated with a foreground object associated with the observed event and a behavior associated with the observed event.

15. A system comprising:

a processor and

a memory hosting an application, which, when executed on the processor, performs an operation for processing events generated from an evaluation of a stream of video frame, the operation comprising:

obtaining characteristic values for an observed event in a scene depicted by the stream of video frames,

updating a learned state of the scene based on the characteristic values, wherein the learned state provides a model of patterns of behavior generated from evaluating a plurality of foreground objects detected in the stream of video frames,

parsing a list of alert directives for a matching alert directive having ranges of criteria values, wherein the characteristic values are within the ranges of the criteria values and wherein the alert directive overrides a decision to either publish an alert or to not publish an alert for the observed event based on the updated learned state of the scene without changing the updated learned state of the scene, and

upon identifying the matching alert directive, either publishing the alert or not publishing the alert regarding the observed event according to alert directive.

16. The system of claim 15 , wherein the observed event characteristic values are a pixel-height value, a pixel-width value, and an x- and y-coordinate center position of a foreground object.

17. The system of claim 15 , wherein the observed event characteristic values are a set of x- and y-coordinates corresponding to a foreground object trajectory.

18. The system of claim 15 , wherein the matching alert directive has a focus mask, the focus mask intersecting with a region in video frames of the scene where the observed event occurred.

19. The system of claim 15 , wherein the criteria values may be adjusted in a graphical editor.

20. The system of claim 15 , wherein publishing the alert for the observed event comprises generating one or more alerts based on the matching alert directive.

21. The system of claim 15 , wherein parsing a list of alert directives for a matching alert directive comprises matching a first alert directive with an object type associated with a foreground object associated with the observed event and a behavior associated with the observed event.

Assignments (68)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2020
From: OMNI AI, INC.
To: INTELLECTIVE AI, INC.
Reel/Frame 052216/0585 →
SECURITY INTEREST Recorded Jun 14, 2017
From: GIANT GRAY, INC.
To: BLESSING, STEPHEN C.; MCCLAIN, TERRY F.; WALTER, JEFFREY; WALTER, SIDNEY; WILLIAMS, JAY; WILLIAMS, SUE
Reel/Frame 042807/0240 →
SECURITY INTEREST Recorded Jun 8, 2017
From: GIANT GRAY, INC.
To: GOLDEN, ROGER; PEREZ-MAJUL, ALAIN; PEREZ-MAJUL, ALENA; PEREZ-MAJUL, MARIA; PEREZ-MAJUL, FERNANDO
Reel/Frame 042734/0380 →
SECURITY INTEREST Recorded Jun 5, 2017
From: GIANT GRAY, INC.
To: HOLT, HILLERY N.; HUTTON, DONNA; HUTTON, WILLIAM; HUTTON, GARY; HUTTON, DEBORAH K.; JAMES, RONALD; JAMES, JUDITH; JOHNSON, ANN; JOHNSON, NORMAN; JUDGE, JOYCE A.; KEEVIN, LOIS JANE; KINNAMAN, SANDRA; KINNEY, JOY E.; KOUSARI, EHSAN; KOUSARI, MARY; LEMASTER, CHERYL J.; LEMASTER, CARL D.; LITTLE, CAMILLE; LITTLE, STEPHEN C.; MARCUM, JOSEPH; MARCUM, DEBRA; MCAVOY, JOHN; MCAVOY, TIFFANY; MCCORD, LUCINDA; MCCORD, STEPHEN; MCKAIN, CHRISTINE; MERCER, JOAN; MORRIS, GILBERT; MORRIS, DEBRA; NECESSARY, MICHAEL J.; PEGLOW, SUE ELLEN; PETERS, CYNTHIA; PIKE, DAVID A.; REECE, DONALD B.; REECE, MYRTLE D.; RENBARGER, TERRY; RENBARGER, ROSEMARY; REYES, JOSE; REYES, BETH; RHOTEN, MARY C.; RICKS, PENNY L.; ROBINSON, RICK; SGRO, MARIO P.; SGRO, MARIO; ST. LOUIS, GLORIA; STROEH, MARY ANN; STROEH, STEPHEN L.; SULLIVAN, DONNA L.; TOWNSEND, CHRISTOPHER; TOWNSEND, JILL; TREES, CRAIG; WELPOTT, WARREN R.; WELPOTT, WARREN; WELPOTT, TRAVIS; WELPOTT, MELISSA; ZEIGLER, BETTY JO
Reel/Frame 042687/0055 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HARRINGTON, ANNE
Reel/Frame 042665/0109 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: ENRIQUEZ, RICK
Reel/Frame 042663/0577 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: GANGWER, ALAN; GANGWER, JANE
Reel/Frame 042663/0691 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: GINDER, DARLENE; GINDER, MICHAEL
Reel/Frame 042663/0764 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HANNER, DAVID; HANNER, KATTE
Reel/Frame 042664/0172 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HARRINGTON, ANNE M.
Reel/Frame 042665/0161 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HIGGINBOTTOM, BRYCE E.
Reel/Frame 042665/0493 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HIGGINBOTTOM, BRYCE
Reel/Frame 042665/0678 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HOLT, RUTH ANN
Reel/Frame 042665/0685 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DUNLAVY, FRIEDA
Reel/Frame 042666/0637 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BAGIENSKI, FRANK
Reel/Frame 042645/0494 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BATCHELDER, ROBERT
Reel/Frame 042645/0507 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BATCHELDER, LEANNE
Reel/Frame 042645/0552 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BIVANS, WAYNE
Reel/Frame 042646/0443 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BIVANS, JENNIFER
Reel/Frame 042646/0512 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, EDWARD
Reel/Frame 042646/0534 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, EDWARD
Reel/Frame 042646/0599 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, REBECCAH
Reel/Frame 042646/0630 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, REBECCAH
Reel/Frame 042646/0711 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSE, BETHEL
Reel/Frame 042646/0862 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, ALAN J.
Reel/Frame 042647/0016 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, MARY ALICE
Reel/Frame 042647/0143 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, ALAN J.
Reel/Frame 042647/0196 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, MARY ALICE
Reel/Frame 042647/0384 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNER, JOHN
Reel/Frame 042647/0447 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNER, LINDA
Reel/Frame 042647/0831 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0446 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0518 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, JOHNIE
Reel/Frame 042652/0777 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0788 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, JOHNIE
Reel/Frame 042652/0795 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, MARY
Reel/Frame 042652/0828 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, MARY
Reel/Frame 042652/0905 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BUSBY, RANAYE
Reel/Frame 042652/0912 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BUSBY, BRET D.
Reel/Frame 042652/0919 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, LISBETH ANN
Reel/Frame 042652/0946 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, ROBERT
Reel/Frame 042653/0367 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, LISBETH ANN
Reel/Frame 042653/0374 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CHEEK, GERALD
Reel/Frame 042657/0671 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CHEEK, PAMELA
Reel/Frame 042658/0507 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, STEVEN F.
Reel/Frame 042658/0634 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, LINDA
Reel/Frame 042658/0962 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, STEVEN F.
Reel/Frame 042658/0969 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, PAIGE
Reel/Frame 042659/0039 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, PAIGE
Reel/Frame 042659/0179 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, SEAN P.
Reel/Frame 042659/0272 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, SEAN
Reel/Frame 042659/0431 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COX, REBECCA J.
Reel/Frame 042659/0603 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COX, LAWRENCE E.
Reel/Frame 042659/0667 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DARLING, WILLIAM; DARLING, DIANA
Reel/Frame 042659/0776 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DAVIS, JEFFREY J.
Reel/Frame 042661/0438 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DAVIS, JEFFREY J.; DAVIS, NAOMI
Reel/Frame 042662/0103 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DENNY, SUMMER
Reel/Frame 042662/0923 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DESHIELDS, JAMES
Reel/Frame 042662/0983 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DESHIELDS, JAMES
Reel/Frame 042663/0048 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: DAVIS, DREW
Reel/Frame 042621/0962 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: DAVIS, DREW
Reel/Frame 042621/0988 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: TRAN, JOHN
Reel/Frame 042622/0033 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: TRAN, JOHN
Reel/Frame 042622/0052 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: WILKINSON, PHILIP
Reel/Frame 042622/0065 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: MULTIMEDIA GRAPHIC NETWORK
Reel/Frame 042621/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2017
From: GIANT GRAY, INC.
To: PEPPERWOOD FUND II, LP
Reel/Frame 041685/0404 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2017
From: PEPPERWOOD FUND II, LP
To: OMNI AI, INC.
Reel/Frame 041687/0576 →
CHANGE OF NAME Recorded Mar 22, 2017
From: BEHAVIORAL RECOGNITION SYSTEMS, INC.
To: GIANT GRAY, INC.
Reel/Frame 042068/0551 →