IP Library Granted Patent US 11,727,689
Granted Patent B2
US 11,727,689 · App. 17/378,530 · Granted Aug 15, 2023

Alert directives and focused alert directives in a behavioral recognition system

Inventors: Wesley Kenneth Cobb (The Woodlands, TX); Ming-Jung Seow (The Woodlands, TX); Gang Xu (Katy, TX); Kishor Adinath Saitwal (Houston, TX); Anthony Akins (West Columbia, TX); Kerry Joseph (Pearland, TX); Dennis G. Urech (Katy, TX)
Assignee: Intellective Ai, Inc.
G06V20/52G06F18/41G06N20/00G06V10/7788G06V20/53G06V40/103G08B21/182G08B23/00G08B29/185H04N7/002G08B13/19608
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,727,689
App. No.
17/378,530
Granted
Aug 15, 2023
Kind
B2
Abstract

Alert directives and focused alert directives allow a user to provide feedback to a behavioral recognition system to always or never publish an alert for certain events. Such an approach bypasses the normal publication methods of the behavioral recognition system yet does not obstruct the system's learning procedures.

Claims (56)

1. A method, comprising:

obtaining characteristic values for an observed event in a scene, the characteristic values including at least one of: a pixel-height value, a pixel-width value, or an x-coordinate and y-coordinate center position of a foreground object,

parsing a plurality of alert directives, the alert directives being previously generated by a behavioral recognition system, to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of the behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

2. The method of claim 1 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

3. The method of claim 1 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

4. The method of claim 1 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

5. The method of claim 1 , wherein each alert directive from the plurality of alert directives includes a pointer to an original alert on which that alert directive is based.

6. The method of claim 1 , wherein each alert directive from the plurality of alert directives includes an identifier, an alert pointer, and an epilog, the epilog including an array of tolerance values for each alert characteristic from a plurality of alert characteristics.

7. The method of claim 1 , wherein the one of publishing or not publishing an alert of the observed event in the scene is further based on a focus mask.

8. A non-transitory computer-readable storage medium storing instructions that, when executed on a processor, perform an operation comprising:

obtaining characteristic values for an observed event in a scene, the characteristic values including at least one of: a pixel-height value, a pixel-width value, or an x-coordinate and y-coordinate center position of a foreground object,

parsing a plurality of alert directives to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of a behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

9. The non-transitory computer-readable storage medium of claim 8 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

10. The non-transitory computer-readable storage medium of claim 8 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

11. The non-transitory computer-readable storage medium of claim 9 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

12. A system, comprising:

a processor and

a memory hosting an application, which, when executed on the processor, performs an operation for alerting a user to behavior corresponding to an alert directive, the operation comprising:

obtaining characteristic values for an observed event in a scene, the characteristic values including at least one of: a pixel-height value, a pixel-width value, or an x-coordinate and y-coordinate center position of a foreground object,

parsing a plurality of alert directives to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of a behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

13. The system of claim 12 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

14. The system of claim 12 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

15. The system of claim 12 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

16. A method, comprising:

obtaining characteristic values for an observed event in a scene,

parsing a plurality of alert directives, the alert directives being previously generated by a behavioral recognition system, to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including (1) at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, (2) an identifier, (3) an alert pointer, and (4) an array of tolerance values for each alert characteristic from a plurality of alert characteristics, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of the behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

17. The method of claim 16 , wherein the characteristic values include at least one of: a pixel-height value, a pixel-width value, and an x-coordinate and y-coordinate center position of a foreground object.

18. The method of claim 16 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

19. The method of claim 16 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

20. The method of claim 16 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

21. The method of claim 16 , wherein each alert directive from the plurality of alert directives includes a pointer to an original alert on which that alert directive is based.

22. The method of claim 16 , wherein each alert directive from the plurality of alert directives further includes an epilog that includes the array of tolerance values.

23. The method of claim 16 , wherein the one of publishing or not publishing an alert of the observed event in the scene is further based on a focus mask.

24. A non-transitory computer-readable storage medium storing instructions that, when executed on a processor, perform an operation comprising:

obtaining characteristic values for an observed event in a scene,

parsing a plurality of alert directives to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including (1) at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, (2) an identifier, (3) an alert pointer, and (4) an array of tolerance values for each alert characteristic from a plurality of alert characteristics, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of a behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

25. The non-transitory computer-readable storage medium of claim 24 , wherein the characteristic values include at least one of: a pixel-height value, a pixel-width value, and an x-coordinate and y-coordinate center position of a foreground object.

26. The non-transitory computer-readable storage medium of claim 24 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

27. The non-transitory computer-readable storage medium of claim 24 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

28. The non-transitory computer-readable storage medium of claim 24 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

29. A system, comprising:

a processor and

a memory hosting an application, which, when executed on the processor, performs an operation for alerting a user to behavior corresponding to an alert directive, the operation comprising:

obtaining characteristic values for an observed event in a scene,

parsing a plurality of alert directives to identify a matching alert directive from the plurality of alert directives based on the characteristic values being within a set of at least one pre-defined user-defined alert directive matching criterion, each alert directive from the plurality of alert directives including (1) at least one of a representation of whether a specified behavior should result in an alert, a representation of an alert publication frequency, or a representation specifying that matching to that alert directive is based on at least one of a behavior type or an object type, (2) an identifier, (3) an alert pointer, and (4) an array of tolerance values for each alert characteristic from a plurality of alert characteristics, and

upon identifying the matching alert directive, bypassing an existing alert publication procedure of a behavioral recognition system by one of publishing or not publishing an alert of the observed event in the scene, based on the matching alert directive.

30. The system of claim 29 , wherein the characteristic values include at least one of: a pixel-height value, a pixel-width value, and an x-coordinate and y-coordinate center position of a foreground object.

31. The system of claim 29 , wherein the characteristic values include a set of x-coordinates and y-coordinates corresponding to a foreground object trajectory.

32. The system of claim 29 , wherein the matching alert directive includes a focus mask that intersects with a region in the scene where the observed event occurred.

33. The system of claim 29 , wherein the set of at least one pre-defined user-defined alert directive matching criterion is adjustable via a graphical editor.

34. The system of claim 29 , wherein each alert directive from the plurality of alert directives further includes an epilog that includes the array of tolerance values.

Assignments (5)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: COBB, WESLEY KENNETH; SEOW, MING-JUNG; XU, GANG; SAITWAL, KISHOR ADINATH; AKINS, ANTHONY; JOSEPH, KERRY; URECH, DENNIS
To: BEHAVIORAL RECOGNITION SYSTEMS, INC.
Reel/Frame 057148/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: GIANT GRAY, INC.
To: PEPPERWOOD FUND II, LP
Reel/Frame 057148/0247 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: PEPPERWOOD FUND II, LP
To: OMNI AI, INC.
Reel/Frame 057148/0343 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 11, 2021
From: OMNI AI, INC.
To: INTELLECTIVE AI, INC.
Reel/Frame 057228/0280 →
CHANGE OF NAME Recorded Aug 11, 2021
From: BEHAVIORAL RECOGNITION SYSTEMS, INC.
To: GIANT GRAY, INC.
Reel/Frame 057232/0760 →
Cited By (1)
US 12,597,258