IP Library Granted Patent US 9,349,275
Granted Patent B2
US 9,349,275 · App. 13/836,730 · Granted May 24, 2016

Alert volume normalization in a video surveillance system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,349,275
App. No.
13/836,730
Granted
May 24, 2016
Kind
B2
Abstract

Techniques are disclosed for normalizing and publishing alerts using a behavioral recognition-based video surveillance system configured with an alert normalization module. Certain embodiments allow a user of the behavioral recognition system to provide the normalization module with a set of relative weights for alert types and a maximum publication value. Using these values, the normalization module evaluates an alert and determines whether its rareness value exceed a threshold. Upon determining that the alert exceeds the threshold, the module normalizes and publishes the alert.

Claims (318)

1. A method for normalizing and publishing alerts generated by a behavioral recognition system evaluating a sequence of video frames, the method comprising:

receiving an alert having a type and an original rareness value, wherein the alert corresponds to an observed behavior of one or more foreground objects detected in the sequence of video frames and wherein the original rareness value reflects how common the alert is based on alerts of the type that have previously been generated by the behavioral recognition system while evaluating the sequence of video frames;

converting the original rareness value to an alert percentile value;

upon determining that the alert percentile value is greater than a percentile threshold, normalizing the alert, wherein the percentile threshold is

ξ

i

=

1

-

v

i

N

i

,

where v i is a maximum allowed alert counts for the alert type value and N i is an estimated next-day alert counts value; and

publishing the alert.

2. The method of claim 1 , wherein the percentile threshold is

ξ

i

=

N

i

+

p

i

-

(

1

+

λ

)

v

i

N

i

if

p

i

>

v

i

,

where p i is a number of published alerts for a current day and λ is an overage value.

3. The method of claim 1 , wherein normalizing the alert further comprises calculating a normalized rareness value

η

i

=

ɛ

i

-

ξ

i

1

-

ξ

i

,

where ε i is the alert percentile value and ξ i is the percentile threshold.

4. The method of claim 3 , wherein the normalized rareness value is

η

i

=

1

-

rand

m

+

k

=

1

B

m

k

p

+

k

=

1

B

p

k

if

r

=

1

,

where m is a current number of alerts having an original rareness value being 1 for a current day, p is a current number of published alerts for a current day, and is the original rareness value.

5. The method of claim 1 , wherein publishing the alert further comprises calculating a publication rank value β=min(P, N p )*(1−η i ), where P is a maximum publication value, N p is a rank-renormalization constant, and η i is a normalization rareness value.

6. The method of claim 5 , further comprising upon determining that the publication rank value is less than a maximum dispatch value, dispatching the alert.

7. A computer-readable storage medium storing instructions, which, when executed on a processor, performs an operation for normalizing and publishing an alert generated by a behavioral recognition system evaluating a sequence of video frames, the operation comprising:

receiving an alert having a type and an original rareness value, wherein the alert corresponds to an observed behavior of one or more foreground objects detected in the sequence of video frames and wherein the original rareness value reflects how common the alert is based on alerts of the type that have previously been generated by the behavioral recognition system while evaluating the sequence of video frames;

converting the original rareness value to an alert percentile value;

upon determining that the alert percentile value is greater than a percentile threshold, normalizing the alert, wherein the percentile threshold is

ξ

i

=

1

-

v

i

N

i

,

where v i is a maximum allowed alert counts for the alert type value and N i is an estimated next-day alert counts value; and

publishing the alert.

8. The computer-readable storage medium of claim 7 ,

wherein the percentile threshold is

ξ

i

=

N

i

+

p

i

-

(

1

+

λ

)

v

i

N

i

if

p

i

>

v

i

,

where p i is a number of published alerts for a current day and λ is an overage value.

9. The computer-readable storage medium of claim 7 , wherein normalizing the alert further comprises calculating a normalized rareness value

η

i

=

ɛ

i

-

ξ

i

1

-

ξ

i

,

where ε i is the alert percentile value and ξ i is the percentile threshold.

10. The computer-readable storage medium of claim 9 , wherein the normalized rareness value is

η

i

=

1

-

rand

m

+

k

=

1

B

m

k

p

+

k

=

1

B

p

k

if

r

=

1

,

where m is a current number of alerts having an original rareness value being 1 for a current day, p is a current number of published alerts for a current day, and r is the original rareness value.

11. The computer-readable storage medium of claim 7 , wherein publishing the alert further comprises calculating a publication rank value β=min(P, N p )*(1−η i ), where is a maximum publication value, N p is a rank-renormalization constant, and η i is a normalization rareness value.

12. The computer-readable storage medium of claim 11 , further comprising upon determining that the publication rank value is less than a maximum dispatch value, dispatching the alert.

13. A system comprising:

a processor; and

a memory for hosting an application, which, when executed on the processor, performs an operation for normalizing and publishing an alert generated by a behavioral recognition system evaluating a sequence of video frames, the operation comprising:

receiving an alert having a type and an original rareness value, wherein the alert corresponds to an observed behavior of one or more foreground objects detected in the sequence of video frames and wherein the original rareness value reflects how common the alert is based on alerts of the type that have previously been generated by the behavioral recognition system while evaluating the sequence of video frames,

converting the original rareness value to an alert percentile value,

upon determining that the alert percentile value is greater than a percentile threshold, normalizing the alert, wherein the percentile threshold is

ξ

i

=

1

-

v

i

N

i

,

where v i is a maximum allowed alert counts for the alert type value and N i is an estimated next-day alert counts value, and

publishing the alert.

14. The system of claim 13 , wherein the percentile threshold is

ξ

i

=

N

i

+

p

i

-

(

1

+

λ

)

v

i

N

i

if

p

i

>

v

i

,

where p i is a number of published alerts for a current day and λ is an overage value.

15. The system of claim 13 , wherein normalizing the alert further comprises calculating a normalized rareness value

η

i

=

ɛ

i

-

ξ

i

1

-

ξ

i

,

where ε i is the alert percentile value and ξ i is the percentile threshold.

16. The system of claim 15 , wherein the normalized rareness value is

η

i

=

1

-

rand

m

+

k

=

1

B

m

k

p

+

k

=

1

B

p

k

if

r

=

1

,

where m is a current number of alerts having an original rareness value being 1 for a current day, p is a current number of published alerts for a current day, and r is the original rareness value.

17. The system of claim 13 , wherein publishing the alert further comprises calculating a publication rank value β=min(P, N p )*(1−η i ), where P is a maximum publication value, N p is a rank-renormalization constant, and η i is a normalization rareness value.

18. The system of claim 17 , further comprising upon determining that the publication rank value is less than a maximum dispatch value, dispatching the alert.

Assignments (68)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2020
From: OMNI AI, INC.
To: INTELLECTIVE AI, INC.
Reel/Frame 052216/0585 →
SECURITY INTEREST Recorded Jun 14, 2017
From: GIANT GRAY, INC.
To: BLESSING, STEPHEN C.; MCCLAIN, TERRY F.; WALTER, JEFFREY; WALTER, SIDNEY; WILLIAMS, JAY; WILLIAMS, SUE
Reel/Frame 042807/0240 →
SECURITY INTEREST Recorded Jun 8, 2017
From: GIANT GRAY, INC.
To: GOLDEN, ROGER; PEREZ-MAJUL, ALAIN; PEREZ-MAJUL, ALENA; PEREZ-MAJUL, MARIA; PEREZ-MAJUL, FERNANDO
Reel/Frame 042734/0380 →
SECURITY INTEREST Recorded Jun 5, 2017
From: GIANT GRAY, INC.
To: MARCUM, JOSEPH; MARCUM, DEBRA; MCAVOY, JOHN; MCAVOY, TIFFANY; MCCORD, LUCINDA; MCCORD, STEPHEN; MCKAIN, CHRISTINE; MERCER, JOAN; MORRIS, GILBERT; MORRIS, DEBRA; HOLT, HILLERY N.; HUTTON, DONNA; HUTTON, WILLIAM; HUTTON, GARY; HUTTON, DEBORAH K.; JAMES, RONALD; JAMES, JUDITH; JOHNSON, ANN; JOHNSON, NORMAN; JUDGE, JOYCE A.; KEEVIN, LOIS JANE; KINNAMAN, SANDRA; KINNEY, JOY E.; KOUSARI, EHSAN; KOUSARI, MARY; LEMASTER, CHERYL J.; LEMASTER, CARL D.; LITTLE, CAMILLE; LITTLE, STEPHEN C.; NECESSARY, MICHAEL J.; PEGLOW, SUE ELLEN; PETERS, CYNTHIA; PIKE, DAVID A.; REECE, DONALD B.; REECE, MYRTLE D.; RENBARGER, TERRY; RENBARGER, ROSEMARY; REYES, JOSE; REYES, BETH; RHOTEN, MARY C.; RICKS, PENNY L.; ROBINSON, RICK; SGRO, MARIO P.; SGRO, MARIO; ST. LOUIS, GLORIA; STROEH, MARY ANN; STROEH, STEPHEN L.; SULLIVAN, DONNA L.; TOWNSEND, CHRISTOPHER; TOWNSEND, JILL; TREES, CRAIG; WELPOTT, WARREN R.; WELPOTT, WARREN; WELPOTT, TRAVIS; WELPOTT, MELISSA; ZEIGLER, BETTY JO
Reel/Frame 042687/0055 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HARRINGTON, ANNE M.
Reel/Frame 042665/0161 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: ENRIQUEZ, RICK
Reel/Frame 042663/0577 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: GANGWER, ALAN; GANGWER, JANE
Reel/Frame 042663/0691 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: GINDER, DARLENE; GINDER, MICHAEL
Reel/Frame 042663/0764 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HANNER, DAVID; HANNER, KATTE
Reel/Frame 042664/0172 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HARRINGTON, ANNE
Reel/Frame 042665/0109 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HIGGINBOTTOM, BRYCE E.
Reel/Frame 042665/0493 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HIGGINBOTTOM, BRYCE
Reel/Frame 042665/0678 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: HOLT, RUTH ANN
Reel/Frame 042665/0685 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DUNLAVY, FRIEDA
Reel/Frame 042666/0637 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BAGIENSKI, FRANK
Reel/Frame 042645/0494 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BATCHELDER, ROBERT
Reel/Frame 042645/0507 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BATCHELDER, LEANNE
Reel/Frame 042645/0552 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BIVANS, WAYNE
Reel/Frame 042646/0443 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BIVANS, JENNIFER
Reel/Frame 042646/0512 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, EDWARD
Reel/Frame 042646/0534 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, EDWARD
Reel/Frame 042646/0599 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, REBECCAH
Reel/Frame 042646/0630 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BODINE, REBECCAH
Reel/Frame 042646/0711 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSE, BETHEL
Reel/Frame 042646/0862 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, ALAN J.
Reel/Frame 042647/0016 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, MARY ALICE
Reel/Frame 042647/0143 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, ALAN J.
Reel/Frame 042647/0196 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BOSLER, MARY ALICE
Reel/Frame 042647/0384 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNER, JOHN
Reel/Frame 042647/0447 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNER, LINDA
Reel/Frame 042647/0831 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0446 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0518 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, JOHNIE
Reel/Frame 042652/0777 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BRUNNEMER, BRENT
Reel/Frame 042652/0788 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, JOHNIE
Reel/Frame 042652/0795 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, MARY
Reel/Frame 042652/0828 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BURKE, MARY
Reel/Frame 042652/0905 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BUSBY, RANAYE
Reel/Frame 042652/0912 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: BUSBY, BRET D.
Reel/Frame 042652/0919 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, LISBETH ANN
Reel/Frame 042652/0946 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, ROBERT
Reel/Frame 042653/0367 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CANADA, LISBETH ANN
Reel/Frame 042653/0374 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CHEEK, GERALD
Reel/Frame 042657/0671 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CHEEK, PAMELA
Reel/Frame 042658/0507 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, STEVEN F.
Reel/Frame 042658/0634 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, LINDA
Reel/Frame 042658/0962 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COLLINS, STEVEN F.
Reel/Frame 042658/0969 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, PAIGE
Reel/Frame 042659/0039 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, PAIGE
Reel/Frame 042659/0179 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, SEAN P.
Reel/Frame 042659/0272 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: CONBOY, SEAN
Reel/Frame 042659/0431 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COX, REBECCA J.
Reel/Frame 042659/0603 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: COX, LAWRENCE E.
Reel/Frame 042659/0667 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DARLING, WILLIAM; DARLING, DIANA
Reel/Frame 042659/0776 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DAVIS, JEFFREY J.
Reel/Frame 042661/0438 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DAVIS, JEFFREY J.; DAVIS, NAOMI
Reel/Frame 042662/0103 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DENNY, SUMMER
Reel/Frame 042662/0923 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DESHIELDS, JAMES
Reel/Frame 042662/0983 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GIANT GRAY, INC.
To: DESHIELDS, JAMES
Reel/Frame 042663/0048 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: MULTIMEDIA GRAPHIC NETWORK
Reel/Frame 042621/0900 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: TRAN, JOHN
Reel/Frame 042622/0052 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: DAVIS, DREW
Reel/Frame 042621/0988 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: WILKINSON, PHILIP
Reel/Frame 042622/0065 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: TRAN, JOHN
Reel/Frame 042622/0033 →
SECURITY INTEREST Recorded May 30, 2017
From: GIANT GRAY, INC.
To: DAVIS, DREW
Reel/Frame 042621/0962 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2017
From: PEPPERWOOD FUND II, LP
To: OMNI AI, INC.
Reel/Frame 041687/0576 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 22, 2017
From: GIANT GRAY, INC.
To: PEPPERWOOD FUND II, LP
Reel/Frame 041685/0404 →
CHANGE OF NAME Recorded Mar 22, 2017
From: BEHAVIORAL RECOGNITION SYSTEMS, INC.
To: GIANT GRAY, INC.
Reel/Frame 042068/0551 →