IP Library › Granted Patent US 12,387,497
Granted Patent B2
US 12,387,497 · App. 18/536,349 · Granted Aug 12, 2025

Methods and systems for detection of anomalous motion in a video stream and for creating a video summary

Inventor: Sean Lawlor (Dollard-des-Ormeaux, CA)
G06V20/52G06V10/764G06V20/40G06V20/47G11B27/3081G11B27/34G06V20/44G08B17/125
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,387,497
App. No.
18/536,349
Granted
Aug 12, 2025
Kind
B2
Abstract

A computer-implemented method, comprising: obtaining motion indicators for a plurality of samples of a video stream; obtaining an anomaly state for each of a plurality of time windows of the video stream, each of the time windows spanning a subset of the samples, by (i) obtaining estimated statistical parameters for the given time window based on measured statistical parameters characterizing the motion indicators for the samples in at least one time window of the video stream that precedes the given time window and (ii) determining the anomaly state for the given time window based on the plurality of motion indicators obtained for the samples in the given time window and the estimated statistical parameters; and processing the video stream based on the anomaly state for various ones of the time windows.

Claims (51)

1. A computer-implemented media processing method, comprising:

obtaining an original media stream that includes a plurality of time windows;

identifying a video segment of interest that includes a given time window of the plurality of time windows, wherein the given time window is associated with an anomaly state that meets criteria; and

including the video segment of interest and an indication of the anomaly state associated with the given time window in a composite media stream.

2. The method defined in claim 1 , wherein the criteria define an anomalous change in motion including at least one of an anomalous increase in motion and an anomalous decrease in motion.

3. The method defined in claim 1 , wherein the anomaly state associated with the given time window is based on (i) an estimate of statistical parameters about a normal motion level for the original media stream; (ii) instantaneous measures of a current motion level of the given time window; and (iii) utilizing statistical hypothesis testing to determine if the current motion level is statistically normal or abnormal.

4. The method defined in claim 1 , further comprising:

obtaining motion indicators for a plurality of samples of the original media stream, each of the plurality of time windows spanning a subset of the samples;

obtaining the anomaly state for the given time window of the plurality of time windows by:

obtaining estimated statistical parameters for the given time window based on measured statistical parameters characterizing the motion indicators for the subset of the samples in at least one time window of the original media stream that precedes the given time window; and

determining the anomaly state for the given time window based on the motion indicators obtained for the subsets of samples in the given time window and the estimated statistical parameters.

5. The method defined in claim 1 , wherein the original media stream is a video stream originating from a particular camera, and the composite media stream comprises information that identifies the particular camera.

6. The method defined in claim 1 , wherein the video segment of interest further comprises at least one time window that precedes the given time window or follows the given time window.

7. The method defined in claim 1 , further comprising storing the composite media stream in a memory.

8. The method defined in claim 1 , wherein the criteria comprise a threshold, and the original media stream comprises a video stream, wherein identifying the video segment of interest comprises:

obtaining motion indicators for a plurality of samples of the video stream; and

comparing at least one p-value for the motion indicators for samples in the given time window with the threshold to determine whether the anomaly state of the given time window meets the criteria.

9. The method defined in claim 1 , further comprising:

determining a length of a set of time windows associated with the anomaly state that meets the criteria;

calculating a compression ratio based on a length of the original media stream and the determined length; and

displaying the compression ratio on a user interface.

10. The method defined in claim 1 , further comprising generating a media summary that includes the indication of the anomaly state.

11. The method defined in claim 1 , further comprising:

querying a database for a subset of time windows in a desired time range; and

creating a stream summary of the desired time range.

12. A non-transitory computer-readable medium comprising computer-readable instructions which, when executed by a computing device, configure the computing device to carry out a method that includes:

obtaining an original media stream that includes a plurality of time windows;

identifying a video segment of interest that includes a given time window of the plurality of time windows, wherein the given time window is associated with an anomaly state that meets criteria; and

including the video segment of interest and an indication of the anomaly state associated with the given time window in a composite media stream.

13. The non-transitory computer-readable medium defined in claim 12 , wherein the criteria define an anomalous change in motion including at least one of an anomalous increase in motion and an anomalous decrease in motion.

14. The non-transitory computer-readable medium defined in claim 12 , wherein the anomaly state associated with the given time window is based on (i) an estimate of statistical parameters about a normal motion level for the original media stream; (ii) instantaneous measures of a current motion level of the given time window; and (iii) utilizing statistical hypothesis testing to determine if the current motion level is statistically normal or abnormal.

15. The non-transitory computer-readable medium defined in claim 12 , the method further comprises:

obtaining motion indicators for a plurality of samples of the original media stream, each of the plurality of time windows spanning a subset of the samples;

obtaining the anomaly state for the given time window of the plurality of time windows by

obtaining estimated statistical parameters for the given time window based on measured statistical parameters characterizing the motion indicators for the subset of the samples in at least one time window of the original media stream that precedes the given time window; and

determining the anomaly state for the given time window based on the motion indicators obtained for the subsets of samples in the given time window and the estimated statistical parameters.

16. The non-transitory computer-readable medium defined in claim 12 , wherein the original media stream is a video stream originating from a particular camera, and the composite media stream comprises information that identifies the particular camera.

17. The non-transitory computer-readable medium defined in claim 12 , wherein the video segment of interest further comprises at least one time window that precedes the given time window or follows the given time window.

18. The non-transitory computer-readable medium defined in claim 12 , wherein the criteria comprise a threshold, and the original media stream comprises a video stream, wherein identifying the video segment of interest comprises:

obtaining motion indicators for a plurality of samples of the video stream; and

comparing at least one p-value for the motion indicators for samples in the given time window with the threshold to determine whether the anomaly state of the given time window meets the criteria.

19. The non-transitory computer-readable medium defined in claim 12 , the method further comprising:

determining a length of a set of time windows associated with the anomaly state that meets the criteria;

calculating a compression ratio based on a length of the original media stream and the determined length; and

displaying the compression ratio on a user interface.

20. An apparatus comprising:

a non-transitory memory comprising instructions; and

one or more processors in communication with the memory, wherein the one or more processors execute the instructions to:

obtain an original media stream that includes a plurality of time windows;

identify a video segment of interest that includes a given time window of the plurality of time windows, wherein the given time window is associated with an anomaly state that meets criteria; and

include the video segment of interest and an indication of the anomaly state associated with the given time window in a composite media stream.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 12, 2023
From: LAWLOR, SEAN
To: GENETEC INC.
Reel/Frame 065838/0009 →
Continuity (6)
Continuation 17183427 · Feb 24, 2021
Continuation 16677330 · Nov 7, 2019
Provisional Application 62928531 · Oct 31, 2019
Provisional Application 62796734 · Jan 25, 2019
Provisional Application 62756645 · Nov 7, 2018
Related Publication 20240112470A1 · Apr 4, 2024
References Cited (71)
US 4652907A · Fling · 1987 [cited by applicant]
US 4979036A · Smith · 1990 [cited by applicant]
US 6493041B1 · Hanko · 2002 [cited by applicant]
US 7075581B1 · Ozgen · 2006 [cited by applicant]
US 7286709B2 · Wakabayashi · 2007 [cited by applicant]
US 7324163B2 · Bacche · 2008 [cited by applicant]
US 7535515B2 · Bacche · 2009 [cited by applicant]
US 7836476B2 · Yoshikawa et al. · 2010 [cited by applicant]
US 7925106B2 · Seo · 2011 [cited by applicant]
US 8102406B2 · Peleg · 2012 [cited by applicant]
US 8189869B2 · Bell · 2012 [cited by applicant]
US 8275038B2 · Lee · 2012 [cited by applicant]
US 8345761B2 · Sakamoto · 2013 [cited by applicant]
US 8437505B2 · Flosdorf · 2013 [cited by applicant]
US 8553783B2 · Deng · 2013 [cited by applicant]
US 9158974B1 · Laska et al. · 2015 [cited by applicant]
US 9160897B2 · Albu · 2015 [cited by applicant]
US 9460522B2 · Saitwal · 2016 [cited by applicant]
US 9473746B2 · Masuura · 2016 [cited by applicant]
US 9502073B2 · Boiman · 2016 [cited by applicant]
US 9584874B1 · Farías · 2017 [cited by examiner]
US 9615087B2 · Amon · 2017 [cited by examiner]
US 9779303B2 · Zhang · 2017 [cited by applicant]
US 10403326B1 · Medioni et al. · 2019 [cited by applicant]
US 10971192B2 · Lawlor · 2021 [cited by applicant]
US 20040088723A1 · Ma · 2004 [cited by applicant]
US 20060109341A1 · Evans · 2006 [cited by applicant]
US 20060165283A1 · DeWitt · 2006 [cited by examiner]
US 20090142033A1 · Schmouker et al. · 2009 [cited by applicant]
US 20100281383A1 · Meaney et al. · 2010 [cited by applicant]
US 20110043626A1 · Cobb · 2011 [cited by examiner]
US 20120063641A1 · Venkatesh · 2012 [cited by applicant]
US 20120189284A1 · Morrison · 2012 [cited by applicant]
US 20120323925A1 · Fitzsimmons et al. · 2012 [cited by applicant]
US 20130147915A1 · Wiegand · 2013 [cited by examiner]
US 20140350436A1 · Nathan · 2014 [cited by applicant]
US 20140355895A1 · Xu et al. · 2014 [cited by applicant]
US 20160014482A1 · Chen · 2016 [cited by examiner]
US 20160042621A1 · Hogg et al. · 2016 [cited by applicant]
US 20160248835A1 · Petrangeli · 2016 [cited by examiner]
US 20160299968A1 · Song et al. · 2016 [cited by applicant]
US 20170111674A1 · Meredith et al. · 2017 [cited by applicant]
US 20170374120A1 · Vishnia et al. · 2017 [cited by applicant]
US 20180075877A1 · Cilingir · 2018 [cited by examiner]
US 20190026882A1 · Liu · 2019 [cited by examiner]
US 20200019790A1 · Periaswamy et al. · 2020 [cited by applicant]
US 20200143844A1 · Lawlor · 2020 [cited by applicant]
US 20210225409A1 · Lawlor · 2021 [cited by applicant]
JP 2005094245 · 2005 [cited by applicant]
WO 2001061993 · 2001 [cited by applicant]
WO 2018176162 · 2018 [cited by applicant]
WO 2020093164 · 2020 [cited by applicant]
Fathy, M. and Siyal, Y. A window based image processing technique for quantitative and qualitative analysis of road traffic parameters, IEEE Transactions on Vehicular Technology, 1998, pp. 1342-1349. [cited by applicant]
Jing G, Rajan D and Chng Eng Siong, Motion detection with adaptive background and dynamic thresholds, Information, Communications and Signal Processing, 2005, Fifth International Conference on. IEEE. [cited by applicant]
Quen-Zong Wu, Hsu Yung Cheng and Bor-Shenn Jeng, Motion detection via change-point detection for cumulative histograms of ratio images, Pattern Recognition Letters 26.5 ,2005, pp. 555-563. [cited by applicant]
Elhabian, El Sayed and Ahmed, Moving object detection in spatial domain using background removal techniques—state-of-art, Recent patents on computer science 1.1, 2008, pp. 32-54. [cited by applicant]
Dimou, Nemethova and Rupp, Scene change detection for H. 264 using dynamic threshold techniques, http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.92.9213&rep=rep1&type=pdf , 2005. [cited by applicant]
Zhang and Liang, Motion human detection based on background subtraction, Education Technology and Computer Science (ETCS), 2010 Second International Workshop on. vol. 1. IEEE, 2010. [cited by applicant]
Browne et al, Evaluating and combining digital video shot boundary detection algorithms, http://doras.dcu.ie/336/1/imvip_2000.pdf , 2000. [cited by applicant]
Intelligent Video Analytics Solutions—BriefCam, https://www.briefcam.com/technology/how-it-works/, 8 pages, [retrieved on Nov. 7, 2019]. [cited by applicant]
Wisenet Wave—VMS Made Simple, https://wavevms.com/, 8 pages [retrieved on Nov. 7, 2019]. [cited by applicant]
Fast Finder—Apps on Google Play, 2019, 4 pages. [cited by applicant]
International Search Report and Writen Opinion issued on Feb. 5, 2020, in connection with PCT CA2019/051588, 12 pages. [cited by applicant]
Office Action issued on Aug. 21, 2020 in connection with U.S. Appl. No. 16/677,330, 49 pages. [cited by applicant]
EESR issued by the EPO on Jul. 7, 2022 in connection with EP patent application No. 19882193.6, 9 pages. [cited by applicant]
Office Action issued on Aug. 26, 2022 in connection with U.S. Appl. No. 17/183,427, 82 pages. [cited by applicant]
Final Office Action issued on Jan. 26, 2023 in connection with U.S. Appl. No. 17/183,427, 50 pages. [cited by applicant]
Advisory Action issued on Apr. 6, 2023 in connection with U.S. Appl. No. 17/183,427, 5 pages. [cited by applicant]
Office Action Summary issued on Jun. 15, 2023 in connection with U.S. Appl. No. 17/183,427, 22 pages. [cited by applicant]
Notice of Allowance issued on Sep. 22, 2023 in connection with U.S. Appl. No. 17/183,427, 5 pages. [cited by applicant]
European Search Report issued by the European Patent Office on Dec. 22, 2023 in connection with EP patent application No. 19882193.6, 8 pages. [cited by applicant]