IP Library Granted Patent US 12,354,328
Granted Patent B2
US 12,354,328 · App. 18/265,870 · Granted Jul 8, 2025

Method, apparatus, computer device and storage medium for detecting objects thrown from height

Inventors: Yuan Li (Anhui, CN); Xiangyu Ji (Anhui, CN)
Assignees: China Science IntelliCloud Technology Co., Ltd.; Shanghai DianZe Intelligent Technology Co., Ltd.
G06V10/765G06V10/993G06V20/52G08B21/02G06V10/82
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,354,328
App. No.
18/265,870
Granted
Jul 8, 2025
Kind
B2
Abstract

The present application provides a method, apparatus, computer device and storage medium for detecting objects thrown from height, the method including: setting up a video surveillance area for capturing a target video image in real time; detecting all moving objects within the target video image using a background modeling algorithm; tracking the detected moving objects using Kalman filtering to obtain trajectory characteristics and related parameters of the moving objects; identifying whether the moving objects are objects thrown from height through rule-based identification of objects thrown from height; performing classification using a Long Short-Term Memory (LSTM) network classification model, including inputting parameters of the moving objects as feature data into the LSTM, to obtain a classification result and determine whether a false positive occurs. The method has strong anti-interference ability and can effectively filter out moving objects other than objects thrown from height.

Claims (17)

1. A method for detecting objects thrown from height, comprising the following steps of:

setting up a video surveillance area for capturing a target video image in real time;

detecting all moving objects within the target video image using a background modeling algorithm;

tracking the detected moving objects using Kalman filtering to obtain trajectory characteristics and related parameters of the moving objects, including trajectory curve trend, object movement acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes, then all trajectories being analyzed and filtered;

identifying whether the moving objects are objects thrown from height through rule-based identification of objects thrown from height, setting an outer contour line of the building and a special position line, so that once the trajectory of a moving object crosses the contour line from inside to outside, or crosses the special position line from top to bottom, the object is identified as an object thrown from height;

performing classification using a Long Short-Term Memory (LSTM) network classification model, including inputting trajectory curve trend, object movement acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes as feature data into the LSTM, to obtain a classification result and determine whether misinformation occurs, wherein an input layer of the LSTM network includes extracted feature data including trajectory curve trend, object moving acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes, a number of neurons in a first LSTM hidden layer is 128, a number of neurons in a second LSTM hidden layer is 32, and a number of neurons in a final output layer is 1, which represents a probability of objects thrown from height; and

pushing an alarm to the monitoring center if the classification result of the LSTM classification model does not indicate misinformation.

2. The method for detecting objects thrown from height according to claim 1 , wherein the background modeling algorithm is a single Gaussian model method, a Gaussian mixture model method, or an optical flow method to achieve detection of the moving objects.

3. An apparatus for detecting objects thrown from height, comprising:

a camera module configured to capture a target video image in real time;

a detection module configured to detect all moving objects within the target video image using a background modeling algorithm;

a tracking module configured to track the detected moving objects using Kalman filtering to obtain trajectory characteristics and related parameters of the moving objects, including trajectory curve trend, object movement acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes, then all trajectories being analyzed and filtered;

an identification module configured to identify whether the objects are objects thrown from height through rule-based identification of objects thrown from height, setting an outer contour line of the building and a special position line, so that once the trajectory of a moving object crosses the contour line from inside to outside, or crosses the special position line from top to bottom, the object is identified as an object thrown from height;

a filtering module configured to perform classification using a Long Short-Term Memory (LSTM) network classification model, including inputting trajectory curve trend, object movement acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes as feature data into the LSTM network, to obtain a classification result and determine whether misinformation occurs, wherein an input layer of the LSTM network includes extracted feature data including trajectory curve trend, object moving acceleration, intersection over union of previous and current frames of the object, object shape and pixel size changes, a number of neurons in a first LSTM hidden layer is 128, a number of neurons in a second LSTM hidden layer is 32, and a number of neurons in a final output layer is 1, which represents a probability of objects thrown from height; and

an alarm module configured to push an alarm to the monitoring center.

4. A computer device comprising a memory, a processor and a computer program stored in the memory and executable by the processor, wherein the computer program, when executed by the processor, causes the processor to perform the method according to claim 1 .

5. A non-transitory storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, causes the processor to perform the method according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 7, 2023
From: LI, YUAN; JI, XIANGYU
To: CHINA SCIENCE INTELLICLOUD TECHNOLOGY CO., LTD.; SHANGHAI DIANZE INTELLIGENT TECHNOLOGY CO., LTD.
Reel/Frame 063884/0507 →
Priority Claims (1)
CN 202011306953.2 · Nov 19, 2020 · national
Continuity (1)
Related Publication 20240062518A1 · Feb 22, 2024
References Cited (10)
CN 102547244A · 2012 [cited by applicant]
CN 105163067A · 2015 [cited by applicant]
CN 109309811A · 2019 [cited by applicant]
CN 111079663A · 2020 [cited by applicant]
CN 111553256A · 2020 [cited by applicant]
CN 111627049A · 2020 [cited by applicant]
CN 111898511A · 2020 [cited by applicant]
CN 111931719A · 2020 [cited by applicant]
CN 112418069A · 2021 [cited by applicant]
Hassan, “Multiple object tracking using feature fusion in hierarchical LSTMs,” The Journal of Engineering (Year: 2020). [cited by examiner]