IP Library Granted Patent US 10,713,798
Granted Patent B2
US 10,713,798 · App. 14/828,733 · Granted Jul 14, 2020

Low-complexity motion detection based on image edges

Inventor: Lili Zhao (Beijing, CN)
Assignee: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
G06T7/246G06T2207/30232G06T2207/30242
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,713,798
App. No.
14/828,733
Granted
Jul 14, 2020
Kind
B2
Abstract

A system for detecting a motion event based on images. The system acquires a first image and a comparison image, and generates a first edge image and a comparison edge image based on the first image and the comparison image. The system also determines the difference between the first edge image and the comparison edge image. The system indicates a motion event if the difference between the first edge image and the comparison edge image meets or exceeds a threshold.

Claims (75)

1. A method for detecting a motion event comprising:

acquiring a first image;

obtaining a comparison image;

identifying edge pixels in the first image;

generating a first edge image by assigning a first pixel value to the edge pixels of the first image and a second pixel value to non-edge pixels of the first image, the first pixel value being different from the second pixel value;

identifying edge pixels in the comparison image by:

obtaining, for each pixel in the comparison image, pixel values of two neighboring pixels;

computing a difference in pixel value between the two neighboring pixels;

determining whether the difference in pixel value meets or exceeds a first threshold; and

identifying the pixel as an edge pixel if the difference in pixel value meets or exceeds the first threshold;

generating a comparison edge image by assigning the first pixel value to the edge pixels of the comparison image and the second pixel value to non-edge pixels of the comparison image;

generating a difference image based on the first edge image and the comparison edge image;

reducing noise in the difference image by an erosion operation;

determining difference between the first edge image and the comparison edge image by obtaining pixels having the first pixel value in the difference image after noise reduction, wherein the difference comprises distances in the horizontal and vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value and a number count of the obtained pixels in the difference image;

determining whether the difference between the first edge image and the comparison edge image meets or exceeds a second threshold, the second threshold being adjustable by a user, wherein the determining whether the difference between the first edge image and the comparison edge image meets or exceeds a second threshold comprises:

determining whether distances in the horizontal or vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value meets or exceeds a third threshold,

determining whether a number count of the obtained pixels in the difference image meets or exceeds a fourth threshold; and

in response to that the difference is determined to meet or exceed the second threshold, generating an alert indicating that a motion event occurs, and transmitting the alert to a user device, the alert including image data associated with the motion event.

2. The method of claim 1 , the first pixel value being a maximum pixel value among pixels in the first image or the comparison image, and the second pixel value being a minimum pixel value among pixels in the first image or the comparison image.

3. The method of claim 1 , the obtaining the comparison image includes:

determining whether a time that has elapsed since acquiring the first image meets or exceeds a threshold period of time; and

obtaining the comparison image if the time meets or exceeds the threshold period of time.

4. The method of claim 1 , wherein the generating the difference image based on the first edge image and the comparison edge image comprises:

identifying a first group of pixels in the first edge image that have a different pixel value from corresponding pixels in the comparison edge image;

identifying a second group of pixels in the first edge image that have a same pixel value as corresponding pixels in the comparison edge image; and

generating the difference image by assigning a first pixel value to the first group of pixels and a second pixel value to the second group, the first pixel value being different from the second pixel value.

5. A system for detecting a motion event comprising:

a memory storing instructions;

a processor configured to execute the instructions to:

acquire a first image;

obtain a comparison image;

identify edge pixels in the first image;

generate a first edge image by assigning a first pixel value to the edge pixels of the first image and a second pixel value to non-edge pixels of the first image, the first pixel value being different from the second pixel value;

identify edge pixels in the comparison image by:

obtaining, for each pixel in the comparison image, pixel values of two neighboring pixels;

computing a difference in pixel value between the two neighboring pixels;

determining whether the difference in pixel value meets or exceeds a first threshold; and

identifying the pixel as an edge pixel if the difference in pixel value meets or exceeds the first threshold;

generate a comparison edge image by assigning the first pixel value to the edge pixels of the comparison image and the second pixel value to non-edge pixels of the comparison image;

generate a difference image based on the first edge image and the comparison edge image;

reduce noise in the difference image by an erosion operation;

determine difference between the first edge image and the comparison edge image by obtaining pixels having the first pixel value in the difference image after noise reduction, wherein the difference comprises distances in the horizontal and vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value and a number count of the obtained pixels in the difference image;

determine whether the difference between the first edge image and the comparison image meets or exceeds a second threshold, the second threshold being adjustable by a user, wherein the determine whether the difference between the first edge image and the comparison edge image meets or exceeds a second threshold comprises:

determining whether distances in the horizontal or vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value meets or exceeds a third threshold,

determining whether a number count of the obtained pixels in the difference image meets or exceeds a fourth threshold; and

if the difference meets or exceeds the second threshold, generate an alert indicating that a motion event occurs, and transmit the alert to a user device, the alert including image data associated with the motion event.

6. The system of claim 5 , the first pixel value being a maximum pixel value among pixels in the first image or the comparison image, and the second pixel value being a minimum pixel value among pixels in the first image or the comparison image.

7. The system of claim 5 , the obtaining the comparison image includes:

determining whether a time that has elapsed since acquiring the first image meets or exceeds a threshold period of time; and

obtaining the comparison image if the time meets or exceeds the threshold period of time.

8. The system of claim 5 , wherein the generating a difference image based on the first edge image and the comparison edge image comprises:

identifying a first group of pixels in the first edge image that have a different pixel value from corresponding pixels in the comparison edge image;

identifying a second group of pixels in the first edge image that have a same pixel value as corresponding pixels in the comparison edge image; and

generating the difference image by assigning a first pixel value to the first group of pixels and a second pixel value to the second group, the first pixel value being different from the second pixel value.

9. A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to perform a method for video monitoring, the method comprising:

acquiring a first image and a comparison image;

identifying edge pixels in the first image by:

obtaining, for each pixel in the first image, pixel values of two neighboring pixels;

computing a difference in pixel value between the two neighboring pixels;

determining whether the difference in pixel value meets or exceeds a first threshold; and

identifying the pixel as an edge pixel if the difference in pixel value meets or exceeds the first threshold;

generating a first edge image by assigning a first pixel value to the edge pixels of the first image and a second pixel value to non-edge pixels of the first image, the first pixel value being different from the second pixel value;

identifying edge pixels in the comparison image;

generating a comparison edge image by assigning the first pixel value to the edge pixels of the comparison image and the second pixel value to non-edge pixels of the comparison image;

generating a difference image based on the first edge image and the comparison edge image;

reducing noise in the difference image by an erosion operation;

determining difference between the first edge image and the comparison edge image by obtaining pixels having the first pixel value in the generated difference image after noise reduction, wherein the difference comprises distances in the horizontal and vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value and a number count of the obtained pixels in the difference image;

determining whether the difference between the first edge image and the comparison edge image meets or exceeds a second threshold, the second threshold being adjustable by a user, wherein the determine whether the difference between the first edge image and the comparison edge image meets or exceeds a second threshold comprises:

determining whether distances in the horizontal or vertical directions between the obtained pixels having the maximum coordinate value and the minimum coordinate value meets or exceeds a third threshold,

determining whether a number count of the obtained pixels in the difference image meets or exceeds a fourth threshold; and

if the difference meets or exceeds the second threshold, generate an alert indicating that a motion event occurs, and transmit the alert to a user device, the alert including image data associated with the motion event.

10. The non-transitory computer-readable storage medium of claim 9 , wherein the generating a difference image based on the first edge image and the comparison edge image comprises:

identifying a first group of pixels in the first edge image that have a different pixel value from corresponding pixels in the comparison edge image;

identifying a second group of pixels in the first edge image that have a same pixel value as corresponding pixels in the comparison edge image; and

generating the difference image by assigning a first pixel value to the first group of pixels and a second pixel value to the second group, the first pixel value being different from the second pixel value.

Assignments (5)
RELEASE OF SECURITY INTEREST Recorded Nov 5, 2024
From: EAST WEST BANK
To: KAMI VISION INCORPORATED
Reel/Frame 070792/0551 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Mar 28, 2022
From: KAMI VISION INCORPORATED
To: EAST WEST BANK
Reel/Frame 059512/0101 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 1, 2022
From: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
To: KAMI VISION INC.
Reel/Frame 059275/0652 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY'S NAME PREVIOUSLY RECORDED AT REEL: 036348 FRAME: 0428. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jan 30, 2018
From: ZHAO, LILI
To: SHANGHAI XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 045194/0162 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 18, 2015
From: ZHAO, LILI
To: XIAOYI TECHNOLOGY CO., LTD.
Reel/Frame 036348/0428 →
Priority Claims (1)
CN 2015 1 0441049 · Jul 24, 2015 · national
Continuity (2)
Related Publication 20170004629A1 · Jan 5, 2017
Related Publication 20200175692A9 · Jun 4, 2020