IP Library Granted Patent US 9,047,748
Granted Patent B2
US 9,047,748 · App. 13/686,955 · Granted Jun 2, 2015

Safety guard device and method for detecting falling object

Inventors: Hou-Hsien Lee (New Taipei, TW); Chang-Jung Lee (New Taipei, TW); Chih-Ping Lo (New Taipei, TW)
Assignee: Zhongshan Innocloud Intellectual Property Services Co., Ltd.
G08B21/02H04N7/18G06K2009/3291A42B3/046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,047,748
App. No.
13/686,955
Granted
Jun 2, 2015
Kind
B2
Abstract

In a method for detecting a falling object using a safety guard device, a current digital image of the overhead scene is captured by an image capturing device of the safety guard device. The method detects a falling object in the current digital image, and outputs alarm messages when a falling object is detected in the current digital image and the falling object is going to hit a user of the safety guard device.

Claims (69)

1. A computer-implemented method for detecting a falling object using a safety guard device, the method comprising:

obtaining a current digital image captured by an image capturing device of the safety guard device, and obtaining a movement direction and a movement speed of a user of the safety guard device detected by an acceleration sensor of the safety guard device;

detecting a falling object in the current digital image, the current digital image comprising distance information between a lens of the image capturing device and each point in the current digital image;

determining whether a detected falling object is in proximity to the user of the safety guard device according to a position of the detected falling object, the movement direction and the movement speed of the user; and

outputting alarm messages by enabling one or more alarm units of the safety guard device upon the condition that the detected falling object is in proximity to the user of the safety guard device.

2. The method according to claim 1 , further comprising: enabling one or more alarm units according to a relative position between the user of the safety guard device and the detected falling object.

3. The method according to claim 1 , wherein the falling object is detected by:

obtaining a previous digital image captured by the image capturing device, comparing a current distance of each point in the current digital image with a previous distance of each point in the previous digital image, and determining whether the current distance is less than the previous distance; and

determining that the current digital image comprises the falling object upon the condition that a specified number of points whose current distances are less than the previous distances are found.

4. The method according to claim 3 , wherein the falling object is determined by calculating a smallest rectangle framing the specified number of points, or determined by fitting the specified number of points into a fitted figure using a feature point fitting method.

5. The method according to claim 1 , wherein the step of determining whether a detected falling object is in proximity to the user comprises:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

determining a falling range of the detected falling object according to the falling distance, the falling range comprising a horizontal coordinate range and a vertical coordinate range of the detected falling object, and determining a horizontal direction to be the movement direction of the user;

determining an alarm range according to the falling range of the detected falling object, and determining a user range according a current position of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the user range and the alarm range have at least one intersection point.

6. The method according to claim 1 , wherein the step of determining whether a detected falling object is in proximity to the user comprises:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

calculating a horizontal distance between the user of the safety guard device and the detected falling object along a horizontal direction, the horizontal direction being the movement direction of the user;

calculating a falling time of the detected falling object according to the falling distance of the detected falling object;

determining a movement distance of the user within the falling time according to the movement speed of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the movement distance plus a preset value is greater than the horizontal distance.

7. A safety guard device, comprising:

a storage device;

an image capturing device;

an acceleration sensor;

at least one processor; and

one or more modules that are stored in the storage device and are executed by the at least one processor, the one or more modules comprising:

an image obtaining module that obtains a current digital image captured by the image capturing device, and obtains a movement direction and a movement speed of a user of the safety guard device detected by the acceleration sensor;

an object detection module that detects a falling object in the current digital image, the current digital image comprising distance information between a lens of the image capturing device and each point in the current digital image;

a safety analysis module that determines whether a detected falling object is in proximity to the user of the safety guard device according to a position of the detected falling object, the movement direction and the movement speed of the user; and

an alarm message generation module that outputs alarm messages by enabling one or more alarm units of the safety guard device upon the condition that the detected falling object is in proximity to the user of the safety guard device.

8. The safety guard device according to claim 7 , wherein the one or more modules further comprise:

an alarm unit determination module that enabling one or more alarm units according to a relative position between the user of the safety guard device and the detected falling object.

9. The safety guard device according to claim 7 , wherein the falling object is detected by:

obtaining a previous digital image captured by the image capturing device, comparing a current distance of each point in the current digital image with a previous distance of each point in the previous digital image, and determining whether the current distance is less than the previous distance; and

determining that the current digital image comprises the falling object upon the condition that a specified number of points whose current distances are less than the previous distances are found.

10. The safety guard device according to claim 9 , wherein the falling object is determined by calculating a smallest rectangle framing the specified number of points, or determined by fitting the specified number of points into a fitted figure using a feature point fitting method.

11. The safety guard device according to claim 7 , wherein the safety analysis module determines whether a detected falling object is in proximity to the user by:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

determining a falling range of the detected falling object according to the falling distance, the falling range comprising a horizontal coordinate range and a vertical coordinate range of the detected falling object, and determining a horizontal direction to be the movement direction of the user;

determining an alarm range according to the falling range of the detected falling object, and determining a user range according a current position of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the user range and the alarm range have at least one intersection point.

12. The safety analysis module according to claim 7 , wherein the safety analysis module determines whether a detected falling object is in proximity to the user by:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

calculating a horizontal distance between the user of the safety guard device and the detected falling object along a horizontal direction, the horizontal direction being the movement direction of the user;

calculating a falling time of the detected falling object according to the falling distance of the detected falling object;

determining a movement distance of the user within the falling time according to the movement speed of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the movement distance plus a preset value is greater than the horizontal distance.

13. A non-transitory storage medium having stored thereon instructions that, when executed by a processor of a safety guard device, causes the safety guard device to perform a method for detecting a falling object, the method comprising:

obtaining a current digital image captured by an image capturing device of the safety guard device, and obtaining a movement direction and a movement speed of a user of the safety guard device detected by an acceleration sensor of the safety guard device;

detecting a falling object in the current digital image, the current digital image comprising distance information between a lens of the image capturing device and each point in the current digital image;

determining whether a detected falling object is in proximity to the user of the safety guard device according to a position of the detected falling object, the movement direction and the movement speed of the user; and

outputting alarm messages by enabling one or more alarm units of the safety guard device upon the condition that the detected falling object is in proximity to the user of the safety guard device.

14. The non-transitory storage medium according to claim 13 , wherein the method further comprises: enabling one or more alarm units according to a relative position between the user of the safety guard device and the detected falling object.

15. The non-transitory storage medium according to claim 13 , wherein the falling object is detected by:

obtaining a previous digital image captured by the image capturing device, comparing a current distance of each point in the current digital image with a previous distance of each point in the previous digital image, and determining whether the current distance is less than the previous distance; and

determining that the current digital image comprises the falling object upon the condition that a specified number of points whose current distances are less than the previous distances are found.

16. The non-transitory storage medium according to claim 15 , wherein the falling object is determined by calculating a smallest rectangle framing the specified number of points, or determined by fitting the specified number of points into a fitted figure using a feature point fitting method.

17. The non-transitory storage medium according to claim 13 , wherein the step of determining whether a detected falling object is in proximity to the user comprises:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

determining a falling range of the detected falling object according to the falling distance, the falling range comprising a horizontal coordinate range and a vertical coordinate range of the detected falling object, and determining a horizontal direction to be the movement direction of the user;

determining an alarm range according to the falling range of the detected falling object, and determining a user range according a current position of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the user range and the alarm range have at least one intersection point.

18. The non-transitory storage medium according to claim 13 , wherein the step of determining whether a detected falling object is in proximity to the user comprises:

calculating a falling distance from the detected falling object to the safety guard device according to a distance between the detected falling object and the lens of the image capturing device;

calculating a horizontal distance between the user of the safety guard device and the detected falling object along a horizontal direction, the horizontal direction being the movement direction of the user;

calculating a falling time of the detected falling object according to the falling distance of the detected falling object;

determining a movement distance of the user within the falling time according to the movement speed of the user; and

determining that the detected falling object is going to hit the user of the safety guard device upon the condition that the movement distance plus a preset value is greater than the horizontal distance.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2019
From: ZHONGSHAN INNOCLOUD INTELLECTUAL PROPERTY SERVICES CO.,LTD.
To: SCIENBIZIP CONSULTING(SHENZHEN)CO.,LTD.
Reel/Frame 050709/0949 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 12, 2015
From: SCIENBIZIP CONSULTING(SHENZHEN)CO.,LTD.
To: ZHONGSHAN INNOCLOUD INTELLECTUAL PROPERTY SERVICES CO.,LTD.
Reel/Frame 035388/0473 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2015
From: HON HAI PRECISION INDUSTRY CO., LTD.
To: SCIENBIZIP CONSULTING(SHENZHEN)CO.,LTD.
Reel/Frame 035293/0270 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 28, 2012
From: LEE, HOU-HSIEN; LEE, CHANG-JUNG; LO, CHIH-PING
To: HON HAI PRECISION INDUSTRY CO., LTD.
Reel/Frame 029360/0662 →
Priority Claims (1)
TW 101115176 · Apr 27, 2012 · national
Continuity (1)
Related Publication 20130286197A1 · Oct 31, 2013