IP Library › Granted Patent US 10,922,552
Granted Patent B2
US 10,922,552 · App. 15/430,326 · Granted Feb 16, 2021

System and method for man overboard incident detection

Inventors: Fereydoun Maali (Scottsdale, AZ); Marvin Wade Barnes (Glendale, AZ)
Assignee: PureTech Systems, Inc.
G06K9/00758G06K9/00624G06K9/209G06T7/00G06T7/246G06T7/292H04N5/247H04N5/33H04N5/77H04N5/91H04N7/181G06K2009/00738G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,922,552
App. No.
15/430,326
Granted
Feb 16, 2021
Kind
B2
Abstract

A system and method for detecting a man overboard incident on structures such as cruise vessels and oil rigs. The system includes at least two opposed imaging devices which record video streams of a detection cuboid within an overlapping region of view volumes for the imaging devices. The imaging devices are located at the lowest deck of the structure and monitor a fall that passes through the cuboid. Identified objects within the video streams are paired, their conformance is determined, and real world information such as size, trajectory, and location is determined.

Claims (46)

1. A method of detecting a man overboard event on a structure above a waterline, the method comprising the steps of:

providing first and second imaging devices, each having an angular field of view, wherein the angular fields of view of each of the first and second imaging devices overlap to establish a detection cuboid, the detection cuboid having:

a ceiling extending along an upper boundary common to the angular fields of view of the first and second imaging devices;

a base defined by the waterline; and

an inner boundary extending along a vertical plane which is registered with an outer edge of the structure;

contemporaneously recording first and second video streams, respectively, of the detection cuboid while the object is actively falling through the detection cuboid established by the overlap of the first and second imaging devices;

monitoring, in the detection cuboid established by the overlap of the first and second imaging devices, an object in both the first and second video streams while the object is actively falling along the structure and in the detection cuboid;

determining first and second characteristics of the object from the first and second video streams, respectively;

comparing the first and second characteristics and identifying a man overboard event in response to a conforming comparison;

determining a first range of the object from the first imaging device and a second range of the object from the second imaging device; and

determining a real-word location of the object from the first range, the second range, the angular fields of view of the first and second imaging devices, a real-world position of the structure, and a dimension of the object.

2. The method of claim 1 , wherein the step of comparing includes comparing the first characteristic from the first video stream to the second characteristic from the second video stream.

3. The method of claim 1 , wherein the step of comparing includes comparing the first and second characteristics from the first and second video streams with an expected characteristic.

4. The method of claim 1 , wherein the first and second characteristics include at least one of a height of the object, a width of the object, the first range of the object from the first imaging device, the second range of the object from the second imaging device, a velocity of the object, an acceleration of the object, a trajectory of the object, a segment of the trajectory of the object, and a position of the object.

5. The method of claim 1 , wherein the first imaging device has a first view volume and the second imaging device has a second view volume which overlaps the first view volume to define the detection cuboid.

6. The method of claim 5 , wherein the detection cuboid is limited vertically to extending between the waterline at the base and a lowest height from which a fall could originate from the structure at the ceiling.

7. The method of claim 1 , wherein the first and second imaging devices are thermal cameras.

8. The method of claim 1 , wherein the first and second imaging devices have larger angular fields of view in a vertical direction than in a horizontal direction.

9. The method of claim 1 , wherein the first and second imaging devices are oriented so that the first and second view volumes extend across an exterior surface of the structure.

10. The method of claim 1 , further comprising the step of transmitting an alarm, the alarm including portions of the first and second video streams including the man overboard event, a time of the man overboard event, and a location of the man overboard event.

11. A method of detecting a man overboard event on a structure above a waterline, having an exterior, and having a plurality of decks including a lowest deck, the method comprising the steps of:

providing first and second imaging devices, each having an angular field of view, and each contemporaneously recording first and second video streams, respectively, wherein the first imaging device has a first view volume, and the second imaging device has a second view volume which overlaps the first view volume to define a detection cuboid;

wherein the detection cuboid has an inner boundary which extends along a vertical plane which is registered with the outer edge of the structure, and the detection cuboid also extends between a ceiling, which is along an upper boundary common to the angular fields of view of the first and second imaging devices, and a base, which is defined by the waterline

monitoring, in the detection cuboid established by the overlap of the first and second imaging devices, and in both the first and second video streams simultaneously, an object actively falling along the structure and in the detection cuboid;

processing the first and second video streams;

identifying a man overboard event in response to an object in the detection cuboid having determined characteristics which conform to expected characteristics;

determining a first range of the object from the first imaging device and a second range of the object from the second imaging device; and

determining a real-world location of the object from the first range, the second range, the angular fields of view of the first and second imaging devices, a real-world position of the structure, and a dimension of the object.

12. The method of claim 11 , wherein the determined characteristics include at least one of a height of the object, a width of the object, a first range of the object from the first imaging device, a second range of the object from the second imaging device, a velocity of the object, an acceleration of the object, a trajectory of the object, a segment of the trajectory of the object, and a position of the object.

13. The method of claim 11 , wherein the first and second imaging devices have larger angular fields of view in a vertical direction than in a horizontal direction.

14. The method of claim 11 , wherein the detection cuboid is bound between the waterline and the lowest deck.

15. The method of claim 11 , wherein the first and second imaging devices are oriented so that the first and second view volumes extend across the exterior of the structure.

16. A system of detecting a man overboard event on a structure above a waterline, having an exterior, and having a plurality of decks including a lowest deck, the system comprising:

first and second imaging devices, each having an angular field of view, and each having first and second view volumes and configured to record first and second video streams of the first and second view volumes, respectively;

a detection cuboid established by an overlap of the first and second view volumes, wherein the detection cuboid has:

a height bound between the waterline and the lowest deck; and

an inner boundary which extends along a vertical plane which is registered with the outer edge of the structure; and

a computer coupled in data communication with the first and second imaging devices, the computer configured to contemporaneously process the first and second video streams and identify a man overboard event in response to an object actively falling along the structure in the detection cuboid and having determined characteristics which conform to expected characteristics;

wherein the computer is further configured to determine a real-world location of the object, such location determined from a first range of the object from the first imaging device, a second range of the object from the second imaging device, the angular fields of view of the first and second imaging devices, a real-world position of the structure, and a dimension of the object.

17. The system of claim 16 , wherein the first and second imaging devices are thermal cameras.

18. The system of claim 16 , wherein the first and second imaging devices have larger angular fields of view in a vertical direction than in a horizontal direction.

19. The system of claim 16 , wherein the first and second imaging devices are oriented so that the first and second view volumes extend across the exterior of the structure.

20. The system of claim 16 , wherein:

the first and second imaging devices are spaced apart from each other by an inter-camera distance;

the inter-camera distance is limited by a maximum range of the imaging devices; and

the maximum range is limited by a pixel-on-target minimum for the object in the detection cuboid.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 10, 2017
From: MAALI, FEREYDOUN; BARNES, MARVIN WADE
To: PURETECH SYSTEMS, INC.
Reel/Frame 041230/0558 →
Continuity (3)
Continuation 14871638 · Sep 30, 2015
Provisional Application 62057639 · Sep 30, 2014
Related Publication 20170154223A1 · Jun 1, 2017
Cited By (1)
US 12,597,222