Granted Patent B2

US 12,198,418 · App. 17/292,392 · Granted Jan 14, 2025

Inventors: Raphaël Biancale (Linz, AT); David Moser (Vienna, AT)

Assignee: SEA.AI GmbH

G06V20/00B63B43/18G01P15/032G01S13/93G01S17/93G05D1/0206G05D1/693G06N3/02G06T7/55G06V10/40G06V10/751G06V20/10G06T2207/10016G06T2207/10024G06T2207/10048G06T2207/20084

Abstract

Claims (19)

1. A system for determining a distance between a boat and at least one object at least partially immerged in a water area, said system comprising:

a capturing module, configured to be mounted on said boat, said capturing module comprising at least one camera, said at least one camera being configured to generate at least one sequence of images of said water area, a processing module, configured to be embedded onboard said boat, said processing module being configured to receive the at least one sequence of images from said at least one camera, to detect at least one object in said at least one received sequence of images, to determine rotation component values of the at least one camera in a boat reference frame, wherein said boat reference frame is vehicle-carried and comprises a plane defined by the water area and a vertical axis normal to said plane, and to determine the distance between the boat and the at least one detected object using said rotation component values by doing a mapping from a two-dimensional image space to a two-dimensional water surface, said mapping including an inverse projection from said two-dimensional image space to said two-dimensional water surface.

2. The system according to claim 1 , said system comprising an inertial measurement module, coupled to the capturing module, said inertial measurement module comprising a gyroscope configured to generate spatial data, said spatial data comprising the angular positions of the boat along the roll, pitch and yaw axes of the boat, the processing module being configured to:

receive the spatial data from the inertial measurement module,

calculate the coordinates of the at least one object in a boat reference frame using the received sequence of images and the received spatial data,

calculate the distance between the boat and the at least one detected object using the calculated coordinates.

3. The system according to claim 2 , wherein the calculation of the coordinates of the at least one object in the boat reference frame comprises applying rotations and translations between coordinate systems of the image plane of the at least one camera and the capturing module using the received sequence of images and between the capturing module and the boat reference frame.

4. The system according to claim 1 , wherein the processing module is configured to detect the horizon in the received sequence of images and to determine the inclination of the capturing module in respect to the water surface of the water area.

5. The system according to claim 1 , wherein said system comprises a LIDAR or a RADAR or a stereo vision device configured for measuring 3D environmental data and estimating the inclination of the capturing module by delivering 3D point clouds of the water plane to derive said water plane by removing outliers.

6. The system according to claim 1 , wherein the processing module is configured to identify the at least one detected object.

7. The system according to claim 6 , wherein the processing module comprises at least one artificial neural network for detecting at least one object, said at least one artificial neural network being configured to detect the at least one object in the at least one received sequence of images, to extract a set of features from said at least one detected object, to compare said extracted set of features with at least one predetermined set of features associated with a predefined object, and to identify the at least one detected object when the extracted set of features matches with the at least one predetermined set of features.

8. The system according to claim 1 , said system comprising an inertial measurement module configured to provide spatial data, said spatial data comprising at least the inclination angle, relatively to the terrestrial horizontal axis, of the support on which the capturing module is mounted.

9. The system according to claim 8 , wherein the processing module is configured to receive the inclination angle and to compensate each image of the sequence of images using the received inclination angle.

10. The system according to claim 1 , wherein the processing module is configured to detect the horizon in each image of the sequence of image.

11. The system according to claim 1 , wherein the at least one camera is a RGB camera or a thermal camera.

12. The system according to claim 1 , wherein the capturing module comprises at least one RGB camera and at least one thermal camera.

13. The system according to claim 1 , wherein the processing module is configured to track the at least one identified object in the at least one sequence of images.

14. A boat comprising the system according to claim 1 .

15. A method of determining a distance between a boat and at least one object at least partially immerged in a water area, said method comprising: generating at least one sequence of images of said water area, detecting at least one object in said at least one received sequence of images, determining rotation component values of the at least one camera in a boat reference frame, wherein said boat reference frame is vehicle-carried and comprises a plane defined by the water area and a vertical axis normal to said plane, and determining the distance between the boat and the at least one detected object using said rotation component values by creating a mapping from a two-dimensional image space to a two-dimensional water surface, said mapping including an inverse projection from said two-dimensional image space to said two-dimensional water surface.

Assignments (2)

Priority Claims (1)

Continuity (1)

References Cited (21)