IP Library Granted Patent US 12,205,473
Granted Patent B2
US 12,205,473 · App. 17/155,048 · Granted Jan 21, 2025

Collision avoidance systems and methods

Inventors: Jean-Luc Kersulec (Fareham, GB); Mark Johnson (Vannes, FR)
Assignee: FLIR Belgium BVBA
G08G3/02B63B43/18B63B49/00G05D1/0206
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,205,473
App. No.
17/155,048
Granted
Jan 21, 2025
Kind
B2
Abstract

Techniques are disclosed for systems and methods to provide navigation control and/or docking assist for mobile structures. A navigation control system includes a logic device, one or more sensors, one or more actuators/controllers, and modules to interface with users, sensors, actuators, and/or other modules of a mobile structure. The logic device is configured to receive navigation control parameters from a user interface for the mobile structure and perimeter sensor data from a perimeter ranging system mounted to the mobile structure. The logic device determines navigation control signals based on the navigation control parameters and perimeter sensor data and provides the navigation control signals to a navigation control system for the mobile structure. Control signals may be displayed to a user and/or used to adjust a steering actuator, a propulsion system thrust, and/or other operational systems of the mobile structure.

Claims (69)

1. A system comprising:

a logic device configured to provide navigation control for a mobile structure and to communicate with a user interface and a perimeter ranging system mounted to the mobile structure, wherein the logic device is configured to:

receive navigation control parameters from the user interface and perimeter sensor data from the perimeter ranging system;

determine one or more navigation control signals configured to maneuver the mobile structure based, at least in part, on the received navigation control parameters and the received perimeter sensor data, wherein the one or more navigation control signals comprises a collision avoidance thruster or velocity demand; and

provide the one or more navigation control signals to a navigation control system for the mobile structure;

wherein the determining the one or more navigation control signals comprises:

determining one or more projected collision detection areas for the mobile structure within a two dimensional occupancy map, wherein each projected collision detection area corresponds to a test thruster or velocity demand; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the one or more projected collision detection areas and the received perimeter sensor data, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to maneuver the mobile structure to minimize risk of collision with a navigation hazard identified in the perimeter sensor data;

wherein the determining the collision avoidance thruster or velocity demand comprises:

determining a projected collision risk estimation for each projected collision detection area; and

determining the collision avoidance thruster or velocity demand corresponding to the projected collision detection area that minimizes a thruster or velocity demand cost function based, at least in part, on minimizing the projected collision risk estimation and a deviation from a user demand contained in the received navigation control parameters.

2. The system of claim 1 , wherein determining the projected collision risk estimation for each projected collision detection area comprises:

identifying projected collision detection voxels of the projected collision detection area that are also obstacle voxels corresponding to a navigation hazard identified in the perimeter sensor data, and

determining the projected collision risk estimation based, at least in part, on a simple count of overlapping projected collision detection voxels and obstacle voxels and/or a weighted count of overlapping projected collision detection voxels and obstacle voxels, the projected collision risk estimation being defined by the simple count and/or the weighted count.

3. The system of claim 2 , wherein:

the one or more projected collision detection areas are a plurality of the projected collision detection areas, and each projected collision detection area corresponds to a projection time interval for all projected collision detection areas and a test thruster or velocity demand unique for each projected collision detection area; and

each projected collision detection area is determined by determining a set of positions and orientations of a virtual bumper polygon of the mobile structure at each discrete time within the projection time interval, and combining extents of the virtual bumper polygons by overlapping them within the 2D occupancy map.

4. The system of claim 2 , wherein the cost function is defined as:

cost(τ)=α∥τ−τ 0 ∥ 2 +collision(τ)

wherein collision(τ) represents the projected collision risk estimation, and ∥τ−τ 0 ∥ 2 represents deviation from the user demand τ 0 .

5. The system of claim 2 , wherein each overlapping voxel is weighted according to a distance to a nearest extent of the mobile structure, a measurement of how stationary the corresponding navigation hazard is, and/or other characteristics of the obstacle and/or motion of the mobile structure.

6. The system of claim 2 , further comprising the user interface, wherein the logic device is configured to:

render a display view on the user interface for the mobile structure, wherein the display view comprises a chart comprising at least one of the projected collision detection areas and a virtual bumper polygon corresponding to the mobile structure.

7. The system of claim 2 , wherein:

the projected collision risk estimation is implemented as the simple count; and

the navigation control parameters comprise user input provided to a user interface for the mobile structure for direct navigational control of the mobile structure, a target track for the mobile structure, and/or a target position and/or orientation for the mobile structure.

8. The system of claim 1 , wherein the determining the one or more navigation control signals comprises:

determining a relative velocity of the navigation hazard disposed within a monitoring perimeter of the perimeter ranging system based, at least in part, on the received perimeter sensor data; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the determined relative velocity of the navigation hazard, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to maneuver the mobile structure to minimize risk of collision with the navigation hazard.

9. The system of claim 1 , wherein determining the one or more navigation control signals comprises:

determining wind and/or water current disturbances affecting navigation of the mobile structure based, at least in part, on the perimeter sensor data, the received navigation control parameters, and/or orientation and/or position data provided by orientation and/or position sensors coupled to the mobile structure; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the determined wind and/or water current disturbances, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to compensate for the determined wind and/or water current disturbances while maneuvering the mobile structure to minimize risk of collision with the navigation hazard identified in the perimeter sensor data.

10. The system of claim 1 , wherein:

the navigation control system comprises one or more of a steering actuator, a propulsion system, and/or a thrust maneuver system for the mobile structure; and

the navigation control signals are configured to evade the navigation hazard identified in the perimeter sensor data by maintaining or increasing a range to the navigation hazard and/or by decreasing a relative velocity of the navigation hazard towards the mobile structure and to minimize deviation from the navigation control parameters while evading the navigation hazard.

11. A method comprising:

receiving, by a logic device, navigation control parameters from a user interface for a mobile structure and perimeter sensor data from a perimeter ranging system mounted to the mobile structure;

determining, by the logic device, one or more navigation control signals based, at least in part, on the received navigation control parameters and the received perimeter sensor data, wherein the one or more navigation control signals comprises a collision avoidance thruster or velocity demand; and

providing, by the logic device, the one or more navigation control signals to a navigation control system for the mobile structure;

wherein the determining the one or more navigation control signals comprises:

determining one or more projected collision detection areas for the mobile structure within a two dimensional occupancy map, wherein each projected collision detection area corresponds to a test thruster or velocity demand; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the one or more projected collision detection areas and the received perimeter sensor data, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to maneuver the mobile structure to minimize risk of collision with a navigation hazard identified in the perimeter sensor data;

wherein the determining the collision avoidance thruster or velocity demand comprises:

determining a projected collision risk estimation for each projected collision detection area; and

determining the collision avoidance thruster or velocity demand corresponding to the projected collision detection area that minimizes a thruster or velocity demand cost function based, at least in part, on minimizing the projected collision risk estimation and a deviation from a user demand contained in the received navigation control parameters.

12. The method of claim 11 , wherein the determining the projected collision risk estimation for each projected collision detection area comprises:

identifying projected collision detection voxels of the projected collision detection area that are also obstacle voxels corresponding to a navigation hazard identified in the perimeter sensor data, and

determining the projected collision risk estimation based, at least in part, on a simple count of overlapping projected collision detection voxels and obstacle voxels and/or a weighted count of overlapping projected collision detection voxels and obstacle voxels, the projected collision risk estimation being defined by the simple count and/or the weighted count.

13. The method of claim 12 , wherein:

the one or more projected collision detection areas are a plurality of the projected collision detection areas, and each projected collision detection area corresponds to a projection time interval for all projected collision detection areas and a test thruster or velocity demand unique for each projected collision detection area; and

each projected collision detection area is determined by determining a set of positions and orientations of a virtual bumper polygon of the mobile structure at each discrete time within the projection time interval, and combining extents of the virtual bumper polygons by overlapping them within the 2D occupancy map.

14. The method of claim 12 , wherein the cost function is defined as:

cost(τ)=α∥τ−τ 0 ∥ 2 +collision(τ)

wherein collision (τ) represents the projected collision risk estimation, and ∥τ−τ 0 ∥ 2 represents deviation from the user demand τ 0 .

15. The method of claim 12 , wherein each overlapping voxel is weighted according to a distance to a nearest extent of the mobile structure, a measurement of how stationary the corresponding navigation hazard is, and/or other characteristics of the obstacle and/or motion of the mobile structure.

16. The method of claim 12 , further comprising:

render a display view on a user interface for the mobile structure, wherein the display view comprises a chart comprising at least one of the projected collision detection areas and a virtual bumper polygon corresponding to the mobile structure.

17. The method of claim 12 , wherein:

the projected collision risk estimation is implemented as the simple count; and

the navigation control parameters comprise user input provided to a user interface for the mobile structure for direct navigational control of the mobile structure, a target track for the mobile structure, and/or a target position and/or orientation for the mobile structure.

18. The method of claim 11 , wherein the determining the one or more navigation control signals comprises:

determining a relative velocity of the navigation hazard disposed within a monitoring perimeter of the perimeter ranging system based, at least in part, on the received perimeter sensor data; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the determined relative velocity of the navigation hazard, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to maneuver the mobile structure to minimize risk of collision with the navigation hazard.

19. The method of claim 11 , wherein the determining the one or more navigation control signals comprises:

determining wind and/or water current disturbances affecting navigation of the mobile structure based, at least in part, on the perimeter sensor data, the received navigation control parameters, and/or orientation and/or position data provided by orientation and/or position sensors coupled to the mobile structure; and

determining the collision avoidance thruster or velocity demand based, at least in part, on the determined wind and/or water current disturbances, wherein the collision avoidance thruster or velocity demand is configured to cause the navigation control system to compensate for the determined wind and/or water current disturbances while maneuvering the mobile structure to minimize risk of collision with the navigation hazard identified in the perimeter sensor data.

20. The method of claim 11 , wherein:

the navigation control system comprises one or more of a steering actuator, a propulsion system, and/or a thrust maneuver system for the mobile structure; and

the navigation control signals are configured to evade the navigation hazard identified in the perimeter sensor data by maintaining or increasing a range to the navigation hazard and/or by decreasing a relative velocity of the navigation hazard towards the mobile structure and to minimize deviation from the navigation control parameters while evading the navigation hazard.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 1, 2025
From: FLIR BELGIUM BVBA
To: RAYMARINE UK LIMITED
Reel/Frame 071149/0656 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2021
From: KERSULEC, JEAN-LUC; JOHNSON, MARK
To: FLIR BELGIUM BVBA
Reel/Frame 055980/0459 →
Continuity (9)
Continuation In Part 16533598 · Aug 6, 2019
Continuation In Part 16533572 · Aug 6, 2019
Continuation PCTUS2018037954 · Jun 15, 2018
Continuation PCTUS2018037953 · Jun 15, 2018
Provisional Application 62965768 · Jan 24, 2020
Provisional Application 62628905 · Feb 9, 2018
Provisional Application 62584718 · Nov 10, 2017
Provisional Application 62521346 · Jun 16, 2017
Related Publication 20210166568A1 · Jun 3, 2021
References Cited (136)
US 2968957A · Condie et al. · 1961 [cited by applicant]
US 3140436A · Hatch · 1964 [cited by applicant]
US 3301510A · Cook · 1967 [cited by applicant]
US 3436531A · Throckmorton · 1969 [cited by applicant]
US 3488954A · Thomas et al. · 1970 [cited by applicant]
US 3741474A · Kawada et al. · 1973 [cited by applicant]
US 4129087A · Dimmick et al. · 1978 [cited by applicant]
US 4524615A · Curran et al. · 1985 [cited by applicant]
US 5140416A · Tinkler · 1992 [cited by applicant]
US 5488674A · Burt et al. · 1996 [cited by applicant]
US 5523951A · Kriesgman et al. · 1996 [cited by applicant]
US 5525081A · Mardesich et al. · 1996 [cited by applicant]
US 5537818A · Hosseini et al. · 1996 [cited by applicant]
US 5548694A · Frisken Gibson · 1996 [cited by examiner]
US 5729016A · Klapper et al. · 1998 [cited by applicant]
US 5815411A · Ellenby · 1998 [cited by applicant]
US 6273771B1 · Buckley et al. · 2001 [cited by applicant]
US 6450112B1 · Deghuee · 2002 [cited by applicant]
US 6677889B2 · Van Rees et al. · 2004 [cited by applicant]
US 7021231B2 · Smart · 2006 [cited by applicant]
US 7305928B2 · Bradley et al. · 2007 [cited by applicant]
US 7469168B1 · Richey · 2008 [cited by applicant]
US 7727036B1 · Poorman et al. · 2010 [cited by applicant]
US 8078297B2 · Lasher et al. · 2011 [cited by applicant]
US 8215252B1 · Chun · 2012 [cited by examiner]
US 8275544B1 · Wells et al. · 2012 [cited by applicant]
US 8604976B1 · Chang et al. · 2013 [cited by applicant]
US 8622778B2 · Tyers et al. · 2014 [cited by applicant]
US 8978259B1 · Stephenson, Jr. · 2015 [cited by applicant]
US 9123220B2 · Icove et al. · 2015 [cited by applicant]
US 9471970B2 · Strandmar · 2016 [cited by applicant]
US 9515106B2 · Hourtash et al. · 2016 [cited by applicant]
US 9676464B2 · Johnson et al. · 2017 [cited by applicant]
US 9778657B2 · Tyers · 2017 [cited by applicant]
US 10095232B1 · Arbuckle et al. · 2018 [cited by applicant]
US 10324468B2 · Arbuckle et al. · 2019 [cited by applicant]
US 10671073B2 · Arbuckle et al. · 2020 [cited by applicant]
US 10747226B2 · Johnson et al. · 2020 [cited by applicant]
US 10908678B2 · Johnson et al. · 2021 [cited by applicant]
US 10931934B2 · Richards et al. · 2021 [cited by applicant]
US 10942028B2 · Johnson et al. · 2021 [cited by applicant]
US 20020030591A1 · Paranjpe · 2002 [cited by applicant]
US 20030137443A1 · Rees et al. · 2003 [cited by applicant]
US 20030149528A1 · Lin · 2003 [cited by applicant]
US 20050075016A1 · Bertetti et al. · 2005 [cited by applicant]
US 20070055446A1 · Schiffmann et al. · 2007 [cited by applicant]
US 20070089660A1 · Bradley et al. · 2007 [cited by applicant]
US 20090043904A1 · Okuyama · 2009 [cited by applicant]
US 20090048726A1 · Lofall · 2009 [cited by applicant]
US 20090076717A1 · Goutelard et al. · 2009 [cited by applicant]
US 20090171520A1 · Kaji · 2009 [cited by applicant]
US 20090222154A1 · Lopriore · 2009 [cited by applicant]
US 20100094491A1 · Oehlgrien et al. · 2010 [cited by applicant]
US 20100100325A1 · Lovell · 2010 [cited by examiner]
US 20100138083A1 · Kaji · 2010 [cited by applicant]
US 20100228420A1 · Lee · 2010 [cited by applicant]
US 20100234129A1 · Sharma et al. · 2010 [cited by applicant]
US 20100309315A1 · Hogasten et al. · 2010 [cited by applicant]
US 20110046843A1 · Caveney · 2011 [cited by applicant]
US 20110279673A1 · Teich et al. · 2011 [cited by applicant]
US 20110307128A1 · Igarashi et al. · 2011 [cited by applicant]
US 20120129410A1 · Tyers · 2012 [cited by applicant]
US 20120130570A1 · Pease · 2012 [cited by applicant]
US 20120132120A1 · Gai et al. · 2012 [cited by applicant]
US 20120229597A1 · Gagel · 2012 [cited by applicant]
US 20120262584A1 · Strandemar · 2012 [cited by applicant]
US 20120265380A1 · Kuwata · 2012 [cited by examiner]
US 20120290175A1 · Hisanaga · 2012 [cited by applicant]
US 20130063599A1 · Imai et al. · 2013 [cited by applicant]
US 20130113939A1 · Strandemar · 2013 [cited by applicant]
US 20130173096A1 · Chalhoub et al. · 2013 [cited by applicant]
US 20130297104A1 · Tyers et al. · 2013 [cited by applicant]
US 20140106631A1 · Ito · 2014 [cited by applicant]
US 20140156133A1 · Cullinane et al. · 2014 [cited by applicant]
US 20140316657A1 · Johnson et al. · 2014 [cited by applicant]
US 20140330480A1 · Kopper et al. · 2014 [cited by applicant]
US 20150089427A1 · Akuzawa · 2015 [cited by examiner]
US 20150089434A1 · Akuzawa · 2015 [cited by applicant]
US 20150125065A1 · Lee et al. · 2015 [cited by applicant]
US 20150154460A1 · Baba et al. · 2015 [cited by applicant]
US 20160187883A1 · Tyers et al. · 2016 [cited by applicant]
US 20160214534A1 · Richards et al. · 2016 [cited by applicant]
US 20160217578A1 · Can et al. · 2016 [cited by applicant]
US 20170205829A1 · Tyers · 2017 [cited by examiner]
US 20170210008A1 · Maeda · 2017 [cited by examiner]
US 20170210449A1 · Frisbie et al. · 2017 [cited by applicant]
US 20170365175A1 · Harnett · 2017 [cited by applicant]
US 20180015994A1 · Kishimoto · 2018 [cited by examiner]
US 20180075383A1 · Fogel et al. · 2018 [cited by applicant]
US 20180362028A1 · Prokhorov · 2018 [cited by examiner]
US 20190163191A1 · Sorin · 2019 [cited by examiner]
US 20190243371A1 · Nister · 2019 [cited by examiner]
US 20190359300A1 · Johnson et al. · 2019 [cited by applicant]
US 20190361457A1 · Johnson et al. · 2019 [cited by applicant]
US 20200025873A1 · Kubertschak et al. · 2020 [cited by applicant]
US 20200193812A1 · Morris · 2020 [cited by examiner]
US 20200202719A1 · Derginer · 2020 [cited by examiner]
US 20200369351A1 · Behrendt · 2020 [cited by examiner]
US 20200401143A1 · Johnson et al. · 2020 [cited by applicant]
US 20210166568A1 · Kersulec et al. · 2021 [cited by applicant]
US 20210206460A1 · Hawker · 2021 [cited by applicant]
CN 101145200A · 2008 [cited by applicant]
CN 102692225 · 2012 [cited by applicant]
CN 103149948 · 2013 [cited by applicant]
DE 19803078 · 1999 [cited by applicant]
DE 19807525 · 1999 [cited by applicant]
EP 1873052 · 2008 [cited by applicant]
EP 2096018 · 2009 [cited by applicant]
GB 1125306A · 1968 [cited by applicant]
GB 1223986 · 1971 [cited by applicant]
GB 1419244 · 1975 [cited by applicant]
GB 2369607B · 2003 [cited by applicant]
GB 2388355B · 2004 [cited by applicant]
GB 2388356B · 2004 [cited by applicant]
GB 2429541 · 2007 [cited by applicant]
JP H0622980U · 1994 [cited by applicant]
JP 2013086745 · 2013 [cited by applicant]
JP 2017052297A · 2017 [cited by applicant]
KR 20080071269A · 2008 [cited by applicant]
KR 20120072516A · 2012 [cited by applicant]
WO WO02030291A1 · 2002 [cited by applicant]
WO WO02097763A1 · 2002 [cited by applicant]
WO WO2008084465A2 · 2008 [cited by applicant]
WO WO2014168674 · 2014 [cited by applicant]
WO WO2016034516A2 · 2016 [cited by applicant]
WO WO2016109601A1 · 2016 [cited by applicant]
WO WO2016109832A2 · 2016 [cited by applicant]
WO WO2017167890 · 2017 [cited by applicant]
WO WO2018232376A1 · 2018 [cited by applicant]
WO WO2019157400A1 · 2019 [cited by applicant]
C. Fulgenzi, A. Spalanzani and C. Laugier, “Dynamic Obstacle Avoidance in uncertain environment combining PVOs and Occupancy Grid,” Proceedings 2007 IEEE International Conference on Robotics and Automation, Rome, Italy,… [cited by examiner]
Rao et al., “Identification of Low-Level Point Radiation Sources Using a Sensor Network,” 2008 International Conference on Information Processing in Sensor Networks, pp. 493-504, St. Louis, MO, 2008. [cited by applicant]
Chin et al., “Accurate localization of low-level radioactive source under noise and measurement errors”, pp. 183-196. 10.1145/1460412.1460431, Computer Science Technical Reports, 2008. [cited by applicant]
Riley et al., “Low Cost Dept and Radiological Sensor Fusion to Detect Moving Sources,” 2015 International Conference on 3D Vision (3DV), Oct. 19-22, 2015. [cited by applicant]
Gorovyi et al., “A Novel Trajectory Restoration Algorithm for High-Resolution SAR Imaging”, 2014 15 [cited by applicant]
Gierusz et al., “Multivariable Robust Steering of the Ship with Feedforward Controller”, IFAC Proceedings Volumes, 2007, pp. 310-314, vol. 40, Issue 17, Elsevier, Amsterdam, Netherlands. [cited by applicant]