IP Library Granted Patent US 11,624,822
Granted Patent B2
US 11,624,822 · App. 15/494,232 · Granted Apr 11, 2023

Pilot display systems and methods

Inventors: Paul Stokes (Fleet, GB); Mark Rivers (Hampshire, GB)
Assignee: Teledyne FLIR, LLC
G01S15/89G01S7/6272G01S7/6281G01S15/104
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,624,822
App. No.
15/494,232
Granted
Apr 11, 2023
Kind
B2
Abstract

A method for providing enhanced sonar images includes ensonifying a target column of water with sonar beams corresponding to pulses of continuous wave (CW) and pulse compression (FM) signals. Received acoustic returns are processed to generate sonar image data corresponding to the CW signals and the FM signals. The CW and FM sonar image data are then displayed contemporaneously such that one sonar image data set overlays another. Techniques are also disclosed to provide situational imagery. A pilot display system includes a user interface, a logic device, and a speed sensor mounted to a mobile structure. The user interface is configured to receive user input and provide user feedback, and the logic device is configured to receive a speed of the mobile structure from the speed sensor, generate corresponding situational image data, and render the situational image data via at least one display of the user interface.

Claims (105)

1. A system comprising:

a transmitter configured to transmit pulses of continuous wave (CW) and pulse compression (FM) sonar signals to a sonar transducer;

a receiver configured to receive acoustic returns comprising echoes of the transmitted sonar signals;

a user interface configured to receive user input and provide user feedback with respect to a mobile structure, wherein the mobile structure is a watercraft; and

a logic device configured to communicate with the transmitter, the receiver, and the user interface, wherein the logic device is configured to:

process the acoustic returns into CW and FM sonar image data sets corresponding to the CW and FM sonar signals;

receive a speed of the mobile structure from a speed sensor mounted to the mobile structure;

determine one or more threats to the mobile structure based at least on the speed of the mobile structure, wherein the determining the one or more threats comprises determining a threat level of each of the one or more threats relative to the mobile structure;

generate situational image data based, at least in part, on the speed of the mobile structure and the one or more threats, wherein the situational image data comprises an overhead chart plot of the one or more threats in a geographical area near the mobile structure, the overhead chart plot comprising at least one of mapping data or navigation data, and wherein the overhead chart plot is adjusted based on an updated speed of the mobile structure relative to the one or more threats indicated in the overhead chart plot, an updated position of the mobile structure relative to the one or more threats indicated in the overhead chart plot, and an updated threat level of the one or more threats indicated in the overhead chart plot; and

render the situational image data via at least one display of the user interface, wherein rendering the situational image data comprises overlaying the CW and FM sonar image data sets in an overlay image of the overhead chart plot.

2. The system of claim 1 , wherein the logic device is configured to:

generate the situational image data such that a center position of the overhead chart plot as rendered via the at least one display leads a position of the mobile structure according to an expected trajectory of the mobile structure and a level of detail of the overhead chart plot is increased or decreased according to the received speed of the mobile structure.

3. The system of claim 1 , wherein the logic device is configured to:

receive a fuel-usage rate from a fuel-usage sensor configured to measure an amount of fuel used by the mobile structure; and

determine a fuel-efficiency rate of the mobile structure based, at least in part, on the fuel-usage rate and the speed of the mobile structure, wherein the situational image data comprises a fuel efficiency chart and the determined fuel-efficiency rate is plotted against the speed of the mobile structure on the fuel efficiency chart.

4. The system of claim 1 , further comprising:

the sonar transducer, wherein the sonar transducer is configured to ensonify a target column of water; and

wherein:

the logic device is configured to process the acoustic returns into a relatively high resolution sonar image data set and to post-process the relatively high resolution sonar image data set to generate a blurred sonar image data set;

the user interface is configured to display the relatively high resolution and blurred sonar image data sets such that either the relatively high resolution or the blurred sonar image data set overlays the other sonar image data set; and

the situational image data comprises the relatively high resolution and blurred sonar image data sets.

5. A method for providing an enhanced sonar image using the system of claim 4 , the method comprising:

ensonifying a target column of water with sonar beams corresponding to the pulses of FM sonar signals;

receiving acoustic returns comprising echoes of the ensonifying beams;

processing the acoustic returns into the relatively high resolution sonar image data set corresponding to the FM sonar signals;

post-processing the relatively high resolution sonar image data set to generate the blurred sonar image data set; and

displaying the relatively high resolution and blurred sonar image data sets such that either the relatively high resolution or the blurred sonar image data set overlays the other sonar image data set.

6. The system of claim 1 , further comprising:

the sonar transducer, wherein the sonar transducer is configured to ensonify a target column of water,

wherein the transmitter is configured to:

transmit a pulsed CW signal and a pulsed FM signal simultaneously;

transmit a pulsed CW signal and a pulsed FM signal sequentially with substantially no delay between transmissions;

transmit a pulsed CW signal and a pulsed FM signal separated by a delay; and/or

transmit pulsed CW and FM signals in a pattern or an alternating fashion,

wherein each CW or FM pulse defines a single ping and successive pairs of CW or FM pings are separated by a pulse repetition interval (PRI); and

wherein:

the user interface is configured to display the CW and FM sonar image data sets simultaneously or contemporaneously and overlaid in the overlay image of the overhead chart plot.

7. The system of claim 6 , wherein:

the sonar transducer is a multichannel transducer;

the transmitter is configured to form an angular array of transmit beams having generally equal transmissivity and extending radially from a single point at discrete angular intervals and/or the receiver is configured to form an angular array of receive beams having generally equal sensitivity and extending radially from a single point at discrete angular intervals; and

the logic device comprises at least one of an analog to digital converter (ADC), a finite impulse response (FIR) filter, a fast Fourier transformer (FFT), an inverse fast Fourier transformer (IFFT), a comparator configured to compare the acoustic returns to the transmitted signals, and/or a comparator configured to compare the acoustic returns to complex conjugates of the transmitted signals.

8. The system of claim 1 , further comprising a proximity sensor and/or a light sensor configured to detect a proximity of a user relative to the user interface, wherein the logic device is configured to:

receive an orientation of the mobile structure from an orientation sensor mounted to the mobile structure;

generate the situational image data based, at least in part, on the orientation and the speed, wherein the situational image data corresponds to a chart plot of a geographical area near the mobile structure that is scaled according to the speed of the mobile structure;

determine the proximity of the user to the user interface; and

modify characteristics of the situational image data based on the determined proximity of the user.

9. The system of claim 1 , wherein the at least one display comprises first and second touchscreen displays and the logic device is configured to:

receive user touch input on the first and second touchscreen displays;

determine a relative orientation of the second display relative to the first display based, at least in part, on the user touch input; and

render the situational image data via at least one of the first and second touchscreen displays based, at least in part, on the determined relative orientation.

10. The system of claim 9 , wherein:

the relative orientation comprises a first relative orientation;

the at least one display comprises a third touchscreen display;

the user touch input comprises a substantially continuous swipe motion connecting centers of the first, second, and third touchscreen displays; and

the logic device is configured to:

determine a second relative orientation of the third touchscreen display relative to the first and/or second touchscreen displays based, at least in part, on the substantially continuous swipe motion; and

render the situational image data via the at least one of the first, second, and third touchscreen displays based, at least in part, on the first and/or second determined relative orientations.

11. The system of claim 1 , further comprising:

the speed sensor;

the at least one display of the user interface;

an orientation sensor, a GPS, a fuel-usage sensor, and/or a target sensor mounted to the mobile structure; and/or

a proximity sensor and/or a light sensor configured to detect a proximity of a user relative to the user interface;

wherein the logic device is configured to generate the situational image data based on the speed, location, and/or orientation of the mobile structure, a fuel usage rate for the mobile structure detected by the fuel-usage sensor, a location of an object detected by the target sensor, and/or a proximity of the user to the user interface.

12. The system of claim 1 , wherein the logic device is configured to:

receive a direction of the mobile structure from an orientation sensor mounted to the mobile structure;

determine the one or more threats to the mobile structure based at least on the speed and the direction of the mobile structure; and

adjust the situational image data based on the speed and the direction of the mobile structure, wherein the adjusting comprises switching between a first view mode and a second view mode, the second view mode removing one or more features or controls from the overhead chart plot based on an updated speed of the mobile structure.

13. A method comprising:

ensonifying a target column of water with sonar beams corresponding to pulses of continuous wave (CW) and pulse compression (FM) sonar signals;

receiving acoustic returns comprising echoes of the ensonifying beams;

processing the acoustic returns into CW and FM sonar image data sets corresponding to the CW and FM sonar signals;

receiving a speed of a mobile structure, wherein the mobile structure includes a watercraft;

determining one or more threats to the mobile structure based at least on the speed of the mobile structure, wherein the determining the one or more threats comprises determining a threat level of each of the one or more threats relative to the mobile structure;

generating situational image data based, at least in part, on the speed of the mobile structure and the one or more threats, wherein the situational image data comprises an overhead chart plot of the one or more threats in a geographical area near the mobile structure, the overhead chart plot comprising at least one of mapping data or navigation data, and wherein the overhead chart plot is adjusted based on an updated speed of the mobile structure relative to the one or more threats indicated in the overhead chart plot, an updated position of the mobile structure relative to the one or more threats indicated in the overhead chart plot, and an updated threat level of the one or more threats indicated in the overhead chart plot; and

rendering the situational image data via at least one display of a user interface in proximity to the mobile structure, wherein the rendering the situational image data comprises overlaying the CW and FM sonar image data sets in an overlay image of the overhead chart plat.

14. The method of claim 13 , further comprising:

receiving an orientation of the mobile structure; and

generating the situational image data based, at least in part, on the orientation and the speed, wherein a center position of the overhead chart plot as rendered via the at least one display leads a position of the mobile structure according to an expected trajectory of the mobile structure, and a level of detail of the overhead chart plot is increased or decreased according to the received speed of the mobile structure.

15. The method of claim 13 , further comprising:

receiving a fuel-usage rate from a fuel-usage sensor configured to measure an amount a fuel used by the mobile structure; and

determining a fuel-efficiency rate of the mobile structure based, at least in part, on the fuel-usage rate and the speed of the mobile structure, wherein the situational image data comprises a fuel efficiency chart and the determined fuel-efficiency rate plotted against the speed of the mobile structure on the fuel efficiency chart.

16. The method of claim 13 , wherein the at least one display comprises first and second touchscreen displays, the method further comprising:

receiving user touch input on the first and second touchscreen displays;

determining a relative orientation of the second display relative to the first display based, at least in part, on the user touch input; and

rendering the situational image data via at least one of the first and second touchscreen displays based, at least in part, on the determined relative orientation.

17. The method of claim 13 , wherein:

the relative orientation comprises a first relative orientation;

the at least one display comprises a third touchscreen display;

the user touch input comprises a substantially continuous swipe motion connecting centers of the first, second, and third touchscreen displays; and

the logic device is configured to:

determine a second relative orientation of the third touchscreen display relative to the first and/or second touchscreen displays based, at least in part, on the substantially continuous swipe motion; and

render the situational image data via the at least one of the first, second, and third touchscreen displays based, at least in part, on the first and/or second determined relative orientations.

18. The method of claim 13 , further comprising:

wherein the ensonifying comprises one or more of:

transmitting a pulsed CW signal and a pulsed FM signal simultaneously;

transmitting a pulsed CW signal and a pulsed FM signal sequentially with substantially no delay between transmissions;

transmitting a pulsed CW signal and a pulsed FM signal separated by a delay; and/or

transmitting a pulsed CW and FM signals in a pattern or an alternating fashion,

wherein each CW or FM pulse defines a single ping and successive pairs of CW or FM pings are separated by a pulse repetition interval (PRI); and

displaying the CW and FM sonar image data sets overlaid in the overlay image of the overhead chart plot.

19. The method of claim 18 , wherein the displaying comprises at least one of transposing the image data sets from a polar coordinate system to a rectangular coordinate system and/or scaling the image data sets to fit a rectangular display.

20. The method of claim 13 , further comprising:

receiving a direction of the mobile structure from an orientation sensor mounted to the mobile structure;

generating the situational image data based on the speed and the direction of the mobile structure; and

modifying the situational image data based at least on an updated speed and/or an updated direction of the mobile structure, wherein the modifying the situational image data comprises switching between a first view mode and a second view mode, the second view mode removing one or more features or controls from the overhead chart plot based on the updated speed and/or the updated direction of the mobile structure.

Assignments (2)
MERGER AND CHANGE OF NAME Recorded Nov 24, 2021
From: FLIR SYSTEMS, INC.; FIREWORK MERGER SUB II, LLC
To: TELEDYNE FLIR, LLC
Reel/Frame 058250/0271 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 10, 2017
From: STOKES, PAUL; RIVERS, MARK
To: FLIR SYSTEMS, INC.
Reel/Frame 042440/0512 →
Continuity (4)
Continuation PCTUS2015056786 · Oct 21, 2015
Provisional Application 62069961 · Oct 29, 2014
Provisional Application 62066802 · Oct 21, 2014
Related Publication 20170227639A1 · Aug 10, 2017