IP Library › Granted Patent US 11,671,783
Granted Patent B2
US 11,671,783 · App. 17/328,460 · Granted Jun 6, 2023

Directional awareness audio communications system

Inventors: Daniel F. Stanek (Chicago, IL); Bernard L. Knych (Arlington Heights, IL)
Assignee: OTTO ENGINEERING, INC.
H04S7/304G08B7/06H04R1/403H04R3/12H04R5/033H04R29/002H04S3/008H04S2400/01H04S2400/13H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,671,783
App. No.
17/328,460
Granted
Jun 6, 2023
Kind
B2
Abstract

Various embodiments include a directional awareness audio communication system and method. The system may include remote speaker/transmitting device(s) and listener/receiving device(s). The speaker/transmitting device(s) may send real-time location information with audio or separate from the audio to the listener/receiving device(s). The listener/receiving device(s) use the speaker/transmitting device(s) location information relative to the listener/receiving device location and orientation to perform audio processing on the transmitted audio signal. The listener/receiving device(s) provide the processed audio signal in stereo (i.e., at least two speakers such as left and right headphones, vehicle speakers, control center speakers, surround sound speakers, etc.) to a user of the listener/receiving device. The listener/receiving device(s) provides a warning and outputs standard audio if the real-time location information of the speaker/transmitting device(s) is unavailable or unreliable. In various embodiments, the listener device provides haptic and/or visual feedback of the speaker device location with respect to the listener device location.

Claims (53)

1. A directional awareness audio communications system comprising:

a first transmit and receive voice communications device comprising a first listener device receiver and a first talker device transmitter, wherein:

the first talker device transmitter comprises at least one first device microphone configured to generate a first voice audio signal, wherein the first talker device transmitter is configured to transmit the first voice audio signal; and

the first listener device receiver is configured to receive a second voice audio signal from a second talker device transmitter of a second transmit and receive voice communications device, the first listener device receiver comprising:

a location identification device integrated with or communicatively coupled to the first listener device receiver, the location identification device configured to provide receiver orientation data of the first listener device receiver;

a Radio Direction Finding (RDF) device integrated with or communicatively coupled to the first listener device receiver, the RDF device comprising an RDF processor and at least one antenna, the RDF device configured to generate a transmitter location data signal identifying a remote location of the second talker device transmitter with respect to the first listener device receiver based on a signal strength of a transmitter radio frequency (RF) signal from the second talker device transmitter, the transmitter RF signal comprising the second voice audio signal;

a location data processor configured to:

receive the receiver orientation data from the location identification device;

receive the transmitter location data signal from the RDF device; and

compute a directional vector between the second talker device transmitter and the first listener device receiver based on the transmitter location data signal and the receiver orientation data;

an audio processor configured to:

receive the second voice audio signal from the second talker device transmitter; and

process the second voice audio signal based on the directional vector to convert the second voice audio signal to a directionally-enhanced voice audio signal; and

a plurality of speakers integrated with or communicatively coupled to the first listener device receiver, the plurality of speakers configured to output the directionally-enhanced voice audio signal provided by the audio processor.

2. The directional awareness audio communications system of claim 1 , wherein the audio processor is configured to apply head-related transfer function (HRTF) filters to convert the second voice audio signal to the directionally-enhanced voice audio signal.

3. The directional awareness audio communications system of claim 1 , wherein the audio processor is configured to apply volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced voice audio signal.

4. The directional awareness audio communications system of claim 1 , wherein the audio processor is configured to provide a spatially-positioned audible sound in addition to a sound corresponding to the second voice audio signal to generate the directionally-enhanced voice audio signal.

5. The directional awareness audio communications system of claim 1 , comprising the second transmit and receive voice communications device having the second talker device transmitter, the second talker device transmitter comprising at least one second device microphone configured to generate the second voice audio signal, wherein the second voice audio signal is transmitted from the second talker device transmitter to the first listener device receiver.

6. The directional awareness audio communications system of claim 1 , comprising a user-worn device communicatively coupled to the first listener device receiver, the user-worn device comprising:

a plurality of haptic sensors configured to pulse in response to a drive signal received during output of the directionally-enhanced voice audio signal by the plurality of speakers; and

at least one processor configured to generate and provide the drive signal to at least one of the plurality of haptic sensors based on the directional vector computed by the location data processor.

7. The directional awareness audio communications system of claim 1 , comprising a display device communicatively coupled to the first listener device receiver, the display device comprising a display screen configured to present a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced voice audio signal by the plurality of speakers,

wherein the visual indicator identifies one or more of:

a direction of the second talker device transmitter from the first listener device receiver;

a distance of the second talker device transmitter from the first listener device receiver; and

an identifier corresponding to the second talker device transmitter.

8. A method comprising:

providing, by a location identification device integrated with or communicatively coupled to a first listener device receiver, receiver orientation data of the first listener device receiver, wherein:

a first transmit and receive voice communications device comprises the first listener device receiver and a first talker device transmitter,

the first talker device transmitter comprises at least one first device microphone configured to generate a first voice audio signal,

the first talker device transmitter is configured to transmit the first voice audio signal, and

the first listener device receiver is configured to receive a second voice audio signal from a second talker device transmitter of a second transmit and receive voice communications device;

generating, by a Radio Direction Finding (RDF) device integrated with or communicatively coupled to the first listener device receiver, a transmitter location data signal identifying a remote location of the second talker device transmitter with respect to the first listener device receiver based on a signal strength of a transmitter radio frequency (RF) signal from the second talker device transmitter, the transmitter RF signal comprising the second voice audio signal;

receiving, by a location data processor of the first listener device receiver, the receiver orientation data from the location identification device;

receiving, by the location data processor, the transmitter location data signal from the RDF device;

computing, by the location data processor, a directional vector between the second talker device transmitter and the first listener device receiver based on the transmitter location data signal and the receiver orientation data;

receiving, by an audio processor of the first listener device receiver, the second voice audio signal from the second talker device transmitter;

processing, by the audio processor, the second voice audio signal based on the directional vector to convert the second voice audio signal to a directionally-enhanced voice audio signal; and

outputting, by a plurality of speakers integrated with or communicatively coupled to the first listener device receiver, the directionally-enhanced voice audio signal provided by the audio processor.

9. The method of claim 8 , wherein the processing the second voice audio signal comprises applying, by the audio processor, head-related transfer function (HRTF) filters to convert the second voice audio signal to the directionally-enhanced voice audio signal.

10. The method of claim 8 , wherein the processing the second voice audio signal comprises applying, by the audio processor, volume sound processing algorithms to adjust a volume of one or more of the plurality of speakers to provide the directionally-enhanced voice audio signal.

11. The method of claim 8 , wherein the processing the second voice audio signal comprises providing, by the audio processor, a spatially-positioned audible sound in addition to a sound corresponding to the second voice audio signal to generate the directionally-enhanced voice audio signal.

12. The method of claim 8 , comprising:

generating, by at least one second device microphone of the second talker device transmitter, the second voice audio signal; and

transmitting, from the second talker device transmitter to the first listener device receiver, the second voice audio signal.

13. The method of claim 8 , comprising:

generating, by at least one processor of a user-worn device communicatively coupled to the first listener device receiver, a drive signal based on the directional vector computed by the location data processor; and

pulsing, at least one of a plurality of haptic sensors of the user-worn device, in response to a drive signal received during output of the directionally-enhanced voice audio signal by the plurality of speakers.

14. The method of claim 8 , comprising presenting, at a display screen of a display device communicatively coupled to the first listener device receiver, a visual indicator based on the directional vector computed by the location data processor, the visual indicator presented during output of the directionally-enhanced voice audio signal by the plurality of speakers,

wherein the visual indicator identifies one or more of:

a direction of the second talker device transmitter from the first listener device receiver;

a distance of the second talker device transmitter from the first listener device receiver; and

an identifier corresponding to the second talker device transmitter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 24, 2021
From: STANEK, DANIEL F.; KYNCH, BERNARD L.
To: OTTO ENGINEERING, INC.
Reel/Frame 056331/0718 →
Continuity (5)
Continuation 16654580 · Oct 16, 2019
Provisional Application 62876479 · Jul 19, 2019
Provisional Application 62852452 · May 24, 2019
Provisional Application 62750007 · Oct 24, 2018
Related Publication 20210385608A1 · Dec 9, 2021