IP Library Granted Patent US 11,368,231
Granted Patent B1
US 11,368,231 · App. 16/230,687 · Granted Jun 21, 2022

Local auditory display using ultrasonic encoding and decoding

Inventors: Peter Harty Dodds (Seattle, WA); Morteza Khaleghimeybodi (Bellevue, WA); Philip Robinson (Seattle, WA); Scott Porter (Woodinville, WA); William Owen Brimijoin, II (Kirkland, WA); Andrew Lovitt (Redmond, WA)
Assignee: Facebook Technologies, LLC
H04B11/00G06F3/165
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,368,231
App. No.
16/230,687
Granted
Jun 21, 2022
Kind
B1
Abstract

A system receives audio data in a frequency range of 20 Hz-20 kHz. The received audio data is encoded by the system into ultrasonic data in frequencies that are greater than 20 kHz, and transmitted into a local area that is proximal to the transmitting device, i.e., within the transmission range of the transmitting device. An ultrasonic communication device that is located in the transmission range of the transmitting device may receive the ultrasonic data. The received ultrasonic data is decoded by the ultrasonic communication system in the receiving device into audio data in a frequency range of 20 Hz-20 kHz, and subsequently presented to a user of the receiving ultrasonic communication device.

Claims (82)

1. A method comprising:

receiving, at a first ultrasonic communication device, audio data in a human audible frequency;

encoding, at the first ultrasonic communication device, the received audio data into ultrasonic data in an ultrasonic frequency;

transmitting an informational ultrasonic beacon with information comprising one or more of:

communication channel information,

one or more encryption keys,

transmission protocol information,

encoding protocol information,

access point information; and

transmitting, via the first ultrasonic communication device, the encoded ultrasonic data based on the information into a local area that includes a second ultrasonic communication device, wherein the second ultrasonic communication device decodes the ultrasonic data to retrieve the audio data, and presents the audio data.

2. The method of claim 1 , further comprising:

prior to transmitting the ultrasonic data,

receiving an indicator signal that indicates a presence of the second ultrasonic communication device within a predefined area from the transmitting device; and

transmitting the ultrasonic data in response to the received indicator signal.

3. The method of claim 2 , wherein transmitting the encoded ultrasonic data in response to the received indicator signal comprises:

tracking a location of the second ultrasonic communication device;

transforming the ultrasonic data via beamforming; and

transmitting the beamformed ultrasonic data towards the tracked location.

4. The method of claim 1 , wherein the received audio data is speech data that is captured by one or more microphones via the first ultrasonic communication device.

5. The method of claim 1 , wherein transmitting the encoded ultrasonic data further comprises transmitting a plurality of encoded ultrasonic data.

6. The method of claim 2 , wherein the encoded ultrasonic data is stored along with a plurality of encoded ultrasonic data, wherein the received indicator signal further comprises values for one or more selected settings, and wherein the values for the one or more settings are used to select the encoded ultrasonic data from the plurality of stored encoded ultrasonic data for the transmission.

7. The method of claim 1 , wherein the human audible frequency is in a frequency range of 20 Hz to 20 kHz, wherein the ultrasonic frequency is a frequency that is greater than 20 kHz, and wherein the first ultrasonic communication device transmits the encoded ultrasonic data without an uplink to the second ultrasonic communication device.

8. A method comprising:

receiving at a second ultrasonic communication device, an informational ultrasonic beacon with information comprising one or more of:

communication channel information,

one or more encryption keys,

transmission protocol information,

encoding protocol information,

access point information, and

receiving, at a second ultrasonic communication device from a first ultrasonic communication device, ultrasonic data using the received information, the ultrasonic data in an ultrasonic frequency;

decoding, at the second ultrasonic communication device, the received ultrasonic data into audio data in a human audible frequency; and

presenting, via the second ultrasonic communication device, the audio data to a user, wherein the first ultrasonic communication device initially encoded the audio data into ultrasonic data, and transmitted the received ultrasonic data.

9. The method of claim 8 , further comprising:

prior to receiving the ultrasonic data,

transmitting an indicator signal indicating a presence of the second ultrasonic communication device within a predefined area; and

receiving the ultrasonic data in response to the transmitted indicator signal.

10. The method of claim 9 , wherein receiving the encoded ultrasonic data in response to the transmitted indicator signal comprises receiving a beamformed ultrasonic data.

11. The method of claim 8 , wherein the presented decoded audio data is speech data from a user of the first ultrasonic communication device.

12. The method of claim 8 , wherein receiving, at the second ultrasonic communication device, the ultrasonic data further comprises receiving, at the second ultrasonic communication device, a plurality of ultrasonic data.

13. The method of claim 12 , further comprising:

presenting, at the second ultrasonic communication device, a user interface offering one or more settings for selection by a user of the second ultrasonic communication device;

receiving from the user, at the second ultrasonic communication device, a selection of one or more settings from the offered one or more settings by the user interface; and

decoding, at the second ultrasonic communication device, the received ultrasonic data into audio data further comprising decoding one or more of the received plurality of the ultrasonic data based on the received selection from the user.

14. The method of claim 8 , wherein the human audible frequency is in a frequency range of 20 Hz to 20 kHz, wherein the ultrasonic frequency is a frequency that is greater than 20 kHz, and wherein the second ultrasonic communication device receives the ultrasonic data without an uplink to the first ultrasonic communication device.

15. A ultrasonic communication device comprising:

a processor configured to execute modules;

an ultrasonic data transducer configured to receive/transmit ultrasonic data in an ultrasonic frequency;

an audio data transducer configured to receive/transmit audio data in a human audible frequency; and

a memory storing modules, the modules comprising:

an acoustic encoder that encodes audio data that is in a human audible frequency into ultrasonic data in a ultrasonic frequency, and

an acoustic decoder that decodes ultrasonic data in a ultrasonic frequency range into audio data that is in a human audible frequency;

a processing module configured to:

cause the acoustic encoder to encode received audio data into the ultrasonic data in a ultrasonic frequency, and

cause the acoustic decoder to the received second ultrasonic data into the audio data in a human audible frequency;

a presentation module configured to present the audio data to a user of the device using the audio transducer assembly; and

a handshake module configured to:

transmit ultrasonic network setup information using the ultrasonic data transducer;

receive ultrasonic network setup information using the ultrasonic data transducer; and

process the received network setup information to establish a local network connection with another ultrasonic communication device.

16. The device of claim 15 , the processing module further configured to:

identify an indicator signal that indicates a presence of an ultrasonic communication device within a predefined area from the device;

track a location of the second ultrasonic communication device;

transform ultrasonic data via beamforming; and

cause transmission of the beamformed ultrasonic data towards the tracked location.

17. The device of claim 16 , the processing module is further configured to:

retrieve a selection of settings from the received indicator signal;

retrieve, based on the received selections, one or more stored audio data from a plurality of stored audio data; and

cause the encoder to encode the retrieved one or more audio data to generate the ultrasonic data.

18. The device of claim 15 , wherein the processing module is further configured to:

present a user interface offering one or more settings for selection by a user of the device;

receive a selection of one or more settings from the user of the device; and

cause the decoder to decode, based on the received selection of settings, a received ultrasonic data into the audio data.

19. A method comprising:

receiving, at a first ultrasonic communication device, audio data in a human audible frequency;

encoding, at the first ultrasonic communication device, the received audio data into ultrasonic data in an ultrasonic frequency;

receiving, from a transmitting device, an indicator signal that indicates a presence of a second ultrasonic communication device within a predefined area from the transmitting device; and

transmitting in response to the received indicator signal, via the first ultrasonic communication device, the encoded ultrasonic data into the predefined area that includes the second ultrasonic communication device, wherein the second ultrasonic communication device decodes the ultrasonic data to retrieve the audio data, and presents the audio data.

20. A method comprising:

transmitting an indicator signal indicating a presence of a first ultrasonic communication device within a predefined area;

receiving in response to the transmitted indicator, at the first ultrasonic communication device, ultrasonic data from a second ultrasonic communication device, the ultrasonic data in an ultrasonic frequency;

decoding, at the first ultrasonic communication device, the received ultrasonic data into audio data in a human audible frequency; and

presenting, via the first ultrasonic communication device, the audio data to a user, wherein the first ultrasonic communication device initially encoded the audio data into ultrasonic data and transmitted the received ultrasonic data.

Assignments (3)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0132 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2019
From: LOVITT, ANDREW
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 048096/0089 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2019
From: DODDS, PETER HARTY; KHALEGHIMEYBODI, MORTEZA; ROBINSON, PHILIP; PORTER, SCOTT; BRIMIJOIN, WILLIAM OWEN, II
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 048004/0987 →
Cited By (2)
US 12,373,156 US 12,634,555