IP Library Granted Patent US 11,586,407
Granted Patent B2
US 11,586,407 · App. 16/896,998 · Granted Feb 21, 2023

Systems, devices, and methods of manipulating audio data based on display orientation

Inventors: Tyler Back (San Francisco, CA); Joshua Warren Bingham (Palo Alto, CA); Yuhuan Zeng (San Carlos, CA); Plamen Ivanov (Mountain View, CA); Christopher Evans (Menlo Park, CA); Jens Nilsson (Foster City, CA); Michael Asfaw (Foster City, CA)
Assignee: META PLATFORMS TECHNOLOGIES, LLC
G06F3/14G06F3/162G06N20/00H04R5/02H04R5/027H04R5/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,586,407
App. No.
16/896,998
Granted
Feb 21, 2023
Kind
B2
Abstract

An electronic device includes sensors configured to detect an orientation of a display, driver logic, and a speaker array. The driver logic processes the audio data received by an interface to form audio output data, and forms driver signals representing the audio output data based on the orientation of the display detected by the one or more sensors. The speaker array receives the driver signals formed orientation of the display, and renders the audio output data for playback based on the driver signals.

Claims (40)

1. An electronic device comprising:

sensors configured to detect an orientation of a display with respect to a base;

driver logic configured to:

process audio input data captured by a microphone array fixedly attached to the display and received by an interface to form audio output data; and

form driver signals representing the audio output data based on the orientation of the display with respect to the base detected by the sensors; and

a speaker array physically coupled to the base and configured to:

receive the driver signals formed based on the orientation of the display with respect to the base; and

render the audio output data for playback based on the driver signals.

2. The electronic device of claim 1 , wherein to form the driver signals based on the orientation of the display with respect to the base, the driver logic is configured to:

determine a set of equalization parameters corresponding to the orientation of the display with respect to the base; and

form the driver signals based on the set of equalization parameters.

3. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to select the set of equalization parameters corresponding to the orientation of the display with respect to the base from a plurality of sets of equalization parameters using a lookup table.

4. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to apply a finite element solution that determines the set of equalization parameters corresponding to the orientation of the display with respect to the base.

5. The electronic device of claim 2 , wherein to determine the set of equalization parameters corresponding to the orientation of the display with respect to the base, the driver logic is configured to apply an artificial intelligence model or a machine learning model trained with a mapping of rotation angles of the display to respective sets of equalization parameters to predict the set of equalization parameters corresponding to the orientation of the display with respect to the base.

6. The electronic device of claim 2 , wherein the set of equalization parameters includes one or more of an amplitude, a high pass filter, a low pass filter, notch filters, an adjust Q factor, a filter amplitude, or a phase.

7. The electronic device of claim 6 , wherein the amplitude is expressed as a function of a frequency.

8. The electronic device of claim 1 , wherein the sensors include one or more of an accelerometer, a position encoder, a gyroscope, a motion sensor, camera hardware, an imaging system, a radio frequency probe, an antenna, or a Hall probe.

9. The electronic device of claim 1 , wherein the microphone is array is fixedly attached to a bezel of the display.

10. The electronic device of claim 9 , wherein the sensors are configured to detect a movement of the display with respect to the base while the base remains stationary with respect to an environment.

11. A method comprising:

detecting, by one or more sensors, an orientation of a display of an electronic device with respect to a base of the electronic device;

processing audio input data captured by a microphone array fixedly attached to the base to form audio output data;

forming, by driver logic, driver signals representing the audio output data based the orientation of the display with respect to the base detected by the one or more sensors;

receiving, by a speaker array coupled to the base of the electronic device, the driver signals formed based on the orientation of the display with respect to the base; and

rendering, by the speaker array, the audio output data for playback based on the driver signals.

12. The method of claim 11 , wherein forming the driver signals based on the orientation of the display with respect to the base comprises:

determining, by the driver logic of the electronic device, a set of equalization parameters corresponding to the orientation of the display with respect to the base; and

forming, by the driver logic, the driver signals based on the set of equalization parameters.

13. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises selecting, by the driver logic, the set of equalization parameters corresponding to the orientation of the display with respect to the base from a plurality of sets of equalization parameters using a lookup table.

14. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises applying, by the driver logic, a finite element solution that determines the set of equalization parameters corresponding to the orientation of the display with respect to the base.

15. The method of claim 12 , wherein determining the set of equalization parameters corresponding to the orientation of the display with respect to the base comprises applying, by the driver logic, an artificial intelligence model or a machine learning model trained with a mapping of rotation angles of the display with respect to the base to respective sets of equalization parameters to predict the set of equalization parameters corresponding to the orientation of the display with respect to the base.

16. The method of claim 12 , wherein the set of equalization parameters includes one or more of an amplitude, a high pass filter, a low pass filter, notch filters, an adjust Q factor, a filter amplitude, or a phase.

17. The method of claim 11 , wherein the microphone is array is fixedly attached to a bezel of the display.

18. The method of claim 11 , further comprising detecting, by the one or more sensors, a movement of the display with respect to the base while the base remains stationary with respect to an environment.

19. A non-transitory computer-readable storage medium storing one or more programs configured for execution by one or more processors of an electronic device having a display, a microphone array fixedly attached to the display, an interface, one or more sensors, and a speaker array coupled to a base, the one or more programs including instructions, which when executed by the one or more processors, cause the electronic device to:

receive, via the interface, audio input data captured by the microphone array;

detect, via the one or more sensors coupled to the processing circuitry, an orientation of the display of the electronic device with respect to the base;

process the audio input data received by the interface to form audio output data;

form, based on the orientation of the display with respect to the base detected by the one or more sensors, driver signals representing the audio output data; and

render, via the speaker array, the audio output data for playback based on the driver signals.

Assignments (3)
CHANGE OF NAME Recorded Jul 21, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060802/0799 →
CORRECTIVE ASSIGNMENT TO CORRECT THE 3RD CONVEYOR'S NAME DUE TO USE OF PREFERED NAME IN LIEU OF LEGAL NAME PREVIOUSLY RECORDED AT REEL: 053233 FRAME: 0175. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 18, 2022
From: BACK, TYLER; BINGHAM, JOSHUA WARREN; ZENG, YUHUAN; IVANOV, PLAMEN; EVANS, CHRISTOPHER; NILSSON, JENS; ASFAW, MICHAEL
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 059725/0077 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2020
From: BACK, TYLER; BINGHAM, JOSHUA WARREN; TSANG, EVA; IVANOV, PLAMEN; EVANS, CHRISTOPHER; NILSSON, JENS; ASFAW, MICHAEL
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 053233/0175 →
Continuity (1)
Related Publication 20210382672A1 · Dec 9, 2021
Cited By (1)
US 12,340,014