IP Library Granted Patent US 9,426,598
Granted Patent B2
US 9,426,598 · App. 14/332,098 · Granted Aug 23, 2016

Spatial calibration of surround sound systems including listener position estimation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,426,598
App. No.
14/332,098
Granted
Aug 23, 2016
Kind
B2
Abstract

A method for calibrating a surround sound system is disclosed. The method utilizes a microphone array integrated in a front center loudspeaker of the surround sound system or a soundbar facing a listener. Positions of each loudspeaker relative to the microphone array can be estimated by playing a test signal at each loudspeaker and measuring the test signal received at the microphone array. The listener's position can also be estimated by receiving the listener's voice or other sound cues made by the listener using the microphone array. Once the positions of the loudspeakers and the listener's position are estimated, spatial calibrations can be performed for each loudspeaker in the surround sound system so that listening experience is optimized.

Claims (46)

1. A method for calibrating a multichannel surround sound system including a soundbar and one or more surround loudspeakers, the method comprising:

receiving, by microphone array integrated into the soundbar, a test signal played at a surround loudspeaker to be calibrated, the integrated microphone array comprising a plurality of microphones mounted in a relationship to the soundbar;

estimating a position of the surround loudspeaker relative to the integrated microphone array based on the received test signal at the plurality of microphones;

receiving, by the microphone array, a sound from a listener;

estimating a position of the listener relative to the integrated microphone array based on the received sound at the plurality of microphones;

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

2. The method of claim 1 , wherein the integrated microphone array is mounted on the front center of the soundbar.

3. The method of claim 1 , wherein the position of the surround loudspeaker and the position of the listener each includes a distance and an angle relative to the microphone array.

4. The method of claim 3 , wherein the position of the loudspeaker is estimated based on a direct component of the received test signal.

5. The method of claim 3 , wherein the angle of the loudspeaker is estimated using two or more microphones in the microphone array and based on a time difference of arrival (TDOA) of the test signal at the two or more microphones in the microphone array.

6. The method of claim 1 , wherein the sound from the listener includes the listener's voice or other sound cues made by the listener.

7. The method of claim 1 , wherein the position of the listener is estimated using three or more microphones in the microphone array.

8. The method of claim 1 , wherein performing the spatial calibration comprises:

adjusting delay and gain of a sound channel for the surround loudspeaker based on the estimated position of the surround loudspeaker and the listener; and

correcting spatial position of the sound channel by panning the sound channel to a desired position based on the estimated positions of the surround loudspeaker and the listener.

9. The method of claim 1 , wherein performing the spatial calibration comprises panning a sound object to a desired position based on the estimated positions of the surround loudspeaker and the listener.

10. A method comprising:

receiving a request to calibrate a multichannel surround sound system including a soundbar with an integrated microphone array and one or more surround loudspeakers;

responsive to the request including estimating a position of a surround loudspeaker, playing a test signal at the surround loudspeaker; and

estimating the position of the surround loudspeaker relative to the integrated microphone array based on received test signal from the surround loudspeaker at the integrated microphone array;

responsive to the request including estimating a position of a listener, estimating the position of the listener relative to the integrated microphone array based on a received sound from the listener at the integrated microphone array;

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

11. An apparatus for calibrating a multichannel surround sound system including one or more loudspeakers, the apparatus comprising:

a microphone array with two or more microphones integrated in a front component of the surround sound system, wherein the integrated microphone array is configured for receiving a test signal played at a loudspeaker to be calibrated, and for receiving a sound from the listener;

an estimation module configured for:

estimating a position of the loudspeaker relative to the integrated microphone array based on the received test signal from the loudspeaker, and for estimating a position of the listener relative to the integrated microphone array based on the received sound from the listener; and

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

a calibration module configured for performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

12. The apparatus of claim 11 , wherein the front component of the surround sound system is one of a soundbar, a front loudspeaker and an A/V receiver.

13. The apparatus of claim 11 , wherein the position of the loudspeaker and the position of the listener each includes a distance and an angle relative to the microphone array.

14. The apparatus of claim 13 , wherein the position of the loudspeaker is estimated based on a direct component of the received test signal.

15. The apparatus of claim 13 , wherein the angle of the loudspeaker is estimated using two or more microphones in the microphone array and based on a time difference of arrival (TDOA) of the test signal at the two or more microphones in the microphone array.

16. The apparatus of claim 11 , wherein the position of the listener is estimated using three or more microphones in the microphone array.

17. The apparatus of claim 11 , wherein performing the spatial calibration comprises:

adjusting delay and gain of a sound channel for the loudspeaker based on the estimated position of the loudspeaker and the listener; and

correcting spatial position of the sound channel by panning the sound channel to a desired position based on the estimated positions of the surround loudspeaker and the listener.

18. The apparatus of claim 11 , wherein performing the spatial calibration comprises panning a sound object to a desired position based on the estimated positions of the surround loudspeaker and the listener.

19. A system for calibrating a multichannel surround sound system including one or more loudspeakers, the system comprising:

a microphone array with two or more microphones integrated in a front component of the surround sound system, wherein the microphone array is configured for receiving a test signal played at a loudspeaker to be calibrated and for receiving a sound from the listener;

an estimation module configured for:

estimating a position of the loudspeaker relative to the integrated microphone array based on the received test signal from the loudspeaker, and for estimating a position of the listener relative to the integrated microphone array based on the received sound from the listener; and

deriving a distance and an angle between the surround loudspeaker and the listener based on the estimated position of the surround loudspeaker relative to the integrated microphone array and the estimated position of the listener relative to the integrated microphone array; and

a calibration module configured for performing a spatial calibration to the surround sound system based at least on the derived distance and angle between the surround loudspeaker and the listener.

20. The system of claim 19 , wherein the front component of the surround sound system is one of a soundbar, a front loudspeaker and an A/V receiver.

Assignments (7)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: VEVEO LLC (F.K.A. VEVEO, INC.); DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 061786/0675 →
RELEASE OF SECURITY INTEREST Recorded Jun 11, 2020
From: ROYAL BANK OF CANADA
To: TESSERA, INC.; INVENSAS BONDING TECHNOLOGIES, INC. (F/K/A ZIPTRONIX, INC.); FOTONATION CORPORATION (F/K/A DIGITALOPTICS CORPORATION AND F/K/A DIGITALOPTICS CORPORATION MEMS); INVENSAS CORPORATION; TESSERA ADVANCED TECHNOLOGIES, INC; DTS, INC.; DTS LLC; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
Reel/Frame 052920/0001 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
RELEASE OF SECURITY INTEREST Recorded Dec 6, 2016
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: DTS, INC.
Reel/Frame 040821/0083 →
SECURITY INTEREST Recorded Dec 2, 2016
From: INVENSAS CORPORATION; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; ZIPTRONIX, INC.; DIGITALOPTICS CORPORATION; DIGITALOPTICS CORPORATION MEMS; DTS, LLC; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: ROYAL BANK OF CANADA, AS COLLATERAL AGENT
Reel/Frame 040797/0001 →
SECURITY INTEREST Recorded Nov 2, 2015
From: DTS, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS ADMINISTRATIVE AGENT
Reel/Frame 037032/0109 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 24, 2014
From: WALSH, MARTIN; SHI, GUANGJI
To: DTS, INC.
Reel/Frame 033384/0874 →