IP Library Granted Patent US 8,041,042
Granted Patent B2
US 8,041,042 · App. 11/633,133 · Granted Oct 18, 2011

Method, system, apparatus and computer program product for stereo coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,041,042
App. No.
11/633,133
Granted
Oct 18, 2011
Kind
B2
Abstract

A method, system, apparatus and computer program product are provided for improved stereo coding. In particular, the method, system, apparatus and computer program product provide a technique for performing Mid-Side (M/S) stereo coding, in which an additional step is added to the coding process, whereby a parameter that is used in determining when the mid and side signals will be used instead of the left and right input signals is modified prior to making the selection between the signal pairs. In particular, the masking threshold associated with either the left or the right input signal may be modified based on a relationship between the energies of the two input signals. In addition, once the selection between the signal pairs has been made, the masking thresholds of the selected signals may be further modified, again based on a relationship between the energies of the left and right input signals.

Claims (80)

1. A method comprising:

receiving a left and a right input signal;

deriving left and right masking thresholds associated with respective left and right input signals;

determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

comparing the scale value to a predetermined threshold; and

in an instance in which the scale value exceeds the predetermined threshold, modifying the masking threshold associated with the input signal comprising the minimum energy.

2. The method of claim 1 , wherein modifying the masking threshold comprises multiplying the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

3. The method of claim 1 further comprising:

determining a mid and a side signal based at least in part on the left and right input signals; and

selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

4. The method of claim 3 , wherein the left or right masking threshold is modified prior to selecting between the left and right input signals and the mid and side signals.

5. The method of claim 3 , wherein selecting between the left and right input signals and the mid and side signals comprises:

determining a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

determining a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

comparing the first and second combined perceptual entropies to determine which is lower.

6. The method of claim 3 , wherein determining the mid signal comprises averaging the left and right input signals, and wherein determining the side signal comprises taking the difference between the left and right input signals and dividing the difference by two.

7. The method of claim 3 further comprising:

where the left and right input signals are selected, further modifying at least one of the left or the right masking thresholds;

where the mid and side signals are selected, further modifying at least one of a mid or a side masking thresholds; and

quantizing the selected signals based at least in part on the corresponding masking thresholds.

8. An apparatus comprising:

at least one processor; and

at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:

receive left and right input signals;

derive left and right masking thresholds associated with respective left and right input signals;

determine the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

determine a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

compare the scale value to a predetermined threshold; and

in an instance in which the scale value exceeds the predetermined threshold, modify the masking threshold associated with the input signal comprising the minimum energy.

9. The apparatus of claim 8 , wherein in order to modify the masking threshold, the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to multiply the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

10. The apparatus of claim 8 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:

determine a mid and a side signal based at least in part on the left and right input signals; and

select between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

11. The apparatus of claim 10 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to modify the left or right masking threshold prior to selecting between the left and right input signals and the mid and side signals.

12. The apparatus of claim 10 , wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:

where the left and right input signals are selected, further modify at least one of the left or the right masking thresholds; and

where the mid and side signals are selected, further modify at least one of a mid or a side masking thresholds.

13. The apparatus of claim 12 , wherein the apparatus further comprises:

a quantizer configured to quantize the selected signals based at least in part on the corresponding masking thresholds.

14. An apparatus comprising:

means for receiving a left and a right input signal;

means for deriving left and right masking thresholds associated with respective left and right input signals;

means for determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

means for determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

means for comparing the scale value to a predetermined threshold; and

means for modifying the masking threshold associated with the input signal comprising the minimum energy, in an instance in which the scale value exceeds the predetermined threshold.

15. The apparatus of claim 14 , wherein the means for modifying the masking threshold comprises means for multiplying the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

16. The apparatus of claim 14 further comprising:

means for determining a mid and a side signal based at least in part on the left and right input signals; and

means for selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

17. The apparatus of claim 16 , wherein the means for modifying the left or right masking threshold comprises means for modifying the left or right masking threshold prior to selecting between the left and right input signals and the mid and side signals.

18. The apparatus of claim 16 , wherein the means for selecting between the left and right input signals and the mid and side signals further comprises:

means for determining a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

means for determining a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

means for comparing the first and second combined perceptual entropies to determine which is lower.

19. The apparatus of claim 16 further comprising:

means for further modifying at least one of the left or the right masking thresholds, where the left and right input signals are selected;

means for further modifying at least one of a mid or a side masking thresholds, where the mid and side signals are selected; and

means for quantizing the selected signals based at least in part on the corresponding masking thresholds.

20. A computer program product, wherein the computer program product comprises at least one tangible computer-readable storage medium having computer-readable program code portions stored therein, the computer-readable program code portions comprising:

a first executable portion for receiving a left and a right input signal;

a second executable portion for deriving left and right masking thresholds associated with respective left and right input signals;

a third executable portion for determining the energy associated with respective left and right input signals, wherein the energy associated with one of the left or right input signals comprises a maximum energy and the energy associated with the other of the left or right input signals comprises a minimum energy;

a fourth executable portion for determining a scale value based at least in part on a ratio of the maximum energy to the minimum energy;

a fifth executable portion for comparing the scale value to a predetermined threshold; and

a sixth executable portion for modifying the masking threshold associated with the input signal comprising the minimum energy, in an instance in which the scale value exceeds the predetermined threshold.

21. The computer program product of claim 20 , wherein the sixth executable portion is configured to multiply the derived masking threshold by a threshold scale, said threshold scale equal to the smaller of a predefined value or the determined scale value.

22. The computer program product of claim 20 further comprising:

a seventh executable portion for determining a mid and a side signal based at least in part on the left and right input signals; and

an eighth executable portion for selecting between the left and right input signals and the mid and side signals based at least in part on the left and right masking thresholds.

23. The computer program product of claim 22 , wherein the sixth executable portion is configured to modify the left or right masking threshold prior to the eighth executable portion selecting between the left and right input signals and the mid and side signals.

24. The computer program product of claim 22 , wherein the eighth executable portion is configured to:

determine a first combined perceptual entropy associated with the left and right input signals, said first combined perceptual entropy based at least in part on the left and right masking thresholds;

determine a second combined perceptual entropy associated with the mid and side signals, said second combined perceptual entropy based at least in part on mid and side masking thresholds; and

compare the first and second combined perceptual entropies to determine which is lower.

25. The computer program product of claim 22 further comprising:

a ninth executable portion for further modifying at least one of the left or the right masking thresholds, where the left and right input signals are selected;

a tenth executable portion for further modifying at least one of a mid or a side masking thresholds, where the mid and side signals are selected; and

an eleventh executable portion for quantizing the selected signals based at least in part on the corresponding masking thresholds.

Assignments (10)
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 18, 2017
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 041006/0185 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2006
From: OJANPERA, JUHA
To: NOKIA CORPORATION
Reel/Frame 018640/0581 →