IP Library › Granted Patent US 10,217,468
Granted Patent B2
US 10,217,468 · App. 15/836,604 · Granted Feb 26, 2019

Coding of multiple audio signals

Inventors: Venkatraman Atti (San Diego, CA); Venkata Subrahmanyam Chandra Sekhar Chebiyyam (San Diego, CA)
Assignee: Qualcomm Incorporated
G10L19/008H04S3/008H04R5/02H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,217,468
App. No.
15/836,604
Granted
Feb 26, 2019
Kind
B2
Abstract

A residual scaling unit is configured to determine a scaling factor for a residual channel based on an inter-channel mismatch value. The inter-channel mismatch value is indicative of a temporal alignment between a reference channel and a target channel. The residual scaling unit is further configured to scale (e.g., attenuate) the residual channel by the scaling factor to generate a scaled residual channel. A residual channel encoder is configured to encode the scaled residual channel as part of a bitstream.

Claims (63)

1. A device comprising:

a first transform unit configured to perform a first transform operation on a reference channel to generate a frequency-domain reference channel;

a second transform unit configured to perform a second transform operation on a target channel to generate a frequency-domain target channel;

a stereo channel adjustment unit configured to:

determine an inter-channel mismatch value indicative of a temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel; and

adjust the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;

a down-mixer configured to perform a down-mix operation on the frequency-domain reference channel and the adjusted frequency-domain target channel to generate a mid channel and a side channel;

a residual generation unit configured to:

generate a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel; and

generate a residual channel based on the side channel and the predicted side channel;

a residual scaling unit configured to:

determine a scaling factor for the residual channel based on the inter-channel mismatch value; and

scale the residual channel by the scaling factor to generate a scaled residual channel;

a mid channel encoder configured to encode the mid channel as part of a bitstream; and

a residual channel encoder configured to encode the scaled residual channel as part of the bitstream.

2. The device of claim 1 , wherein the residual channel comprises an error channel signal.

3. The device of claim 1 , wherein the residual scaling unit is further configured to determine a residual gain parameter based on the inter-channel mismatch value.

4. The device of claim 1 , wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

5. The device of claim 1 , wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

6. The device of claim 1 , wherein the residual channel encoder is further configured to set a number of bits used to encode the residual channel in the bitstream based on the inter-channel mismatch value.

7. The device of claim 1 , wherein the residual channel encoder is further configured to compare the inter-channel mismatch value to a threshold.

8. The device of claim 7 , wherein, if the inter-channel mismatch value is less than or equal to the threshold, a first number of bits is used to encode the scaled residual channel.

9. The device of claim 8 , wherein, if the inter-channel mismatch value is greater than the threshold, a second number of bits is used to encode the scaled residual channel.

10. The device of claim 9 , wherein the second number of bits is different from the first number of bits.

11. The device of claim 9 , wherein the second number of bits is less than the first number of bits.

12. The device of claim 1 , wherein the residual generation unit and the residual scaling unit are integrated into a mobile device.

13. The device of claim 1 , wherein the residual generation unit and the residual scaling unit are integrated into a base station.

14. A method of communication, the method comprising:

performing, at an encoder, a first transform operation on a reference channel to generate a frequency-domain reference channel;

performing a second transform operation on a target channel to generate a frequency-domain target channel;

determining an inter-channel mismatch value indicative of a temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel;

adjusting the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;

performing a down-mix operation on the frequency-domain reference channel and the adjusted frequency-domain target channel to generate a mid channel and a side channel;

generating a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel;

generating a residual channel based on the side channel and the predicted side channel;

determining a scaling factor for the residual channel based on the inter-channel mismatch value; and

scaling the residual channel by the scaling factor to generate a scaled residual channel;

encoding the mid channel as part of a bitstream; and

encoding the scaled residual channel as part of the bitstream.

15. The method of claim 14 , wherein the residual channel comprises an error channel signal.

16. The method of claim 14 , further comprising determining a residual gain parameter based on the inter-channel mismatch value.

17. The method of claim 14 , wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

18. The method of claim 14 , wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

19. The method of claim 14 , further comprising setting a number of bits used to encode the residual channel in the bitstream based on the inter-channel mismatch value.

20. The method of claim 14 , further comprising comparing the inter-channel mismatch value to a threshold.

21. The method of claim 20 , wherein, if the inter-channel mismatch value is less than or equal to the threshold, a first number of bits is used to encode the scaled residual channel.

22. The method of claim 21 , wherein, if the inter-channel mismatch value is greater than the threshold, a second number of bits is used to encode the scaled residual channel.

23. The method of claim 22 , wherein the second number of bits is different from the first number of bits.

24. The method of claim 14 , wherein scaling the residual channel is performed at a mobile device.

25. The method of claim 14 , wherein scaling the residual channel is performed at a base station.

26. A non-transitory computer-readable medium comprising instructions that, when executed by a processor within an encoder, cause the processor to perform operations comprising:

performing a first transform operation on a reference channel to generate a frequency-domain reference channel;

performing a second transform operation on a target channel to generate a frequency-domain target channel;

determining an inter-channel mismatch value indicative of a temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel;

adjusting the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel;

performing a down-mix operation on the frequency-domain reference channel and the adjusted frequency-domain target channel to generate a mid channel and a side channel;

generating a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel;

generating a residual channel based on the side channel and the predicted side channel;

determining a scaling factor for the residual channel based on the inter-channel mismatch value; and

scaling the residual channel by the scaling factor to generate a scaled residual channel;

encoding the mid channel as part of a bitstream; and

encoding the scaled residual channel as part of the bitstream.

27. The non-transitory computer-readable medium of claim 26 , wherein the residual channel comprises an error channel signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2018
From: ATTI, VENKATRAMAN; CHEBIYYAM, VENKATA SUBRAHMANYAM CHANDRA SEKHAR
To: QUALCOMM INCORPORATED
Reel/Frame 044621/0235 →
Continuity (2)
Provisional Application 62448287 · Jan 19, 2017
Related Publication 20180204578A1 · Jul 19, 2018