IP Library › Granted Patent US 10,438,598
Granted Patent B2
US 10,438,598 · App. 16/245,161 · Granted Oct 8, 2019

Coding of multiple audio signals

Inventors: Venkatraman Atti (San Diego, CA); Venkata Subrahmanyam Chandra Sekhar Chebiyyam (Seattle, WA)
Assignee: Qualcomm Incorporated
G10L19/008H04S3/008H04R5/02H04S2400/15H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,438,598
App. No.
16/245,161
Granted
Oct 8, 2019
Kind
B2
Abstract

A residual scaling unit is configured to determine a scaling factor for a residual channel based on an inter-channel mismatch value. The inter-channel mismatch value is indicative of a temporal misalignment between a reference channel and a target channel. The residual scaling unit is further configured to scale (e.g., attenuate) the residual channel by the scaling factor to generate a scaled residual channel. A residual channel encoder is configured to encode the scaled residual channel as part of a bitstream.

Claims (49)

1. A device comprising:

a down-mixer configured to perform a down-mix operation, based on a frequency-domain reference channel and a frequency-domain target channel, to generate a mid channel and a side channel;

a residual generation unit configured to:

generate a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel; and

generate a residual channel based on the side channel and the predicted side channel;

a residual scaling unit configured to:

determine a scaling factor based on a temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel; and

scale the residual channel by the scaling factor to generate a scaled residual channel; and

a residual channel encoder configured to encode the scaled residual channel as part of a bitstream.

2. The device of claim 1 , further comprising a stereo channel adjustment unit configured to determine an inter-channel mismatch value, the inter-channel mismatch value indicative of the temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel, wherein the residual scaling unit is configured to determine the scaling factor based on the inter-channel mismatch value.

3. The device of claim 2 , wherein the stereo channel adjustment unit is further configured to adjust the frequency-domain target channel based on the inter-channel mismatch value to generate an adjusted frequency-domain target channel, and wherein the down-mixer is configured to perform the down-mix operation on the frequency-domain reference channel and the adjusted frequency-domain target channel to generate the mid channel and the side channel.

4. The device of claim 2 , wherein the residual scaling unit is further configured to determine a residual gain parameter based on the inter-channel mismatch value.

5. The device of claim 2 , wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

6. The device of claim 2 , wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

7. The device of claim 2 , wherein the residual channel encoder is further configured to set a number of bits used to encode the residual channel in the bitstream based on the inter-channel mismatch value.

8. The device of claim 2 , wherein the residual channel encoder is further configured to compare the inter-channel mismatch value to a threshold.

9. The device of claim 8 , wherein, if the inter-channel mismatch value is less than or equal to the threshold, a first number of bits is used to encode the scaled residual channel.

10. The device of claim 9 , wherein, if the inter-channel mismatch value is greater than the threshold, a second number of bits is used to encode the scaled residual channel.

11. The device of claim 10 , wherein the second number of bits is different from the first number of bits.

12. The device of claim 10 , wherein the second number of bits is less than the first number of bits.

13. The device of claim 1 , further comprising:

a first transform unit configured to perform a first transform operation on a reference channel to generate the frequency-domain reference channel; and

a second transform unit configured to perform a second transform operation on a target channel to generate the frequency-domain target channel.

14. The device of claim 1 , further comprising a mid channel encoder configured to encode the mid channel as part of the bitstream.

15. The device of claim 1 , wherein the residual channel comprises an error channel signal.

16. The device of claim 1 , wherein the residual generation unit and the residual scaling unit are integrated into a wireless device.

17. The device of claim 1 , wherein the residual generation unit and the residual scaling unit are integrated into a base station.

18. A method of communication, the method comprising:

performing a down-mix operation, based on a frequency-domain reference channel and a frequency-domain target channel, to generate a mid channel and a side channel;

generating a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel;

generating a residual channel based on the side channel and the predicted side channel;

determining a scaling factor based on a temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel;

scaling the residual channel by the scaling factor to generate a scaled residual channel; and

encoding the scaled residual channel as part of a bitstream.

19. The method of claim 18 , further comprising determining an inter-channel mismatch value indicative of the temporal misalignment between the frequency-domain reference channel and the frequency-domain target channel, wherein the scaling factor is based on the inter-channel mismatch value.

20. The method of claim 19 , wherein one or more bands of the residual channel are zeroed out based on the inter-channel mismatch value.

21. The method of claim 19 , wherein each band of the residual channel is zeroed out based on the inter-channel mismatch value.

22. The method of claim 19 , further comprising setting a number of bits used to encode the residual channel in the bitstream based on the inter-channel mismatch value.

23. The method of claim 19 , further comprising comparing the inter-channel mismatch value to a threshold, wherein, if the inter-channel mismatch value is less than or equal to the threshold, a first number of bits is used to encode the scaled residual channel.

24. The method of claim 18 , wherein scaling the residual channel is performed at a wireless device.

25. The method of claim 18 , wherein scaling the residual channel is performed at a base station.

26. A non-transitory computer-readable medium comprising instructions that, when executed by a processor within an encoder, cause the processor to perform operations comprising:

performing a down-mix operation, based on a frequency-domain reference channel and a frequency-domain target channel, to generate a mid channel and a side channel;

generating a predicted side channel based on the mid channel, the predicted side channel corresponding to a prediction of the side channel;

generating a residual channel based on the side channel and the predicted side channel;

determining a scaling factor based on a temporal misalignment between a frequency-domain reference channel and a frequency-domain target channel;

scaling the residual channel by the scaling factor to generate a scaled residual channel; and

encoding the scaled residual channel as part of a bitstream.

27. The non-transitory computer-readable medium of claim 26 , wherein the residual channel comprises an error channel signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2019
From: ATTI, VENKATRAMAN; CHEBIYYAM, VENKATA SUBRAHMANYAM CHANDRA SEKHAR
To: QUALCOMM INCORPORATED
Reel/Frame 048545/0037 →
Continuity (3)
Continuation 15836604 · Dec 8, 2017
Provisional Application 62448287 · Jan 19, 2017
Related Publication 20190147895A1 · May 16, 2019
Cited By (1)
US 12,711,967