Audio coder window sizes and time-frequency transformations

1. A method of encoding an audio signal comprising:

receiving an audio signal frame (frame);

applying multiple different time-frequency transforms to the frame to produce multiple transforms of the frame, each of the multiple transforms of the frame that are produced having a corresponding time-frequency resolution for a time span of the frame and a frequency range;

determining multiple frequency bands within the frequency range of the multiple transforms of the frame;

computing a measure of coding efficiency for each of the multiple frequency bands for each of the multiple transforms of the frame;

selecting a combination of time-frequency resolutions to represent the frame at each of the multiple frequency bands, based at least in part upon the computed measures of coding efficiency;

determining a window size and a corresponding transform size for the frame, based at least in part upon the selected combination of time-frequency resolutions;

determining a modification transformation for at least one of the frequency bands based at least in part upon the selected combination of time-frequency resolutions and the determined window size;

windowing the frame using the determined window size to produce a windowed frame;

transforming the windowed frame using the determined transform size to produce a transform of the windowed frame that has a corresponding time-frequency resolution at each of the multiple frequency bands of the frequency range;

modifying a time-frequency resolution within at least one frequency band of the transform of the windowed frame based at least in part upon the determined modification transformation.

2. The method of claim 1 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients;

wherein the combination of time-frequency resolutions selected to represent the frame includes for each of the multiple frequency bands a subset of each corresponding set of coefficients; and

wherein the computed corresponding measures of coding efficiency provide measures of coding efficiency of the corresponding subsets of coefficients.

3. The method of claim 2 ,

wherein computing measures of coding efficiency includes computing measures based upon a combination of data rate and error rate.

4. The method of claim 2 ,

wherein computing measures of coding efficiency includes computing measures based upon the sparsity of the coefficients.

5. The method of claim 1 ,

wherein determining the modification transformation for the at least one of the frequency bands includes determining based at least in part upon a difference between a time-frequency resolution selected to represent the frame in the at least one of the frequency bands and a time-frequency resolution corresponding to the determined window size.

6. The method of claim 1 ,

wherein modifying the time-frequency resolution within the at least one frequency band of the transform of the windowed frame includes modifying the time-frequency resolution within at least one frequency band of the transform of the windowed frame to match a time-frequency resolution selected to represent the frame in the at least one of the frequency bands.

7. The method of claim 1 ,

wherein determining the modification transformation for the at least one of the frequency bands includes determining based at least in part upon a difference between a time-frequency resolution selected to represent the frame in the at least one of the frequency bands and a time-frequency resolution corresponding to the determined window size; and

wherein modifying the time-frequency resolution within the at least one frequency band of the transform of the windowed frame includes modifying a time-frequency resolution within the at least one frequency band of the transform of the windowed frame to match the time-frequency resolution selected to represent the frame in the at least one of the frequency bands.

8. The method of claim 1 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients; further including:

grouping each corresponding set of coefficients into corresponding subsets of coefficients for each of the multiple frequency bands;

wherein computing the measures of coding efficiency for the multiple frequency bands includes determining respective measures of coding efficiency for multiple respective combinations of subsets of coefficients, each respective combination of coefficients having a subset of coefficients from each set of corresponding coefficients in each frequency band.

9. The method of claim 8 ,

wherein selecting the combination of time-frequency resolutions includes comparing the determined respective measures of coding efficiency for multiple respective combinations of subsets of coefficients.

10. The method of claim 1 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients; further including:

grouping each corresponding set of coefficients into corresponding subsets of coefficients for each of the multiple frequency bands;

wherein computing a measure of coding efficiency for the multiple frequency bands includes using a trellis structure to compute the measures of coding efficiency, wherein a node of the trellis structure corresponds to one of the subsets of coefficients and a column of the trellis structure corresponds to one of the multiple frequency bands.

11. The method of claim 10 ,

wherein respective measures of coding efficiency include respective transition costs associated with respective transition paths between nodes in different columns of the trellis structure.

12. An audio encoder comprising:

at least one processor;

one or more computer-readable mediums storing instructions that, when executed by the at least one processor, cause the audio encoder to perform operations comprising:

applying multiple different time-frequency transforms to a frame to produce multiple transforms of the frame, each of the multiple transforms of the frame that are produced having a corresponding time-frequency resolution for a time span of the frame and a frequency range;

determining multiple frequency bands within the frequency range of the multiple transforms of the frame;

computing a measure of coding efficiency for each of the multiple frequency bands for each of the multiple transforms of the frame;

selecting a combination of time-frequency resolutions to represent the frame at each of the multiple frequency bands, based at least in part upon the computed measures of coding efficiency;

determining a window size and a corresponding transform size for the frame, based at least in part upon the selected combination of time-frequency resolutions;

determining a modification transformation for at least one of the frequency bands based at least in part upon the selected combination of time-frequency resolutions and the determined window size;

windowing the frame using the determined window size to produce a windowed frame;

transforming the windowed frame using the determined transform size to produce a transform of the windowed frame that has a corresponding time-frequency resolution at each of the multiple frequency bands of the frequency range;

modifying a time-frequency resolution within at least one frequency band of the transform of the windowed frame based at least in part upon the determined modification transformation.

13. The encoder of claim 12 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients;

wherein the combination of time-frequency resolutions selected to represent the frame includes for each of the multiple frequency bands a subset of each corresponding set of coefficients; and

wherein the computed corresponding measures of coding efficiency provide measures of coding efficiency of the corresponding subsets of coefficients.

14. The encoder of claim 12 ,

wherein determining the modification transformation for at least one of the frequency bands includes determining based at least in part upon a difference between a time-frequency resolution selected to represent the frame in at least one of the frequency bands and a time-frequency resolution corresponding to the determined window size; and

wherein modifying the time-frequency resolution within the at least one frequency band of the transform of the windowed frame includes modifying a time-frequency resolution within the at least one frequency band of the transform of the windowed frame to match the time-frequency resolution selected to represent the frame in at least one of the frequency bands.

15. The encoder of claim 12 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients; further including:

grouping each corresponding set of coefficients into corresponding subsets of coefficients for each of the multiple frequency bands;

wherein computing the measures of coding efficiency for the multiple frequency bands includes determining respective measures of coding efficiency for multiple respective combinations of subsets of coefficients, each respective combination of coefficients having a subset of coefficients from each set of corresponding coefficients in each frequency band.

16. The encoder of claim 12 ,

wherein each corresponding time-frequency resolution corresponds to a corresponding set of coefficients; further including:

grouping each corresponding set of coefficients into corresponding subsets of coefficients for each of the multiple frequency bands;

wherein computing a measure of coding efficiency for the multiple frequency bands includes using a trellis structure to compute the measures of coding efficiency, wherein a node of the trellis structure corresponds to one of the subsets of coefficients and a column of the trellis structure corresponds to one of the multiple frequency bands.

17. The encoder of claim 16 ,

wherein respective measures of coding efficiency include respective transition costs associated with respective transition paths between nodes in different columns of the trellis structure.