Method and system for memory usage in real-time audio systems
View Patent ↗System and method for encoding, transmitting and decoding audio data. Audio bit steam syntax is re-organized to allow system optimizations that work well with memory latency and memory burst operations. Multiple small entropy coding tables are stored in RAM and loaded to on-chip memory as needed. Audio prediction is pipelined in the bitstream syntax. Intra frames, independent of other frames in the bitstream, are included in the bitstream for error recovery and channel change. New algorithms are implemented in legacy syntax by including the new information in the user data space of the audio frame. The new decoder can use projection to determine where the new information is and read ahead in the stream. Audio prediction from the immediately previous frame is restricted. Audio prediction is performed across channels within a single audio frame. A variable re-order function comprises storing channels of data to DRAM in the order they are decoded and reading them out in presentation order.
1. A method of transmitting media data, comprising:
determining, with a processing circuit, a difference value between a first media clip and a previous media clip;
transmitting a reference to a group of codes for decoding;
transmitting a reference to the previous media clip; and
after transmitting the reference to the group of codes for decoding and the reference to the previous media clip, transmitting the difference value.
2. The method of claim 1 wherein:
the reference to the group of codes for decoding, the reference to the previous media clip, and the difference value are transmitted in a media data frame; and
the reference to the group of codes for decoding and the reference to the previous media clip are positioned ahead of the difference value in the frame.
3. The method of claim 1 wherein:
the reference to the previous media clip is transmitted in a first media data frame and the difference value is transmitted in a second media data frame; and
the first frame is transmitted before the second frame.
4. The method of claim 1 wherein the first media clip and the previous media clip comprise clips of audio data.
5. A method of decoding media data, comprising:
receiving a reference to a group of codes for decoding;
receiving a reference to a previous media clip;
retrieving data corresponding to the group of codes for decoding from memory;
retrieving data corresponding to the previous media clip from the memory;
after receiving the reference to the group of codes for decoding and the reference to the previous media clip, receiving difference data corresponding to a first media clip;
decoding, with a processing circuit, the difference data into decoded difference data, at least a portion of the decoding occurring substantially in parallel with at least a portion of the retrieving data corresponding to the previous media clip; and
adding the data corresponding to the previous media clip to the decoded difference data to produce a decoded value corresponding to the first media clip.
6. The method of claim 5 wherein:
the adding is performed by the processing circuit; and
the memory from which the data corresponding to the previous media clip is retrieved comprises an external memory to the processing circuit.
7. The method of claim 6 wherein the external memory comprises DRAM.
8. The method of claim 5 wherein the first media clip and the previous media clip comprise clips of audio data.
9. The method of claim 5 wherein the decoding comprises decoding the difference data into the decoded difference data using the data corresponding to the group of codes for decoding.
10. A method of transmitting audio data, comprising:
determining, with a processing circuit, a difference value between a first audio clip of a first audio channel and a previous audio clip of a second audio channel;
transmitting a reference to a group of codes for decoding;
transmitting a reference to the previous audio clip of the second audio channel; and
transmitting the difference value.
11. A method of decoding a first audio clip of a first audio channel, comprising:
receiving a reference to a group of codes for decoding;
receiving a reference to a previous audio clip of a second audio channel;
receiving difference data indicating a difference value between a first audio clip of a first audio channel and the previous audio clip of the second audio channel;
retrieving data corresponding to the group of codes for decoding from memory;
retrieving data corresponding to the previous audio clip from the memory;
decoding, with a processing circuit, the difference data into decoded difference data; and
adding the data corresponding to the previous audio clip to the decoded difference data to produce a decoded value corresponding to the first audio clip.
12. The method of claim 11 wherein the decoding comprises decoding the difference data into the decoded difference data using the data corresponding to the group of codes for decoding.
13. The method of claim 11 wherein the first audio clip is received in a first audio data frame and the previous audio clip is received in a previous audio data frame.
14. A method of transmitting audio data, comprising:
determining, by a processing circuit, a difference value between a first audio clip of a first audio channel and a second audio clip of a second audio channel, the first and second audio clips being part of a single audio data frame;
transmitting a reference to a group of codes for decoding;
transmitting a reference to the second audio clip of the second audio channel; and
transmitting the difference value.
15. A method of decoding a first audio clip of a first audio channel, comprising:
receiving a reference to a group of codes for decoding;
receiving a reference to a second audio clip of a second audio channel, the first and second audio clips being part of a single audio data frame;
receiving difference data indicating a difference value between the first audio clip and the second audio clip;
retrieving data corresponding to the group of codes for decoding from memory;
retrieving data corresponding to the second audio clip from the memory;
decoding, with a processing circuit, the difference data into decoded difference data; and
adding the data corresponding to the second audio clip to the decoded difference data to produce a decoded value corresponding to the first audio clip.
16. The method of claim 15 wherein the decoding comprises decoding the difference data into the decoded difference data using the data corresponding to the group of codes for decoding.