System and method for providing audio in a media file
View Patent ↗A system and method adds audio to a media file. The audio may be received via one or more files in an uncompressed format, a compressed format or both types of files may be received. The system and method can mix multiple sources, and converts the audio received into a compressed version in a manner that facilitates streaming.
1. A computer-implemented method comprising:
identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;
determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;
mixing the first audio clip and the second audio clip to generate a combined audio clip; and
storing the combined audio clip and the graphics frame in a media file.
2. The computer-implemented method of claim 1 , further comprising:
determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and
converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.
3. The computer-implemented method of claim 1 , further comprising:
extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.
4. The computer-implemented method of claim 3 , wherein the first audio source file comprises a streaming file.
5. The computer-implemented method of claim 1 , further comprising compressing the combined audio clip.
6. The computer-implemented method of claim 1 , wherein the media file is stored in a streaming format on a streaming media server.
7. The computer-implemented method of claim 1 , wherein mixing the first audio clip and the second audio clip further comprises:
averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.
8. The computer-implemented method of claim 1 , wherein the combined audio clip comprises a header and an audio data field.
9. The computer-implemented method of claim 8 , wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.
10. A computer program product on a computer readable medium for generating a media file, the computer program product comprising instructions operable to cause data processing apparatus to perform operations comprising:
identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;
determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;
mixing the first audio clip and the second audio clip to generate a combined audio clip; and
storing the combined audio clip and the graphics frame in a media file.
11. The computer program product of claim 10 , further comprising:
determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and
converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.
12. The computer program product of claim 10 , further comprising:
extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.
13. The computer program product of claim 12 , wherein the first audio source file comprises a streaming file.
14. The computer program product of claim 10 , further comprising compressing the combined audio clip.
15. The computer program product of claim 10 , wherein the media file is stored in a streaming format on a streaming media server.
16. The computer program product of claim 10 , wherein mixing the first audio clip and the second audio clip further comprises:
averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.
17. The computer program product of claim 10 , wherein the combined audio clip comprises a header and an audio data field.
18. The computer program product of claim 17 , wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.
19. A system comprising:
a storage device configured to store a plurality of files; and
processor electronics configured to perform operations comprising:
identifying a first audio clip and a second audio clip, wherein the first audio clip and the second audio clip are associated with a graphics frame;
determining that at least a portion of the first audio clip and at least a portion of the second audio clip are to be played simultaneously with respect to the graphics frame;
mixing the first audio clip and the second audio clip to generate a combined audio clip; and
storing the combined audio clip and the graphics frame in a media file.
20. The system of claim 19 , wherein the processor electronics are further configured to perform operations comprising:
determining that at least one of the first audio clip and the second audio clip comprises a compressed audio clip; and
converting each compressed audio clip to a common format prior to mixing the first audio clip and the second audio clip.
21. The system of claim 19 , wherein the processor electronics are further configured to perform operations comprising:
extracting the first audio clip from a first audio source file, wherein the extracted first audio clip corresponds temporally to the graphics frame.
22. The system of claim 21 , wherein the first audio source file comprises a streaming file.
23. The system of claim 19 , wherein the processor electronics are further configured to perform operations comprising compressing the combined audio clip.
24. The system of claim 19 , wherein the processor electronics are further configured to perform operations comprising storing the media file in a streaming format on a streaming media server.
25. The system of claim 19 , wherein the processor electronics are further configured to perform operations comprising:
mixing the first audio clip and the second audio clip by averaging one or more sample values of the first audio clip with one or more corresponding sample values of the second audio clip.
26. The system of claim 19 , wherein the combined audio clip comprises a header and an audio data field.
27. The system of claim 26 , wherein the header includes a first field indicating a total number of samples included in the combined audio clip and a second field indicating a first audio sample associated with the graphics frame.