Video encoding and video/audio/data multiplexing device
View Patent ↗A buffer architecture and latency reduction mechanism for buffering uncompressed/compressed information. This combination provides for a proficient division of the encoding task and quicker through-put time. The invention teaches a single chip digital signal processing device for real time video/audio compression comprising a plurality of processors, including a video input processor, a motion estimation processor, a digital signal processor, and a bitstream processor, wherein processing and transfer of the signals within the device is done in a macroblock-by-macroblock manner. The device can include a multiplexing processor that is comprised of a storage unit which buffers a compressed video bitstream and a processor which retrieves the compressed video bitstream from the storage unit and produces a multiplexed data stream whereby the compressed video bitstream is processed in a pipeline manner.
1. A single chip digital signal processing device for real time video/audio compression, the device comprising:
a video input processor which receives, analyzes, scales and processes video data;
a motion estimation processor which receives video data that has been processed by the video input processor and produces a motion analysis therefrom;
a digital signal processor which, according to said motion analysis, compresses video data that has been processed by the video input processor;
a bitstream processor which formats video data that has been compressed by the digital signal processor to produce a video bitstream; and
a multiplexing processor which multiplexes said video bitstream with a second bitstream to produce a multiplexed data stream;
wherein said motion estimation processor operates on macroblock a of frame I, said digital signal processor operates on macroblock b of frame I, said bitstream processor operates on macroblock c of frame I, and said multiplexing processor operates on frame J concurrently, wherein a≧b≧c, and I≧J.
2. A device according to claim 1 , further comprising:
a global controller which controls and schedules said video input processor, said motion estimation processor, said digital signal processor, said bitstream processor, and said multiplexing processor.
3. A device according to claim 1 , wherein said motion estimation processor, said digital signal processor, said video input processor, said bitstream processor and said multiplexing processor operate in parallel.
4. A device according to claim 1 , wherein said motion estimation processor operates on macroblock a of frame I, said digital signal processor operates on macroblock b of frame I, said bitstream processor operates on macroblock c of frame I, said multiplexing processor operates on frame J, and said video input processor operates on frame K concurrently, wherein K≧I≧J.
5. A device according to claim 1 , wherein said second bitstream comprises at least one of an audio bitstream and a user data bitstream.
6. A single chip digital signal processing device for real time video/audio compression, the device comprising:
a video input processor which receives, analyzes, scales and processes video data;
a motion estimation processor which receives video data that has been processed by the video input processor and produces a motion analysis therefrom;
a digital signal processor which, according to said motion analysis, compresses video data that has been processed by the video input processor;
a bitstream processor which formats video data that has been compressed by the digital signal processor to produce a video bitstream; and
a multiplexing processor which multiplexes said video bitstream with a second bitstream to produce a multiplexed data stream, wherein, said multiplexing processor comprises:
a first video storage which buffers said video bitstream, and which transfers said video bitstream to said external memory unit, thereby adjusting between an internal multiplexor processing rate and an external communication rate;
a second video storage which reads from said memory unit said video bitstream, and which buffers said video bitstream, thereby adjusting between said external communication rate and said multiplexor processing rate;
an audio/data storage which buffers an audio/data bitstream and which transfers said audio/data bitstream to a processor, thereby adjusting between an external audio rate and said multiplexor processing rate;
said processor being connected to said first and second video storage and said audio/data storage, and producing a multiplexed video/audio/data stream; and
an output storage which buffers said multiplexed video/audio/data stream, thereby adjusting between a multiplexed video/audio/data stream rate and an external communication rate.
7. A single chip digital signal processing device for real time video/audio compression, said device comprising:
a video input processor which receives, analyzes, scales and processes video data;
a motion estimation processor which receives video data that has been processed by the video input processor and produces a motion analysis therefrom;
a digital signal processor which, according to said motion analysis, compresses video data that has been processed by the video input processor; and
a bitstream processor which formats video data that has been compressed by the digital signal processor to produce a video bitstream;
wherein said motion estimation processor operates on macroblock a of frame I, said digital signal processor operates on macroblock b of frame I, and said bitstream processor operates on macroblock c of frame I concurrently, wherein a≧b≧c.
8. A device according to claim 7 , wherein said motion estimation processor operates on macroblock a of frame I, said digital signal processor operates on macroblock b of frame I, said bitstream processor operates on macroblock c of frame I, and said video input processor operates on frame K concurrently, wherein K≧I.