Multi-Level Video Processing Within A Vehicular Communication Network
A system for performing multi-level video processing within a vehicle includes a pre-processing module for determining an encoding mode and enabling one or more levels of encoding based on the encoding mode. The pre-processing module further receives a video stream from a camera attached to the vehicle via a vehicular communication network and encodes the video stream based on the encoding mode to produce a packet stream output. The system further includes a video decoder for receiving the packet stream output and decoding the packet stream output in accordance with the encoding mode to produce a decoded video output.
1 . A system for performing multi-level video processing within a vehicle, comprising:
a pre-processing module for determining an encoding mode and enabling one or more levels of encoding based on the encoding mode, the pre-processing module further for receiving a video stream from a camera attached to the vehicle via a vehicular communication network and encoding the video stream based on the encoding mode to produce a packet stream output; and
a video decoder for receiving the packet stream output and decoding the packet stream output in accordance with the encoding mode to produce a decoded video output.
2 . The system of claim 1 , wherein the pre-processing module comprises:
a first level encoding module for performing a base layer encoding of the video stream to produce a first level encoded video stream with low latency;
a second level encoding module for performing spatial scaling encoding on the video stream based on the base layer encoding of the first level encoding module to produce a second level encoded video stream;
a third level encoding module for performing quality scaling encoding on the video stream based on the base layer encoding of the first level encoding module and the spatial scaling encoding of the second level encoding module to produce a third level encoded video stream; and
a packetizing module for receiving and packetizing the first level encoded video stream, the second level encoded video stream and the third level encoded video stream to produce a packet stream output;
wherein at least one of the first level encoding module, the second level encoding module and the third level encoding module is enabled based on the encoding mode.
3 . The system of claim 2 , wherein the pre-processing module further comprises:
at least one of:
a first low latency sub-sampling module for sampling the video stream at a first rate to produce a sub-sampled video stream provided to the first level encoding module; and
a second low latency sub-sampling module for sampling the video stream at a second rate higher than the first rate to produce a second sub-sampled video stream provided to the second level encoding module.
4 . The system of claim 2 , further comprising:
a processing module for generating a control signal that indicates the encoding mode to the pre-processing module.
5 . The system of claim 4 , wherein the control signal further adjusts characteristics of one or more of the first level encoding module, the second level encoding module, the third level encoding module and the packetizing module.
6 . The system of claim 4 , wherein the processing module generates the control signal based on at least one of a mode of operation, packet content, a vehicle status and an availability of network resources of the vehicular communication network.
7 . The system of claim 2 , wherein the packetizing module prioritizes output of packets from the first level encoded video stream into the packet stream output.
8 . The system of claim 7 , wherein the packetizing module output packets from the first level encoded video stream, second level encoded video stream and third level encoded video stream in a serial manner with the packets from the first level encoded video stream having priority over the packets from the second level encoded video stream and the third level encoded video stream to produce the packet stream output.
9 . The system of claim 2 , wherein the video decoder further comprises:
a de-packetizing module for receiving the packet stream output and separating the packet stream output into first level encoded packets, second level encoded packets and third level encoded packets;
a first level decoding module for receiving the first level encoded packets and decoding the first level encoded packets to produce a first level decoded video signal;
a second level decoding module for receiving the second level encoded packets and decoding the second level encoded packets to produce a second level decoded video signal;
a third level decoding module for receiving the third level encoded packets and decoding the third level encoded packets to produce a third level decoded video signal; and
a video output module for receiving and outputting at least one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal based on the encoding mode to produce the decoded video output.
10 . The system of claim 9 , further comprising:
a processing module for generating a control signal that indicates the encoding mode to the video decoder.
11 . The system of claim 10 , wherein the control signal further indicates a particular one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal to output as the decoded video output.
12 . The system of claim 10 , wherein the control signal instructs the video output module to output the first level decoded video signal as the decoded video output, and further comprising:
a video safety monitoring module for receiving the output video signal and processing the decoded video output to determine whether criteria for detecting a safety issue are met, and if so, generating a safety command.
13 . The system of claim 10 , wherein the control signal instructs the video output module to output at least one of the second level decoded video signal and the third level decoded video signal as the decoded video output, and further comprising:
a user display for receiving the decoded video output and displaying the decoded video output thereon.
14 . A pre-processing module for performing multi-level video processing within a vehicle, comprising:
a first level encoding module for performing a base layer encoding of a video stream received from a camera attached to the vehicle via a vehicular communication network to produce a first level encoded video stream with low latency;
a second level encoding module for performing spatial scaling encoding on the video stream based on the base layer encoding of the first level encoding module to produce a second level encoded video stream;
a third level encoding module for performing quality scaling encoding on the video stream based on the base layer encoding of the first level encoding module and the spatial scaling encoding of the second level encoding module to produce a third level encoded video stream; and
a packetizing module for receiving and packetizing the first level encoded video stream, the second level encoded video stream and the third level encoded video stream to produce a packet stream output;
wherein at least one of the first level encoding module, the second level encoding module and the third level encoding module is enabled based on an encoding mode.
15 . The pre-processing module of claim 14 , further comprising:
at least one of:
a first low latency sub-sampling module for sampling the video stream at a first rate to produce a sub-sampled video stream provided to the first level encoding module; and
a second low latency sub-sampling module for sampling the video stream at a second rate higher than the first rate to produce a second sub-sampled video stream provided to the second level encoding module.
16 . The pre-processing module of claim 14 , wherein the packetizing module prioritizes output of packets from the first level encoded video stream into the packet stream output.
17 . The pre-processing module of claim 16 , wherein the packetizing module outputs packets from the first level encoded video stream, the second level encoded video stream and the third level encoded video stream in a serial manner with the packets from the first level encoded video stream having priority over the packets from the second level encoded video stream and the third level encoded video stream to produce the packet stream output.
18 . A video decoder for performing multi-level video processing within a vehicle, comprising:
a de-packetizing module for receiving a packet stream output representing a video stream captured by a camera attached to the vehicle via a vehicular communication network, the de-packetizing module further for separating the packet stream output into first level encoded packets, second level encoded packets and third level encoded packets;
a first level decoding module for receiving the first level encoded packets and decoding the first level encoded packets to produce a first level decoded video signal;
a second level decoding module for receiving the second level encoded packets and decoding the second level encoded packets to produce a second level decoded video signal;
a third level decoding module for receiving the third level encoded packets and decoding the third level encoded packets to produce a third level decoded video signal; and
a video output module for receiving and outputting at least one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal based on a control signal to produce a decoded video output.
19 . The video decoder of claim 18 , wherein the control signal further indicates a particular one of the first level decoded video signal, the second level decoded video signal and the third level decoded video signal to output as the decoded video output.
20 . The video decoder of claim 19 , wherein the control signal is generated based on at least one of a mode of operation, packet content, a vehicle status and an availability of network resources of the vehicular communication network.