Hybrid video encoder including real-time and off-line video encoders
View Patent ↗A method and apparatus is provided for encoding a video signal stream. The method includes receiving a video signal stream, identifying a plurality of individual segments within the video signal stream and encoding, off-line, recurring ones of the individual segments that recur with at least a first frequency to produce encoded recurring segments. The video signal stream is also encoded in real-time to generate a real-time encoded video stream. Segments in the real-time encoded video stream are replaced with their corresponding encoded recurring segments to thereby produce an encoded video output stream that includes some segments encoded in real-time and other segments encoded off-line.
1. A method of encoding a video signal stream, comprising:
receiving a video signal stream;
identifying a plurality of individual segments within the video signal stream;
encoding off-line recurring ones of the individual segments that recur with at least a first frequency to produce encoded recurring segments;
encoding the video signal stream in real-time to generate a real-time encoded video stream, wherein during encoding the video signal stream in real-time, performing:
comparing segments in the real-time encoded video stream with encoded recurring segments to determine if any encoded recurring segments correspond with the segments in the real-time encoded video; and
replacing segments in the real-time encoded video stream with their corresponding encoded recurring segments to thereby produce an encoded video output stream that includes some segments encoded in real-time and other segments encoded off-line.
2. The method of claim 1 wherein the individual segments in the video signal stream are individual scenes.
3. The method of claim 1 wherein the individual segments in the video signal stream are picture slices.
4. The method of claim 2 wherein the individual scenes are identified by identifying scene changes separating temporally adjacent scenes.
5. A method of encoding a video signal stream, comprising:
receiving a video signal stream;
identifying a plurality of individual segments within the video signal stream;
assigning to each of the individual segments a digital word representative of the individual segment to which it is assigned;
encoding off-line recurring ones of the individual segments that recur with at least a first frequency to produce encoded recurring segments;
encoding the video signal stream in real-time to generate a real-time encoded video stream and
replacing segments in the real-time encoded video stream with their corresponding encoded recurring segments to thereby produce an encoded video output stream that includes some segments encoded in real-time and other segments encoded off-line.
6. The method of claim 5 further comprising comparing a first digital word assigned to a first segment with recurring digital words assigned to the encoded recurring segments.
7. The method of claim 6 wherein, if the first digital word matches a given recurring digital word assigned to a given encoded recurring segment, replacing the first segment with the given encoded recurring segment.
8. The method of claim 6 wherein, if the first digital word matches a given recurring digital word assigned to a given encoded recurring segment, decoding the given encoded recurring segment and comparing it to its corresponding segment in the video signal stream and, if the decoded given recurring segment matches the corresponding segment, replacing the first segment with the given encoded recurring segment.
9. At least one non-transitory computer-readable storage medium encoded with instructions which, when executed by a processor, performs a method including:
receiving a video signal stream having a plurality of video segments;
encoding the video signal stream in real-time, wherein during encoding the video signal stream in real-time, performing:
comparing frequently recurring video segments in the real-time encoded video stream with pre-encoded video segments to determine if any pre-encoded video segments correspond with the segments in the real-time encoded video; and
substituting frequently recurring video segments encoded using real-time encoding with corresponding pre-encoded video segments.
10. The non-transitory computer-readable medium of claim 9 wherein the corresponding pre-encoded video segments are encoded using off-line encoding.
11. The non-transitory computer-readable medium of claim 9 further comprising identifying the frequently recurring video segments by tabulating digital words assigned to each of the video segments.
12. The non-transitory computer-readable medium of claim 11 wherein comparing comprises identifying the corresponding pre-encoded video segments by comparing the digital words assigned to the video segments with the digital words assigned to the corresponding pre-encoded video segments.
13. The non-transitory computer-readable medium of claim 11 wherein comparing comprises identifying the corresponding pre-encoded video segments by first comparing the digital words assigned to the video segments with the digital words assigned to the corresponding pre-encoded video segments to identify a candidate video segment and a candidate corresponding pre-encoded video segment and then decoding the candidate corresponding pre-encoded video segment and comparing it to the candidate video segment on a pixel by pixel basis to thereby confirm that the two candidate segments represent the same video segment.
14. The non-transitory computer-readable medium of claim 9 further comprising dividing the video signal stream into the plurality of video segments by identifying scene changes arising in the video signal stream.
15. A video encoder arrangement, comprising:
a video segmentation module for segmenting an input video stream into a plurality of video segments;
a real-time video encoder for encoding the input video stream;
a processor configured to identify recurring video segments in the input video stream that recur with at least a first frequency;
an off-line video encoder for encoding the recurring video segments; and
wherein during encoding the input video stream using the real-time video encoder, the processor is further configured to:
compare segments in the input video stream with encoded recurring segments to determine if any encoded recurring segments correspond with the segments in the input video stream, and
replace segments in the input video stream encoded by the real-time encoder with corresponding ones of the encoded recurring segments.
16. The video encoder of claim 15 wherein the segments are scenes or picture slices.
17. The video encoder of claim 15 further comprising:
a storage medium for storing the encoded recurring segments; and
a segment comparator for comparing the video segments to the encoded recurring segments stored in the storage medium to thereby identify the corresponding ones of the encoded recurring segments.
18. The video encoder of claim 15 wherein the video segmentation module is configured to assign a digital identifier to each of the video segments and the segment comparator compares the digital identifiers assigned to the video segments to the digital identifiers assigned to the encoded recurring segments to identify candidate corresponding segments.
19. The video encoder of claim 18 further comprising a decoder for decoding the candidate corresponding segments and wherein the segment comparator is further configured to compare the decoded candidate corresponding segments to the video segments to confirm that the corresponding encoded recurring segments correctly match the video segments in the input video stream which they are replacing.
20. A video encoder arrangement, comprising:
a video segmentation module for segmenting an input video stream into a plurality of video segments;
a real-time video encoder for encoding the input video stream;
a processor configured to identify recurring video segments in the input video stream that recur with at least a first frequency;
an off-line video encoder for encoding the recurring video segments, wherein:
the processor is further configured to replace segments in the input video stream encoded by the real-time encoder with corresponding ones of the encoded recurring segments, and
the video segmentation module is configured to assign a digital identifier to each of the video segments and the segment comparator compares the digital identifiers assigned to the video segments to the digital identifiers assigned to the encoded recurring segments to identify the corresponding encoded recurring segments.