Using motion compensated temporal filter (MCTF) statistics for scene change detection when a fade, dissolve or cut occurs
A method is provided to better detect a scene change to provide a prediction to an encoder to enable more efficient encoding. The method uses a Motion Compensated Temporal Filter (MCTF) that provides motion estimation and is located prior to an encoder. The MCTF provides a Motion Compensated Residual (MCR) used to detect the scene change transition. When a scene is relatively stable, the MCR score is also relatively stable. However, when a scene transition is in process, the MCR score behavior changes, Algorithmically, the MCR score is used by comparing the sliding mean of the MCR score to the sliding median. This comparison highlights the transition points. In the case of a scene cut, the MCR score exhibits a distinct spike. In the case of a fade or dissolve, the MCR score exhibits a transitional period of degradation followed by recovery. By implementing the above detection using the MCR, the location of the I-pictures in the downstream encoding process can be accurately determined for the encoder.
1. A method for encoding video using scene change detection, the method comprising:
determining a sliding MCR score using a motion compensated residual (MCR) for video frames provided to an encoder; and
providing a prediction of when a scene change occurs to the encoder based on a regression of the MCR score and a comparison of the sliding MCR score to a sliding mean of the MCR score.
2. The method of claim 1 , wherein the MCR score is provided from a Motion Compensated Temporal Filter (MCTF) that provides pre-processing prior to encoding to perform motion estimation as well as motion compensation prediction on temporally sequential pictures of the video frames.
3. The method of claim 1 , wherein the scene change comprises at least one of a fade, a dissolve or a scene cut.
4. The method of claim 1 , wherein when the scene change comprises a scene cut, the MCR score exhibits a spike.
5. The method of claim 1 , wherein when the scene change comprises a fade or a dissolve, the MCR score exhibits a transitional period of degradation followed by a recovery.
6. The method of claim 1 , wherein the prediction of when a scene change occurs identifies the transition terminals at the beginning and the end of the scene change.
7. The method of claim 1 further comprising placing an I-frame during the encoding process at a point where the scene change occurs.
8. An apparatus configured to receive video frames to be processed and to receive parameter data to allocate bits for encoding the video frames, the apparatus comprising:
a frame buffer;
a MCTF statistical analyzer that provides a Motion Compensated Residual (MCR) using the video frames from the frame buffer; and
an encoder configured to:
determine a sliding MCR score using the MCR; and
provide a prediction of when a scene change occurs to the encoder based on a regression of the MCR score and a comparison of the sliding MCR score to a sliding mean of the MCR score.
9. The apparatus of claim 8 , wherein the MCR score is provided from a Motion Compensated Temporal Filter (MCTF) that provides pre-processing prior to encoding to perform motion estimation as well as motion compensation prediction on temporally sequential pictures of the video frames.
10. The apparatus of claim 8 , wherein the scene change comprises at least one of a fade, a dissolve or a scene cut.
11. The apparatus of claim 8 , wherein when the scene change comprises a scene cut, the MCR score exhibits a spike.
12. The apparatus of claim 8 , wherein when the scene change comprises a fade or a dissolve, the MCR score exhibits a transitional period of degradation followed by a recovery.
13. The apparatus of claim 8 , wherein the prediction of when a scene change occurs identifies the transition terminals at the beginning and the end of the scene change.
14. The apparatus of claim 8 further comprising placing an I-frame during the encoding process at a point where the scene change occurs.
15. The apparatus of claim 8 , wherein the encoder is a two path device with the MCTF statistical analysis module processor provided in a first path and the encoder provided in the second path.