Applying different motion blur parameters to spatial frame regions within a sequence of image frames
View Patent ↗First and second spatial frame regions are identified in a sequence of motion picture image frames captured at a high frame rate. Different motion blur parameters are determined for each of the first and second spatial frame regions. First and second intermediate frame sequences having frame rates less than the capture frame rate are generated from the original frame sequence. The first motion blur parameter is applied to the first intermediate frame sequence and the second motion blur parameter is applied to the second intermediate frame sequence. The first and second spatial frame regions in the corresponding first and second intermediate frame sequences are composited to produce an output frame sequence having different motion blur in different regions of the scene.
1. A method of processing a sequence of image frames captured at a capture frame rate, the method comprising:
receiving the sequence of image frames captured at the capture frame rate;
identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames;
reducing the frame rate of the first spatial frame region in the sequence of image frames;
applying a first motion blur parameter to the first spatial frame region in the sequence of image frames;
identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames, the second subset different from the first subset;
reducing the frame rate of the second spatial frame region in the sequence of image frames; and
applying a second motion blur parameter to the second spatial frame region in the sequence of image frames, the second motion blur parameter different from the first motion blur parameter.
2. A system for processing a sequence of image frames captured at a capture frame rate, the system comprising one or more processors configured to perform the method of claim 1 .
3. A computer program product for processing a sequence of image frames captured at a capture frame rate, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 1 .
4. A method of processing a sequence of image frames, the method comprising:
receiving the sequence of image frames captured at a capture frame rate;
identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames;
generating a plurality of intermediate frame sequences from the sequence of image frames;
applying a first motion blur parameter to a first intermediate frame sequence; and
after applying the first motion blur parameter to the first intermediate frame sequence, compositing the first spatial frame region of the first intermediate frame sequence with a different intermediate frame sequence.
5. The method of claim 4 , wherein generating the first intermediate frame sequence comprises reducing the frame rate of the sequence of image frames.
6. The method of claim 4 , wherein the applying the first motion blur parameter to the first intermediate frame sequence comprises applying the first motion blur parameter to the first spatial frame region of the first intermediate frame sequence.
7. The method of claim 4 , further comprising:
identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames, the second subset different from the first subset, wherein the different intermediate frame sequence is the second spatial frame region of a second intermediate frame sequence.
8. The method of claim 7 , further comprising:
before the compositing, applying a second motion blur parameter to the second intermediate frame sequence.
9. The method of claim 8 , wherein the applying the second motion blur parameter to the second intermediate frame sequence comprises applying the second motion blur parameter to the second spatial frame region of the second intermediate frame sequence.
10. The method of claim 7 , further comprising:
identifying a third spatial frame region for the image frames in the sequence of image frames, the third spatial frame region being a third subset of image information in the image frames, the third subset different from the first subset, and the third subset different from the second subset; and
further compositing the third spatial frame region of a third intermediate frame sequence with the first spatial frame region of the first intermediate frame sequence and the second spatial frame region of the second intermediate frame sequence.
11. The method of claim 7 , wherein the generating the second intermediate frame sequence comprises reducing the frame rate of the sequence of image frames.
12. The method of claim 7 , wherein the first intermediate frame sequence has a first frame rate and first image content, wherein the second intermediate frame sequence has a second frame rate and second image content, wherein the first frame rate is the same as the second frame rate, and wherein the first image content and the second image content are substantially identical.
13. A system for processing a sequence of image frames, the system comprising one or more processors configured to perform the method of claim 4 .
14. A computer program product for processing a sequence of image frames, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 4 .
15. A method of processing a sequence of image frames captured at a capture frame rate, the method comprising:
receiving the sequence of image frames;
identifying a first spatial frame region for the image frames in the sequence of image frames, the first spatial frame region being a first subset of image information in the image frames;
determining a first motion blur parameter for the first spatial frame region;
identifying a second spatial frame region for the image frames in the sequence of image frames, the second spatial frame region being a second subset of image information in the image frames different from the first subset;
determining a second motion blur parameter for the second spatial frame region different from the first motion blur parameter;
generating a first intermediate frame sequence from the sequence of image frames, the first intermediate frame sequence having an output frame rate less than the capture frame rate;
applying the first motion blur parameter to the first intermediate frame sequence;
generating a second intermediate frame sequence from the sequence of image frames, the second intermediate frame sequence having the output frame rate;
applying the second motion blur parameter to the second intermediate frame sequence; and
for each image frame in the first intermediate frame sequence, compositing the first spatial frame region of the image frame in the first intermediate frame sequence with the second spatial frame region of the corresponding image frame in the second intermediate frame sequence.
16. A system for processing a sequence of image frames, the system comprising one or more processors configured to perform the method of claim 15 .
17. A computer program product for processing a sequence of image frames, the computer program product comprising a non-transitory computer-readable storage medium having computer-readable program instructions thereon for causing at least one processor to perform the method of claim 15 .