System, method, and apparatus for providing improved high definition video from upsampled standard definition video
View Patent ↗Presented herein are system(s), method(s), and apparatus for providing high resolution frames. In one embodiment, there is a method comprising receiving upscaled frames; motion estimating the upscaled frames; and motion compensating the upscaled frames.
1. A method, comprising:
receiving frames;
determining whether the frames correspond to upscaled frames; and
in response to determining that the frames correspond to upscaled frames:
motion estimating the upscaled frames; and
motion compensating the upscaled frames,
wherein motion estimating the upscaled frames comprises:
generating first motion vectors by motion estimating between an upscaled frame and a first frame that is adiacent in time to the upscaled frame;
generating second motion vectors by motion estimating between the first frame and a second frame that is adiacent in time to the first frame; and
estimating motion on the upscaled frame and the first frame by combining at least one of the first motion vectors with another motion vector that is based at least in part on at least one of the second motion vectors.
2. The method of claim 1 , wherein determining whether the frames correspond to the upscaled frames further comprises estimating a kernel used in a spatial interpolation to upscale the frames.
3. The method of claim 1 , wherein determining whether the frames correspond to the upscaled frames further comprises estimating at least one of: a scaling ratio or a scaling offset used in a spatial interpolation to upscale the frames.
4. The method of claim 1 , wherein motion compensating the upscaled frames further comprises at least one of: performing motion-compensated back projection or performing motion-free back projection.
5. The method of claim 1 , further comprising downscaling the upscaled frames to an original resolution, wherein the motion estimating and the motion compensating are performed on the upscaled frames that have been downscaled to the original resolution.
6. The method of claim 1 , wherein motion compensating the upscaled frames comprises:
generating an updated frame by motion compensating one of the upscaled frames with frames that are proximate to the one of the upscaled frames; and
changing pixels in the updated frame based at least in part on the one of the upscaled frames.
7. The method of claim 6 , wherein motion compensating the one of the upscaled frames with the frames that are proximate to the one of the upscaled frames further comprises simulating lower resolution pixels for the one of the upscaled frames and lower resolution pixels for the frames that are proximate to the one of the upscaled frames.
8. The method of claim 7 , wherein simulating lower resolution pixels further comprises applying a point spread function.
9. A system including circuitry, the circuitry comprising:
an input configured to receive upscaled frames;
a downsampler configured to downsample the upscaled frames to a predetermined lower resolution;
an upsampler configured to upsample the downsampled frames to a predetermined higher resolution;
a motion estimator configured to motion estimate the upsampled frames produced by the upsampler; and
a motion compensator configured to motion compensate the upsampled frames produced by the upsampler,
wherein motion estimating the upsampled frames comprises:
generating first motion vectors by motion estimating between an upsampled frame and a first frame that is adiacent in time to the upsampled frame;
generating second motion vectors by motion estimating between the first frame and a second frame that is adiacent in time to the first frame; and
estimating motion on the upsampled frame and the first frame by combining at least one of the first motion vectors with another motion vector that is based at least in part on at least one of the second motion vectors.
10. The system of claim 9 , wherein the predetermined resolution corresponds to the resolution of the frames received by the input.
11. The system of claim 9 , wherein the motion compensator is configured to perform at least one of: motion-compensated back projection or motion-free back projection.
12. The system of claim 9 , wherein the circuitry further comprises a kernel estimator for estimating a kernel used in a spatial interpolation to upscale the upscaled frames.
13. The system of claim 9 , wherein motion compensating the upsampled frames at the predetermined high resolution comprises:
generating an updated frame by motion compensating an upsampled frame at the predetermined high resolution with frames that are proximate to the upsampled frame; and
changing pixels in the updated frame based at least in part on the upsampled frame at the predetermined higher resolution.
14. A system, comprising:
circuitry capable of:
receiving frames;
generating upsampled frames by upsampling the frames to a higher resolution, wherein
the higher resolution is an integer factor higher than a resolution of the frames;
motion estimating the upsampled frames;
motion compensating the upsampled frames; and
downsampling the motion compensated upsampled frames to a predetermined resolution,
wherein motion estimating the upsampled frames comprises:
generating first motion vectors by motion estimating between an upsampled frame and a first frame that is adiacent in time to the upsampled frame;
generating second motion vectors by motion estimating between the first frame and a second frame that is adiacent in time to the first frame; and
estimating motion on the upsampled frame and the first frame by combining at least one of the first motion vectors with another motion vector that is based at least in part on at least one of the second motion vectors.
15. The system of claim 14 , wherein the circuitry is capable of performing motion-compensated back projection.
16. The system of claim 14 , wherein the circuitry is capable of performing motion-free back projection.