Techniques for enabling high fidelity magnification of video
Responsive to a zoom command when presenting a first video, a second video is combined with the first video and presented. The first and second videos are generated from substantially the same camera location as each other at substantially the same time with substantially the same resolution. However, the second video is generated by a physical or virtual lens having a field of view (FOV) smaller than the FOV of a physical or virtual lens used in generating the first video. The technique gives the appearance of zooming without loss of resolution.
1. A device, comprising:
at least one storage device that is not a transitory signal and that comprises instructions executable by at least one processor to cause the processor to:
present a first video on a display; and
responsive to a zoom command, combine a second video with the first video and present the second video combined with the first video on the display, the first and second videos being generated from substantially a same camera location as each other at substantially a same resolution, the second video being generated by a physical or virtual lens having a field of view (FOV) smaller than a FOV of a physical or virtual lens used in generating the first video to give the appearance of zooming without loss of resolution.
2. The device of claim 1 , wherein the first and second videos are generated using virtual lenses.
3. The device of claim 1 , wherein the first and second videos are generated using physical lenses.
4. The device of claim 1 , wherein the zoom command is a first zoom command and the instructions are executable to present only the second video on the display responsive to continued input of the first zoom command or input of a second zoom command.
5. The device of claim 4 , wherein the instructions are executable to, responsive to continued input of the first zoom command or input of a third zoom command after the second zoom command, combine the second video with a third video and present the third video combined with the second video on the display, the first, second, and third videos being generated from substantially the same camera location as each other at substantially the same time and substantially the same resolution, the third video being generated by a physical or virtual lens having a FOV smaller than the FOV of a physical or virtual lens used in generating the second video.
6. The device of claim 5 , wherein the processor has access to fourth and fifth videos each having a successively smaller FOV than the immediately preceding video for use in continued input of zoom commands.
7. The device of claim 1 , comprising the display.
8. The device of claim 7 , wherein the display comprises a head-mounted display (HMD).
9. A method comprising:
presenting a first video on a display; and
responsive to a zoom in command, presenting a second video on the display, wherein the method includes:
switching between respective bitstreams of the respective first and second videos at least in part by using encoding configurations so that a same instance of the decoder can process bitstream access units (AU) from multiple bitstreams, at least some key frames of different bitstreams being aligned and evenly spaced, key frame positions and AU offsets for each bitstream being pre-calculated.
10. The method of claim 9 , comprising, after presenting the first video in a wide-angle mode, responsive to a first zoom command, presenting a video in a standard angle mode.
11. The method of claim 10 , comprising, after a second zoom command following the first zoom command, presenting a video in a telephoto mode.
12. The method of claim 11 , wherein the zoom command causing presentation of the second video is a third zoom command following the second zoom command, and the second video is presented in a wide-angle mode.
13. The method of claim 9 , wherein the first video is generated using a lens with a first field of view (FOV) and the second video is generated using a lens with a second FOV that is smaller than the first FOV.
14. The method of claim 13 , wherein the first and second videos are generated as if from cameras located in the same place and at the same time.
15. The method of claim 9 , wherein the first and second videos are captured using a same camera field of view from respective first and second physical or virtual camera locations, respectively.
16. An apparatus comprising:
at least processor programmed to:
present a first video on a display; and
responsive to a zoom command, present a second video on the display, the second video being generated by a physical or virtual lens having a field of view (FOV) smaller than a FOV of a physical or virtual lens used in generating the first video and/or the second video being generated based on a shorter focal length than a focal length on which the first video is presented.
17. The apparatus of claim 16 , wherein the first and second videos have substantially a same resolution.
18. The apparatus of claim 16 , wherein the first and second videos are generated using virtual lenses.
19. The apparatus of claim 16 , wherein the first and second videos are generated using physical lenses.
20. The apparatus of claim 16 , wherein the zoom command is a first zoom command and the processor is programmed to present only the second video on the display responsive to continued input of the first zoom command or input of a second zoom command.
21. The apparatus of claim 20 , wherein the processor is programmed to, responsive to continued input of the first zoom command or input of a third zoom command after the second zoom command, combine the second video with a third video and present the third video combined with the second video on the display, the first, second, and third videos being generated from substantially the same camera location as each other at substantially the same time and substantially the same resolution, the third video being generated by a physical or virtual lens having a FOV smaller than the FOV of a physical or virtual lens used in generating the second video.
22. The apparatus of claim 21 , wherein the processor has access to fourth and fifth videos each having a successively smaller FOV than the immediately preceding video for use in continued input of zoom commands.
23. The apparatus of claim 16 , the first and second videos being generated from substantially a same camera location as each other at substantially a same time.
24. The apparatus of claim 16 , the first and second videos being generated from respective first and second camera locations distanced from each other.
25. The method of claim 9 , comprising reducing computational power needed by selectively decoding only content in a video represented by at least one bitstream that will be visible.
26. The method of claim 9 , comprising smoothly switching between the respective bitstreams so that the same instance of the decoder can process bitstream access units (AU) from multiple bitstreams without requiring extra memory, the at least some key frames of different bitstreams being aligned and evenly spaced according to how fast a user can increase or decrease the magnification level, the key frame positions and AU offsets for each bitstream being pre-calculated to avoid doing this in a decoding module.
27. The method of claim 9 , comprising executing a decoding module (DM) comprising one or more extra decoders to predict a next bitstream that will be processed, decoding the next bitstream prior to decoded pixels from the next bitstream being visible on the display.
28. The method of claim 9 , comprising encoding bitstreams associated with the videos using only keyframes.
29. The method of claim 9 , comprising switching audio streams along with switching video when zooming.