Processing video signals based on user focus on a particular portion of a video display
View Patent ↗Devices and methods are disclosed for detecting a focus of at least one viewer as being directed to a particular region of a video display. A first portion of a frame of video for presentation in the region of the viewer's focus is processed differently than another portion of the frame of video related to a region that is not part of the viewer's focus.
1. Apparatus comprising:
at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor to receive images from a camera of eyes of at least one viewer of a video display; and
responsive to determining that the viewer is focused on a first region of the display, decode all pixels in a predetermined area around a center of the first region and decode only a fraction of pixels outside the predetermined area, the fraction being greater than zero.
2. The apparatus of claim 1 , wherein the decoding of all pixels in the predetermined area establishes a first processing and the decoding of only a fraction of pixels outside the predetermined area establishes a second processing.
3. The apparatus of claim 2 , wherein the first processing includes decoding a portion of the frame at a first rate and the second processing includes decoding a portion of the frame at a second rate different from the first rate.
4. The apparatus of claim 2 , wherein the images indicate a viewer focus on a first region of the display, and the instructions are executable to, responsive to the images indicating a viewer focus on the first region, process the first portion of the frame using the first processing.
5. The apparatus of claim 4 , wherein the instructions are executable to, responsive to a change in the viewer's focus from the first region to a second region determined from the images, process the second portion of a frame using the first processing and process the first portion of a frame using the second processing.
6. The apparatus of claim 2 , wherein the frame is a first frame, and wherein the instructions are executable to, responsive to receiving additional images from the camera subsequent to processing the first portion of the first frame of video using the first processing, process a first portion of a second frame of video using the second processing and process a second portion of the second frame using the first processing, the first portion of the first frame and the first portion of the second frame both being presentable on a substantially similar area of the video display.
7. The apparatus of claim 2 , wherein the instructions are executable to receive images of eyes of plural viewers of the video display, and wherein the instructions are executable to, responsive to receiving the images, process the first portion of the frame and a third portion of the frame using the first processing and process the second portion of the frame using the second processing.
8. The apparatus of claim 1 , wherein the video display is a three-dimensional (3D) video display and the frame is a 3D frame.
9. Device comprising:
at least one computer memory that is not a transitory signal and that comprises instructions executable by at least one processor to:
present, on a video display, a first portion of demanded images in greater resolution or at a greater refresh rate than a second portion of the demanded images responsive to a determination that a viewer is focused on a first region of the video display corresponding to the first portion, the instructions being executable to execute at least one of the following:
responsive to determining that the viewer is focused on the first region, decode as much video data in a first frame period as possible starting from a center of the first region and progressing outward therefrom such that should outer portions of a frame not be entirely decoded before a next frame period, an area of the display corresponding to where the first frame is not entirely decoded presents an image from a frame previous to the first frame;
responsive to determining that the viewer is focused on the first region, decode all pixels in a predetermined area around a center of the first region and decode only a fraction of pixels outside the predetermined area, the fraction being greater than zero.
10. The device of claim 9 , wherein the instructions are executable for presenting the first portion of the demanded images in greater resolution and at a greater refresh rate than the second portion of the demanded images responsive to the determination that a viewer is focused on a region of the video display corresponding to the first portion.
11. The device of claim 9 , wherein the instructions are executable for presenting both the first portion of the demanded images and a third portion of the demanded images in greater resolution or at a greater refresh rate than the second portion of the demanded images responsive to a determination that the first viewer is focused on a region of the video display corresponding to the first portion and a second viewer is focused on a region of the video display corresponding to the third portion.
12. The device of claim 9 , wherein the region is a first region, and wherein the instructions are executable to dynamically change processing of the demanded images in response to a change in viewer focus from the first region to a second region of the video display such that the second portion of the demanded images is presented in greater resolution or at a greater refresh rate than the first portion, the change in focus being directed to the second portion.
13. The device of claim 9 , wherein the determination that the viewer is focused on the region of the video display corresponding to the first portion is based on input from a camera juxtaposed with the video display to generate images of the viewer's eyes, and/or the determination that the viewer is focused on the region of the video display corresponding to the first portion is based on input from a camera mounted on eyewear worn by the viewer to generate images of the viewer's eyes.
14. The device of claim 9 , wherein the instructions are executable to:
responsive to determining that the viewer is focused on the first region, decode as much area in a first frame period as possible starting from a center of the first region and progressing outward therefrom such that should outer portions of a frame not be entirely decoded before a next frame period, an area of the display corresponding to where the first frame is not entirely decoded presents an image from a frame previous to the first frame.
15. The device of claim 9 , wherein the instructions are executable to:
responsive to determining that the viewer is focused on the first region, decode all pixels in a predetermined area around a center of the first region and decode only a fraction of pixels outside the predetermined area.
16. Method comprising:
responsive to determining that a viewer of a video display is focused on a first region of the video display, decoding video data in a first frame period starting from a center of the first region and progressing outward therefrom such that should outer portions of a frame not be entirely decoded before a next frame period, an area of the video display corresponding to where the first frame is not entirely decoded presents an image from a frame previous to the first frame; and
presenting the video on the video display.