Augmented reality and screen image rendering coordination

1 . A method, comprising:

receiving a first image for rendering on a first image display in a combination of a stationary image display and a non-stationary image display;

tracking a gaze of a viewer in real time by tracking a viewing direction of a user device that includes the non-stationary image display;

identifying a visual object depicted in the first image by analyzing the tracked viewing direction to determine the visual object gazed at by the viewer, wherein identifying the visual object comprises detecting edges of the visual object to separate background from the visual object;

generating a corresponding image portion in a second image depicting only the identified visual object for rendering on a second image display in the combination of the stationary image display and the non-stationary image display, wherein the first image display and the second image display respectively represent the stationary image display and the non-stationary image display, wherein the corresponding image portion in the second image as rendered on the second image display overlaps in a vision field of a viewer with the visual object depicted in the second image as rendered on the first image display to perform compensated image rendering for enhancing only the identified visual object in one or more visual characteristics such as one or more of dynamic range, color gamut, spatial resolution, color saturation and color precision;

performing perspective correction on the second image based on a change of one or both of a spatial position and a spatial direction of the non-stationary image display;

causing the second image generated with the perspective correction to be rendered on the second image display concurrently while the first image is being rendered on the first image display.

2 . The method of claim 1 , wherein the stationary image display represents a screen image display stationary in a physical 3D space in which the stationary image display and the non-stationary image display reside.

3 . The method of claim 1 , wherein the non-stationary image display is included in a user coupled device of the viewer.

4 . The method of claim 1 , wherein the viewing direction of the user device is used to perform perspective correction adjustments on at least one of the first image or the second image.

5 . The method of claim 1 , wherein the viewing direction of the viewer is represented by one or both of a spatial position of the user device or a spatial direction of the user device.

6 . The method of claim 1 , wherein the first image represents a stereoscopic image; wherein the first image depicts one or more 3D images that include the visual object; wherein the viewer visually perceives the one or more 3D objects depicted in the first image through a 3D viewing device.

7 . The method of claim 1 , wherein the first and second images relate to one of: an augmented reality application, a virtual reality application, a mixed reality application, a computer game application, an interactive video application, or a non-interactive video application.

8 . The method of claim 1 , wherein an overall image space in which the first image display and the second image display renders visual objects is partitioned into a first image subspace, a second image subspace and a third image subspace; wherein a specific visual characteristic of any visual object in the first image subspace is completely rendered by the first image display; wherein the specific visual characteristic of any visual object in the second image subspace is jointly rendered by the first image display and the second image display; wherein the specific visual characteristic of any visual object in the third image subspace is completely rendered by the second image display.

9 . The method of claim 1 , wherein the first image display is the stationary image display; wherein the visual object is a part of a main visual scene depicted in a sequence of images rendered on the stationary image display; wherein supplemental information is rendered by the non-stationary image display in image space portions that are free from obstructing the main visual scene depicted in the sequence of images rendered on the stationary image display.

10 . The method of claim 1 , wherein the gaze of the viewer is used to render, on the stationary image display, one or more relatively high quality image portions corresponding to a foveal vision field portion of the viewer and other relatively low quality image portions not corresponding to the foveal vision field portion.

11 . A display system, comprising:

a non-stationary image display that renders non-screen display images;

a stationary image display that renders screen display images;

an image rendering controller that performs the method as recited in claim 1 .

12 . A non-transitory computer readable storage medium, storing software instructions, which when executed by one or more computer processors cause performance of the method recited in claim 1 .

13 . An apparatus comprising one or more computer processors and one or more storage media storing a set of instructions which, when executed by the one or more computer processors, cause performance of the method recited in claim 1 .