Systems and method for rendering of virtual objects
An augment reality (AR) system captures an image of a physical environment. The AR system identifies an object in the captured image to serve as an anchor point. The AR system calculates a distance between the identified object and an AR display device that comprises left and right displays. The AR system identifying a virtual object associated with the anchor point. The AR system then generates for simultaneous display: (a) a first separate image of the virtual object on the left display of the AR device, and (b) a second separate image of the virtual object on the right display of the AR device, such that apparent distance of the virtual object of the composite image of the first separate image and the second separate image is set to the calculated distance between the identified object and the AR display device.
1 . A method comprising:
identifying a virtual object that is to remain prominent in an augmented reality (AR) display device with a left display and a right display;
continuously modifying output of the AR display device such that the virtual object that is to remain prominent remains displayed at respective biometrically determined vergence planes at which a user's eyes are focusing, wherein the continuously modifying the output of the AR display device comprises:
computing at a first time, based at least in part on biometric information of a user of the AR display device, a first plane at a first apparent distance at which a user's eyes' views via the left display and the right display of the AR display device intersect;
generating for display, using the left display and the right display of the AR display device, a first composite image comprising the virtual object, wherein the display is generated such that the first composite image appears in the AR display device at the first plane at the first apparent distance; and
based at least in part on determining at a second time subsequent to the first time that the user's eyes' views via the left display and the right display of the AR display device intersect at a second plane that is at a second apparent distance different from the first apparent distance to focus on an object other than the virtual object that is to remain prominent:
generating for display a second composite image using the left display and the right display of the AR display device, wherein the display is generated such that the second composite image comprising the virtual object that is to remain prominent appears in the AR display device at the second plane at the second apparent distance.
2 . The method of claim 1 , further comprising:
capturing an image of a physical environment; and
generating for display the image of the physical environment to create a video-see through (VST) image on the AR display device.
3 . The method of claim 1 , wherein the determining that the second plane at which the user's eyes' views via the left display and the right display of the AR display device intersect comprises:
capturing at least one image of eyes of the user; and
computing the second apparent distance based on eye rotation in the captured at least one image of the eyes of the user.
4 . The method of claim 1 , wherein the identifying the virtual object that is to remain prominent comprises identifying a system notification.
5 . The method of claim 1 , wherein the identifying the virtual object that is to remain prominent comprises identifying an incoming message that matches pre-selected criteria.
6 . The method of claim 5 , wherein the pre-selected criteria comprise identification of a source of the incoming message.
7 . The method of claim 1 , wherein the identifying the virtual object that is to remain prominent comprises identifying supplemental content relevant to an AR environment displayed on the AR display device.
8 . The method of claim 1 , wherein the identifying the virtual object that is to remain prominent comprises identifying a first virtual object that is newly inserted into an AR environment displayed on the AR display device.
9 . The method of claim 1 , wherein as the user of the AR display device gazes at various depths in a scene, the first composite image comprises the virtual object and an image of a first physical object at the first plane, wherein the second composite image comprises the virtual object and a second physical object at the second plane, and wherein the virtual object is displayed continually from the first time to the second time.
10 . A system comprising:
an input/output circuitry configured for outputting AR images;
control circuitry configured to:
identify a virtual object that is to remain prominent in an augmented reality (AR) display device comprising a left display and a right display;
continuously modify output of the AR display device such that the virtual object that is to remain prominent remains displayed at respective biometrically determined vergence planes at which a user's eyes are focusing, by:
computing at a first time, based at least in part on biometric information of a user of the AR display device, a first plane at a first apparent distance at which a user's eyes' views via the left display and the right display of the AR display device intersect; and
causing the input/output circuitry to generate for display, using the left display and the right display of the AR display device, a first composite image comprising the virtual object, wherein the display is generated such that the first composite image appears in the AR display device on the first plane at the first apparent distance; and
based at least in part on determining, as a first determination, that the user's eyes' views via the left display and the right display of the AR display device intersect at a second plane that is at a second apparent distance different from the first apparent distance to focus on an object other than the virtual object that is to remain prominent,
wherein the system is configured to cause generating for display a second composite image using the left display and the right display of the AR display device, wherein the display is generated such that the second composite image comprising the virtual object that is to remain prominent appears in the AR display device at the second plane at the second apparent distance.
11 . The system of claim 10 , wherein the input/output circuitry is configured to:
capture an image of a physical environment; and
generate for display the image of the physical environment to create a video-see through (VST) image on the AR display device.
12 . The system of claim 10 , wherein the control circuitry is configured to determine the second plane based at least in part on the biometric information of the user by:
capturing at least one image of eyes of the user; and
computing the second apparent distance based on eye rotation in the captured at least one image of the eyes of the user.
13 . The system of claim 10 , wherein the identifying the virtual object that is to remain prominent at the AR display device comprises identifying a system notification.
14 . The system of claim 10 , wherein the control circuitry is configured to identify the virtual object that is to remain prominent by identifying an incoming message that matches pre-selected criteria.
15 . The system of claim 14 , wherein the pre-selected criteria comprise identification of a source of the incoming message.
16 . The system of claim 15 , wherein the control circuitry is configured to identify the virtual object that is to remain prominent by identifying supplemental content relevant to an AR environment displayed on the AR display device.
17 . The system of claim 15 , wherein the control circuitry is configured to identify the virtual object that is to remain prominent by identifying a first virtual object that is newly inserted into an AR environment displayed on the AR display device.
18 . A system comprising:
means for identifying a virtual object that is to remain prominent in an augmented reality (AR) display device with a left display and a right display;
means for continuously modifying the output of the AR display device such that the virtual object that is to remain prominent remains displayed at respective biometrically determined vergence planes at which a user's eyes are focusing, wherein the means for continuously modifying the output of the AR display comprise:
means for determining, at a first time based at least in part on biometric information of a user of the AR display device, a first plane at a first apparent distance at which a user's eyes' views via the left display and the right display of the AR display device intersect;
means for generating for display, using the left display and the right display of the AR display device, a first composite image comprising the virtual object, wherein the display is generated such that the first composite image appears in the AR display device at the first plane at the first apparent distance;
means for determining as a first determination that the user's eyes' views via the left display and the right display of the AR display device intersect at a second plane at a second apparent distance that is different from the first apparent distance to focus on an object other than the virtual object that is to remain prominent; and
means for generating for display, based at least in part on the first determination: a second composite image using the left display and the right display of the AR display device, wherein the display is generated such that the second composite image comprising the virtual object that is to remain prominent appears in the AR display device at the second plane at the second apparent distance.
19 . The system of claim 18 , further comprising:
means for capturing an image of a physical environment; and
means for generating for display the image of the physical environment to create a video-see through (VST) image on the AR display device.
20 . The system of claim 18 , wherein the means for determining the second plane based at least in part on the biometric information of the user comprise:
means for capturing at least one image of eyes of the user; and
means for computing the second apparent distance based on eye rotation in the captured at least one image of the eyes of the user.
21 . The system of claim 18 , wherein the means for identifying the virtual object that is to remain prominent comprise means for identifying a system notification.