Reverse pass-through glasses for augmented reality and virtual reality devices
A device for providing a reverse pass-through view of a user of a headset display to an onlooker includes an eyepiece comprising an optical surface configured to provide an image to a user on a first side of the optical surface. The device also includes a first camera configured to collect an image of a portion of a face of the user reflected from the optical surface in a first field of view, a display adjacent to the optical surface and configured to project forward an image of the face of the user, and a screen configured to receive light from the display and provide the image of the face of the user to an onlooker.
1 . A computer-implemented method, comprising:
receiving, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;
receiving, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;
generating a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;
generating a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and
providing, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.
2 . The method of claim 1 , wherein the first camera is an IR camera.
3 . The method of claim 1 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.
4 . The method of claim 1 , wherein the first image projection is generated using one or more models, comprising: a neural network, a convolutional neural network, a machine learning model, or artificial intelligence model.
5 . The method of claim 1 , wherein the first image projection or the second image projection is provided based on the onlooker changing from the first angle of view to the second angle of view.
6 . The method of claim 1 , further comprising:
tracking the onlooker; and
identifying, based on the tracking of the onlooker, the first angle of view of the onlooker.
7 . The method of claim 1 , further comprising:
assessing at least one of a gaze, a vergence, or a focus of the first eye in the first image;
wherein the generating the first image projection is based on the assessed at least one of the gaze, the vergence, or the focus of the first eye.
8 . The method of claim 1 , wherein at least one of the first image projection or the second image projection further includes one or more superimposed virtual elements.
9 . The method of claim 1 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.
10 . The method of claim 1 , wherein the one or more first displays of the headset are the one or more second displays of the headset.
11 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to:
receive, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;
receive, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;
generate a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;
generate a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and
provide, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.
12 . The non-transitory computer-readable storage medium of claim 11 , wherein the first camera is an IR camera.
13 . The non-transitory computer-readable storage medium of claim 11 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.
14 . The non-transitory computer-readable storage medium of claim 11 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.
15 . The non-transitory computer-readable storage medium of claim 11 , wherein the one or more first displays of the headset are the one or more second displays of the headset.
16 . A computing system comprising:
one or more processors; and
one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to:
receive, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;
receive, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;
generate a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;
generate a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and
provide, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.
17 . The computing system of claim 16 , wherein the first camera is an IR camera.
18 . The computing system of claim 16 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.
19 . The computing system of claim 16 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.
20 . The computing system of claim 16 , wherein the one or more first displays of the headset are the one or more second displays of the headset.