Granted Patent B2

US 12,684,103 · App. 18/924,179 · Granted Jul 14, 2026

Inventors: Nathan Matsuda (Seattle, WA); Brian Wheelwright (Sammamish, WA); Joel Hegland (Snohomish, WA)

Assignee: Meta Platforms Technologies, LLC

H04N13/322G02B27/0093G06T19/006H04N13/344H04N13/366

Abstract

Claims (41)

1 . A computer-implemented method, comprising:

receiving, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;

receiving, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;

generating a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;

generating a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and

providing, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.

2 . The method of claim 1 , wherein the first camera is an IR camera.

3 . The method of claim 1 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.

4 . The method of claim 1 , wherein the first image projection is generated using one or more models, comprising: a neural network, a convolutional neural network, a machine learning model, or artificial intelligence model.

5 . The method of claim 1 , wherein the first image projection or the second image projection is provided based on the onlooker changing from the first angle of view to the second angle of view.

6 . The method of claim 1 , further comprising:

tracking the onlooker; and

identifying, based on the tracking of the onlooker, the first angle of view of the onlooker.

7 . The method of claim 1 , further comprising:

assessing at least one of a gaze, a vergence, or a focus of the first eye in the first image;

wherein the generating the first image projection is based on the assessed at least one of the gaze, the vergence, or the focus of the first eye.

8 . The method of claim 1 , wherein at least one of the first image projection or the second image projection further includes one or more superimposed virtual elements.

9 . The method of claim 1 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.

10 . The method of claim 1 , wherein the one or more first displays of the headset are the one or more second displays of the headset.

11 . A non-transitory computer-readable storage medium storing instructions that, when executed by a computing system, cause the computing system to:

receive, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;

receive, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;

generate a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;

generate a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and

provide, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.

12 . The non-transitory computer-readable storage medium of claim 11 , wherein the first camera is an IR camera.

13 . The non-transitory computer-readable storage medium of claim 11 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.

14 . The non-transitory computer-readable storage medium of claim 11 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.

15 . The non-transitory computer-readable storage medium of claim 11 , wherein the one or more first displays of the headset are the one or more second displays of the headset.

16 . A computing system comprising:

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the computing system to:

receive, from a first camera of a headset, a first image having a first field of view including a first eye of a subject, wherein the subject is a user of the headset;

receive, from a second camera of the headset, a second image having a second field of view including a second eye of the subject;

generate a first image projection including information associated with the first field of view and the second field of view from a first angle of view, of an onlooker, relative to one or more first displays of the headset;

generate a second image projection including information associated with the first field of view and the second field of view from a second angle of view, of the onlooker, relative to one or more second displays of the headset; and

provide, for display on the one or more first or second displays of the headset, the first image projection or the second image projection.

17 . The computing system of claim 16 , wherein the first camera is an IR camera.

18 . The computing system of claim 16 , wherein the first image projection is based on a 3D rendition of a portion of the subject's face.

19 . The computing system of claim 16 , wherein at least one of the one or more first displays of the headset is a light field display, and wherein the first image projection and the second image projection are autostereoscopic images.

20 . The computing system of claim 16 , wherein the one or more first displays of the headset are the one or more second displays of the headset.

Assignments (1)

Continuity (4)

References Cited (147)