Granted Patent B2

US 12,694,630 · App. 18/783,073 · Granted Jul 28, 2026

Inventors: Karen Stolzenberg (Venice, CA); Lorena Pazmino (Wilton Manors, FL); Savannah Niles (Fort Lauderdale, FL); Ian Mankowski (Marina Del Rey, CA); Paul Kim (Los Angeles, CA); Christina Lee (Los Angeles, CA)

Assignee: MAGIC LEAP, INC.

G06T19/006G06F3/012G06F3/013G06F3/017G06F3/167G06T13/40G06T19/20G06V20/20G06V40/11G06V40/193G06T2219/024

Abstract

Claims (20)

1 . A computing system comprising:

a hardware computer processor;

a non-transitory computer readable medium having software instructions stored thereon, the software instructions executable by the hardware computer processor to cause the computing system to perform operations comprising:

determine an avatar associated with a user in an augmented reality environment,

wherein the avatar is configured to represent input cues from the user with changes to visual elements of the avatar that are non-literal indications of the corresponding input cue; and

provide real-time rendering updates to the avatar that are viewable by each of a plurality of users in a shared augmented reality environment.

2 . The computing system of claim 1 , wherein, when the input cue is associated with a hand direction of the user, the changes to the visual element includes changes outside of a hand direction of the avatar.

3 . The computing system of claim 1 , wherein, in response to receiving the input cues from the user, the computing system performs operations comprising an indirect mapping such that a first input cue of the input cues associated with a first body part results in a first change of the changes to the avatar of at least one of a change in shape of a feature of the avatar, in a shading of a feature, or in a color of a feature.

4 . The computing system of claim 1 , wherein the input cue is associated with a specific body part of the user, and the changes to the visual element resulting from the input cue is associated with a characteristic other than a body part on the avatar that corresponds to the specific body part of the user.

5 . The computing system of claim 1 , wherein a first visual element is associated with two or more input cues.

6 . The computing system of claim 5 , wherein the input cues include one or more of gaze direction, voice, head pose and hand pose.

7 . The computing system of claim 6 , wherein the input cues include one or more of shared attention, shared gaze, and mutual gestures.

8 . The computing system of claim 1 , further comprising:

a signal mapping component storing a mapping between input cues and corresponding output signals, wherein the real-time rendering updates are determined based on the output signals.

9 . The computing system of claim 1 , wherein the avatar includes a visual element that is deformable in response to a voice input cue.

10 . The computing system of claim 9 , wherein the visual element is deformable in another manner in response to an input cue indicating a particular gaze activity.

11 . The computing system of claim 1 , wherein the avatar includes a visual element that changes in size in response to a voice input cue.

12 . The computing system of claim 1 , wherein the avatar includes a visual element that changes shading of a portion of the avatar in response to a voice input cue.

13 . The computing system of claim 12 , wherein the portion of the avatar is not associated with a mouth area of the avatar.

14 . The computing system of claim 1 , wherein the avatar comprises one or more geometric shapes.

Assignments (2)

Continuity (5)

References Cited (104)