IP Library Granted Patent US 12,112,436
Granted Patent B2
US 12,112,436 · App. 17/703,837 · Granted Oct 8, 2024

Systems and methods of implementing real-world ambient variance in augmented environments

Inventors: Curtis Hutten (Laguna Beach, CA); Robert D. Fish (Irvine, CA)
Assignee: Wormhole Labs, Inc.
G06T19/006G06F3/1454G06F3/165G06T13/40G06T15/20G10L21/034H04S1/007H04S7/303G06T2200/28G06T2219/024H04S2400/11H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,112,436
App. No.
17/703,837
Granted
Oct 8, 2024
Kind
B2
Abstract

In a computer-implemented method of implementing real-world limitations in shared environment, an environment engine is configured to receive a user selection of a shared environment, wherein the shared environment represents a real-world environment. The environment engine retrieves spatial data associated with the shared environment and retrieves environmental sensor data associated with the shared environment. The environmental sensor data is contemplated to capture a varying ambient environment of the shared environment, which includes at least one of audio data and image data associated with the real-world environment. The environment engine is further configured to render a first user avatar and a second user avatar within the shared environment.

Claims (21)

1. A computer-implemented method of incorporating real-world limitations into a shared, environment, concurrently renderable by first and second users, comprising:

receiving a user selection of a shared environment, wherein the shared environment represents a real-world environment;

retrieving spatial data associated with the shared environment;

retrieving environmental sensor data associated with the shared environment, wherein the environmental sensor data captures a varying ambient environment of the shared environment, and wherein the environmental sensor data includes at least one of audio data and image data;

rendering an avatar of the first user within the shared environment from a first third-person perspective; and

rendering an avatar of the second user within the shared environment from a second third-person perspective.

2. The method of claim 1 , further comprising using at least stereo rendering to the first and second users, of sounds actually occurring within the real-world environment, such that the first and second users perceive the sounds to be positionally oriented with respect to their respective avatars.

3. The method of claim 1 , further comprising rendering to the second user, apparent speech of the first avatar using a volume that varies according to varying apparent distances of the first and second avatars, within the shared environment.

4. The method of claim 1 , further comprising rendering to the second user, apparent speech of the first avatar using a volume that varies according to an apparent facial direction of the first avatar with respect to the second avatar, within the shared environment.

5. The method of claim 1 , further comprising rendering to the second user, apparent speech of the first avatar using a volume that varies according to apparent facial directions of both the first and second avatars, within the shared environment.

6. The method of claim 1 , further comprising rendering to the second user, apparent speech of the first avatar using a volume that varies according to apparent hand movements of the first avatar, with respect to the mouth of the first avatar, within the shared environment.

7. The method of claim 1 , further comprising rendering to at least one of the first and second users, a sound corresponding to an apparent interaction of a body part of the first avatar with respect to an object in the real-world environment.

8. The method of claim 7 , wherein the apparent interaction comprises at least one of the first avatar (a) stamping its foot on the floor, hitting a wall with a hand, and using a hand to open a door.

9. The method of claim 1 , further comprising rendering to the first user, volumes of sounds occurring in the real-world that vary according to apparent distances between a source of the sounds and the first avatar, within the shared environment.

10. The method of claim 1 , further comprising rendering mouth movements of the first avatar to correspond with text created or spoken speech of the first user, in a manner that is visible to both the first and second users.

11. The method of claim 1 , further comprising rendering limb movements of the first avatar to correspond with physical limb movements of the first user, in a manner that is visible to both the first and second users.

12. The method of claim 1 , further comprising rendering walking movements of the first avatar to correspond with console-based instructions from the first user, in a manner that is visible to both the first and second users.

13. The method of claim 1 , further comprising rendering facial expressions of the first avatar to correspond with console-based instructions from the first user, in a manner that is visible to both the first and second users.

14. The method of claim 1 , wherein the first third-person perspective is different from the second third-person perspective.

15. The method of claim 1 , wherein at least one of the first and second users can control sharing of the first third-person perspective with the second person.

16. The method of claim 1 , further comprising providing the first user with a control to manipulate the first third-person perspective.

Assignments (3)
SECURITY INTEREST Recorded Jan 5, 2024
From: BRAVO, DAVID
To: WORMHOLE LABS, INC.
Reel/Frame 066037/0910 →
RELEASE OF SECURITY INTEREST Recorded Nov 28, 2023
From: 54 DYER, LP
To: WORMHOLE LABS, INC.
Reel/Frame 065693/0515 →
SECURITY INTEREST Recorded Feb 6, 2023
From: WORMHOLE LABS, INC.
To: 54 DYER, LP
Reel/Frame 062604/0880 →
Continuity (2)
Provisional Application 63165279 · Mar 24, 2021
Related Publication 20220309755A1 · Sep 29, 2022