IP Library Granted Patent US 11,804,012
Granted Patent B1
US 11,804,012 · App. 17/323,799 · Granted Oct 31, 2023

Method and device for navigation mesh exploration

Inventors: Daniel Laszlo Kovacs (Santa Clara, CA); Payal Jotwani (Santa Clara, CA); Dan Feng (Sunnyvale, CA)
Assignee: APPLE INC.
G06T19/003G06T17/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,804,012
App. No.
17/323,799
Granted
Oct 31, 2023
Kind
B1
Abstract

In some implementations, a method of navigation mesh exploration is performed at a virtual agent operating system. The method includes: determining one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent; generating a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes candidate subsequent locations different from the first location; and in response to detecting movement of the virtual agent to a respective candidate subsequent location among candidate subsequent locations, generating a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location.

Claims (42)

1. A method comprising:

at a virtual agent operating system including non-transitory memory and one or more processors coupled with the non-transitory memory:

determining one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent, wherein the first perceptual vector includes first translational coordinates associated with a first location of the virtual agent within an extended reality (XR) environment, first rotational coordinates of the virtual agent, and a sensory acuity profile associated with the virtual agent;

generating a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes one or more candidate subsequent locations different from the first location;

in response to detecting movement of the virtual agent to a respective candidate subsequent location among the one or more candidate subsequent locations, generating a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location; and

adding the second portion of the navigation mesh for the XR environment to the first portion of a navigation mesh for the XR environment.

2. The method of claim 1 , further comprising:

obtaining a first environmental information vector associated with the one or more first sensory perception regions, wherein the first environmental information vector characterizes a first portion of the XR environment that corresponds to the one or more first sensory perception regions; and wherein the first portion of the navigation mesh for the XR environment is generated based on the first environmental information vector and a locomotive profile for the virtual agent.

3. The method of claim 1 , further comprising:

determining the one or more second sensory perception regions for the one or more senses of the virtual agent based on a second perceptual vector associated with the virtual agent, wherein the second perceptual vector includes the second translational coordinates associated with the respective candidate subsequent location, second rotational coordinates of the virtual agent, and the sensory acuity profile associated with the virtual agent.

4. The method of claim 3 , further comprising:

merging the first and second portions of the navigation mesh into a combined navigation mesh for the XR environment.

5. The method of claim 4 , wherein the combined navigation mesh includes a continuous planar surface.

6. The method of claim 4 , wherein the combined navigation mesh includes at least two perpendicular planar surfaces.

7. The method of claim 1 , further comprising:

selecting the respective candidate subsequent location among the one or more candidate subsequent locations according to predefined selection criteria; and

actuating one or more locomotive elements of the virtual agent to move the virtual agent to the respective candidate subsequent location.

8. The method of claim 7 , wherein the predefined selection criteria correspond to an exploration criterion that will enable the virtual agent to uncover more of the navigation mesh for the XR environment based on the one or more senses of the virtual agent.

9. The method of claim 1 , wherein the first and second portions of the navigation mesh are determined based at least in part on a locomotive profile for the virtual agent that includes size characteristics for the virtual agent and movement characteristics for the virtual agent.

10. The method of claim 1 , wherein the one or more first sensory perception regions includes at least one of a first viewing frustum, a first aural perception region, and a first olfactory perception region relative to the first location of the virtual agent within the XR environment.

11. The method of claim 1 , wherein the sensory acuity profile includes at least one of sensitivity or intensity values for the one or more senses of the virtual agent.

12. The method of claim 1 , wherein the virtual agent corresponds to one of a humanoid, animal, or robot entity.

13. The method of claim 1 , wherein the virtual agent corresponds to a manned vehicle or an unmanned vehicle.

14. The method of claim 1 , wherein the XR environment corresponds to a multilevel structure with a first space and a second space connected by a discontinuous span.

15. The method of claim 1 , wherein the XR environment corresponds to a multi-spatial structure with a first space and a second space connected by a door.

16. The method of claim 1 , wherein the first portion of the navigation mesh includes a continuous planar surface.

17. The method of claim 1 , wherein the first portion of the navigation mesh corresponds to a three-dimensional volumetric region.

18. The method of claim 1 , further comprising:

instantiating the virtual agent at the first location within the XR environment, wherein the first location corresponds to first translational coordinates within the XR environment.

19. A virtual agent operating system comprising:

one or more processors;

a non-transitory memory; and

one or more programs stored in the non-transitory memory, which, when executed by the one or more processors, cause the device to:

determine one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent, wherein the first perceptual vector includes first translational coordinates associated with a first location of the virtual agent within an extended reality (XR) environment, first rotational coordinates of the virtual agent, and a sensory acuity profile associated with the virtual agent;

generate a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes one or more candidate subsequent locations different from the first location;

in response to detecting movement of the virtual agent to a respective candidate subsequent location among the one or more candidate subsequent locations, generate a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location; and

add the second portion of the navigation mesh for the XR environment to the first portion of a navigation mesh for the XR environment.

20. A non-transitory memory storing one or more programs, which, when executed by one or more processors of a virtual agent operating system, cause the virtual agent operating system to:

determine one or more first sensory perception regions for one or more senses of a virtual agent based on a first perceptual vector associated with the virtual agent, wherein the first perceptual vector includes first translational coordinates associated with a first location of the virtual agent within an extended reality (XR) environment, first rotational coordinates of the virtual agent, and a sensory acuity profile associated with the virtual agent;

generate a first portion of a navigation mesh for the XR environment based on the one or more first sensory perception regions, wherein the first portion of the navigation mesh includes one or more candidate subsequent locations different from the first location;

in response to detecting movement of the virtual agent to a respective candidate subsequent location among the one or more candidate subsequent locations, generate a second portion of the navigation mesh for the XR environment based on one or more second sensory perception regions for the one or more senses of the virtual agent relative to the respective candidate subsequent location; and

add the second portion of the navigation mesh for the XR environment to the first portion of a navigation mesh for the XR environment.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: KOVACS, DANIEL LASZLO; JOTWANI, PAYAL; FENG, DAN
To: APPLE INC.
Reel/Frame 056286/0207 →
Continuity (1)
Provisional Application 63035785 · Jun 7, 2020
Cited By (1)
US 12,616,901