IP Library › Granted Patent US 11,494,990
Granted Patent B2
US 11,494,990 · App. 16/620,264 · Granted Nov 8, 2022

Hybrid placement of objects in an augmented reality environment

Inventors: Bryan Woods (Santa Clara, CA); Jianing Wei (Cupertino, CA); Sundeep Vaddadi (Mountain View, CA); Cheng Yang (Mountain View, CA); Konstantine Tsotsos (San Francisco, CA); Keith Schaefer (San Pedro, CA); Leon Wong (San Francisco, CA); Keir Banks Mierle (Mountain View, CA); Matthias Grundmann (Mountain View, CA)
Assignee: Google LLC
G06T19/006G06F3/04815G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,494,990
App. No.
16/620,264
Filed
Dec 6, 2019
Granted
Nov 8, 2022
Kind
B2
Art Unit
2613
USPC
345/633
Abstract

In a general aspect, a method can include receiving data defining an augmented reality (AR) environment including a representation of a physical environment, and changing tracking of an AR object within the AR environment between region-tracking mode and plane-tracking mode.

Claims (49)

1. A method, comprising:

receiving, by an electronic device, data defining an augmented reality (AR) environment including a representation of a physical environment;

identifying a plane representing at least a portion of a first real-world object within the physical environment and an augmented region being a boundary associated with at least a portion of a second real-world object within the physical environment;

receiving an instruction to place an AR object within the AR environment;

in response to receiving the instruction, placing the AR object in the AR environment at a first time based on the augmented region using a region-tracking mode, the augmented region being a two-dimensional region without depth information; and

switching, at a second time, to placing the AR object based on the plane using a plane-tracking mode.

2. The method of claim 1 , further comprising:

maintaining a scale of the physical environment as displayed with a screen of the electronic device while changing a depth of the AR object such that a size of the AR object is changed within the screen of the electronic device.

3. The method of claim 1 , further comprising:

modifying a depth of the AR object within the AR environment in response to a change in size of the augmented region.

4. The method of claim 1 , wherein the plane is a three-dimensional plane having a depth.

5. The method of claim 1 , wherein a world scale of the AR object is maintained when switching between the region-tracking mode and the plane-tracking mode.

6. The method of claim 1 , further comprising:

changing a scale of the AR object when changing from the region-tracking mode to the plane-tracking mode.

7. A method, comprising:

receiving data defining an augmented reality (AR) environment including a representation of a physical environment; and

changing tracking of an AR object within the AR environment between a region-tracking mode and a plane-tracking mode,

the region-tracking mode including tracking the AR object within the AR environment based on a two-dimensional region without depth information, the two-dimensional region being a boundary associated with a first real-world object within the physical environment,

the plane-tracking mode including tracking a depth of the AR object within the AR environment based on a plane representing a second real-world object within the physical environment, the AR object having a world scale maintained when switching between the region-tracking mode and the plane-tracking mode.

8. The method of claim 7 , further comprising when changing from region-tracking mode to plane-tracking mode:

maintaining a scale of the physical environment as displayed with a screen of an electronic device while changing the depth of the AR object such that a size of the AR object is changed within the screen of the electronic device.

9. The method of claim 7 , further comprising when changing from region-tracking mode to plane-tracking mode:

maintaining a size of the AR object as displayed with a screen of an electronic device while changing a scale of the physical world such that the depth of the AR object is changed.

10. The method of claim 7 , further comprising when changing from plane-tracking mode to augmented-region tracking mode:

using the depth of the AR object used in the plane-tracking mode to place the AR object based on the two-dimensional region in the augmented-region tracking mode.

11. The method of claim 7 , wherein the plane is a three-dimensional plane having a depth.

12. A method, comprising:

receiving, by an electronic device, data defining an augmented reality (AR) environment including a representation of a physical environment;

identifying an augmented region, the augmented region being represented by a collection of points associated with a boundary of a first real-world object within the physical environment, the augmented region being a two-dimensional region without depth information;

placing an AR object within the AR environment based on the augmented region;

identifying a three-dimensional plane representing a second real-world object within the physical environment; and

placing the AR object in the AR environment based on the three-dimensional plane, the three-dimensional plane being a three-dimensional region with a depth.

13. The method of claim 12 , wherein the AR object has an initial depth when placed based on the augmented region.

14. The method of claim 12 , wherein the three-dimensional plane represents a surface of the second real-world object.

15. The method of claim 12 , further comprising:

modifying a depth of the AR object within the AR environment in response to a change in size of the augmented region.

16. The method of claim 12 , further comprising:

changing from a region-tracking mode based on the augmented region to a plane-tracking mode based on the three-dimensional plane in response to receiving an instruction to move the AR object.

17. The method of claim 12 , wherein the augmented region is not visible within a display.

18. The method of claim 12 , wherein the augmented region is a two-dimensional surface separate from an image of the first real-world object.

19. A method, comprising:

receiving data defining an augmented reality (AR) environment including a representation of a physical environment;

identifying a plane representing a first real-world object within the physical environment;

placing an AR object within the AR environment based on the plane in a plane-tracking mode, the plane having a calculated depth;

identifying an augmented region representing a boundary associated with a second real-world object within the physical environment, the augmented region being a two-dimensional region without depth information; and

in response to receiving an instruction, placing the AR object in the AR environment based on the augmented region in a region-tracking mode.

20. The method of claim 19 , further comprising:

changing from the plane-tracking mode to the region-tracking mode is in response to receiving the instruction to move the AR object.

21. The method of claim 19 , wherein the augmented region represents a space occupied within the AR environment of the second real-world object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2020
From: WEI, JIANING
To: GOOGLE LLC
Reel/Frame 053538/0514 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 9, 2020
From: WOODS, BRYAN; WEI, JIANINGWEI; VADDADI, SUNDEEP; YANG, CHENG; TSOTSOS, KONSTANTINE; SCHAEFER, KEITH; WONG, LEON; MIERLE, KEIR BANKS; GRUNDMANN, MATTHIAS
To: GOOGLE LLC
Reel/Frame 052047/0567 →
Continuity (2)
Provisional Application 62742772 · Oct 8, 2018
Related Publication 20200211288A1 · Jul 2, 2020