IP Library › Granted Patent US 10,467,811
Granted Patent B1
US 10,467,811 · App. 15/419,010 · Granted Nov 5, 2019

Visualizing change in augmented reality environments

Inventor: Colter Earl Cederlof (San Jose, CA)
Assignee: Amazon Technologies, Inc.
G06T19/006G06F3/011G06F3/017
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,467,811
App. No.
15/419,010
Granted
Nov 5, 2019
Kind
B1
Abstract

An architecture is provided to generate an augmented reality environment and visualize or otherwise output information about changes to a physical object within the environment. The changes may include location, quantity, condition of the physical object, and so forth. Users may also use a rendering of a physical object to plan layout of the physical object in the environment. Prompts may be provided to guide placement of the physical object.

Claims (65)

1. A system comprising:

a processor;

a camera coupled to the processor;

a projector coupled to the processor;

a memory coupled to the processor;

an object datastore stored within the memory; and

instructions stored within the memory that, when executed by the processor, cause the processor to perform acts comprising:

receiving a selection of a representation of a physical object from a datastore of physical objects available for purchase, the datastore of physical objects including a size attribute that corresponds to an actual size of the physical object;

receiving a first selection of a first location on a first surface on which to project a first rendering of the physical object;

presenting, using the projector, the first rendering of the physical object at the first location on the first surface, the first rendering of the physical object depicting the actual size of the physical object from a perspective of a user based at least in part on the size attribute;

receiving a second selection of a second location on a second surface on which to project a second rendering of the physical object; and

presenting, based at least in part on the second selection and using the projector, the second rendering of the physical object at the second location on the second surface, the second rendering of the physical object depicting the actual size of the physical object from the perspective of the user based at least in part on the size attribute.

2. The system of claim 1 , the acts further comprising:

obtaining, using the camera, one or more images representing the user,

wherein receiving the second selection of the second location on the second surface on which to project the second rendering comprises detecting, using the one or more images, a gesture made by the user.

3. The system of claim 1 , the acts further comprising:

obtaining, using the camera, one or more images representing the user;

detecting, using the one or more images, a position of the user within an environment; and

adjusting a size of the second rendering of the physical object at the second location on the second surface such that the second rendering is depicted as the actual size of the physical object based at least in part on the size attribute and from the position of the user.

4. The system of claim 1 , the acts further comprising presenting a positioning prompt indicating placement of the physical object at the second location on the second surface, wherein the positioning prompt comprises at least one of:

one or more visual indicators directing the placement of the physical object; or

one or more audible indicators directing the placement of the physical object.

5. The system of claim 1 , the acts further comprising:

determining, from information stored in the catalog datastore of physical objects, a color associated with the physical object,

wherein at least one of presenting the first rendering of the physical object on the first surface or presenting the second rendering of the physical object on the second surface is based at least in part on the color associated with the physical object.

6. The system of claim 1 , the acts further comprising storing, in the datastore of physical objects, an attribute that indicates the second location in association with the physical object.

7. The system of claim 1 , the acts further comprising:

determining, using the camera or a second camera, a direction of a gaze of the user; and

wherein the first location of the first rendering of the physical object is further based at least in part on the direction of the gaze of the user.

8. The system of claim 1 , wherein the receiving the selection of the representation of the physical object from the datastore of physical objects available for purchase is performed based at least in part on an indication to purchase the physical object, the datastore of physical objects available for purchase including one or more additional attributes related to at least one of a price or an availability of the physical object.

9. The system of claim 1 , wherein the receiving the selection of the representation of the physical object is performed based at least in part on an indication to purchase the physical object, the datastore of physical objects available for purchase including one or more additional attributes related to a receipt of the physical object at an environment, or an installation the physical object at the environment.

10. The system of claim 1 , the acts further comprising:

determining a distance of the user from at least one of the first rendering of the physical object or the second rendering of the physical object; and

wherein the depicting the actual size of the physical object from a perspective of the user is based at least in part on the distance.

11. The system of claim 1 , the acts further comprising:

detecting the physical object in an environment;

presenting a positioning prompt directing placement of the physical object at a location within the environment, wherein the positioning prompt comprises at least one of:

one or more visual indicators directing the placement of the physical object; or

one or more audio indicators directing the placement of the physical object.

12. A system comprising:

one or more processors; and

one or more computer-readable storage media storing instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:

receiving a first selection of a representation of a physical object;

determining a size attribute associated with the physical object stored in a datastore of physical objects available for purchase, the size attribute corresponding to an actual size of the physical object;

receiving a second selection of a location on a surface on which to position a rendering of the physical object in an environment, wherein receiving the second selection is based at least in part on detecting a user gesture in proximity to an actual location on an actual surface within the environment; and

presenting, based at least in part on the second selection of the location on the surface, the rendering of the physical object to appear to be at the location on the surface within the environment, the rendering depicting the actual size of the physical object from a user perspective based at least in part on the size attribute.

13. The system of claim 12 , the system further comprising a projector, and the acts further comprising presenting, using the projector, a positioning prompt indicating placement of the physical object within the environment at the location, wherein the positioning prompt comprises at least one of one or more visual indicators directing the placement of the physical object.

14. The system of claim 12 , the acts further comprising:

determining one or more additional attributes associated with the physical object in the datastore of physical objects available for purchase, the one or more additional attributes including at least one of a color of the physical object, a texture of the physical object, or a topography of the physical object,

wherein presenting the rendering of the physical object is further based at least in part on the one or more additional attributes.

15. The system of claim 12 , the acts further comprising:

determining, using a camera, a direction of a gaze of a user associated with the user gesture; and

wherein the location of the rendering of the physical object is further based at least in part on the direction of the gaze of the user.

16. A method comprising:

receiving a first selection of a representation of a physical object;

determining, from a datastore of physical objects available for purchase, an attribute associated with the physical object, comprising at least a size attribute of the physical object that corresponds to an actual size of the physical object;

presenting a first rendering of the physical object to appear to be on a first surface within an environment, the first rendering depicting the actual size of the physical object from a perspective of a user based at least in part on the size attribute;

receiving a second selection of a second location on a second surface to place the first rendering of the physical object at the second location within the environment, wherein the second selection comprises selecting an actual location within the environment; and

presenting, based at least in part on the second selection of the second location on the second surface, a second rendering of the physical object to appear to be on the second surface, the second rendering depicting the actual size of the physical object from the perspective of the user based at least in part on the size attribute.

17. The method of claim 16 , wherein receiving the second selection of the second location on the second surface comprises detecting a gesture made by the user in proximity to an actual surface within the environment.

18. The method of claim 16 , further comprising presenting, using a projector, a positioning prompt indicating placement of the physical object at the second location on the second surface, the positioning prompt comprising at least one of one or more visual indicators directing the placement of the physical object.

19. The method of claim 16 , further comprising:

determining one or more additional attributes associated with the physical object, the one or more additional attributes including at least one of a color of the physical object, a texture of the physical object, or a topography of the physical object,

wherein presenting the second rendering of the physical object to appear to be at the second location on the second surface is based at least in part on the attribute and the one or more additional attributes.

20. The method of claim 16 , further comprising storing a second attribute that indicates the second location on the second surface in association with the physical object.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: CEDERLOF, COLTER E
To: RAWLES LLC
Reel/Frame 041120/0899 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 041120/0934 →
Continuity (1)
Division 13236407 · Sep 19, 2011
Cited By (3)
US 12,271,516 US 12,367,590 US 12,501,225