IP Library Granted Patent US 9,304,674
Granted Patent B1
US 9,304,674 · App. 14/133,100 · Granted Apr 5, 2016

Depth-based display navigation

Inventors: Matthew Alan Townsend (Redwood City, CA); Deon Poncini (Sunnyvale, CA); Daniel Christopher Bay (Santa Clara, CA); Bryan Harris (San Francisco, CA); Edward Dietz Crump (Santa Cruz, CA); Jason Zimmer (Santa Clara, CA)
Assignee: Amazon Technologies, Inc.
G06F3/0487G06F3/017G06F3/0482G06F3/011G06F3/0488G06F3/04815G06F3/04842G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,304,674
App. No.
14/133,100
Granted
Apr 5, 2016
Kind
B1
Abstract

A system for navigating content may be responsive to movement of a hand by a user toward and away from a display surface. The content may be visually arranged and presented as a stack of visual panes. Moving the hand away from the display surface causes the panes to move upwardly through the stack. Moving the hand toward the display surface causes the panes to move downwardly through the stack. When moving upward, the otherwise topmost pane is deactivated and hidden. Upon reaching the top of the stack, a pane is activated and displayed in full.

Claims (59)

1. A system comprising:

one or more processors;

a projector;

one or more computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform acts comprising:

projecting a graphical representation of an object onto a display surface with the projector;

in response to a grasping gesture of a hand over the graphical representation, projecting a control menu onto the display surface with the projector, the control menu comprising a plurality of control panes that are visually arranged concentrically in a stack at different depths relative to each other, wherein each control pane comprises one or more selectable graphical controls that outwardly border the graphical representation of the object;

detecting a first movement of the hand away from the display surface;

in response to detecting the first movement, (a) making a first of the control panes visible and (b) making the graphical controls of the first control pane available for selection;

detecting a second movement of the hand away from the display surface; and

in response to detecting the second movement of the hand away from the display surface, (a) making a second of the control panes visible, (b) making the graphical controls of the second control pane available for selection, (c) at least partially hiding the first control pane, and (d) making the graphical controls of the first control pane unavailable for selection.

2. The system of claim 1 , further comprising:

visually moving the control panes through the stack as the hand moves away from the display surface;

wherein an individual control pane when at a first depth is at least partially obscured by an overlaying control pane at a second depth; and

wherein the individual control pane when at the second depth is visible.

3. The system of claim 1 , wherein:

the configuring comprises associating each of the graphical controls with a command that is executable to act upon the object; and

the acts further comprise executing the command associated with a particular graphical control in response to movement of the hand in a direction outward from the graphical representation to the particular graphical control.

4. A method comprising:

projecting a graphical representation of an object onto a display surface with the projector;

detecting a gesture of a hand over the graphical representation of the object;

projecting a control menu onto the display surface with the projector, the control menu comprising a plurality of menu layers that are visually arranged concentrically in a stack at different depths relative to each other, wherein each menu layer comprise one or more graphical controls that outwardly border the graphical representation of the object;

detecting a first change in a distance of the hand from the display surface;

in response to detecting the first change, making one or more graphical controls of a first menu layer of the plurality of menu layers available for selection;

detecting a second change in the distance of the hand from the display surface; and

in response to detecting the second change, making one or more graphical controls of a second menu layer of the plurality of menu layers available for selection, and making the one or more graphical controls of the first menu layer unavailable for selection.

5. The method of claim 4 , further comprising:

detecting a third change in the distance of the hand from the display surface; and

in response to detecting the third change, (a) displaying a third menu layer of the plurality of menu layers on the display surface, (b) making one or more graphical controls of the third menu layer available for selection, and (c) at least partially hiding the second menu layer.

6. The method of claim 4 , further comprising:

visually moving the menu layers through at least first and second depths relative to the display surface as the hand moves away from the display surface.

7. The method of claim 4 , wherein:

the displaying of the first menu layer is performed in response to a grasping gesture by the hand.

8. The method of claim 4 , wherein:

the displaying of the first menu layer is performed in response to a grasping gesture by the hand; and

the method further comprising selecting one of the one or more graphical controls in response to an ungrasping gesture by the hand.

9. The method of claim 4 , wherein:

displaying the first menu layer comprises projecting the first menu layer onto the display surface with the projector; and

displaying the second menu layer comprises projecting the second menu layer onto the display surface with the projector.

10. The method of claim 4 , wherein the display surface comprises an electronic display device.

11. The method of claim 4 , further comprising arranging the one or more graphical controls of the first menu layer and second menu layer to graphically border the displayed representation of the object to be acted upon by the one or more graphical controls.

12. The method of claim 4 , wherein the display surface is planar.

13. One or more non-transitory computer-readable storage media storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:

projecting a graphical representation of an object onto a display surface with a projector;

detecting a gesture of a hand over the graphical representation of the object;

projecting a control menu comprising a plurality of content layers that are visually arranged concentrically in a stack at different depths relative to each other, wherein each content layer comprises one or more graphical controls that outwardly border the graphical representation of the object;

detecting a first change in a distance of the hand from the display surface;

in response to detecting the first change, making the one or more graphical controls of a first content layer available for selection;

detecting a second change in the distance of the hand from the display surface; and

in response to detecting the second change, making the one or more graphical controls of a second content layer available for selection, and making the one or more graphical controls of the first content layer unavailable for selection.

14. The one or more non-transitory computer-readable storage media of claim 13 , the acts further comprising:

detecting a third change in the distance of the hand from the display surface; and

in response to detecting the third change, displaying a third content layer on the display surface and at least partially hiding the second content layer.

15. The one or more non-transitory computer-readable storage media of claim 13 , the acts further comprising:

visually moving the content layers through at least first and second depths relative to the display surface as the hand moves away from the display surface.

16. The one or more non-transitory computer-readable storage media of claim 13 , wherein:

the displaying of the first content layer is performed in response to a grasping gesture by the hand.

17. The one or more non-transitory computer-readable storage media of claim 13 , wherein the display surface is planar.

18. The one or more non-transitory computer-readable storage media of claim 13 , wherein the display surface comprises an electronic display device.

19. The one or more non-transitory computer-readable storage media of claim 13 , the acts further comprising projecting the first content layer and second content layer onto the display surface with the projector.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2015
From: RAWLES LLC
To: AMAZON TECHNOLOGIES, INC.
Reel/Frame 037103/0084 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 3, 2014
From: TOWNSEND, MATTHEW ALAN; PONCINI, DEON; BAY, DANIEL CHRISTOPHER; HARRIS, BRYAN; CRUMP, EDWARD DIETZ; ZIMMER, JASON
To: RAWLES LLC
Reel/Frame 032121/0726 →