IP Library Granted Patent US 9,529,454
Granted Patent B1
US 9,529,454 · App. 14/745,197 · Granted Dec 27, 2016

Three-dimensional user input

Inventors: Michael David McGrath (Duvall, WA); Jonathan Ross Hoof (Kenmore, WA)
Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
G06F3/0346G06F3/013G06F3/0487G06F3/04845
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,529,454
App. No.
14/745,197
Granted
Dec 27, 2016
Kind
B1
Abstract

Examples are disclosed herein that relate to processing three-dimensional user input. One example provides a method of processing user input in a three-dimensional coordinate system, comprising receiving a user input of an origin reset for the three-dimensional coordinate system, responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system, receiving three-dimensional user input in the three-dimensional coordinate system, while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin, and causing movement of a user interface element displayed in a user interface, the movement based on the at least one measured three-dimensional displacement.

Claims (44)

1. A method of processing user input in a three-dimensional coordinate system, comprising:

receiving a user input of an origin reset for the three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system;

receiving three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

causing movement of a user interface element displayed in a user interface, the movement based on the at least one measured three-dimensional displacement.

2. The method of claim 1 , wherein causing the movement includes translating the user interface element along a direction of the at least one three-dimensional displacement.

3. The method of claim 1 , wherein causing the movement includes translating the user interface element a distance, the distance determined by scaling a magnitude of the three-dimensional displacement.

4. The method of claim 1 , further comprising, responsive to the three-dimensional displacement exceeding a threshold displacement, resetting the origin of the three-dimensional coordinate system.

5. The method of claim 1 , wherein causing the movement includes translating the user interface element at a speed proportional to a speed at which the three-dimensional displacement was supplied.

6. The method of claim 1 , wherein the user input of the origin reset comprises a hand gesture.

7. The method of claim 1 , wherein the user input of the origin reset comprises voice input.

8. The method of claim 1 , wherein the user interface element is selected by a user input of a gaze direction.

9. The method of claim 1 , wherein the three-dimensional user input is received via a depth camera.

10. The method of claim 1 , further comprising, while the origin remains set, displaying the origin in the user interface.

11. The method of claim 1 , wherein causing the movement includes scrolling the user interface element.

12. A method of processing user input in a three-dimensional coordinate system, comprising:

receiving a user input of a gaze direction;

mapping the gaze direction to a point in a user interface;

receiving a user input of an origin reset for the three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, resetting an origin of the three-dimensional coordinate system;

receiving three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measuring at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

causing movement of a user interface element displayed in the user interface, the movement based on the at least one measured three-dimensional displacement and beginning at the point to which the gaze direction is mapped.

13. The method of claim 12 , wherein the point to which the gaze direction is mapped overlaps the user interface element.

14. The method of claim 12 , wherein causing the movement of the user interface element includes translating the user interface element along a direction of the three-dimensional displacement.

15. The method of claim 12 , further comprising determining a vector based on the three-dimensional displacement, a tail of the vector located at the point to which the gaze direction is mapped.

16. The method of claim 12 , further comprising, responsive to the three-dimensional displacement exceeding a threshold displacement, resetting the origin of the three-dimensional coordinate system.

17. A head mounted display device, comprising:

a display;

an outward-facing image sensor; and

a computing device comprising a processor and a storage device holding instructions executable by the processor to:

display, on the display, a user interface;

receive, via the outward-facing image sensor, a user input of an origin reset for a three-dimensional coordinate system;

responsive to receiving the user input of the origin reset, reset an origin of the three-dimensional coordinate system;

receive three-dimensional user input in the three-dimensional coordinate system;

while the origin remains set, measure, via the outward-facing image sensor, at least one three-dimensional displacement of the three-dimensional user input relative to the origin; and

cause movement of a user interface element displayed in the user interface, the movement based on the at least one measured three-dimensional displacement.

18. The method of claim 17 , wherein the three-dimensional user input is received via a three-dimensional input device held or worn by a user.

19. The method of claim 17 , wherein the three-dimensional user input is received via the outward-facing image sensor.

20. The method of claim 17 , wherein the instructions are further executable to:

receive, via a gaze sensor, a user input of a gaze direction; and

map the gaze direction to a point in the user interface,

wherein the movement of the user interface element begins at the point to which the gaze direction is mapped.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 19, 2015
From: MCGRATH, MICHAEL DAVID; HOOF, JONATHAN ROSS
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 035871/0389 →