IP Library Granted Patent US 10,852,837
Granted Patent B2
US 10,852,837 · App. 16/193,479 · Granted Dec 1, 2020

Gesture-based small device input

Inventors: James B. Miller (Sunnyvale, CA); Richard C. Gossweiler, III (Sunnyvale, CA)
Assignee: Google LLC
G06F3/017G06F1/163G06F1/169G06F3/044G06F3/0418G06F3/0421G06F3/0425G06F3/0426G06F3/04883G06F3/04886G04G21/04G06F2203/04101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,852,837
App. No.
16/193,479
Granted
Dec 1, 2020
Kind
B2
Abstract

A computer-implemented method is described that includes providing a watch defining a body and a watch face on a surface of the body, the body having one or more sensors arranged to sense user inputs in an area adjacent to the body. The method further comprises sensing a motion of an object in the area adjacent to, but not touching, the body using the one or more sensors and changing a display of a pointing element on a graphical user interface on the watch in coordination with the sensed motion.

Claims (52)

1. A computer-implemented method, comprising:

monitoring for movement, by a computing device including one or more sensors, an area that is adjacent to the computing device and a surface of a user wearing the computing device;

detecting, by the computing device using the one or more sensors, a non-touch movement of an object in the area that is adjacent to the computing device and the surface of the user;

identifying, by the computing device, a gesture corresponding to the non-touch movement of the object in the area that is adjacent to the computing device and the surface of the user; and

in response to identifying the gesture corresponding to the non-touch movement of the object, performing an operation that corresponds to the gesture.

2. The computer-implemented method of claim 1 , comprising:

identifying a path traced by the non-touch movement of the object in the area that is adjacent to the computing device and the surface of the user; and

causing a pointing element displayed in a graphical user interface to move in coordination with the path traced by the object.

3. The computer-implemented method of claim 1 , comprising:

projecting an image onto the surface of the user in the area monitored by the computing device for movement, the image comprising a graphical user interface that includes a user-selectable element; and

detecting the non-touch movement of the object in the area comprises identifying user interaction with the user-selectable element in the area adjacent to the computing device and the surface of the user.

4. The computer-implemented method of claim 3 , wherein the user-selectable element in the graphical user interface of the image projected onto the surface of the user comprises a virtual key.

5. The computer-implemented method of claim 4 , further comprising:

identifying the operation that corresponds to the gesture based on the user interaction with the virtual key.

6. The computer-implemented method of claim 1 , wherein detecting that the non-touch movement of the object has occurred comprises identifying a change in an intensity of light reflected from the area on the surface of the user.

7. The computer-implemented method of claim 6 , wherein the computing device comprises a light source and a light sensor and the method comprises:

illuminating the area on the surface of the user using the light source of the computing device; and

using the light sensor to monitor for changes in the intensity of light reflected from the area on the surface of the user.

8. The computer-implemented method of claim 1 , further comprising:

displaying, by the computing device, a graphical user interface.

9. The computer-implemented method of claim 1 , wherein the area includes at least a portion of the surface of the user.

10. The computer-implemented method of claim 1 , wherein:

the object is not the user.

11. The computer-implemented method of claim 1 , wherein:

the computing device is worn on a first hand of the user; and

the object includes a second hand of the user.

12. A computer-implemented method, comprising:

displaying, by a computing device including one or more sensors, an image on a surface of a user wearing the computing device, the image being displayed at an area that is adjacent to the computing device;

monitoring, by the computing device, the area adjacent to the computing device for movement of an object relative to the image;

determining, by the computing device, that a non-touch movement of the object has occurred in the area adjacent to the computing device; and

in response to determining that the non-touch movement of the object has occurred in the area adjacent to the computing device, performing an operation based at least in part on the non-touch movement and the image.

13. The computer-implemented method of claim 12 , comprising:

identifying a path traced by the object within the area on the surface of the user; and

causing a pointing element displayed in a graphical user interface to move in coordination with the path traced by the object within the area on the surface of the user.

14. The computer-implemented method of claim 12 , wherein the image comprises a graphical user interface that includes a user-selectable element, and determining that the non-touch movement of the object has occurred in the area on the surface of the user comprises identifying user interaction with the user-selectable element in the area on the surface of the user.

15. A computing device, comprising:

one or more processors; and

a computer-readable medium having instructions stored thereon that, when executed by the one or more processors, cause performance of operations comprising:

monitoring for movement via one or more sensors, an area that is adjacent to the computing device and a surface of a user wearing the computing device;

detecting via the one or more sensors, a non-touch movement of an object in the area that is adjacent to the computing device and the surface of the user;

identifying a gesture corresponding to the non-touch movement of the object in the area that is adjacent to the computing device and the surface of the user; and

in response to identifying the gesture corresponding to the non-touch movement of the object, performing an operation that corresponds to the gesture.

16. The computing device of claim 15 , wherein the operations comprise:

identifying a path traced by the non-touch movement of the object in the area that is adjacent to the computing device and the surface of the user; and

causing a pointing element displayed in a graphical user interface to move in coordination with the path traced by the object.

17. The computing device of claim 15 , wherein the operations comprise:

projecting an image onto the surface of the user in the area monitored for movement, the image comprising a graphical user interface that includes a user-selectable element; and

detecting the non-touch movement of the object in the area comprises identifying user interaction with the user-selectable element in the area adjacent to the computing device and the surface of the user.

18. The computing device of claim 17 , wherein the user-selectable element in the graphical user interface of the image projected onto the surface of the user comprises a virtual key.

19. The computing device of claim 18 , further comprising:

identifying the operation that corresponds to the gesture based on the user interaction with the virtual key.

20. The computing device of claim 15 , wherein the area includes at least a portion of the surface of the user.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2018
From: MILLER, JAMES B.; GOSSWEILER, RICHARD C., III
To: GOOGLE INC.
Reel/Frame 047528/0162 →
CHANGE OF NAME Recorded Nov 16, 2018
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 047590/0423 →
Continuity (4)
Continuation 15074205 · Mar 18, 2016
Continuation 14093914 · Dec 2, 2013
Continuation 12258009 · Oct 24, 2008
Related Publication 20190087012A1 · Mar 21, 2019