IP Library Granted Patent US 11,307,718
Granted Patent B2
US 11,307,718 · App. 17/078,801 · Granted Apr 19, 2022

Gesture-based small device input

Inventors: James B. Miller (Sunnyvale, CA); Richard C. Gossweiler, III (Sunnyvale, CA)
Assignee: GOOGLE LLC
G06F3/044G06F1/163G06F1/169G06F3/017G06F3/0418G06F3/0421G06F3/0425G06F3/0426G06F3/04883G06F3/04886G04G21/04G06F2203/04101
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,307,718
App. No.
17/078,801
Granted
Apr 19, 2022
Kind
B2
Abstract

A computer-implemented method is described that includes providing a watch defining a body and a watch face on a surface of the body, the body having one or more sensors arranged to sense user inputs in an area adjacent to the body. The method further comprises sensing a motion of an object in the area adjacent to, but not touching, the body using the one or more sensors and changing a display of a pointing element on a graphical user interface on the watch in coordination with the sensed motion.

Claims (79)

1. A computer-implemented method, comprising:

displaying, by a computing device including one or more sensors, an image on a surface of a user wearing the computing device, the image being displayed on the surface of the user at an area that is adjacent to the computing device;

monitoring, by the computing device, the area adjacent to the computing device for movement of an object relative to the image;

determining, by the computing device, that a movement of the object has occurred in the area adjacent to the computing device; and

in response to determining that the movement of the object has occurred in the area adjacent to the computing device, performing an operation based at least in part on the movement and the image.

2. The computer-implemented method of claim 1 , wherein:

displaying, by the computing device, the image on the surface of the user comprises projecting the image onto the surface of the user in the area monitored by the computing device for movement, the image comprising a graphical user interface that includes a user-selectable element; and

detecting the movement of the object in the area comprises identifying user interaction with the user-selectable element in the area adjacent to the computing device and the surface of the user.

3. The computer-implemented method of claim 1 , further comprising:

identifying, by the computing device, a gesture corresponding to the movement of the object in the area that is adjacent to the computing device; and

in response to identifying the gesture corresponding to the movement of the object, identifying the operation as corresponding to the gesture;

wherein performing the operation is performed in response to identifying the operation as corresponding to the gesture.

4. The computer-implemented method of claim 1 , comprising:

identifying a path traced by the movement of the object in the area that is adjacent to the computing device; and

causing a pointing element displayed in a graphical user interface to move in coordination with the path traced by the object.

5. The computer-implemented method of claim 1 , further comprising:

determining, by the computing device, that a detection area on the surface of a body of the user has been contacted.

6. The computer-implemented method of claim 1 , wherein determining, by the computing device, that the movement of the object has occurred in the area adjacent to the computing device comprises:

detecting, by the computing device using the one or more sensors, a non-touch movement of the object in the area that is adjacent to the computing device.

7. The computer-implemented method of claim 1 , further comprising:

illuminating, using one or more light sources included in the computing device, the area that is adjacent to the computing device; and

monitoring, using the one or more sensors of the computing device, light reflected from the area;

wherein determining, by the computing device, that the movement of the object has occurred comprises receiving information about the light reflected from the area.

8. The computer-implemented method of claim 7 , wherein:

the one or more light sources comprise one or more light emitting diodes; and

the one or more sensors comprise one or more photodiodes.

9. The computer-implemented method of claim 1 , further comprising:

identifying a plurality of applications on the computing device;

detecting, using an accelerometer included in the computing device, motion of the computing device;

in response to detecting the motion of the computing device, selecting one or more applications from a plurality of applications; and

providing information to the one or more applications that indicates the motion of the computing device.

10. A computing device, comprising:

one or more sensors;

one or more processors; and

one or more non-transitory computer readable media that collectively store instructions that when executed by the one or more processors cause the one or more processors to perform operations, the operations comprising:

displaying an image on a surface of a user wearing the computing device, the image being displayed on the surface of the user at an area that is adjacent to the computing device;

monitoring the area adjacent to the computing device for movement of an object relative to the image;

determining that a movement of the object has occurred in the area adjacent to the computing device; and

in response to determining that the movement of the object has occurred in the area adjacent to the computing device, performing an operation based at least in part on the movement and the image.

11. The computing device of claim 10 , wherein:

displaying, by the computing device, the image on the surface of the user comprises projecting the image onto the surface of the user in the area monitored by the computing device for movement, the image comprising a graphical user interface that includes a user-selectable element; and

detecting the movement of the object in the area comprises identifying user interaction with the user-selectable element in the area adjacent to the computing device and the surface of the user.

12. The computing device of claim 10 , wherein the operations further comprise:

identifying a gesture corresponding to the movement of the object in the area that is adjacent to the computing device; and

in response to identifying the gesture corresponding to the movement of the object, identifying the operation as corresponding to the gesture;

wherein performing the operation is performed in response to identifying the operation as corresponding to the gesture.

13. The computing device of claim 10 , wherein the operations further comprise:

identifying a path traced by the movement of the object in the area that is adjacent to the computing device; and

causing a pointing element displayed in a graphical user interface to move in coordination with the path traced by the object.

14. The computing device of claim 10 , wherein the operations further comprise:

illuminating, using one or more light sources included in the computing device, the area that is adjacent to the computing device; and

monitoring, using the one or more sensors of the computing device, light reflected from the area;

wherein determining that the movement of the object has occurred comprises receiving information about the light reflected from the area.

15. The computing device of claim 10 , wherein the operations further comprise:

identifying a plurality of applications on the computing device;

detecting, using an accelerometer included in the computing device, motion of the computing device;

in response to detecting the motion of the computing device, selecting one or more applications from a plurality of applications; and

providing information to the one or more applications that indicates the motion of the computing device.

16. One or more non-transitory computer readable media that collectively store instructions that when executed by one or more processors cause the one or more processors to perform operations, the operations comprising:

displaying an image on a surface of a user wearing a computing device, the image being displayed on the surface of the user at an area that is adjacent to the computing device;

monitoring the area adjacent to the computing device for movement of an object relative to the image;

determining that a movement of the object has occurred in the area adjacent to the computing device; and

in response to determining that the movement of the object has occurred in the area adjacent to the computing device, performing an operation based at least in part on the movement and the image.

17. The one or more non-transitory computer readable media of claim 16 , wherein displaying the image on the surface of the user comprises:

projecting the image onto the surface of the user in the area monitored by the computing device for movement, the image comprising a graphical user interface that includes a user-selectable element; and

detecting the movement of the object in the area comprises identifying user interaction with the user-selectable element in the area adjacent to the computing device and the surface of the user.

18. The one or more non-transitory computer readable media of claim 16 , wherein the operations further comprise:

identifying a gesture corresponding to the movement of the object in the area that is adjacent to the computing device; and

in response to identifying the gesture corresponding to the movement of the object, identifying the operation as corresponding to the gesture;

wherein performing the operation is performed in response to identifying the operation as corresponding to the gesture.

19. The one or more non-transitory computer readable media of claim 16 , wherein the operations further comprise:

illuminating, using one or more light sources included in the computing device, the area that is adjacent to the computing device; and

monitoring, using one or more sensors of the computing device, light reflected from the area;

wherein determining that the movement of the object has occurred comprises receiving information about the light reflected from the area.

20. The one or more non-transitory computer readable media of claim 16 , wherein the operations further comprise

identifying a plurality of applications on the computing device;

detecting, using an accelerometer included in the computing device, motion of the computing device;

in response to detecting the motion of the computing device, selecting one or more applications from a plurality of applications; and

providing information to the one or more applications that indicates the motion of the computing device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 18, 2020
From: MILLER, JAMES B.; GOSSWEILER, RICHARD C., III
To: GOOGLE INC.
Reel/Frame 054691/0052 →
CHANGE OF NAME Recorded Dec 18, 2020
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 054807/0286 →
Continuity (5)
Continuation 16193479 · Nov 16, 2018
Continuation 15074205 · Mar 18, 2016
Continuation 14093914 · Dec 2, 2013
Continuation 12258009 · Oct 24, 2008
Related Publication 20210041974A1 · Feb 11, 2021