IP Library Granted Patent US 10,296,128
Granted Patent B1
US 10,296,128 · App. 14/845,396 · Granted May 21, 2019

Multi-state press and hold user interface

Inventors: John Jordan Nold (Boulder, CO); Alberto Abelardo Vildosola (Boulder, CO); Joe Venters (Alameda, CA); Chikezie Ejiasi (Sunnyvale, CA)
Assignee: GOOGLE LLC
G06F3/0416G06F3/016G06F3/04817
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,296,128
App. No.
14/845,396
Filed
Sep 4, 2015
Granted
May 21, 2019
Kind
B1
Art Unit
2686
USPC
340/5.2
Abstract

Systems and techniques are provided for a multi-state press and hold user interface. A state visualization may be displayed on a touchscreen. The state visualization may include a control for a controlled system and an indicator of a state of the controlled system. The indicator may be for an initial state of the controlled system. An indication of an initial touch input to the control may be received. It may be determined that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control. An instruction may be sent to change state to the controlled system. The instruction may be based on the initial state of the controlled system. An updated state of the controlled system may be received. The indicator of the state visualization may be changed to an indicator for the updated state of the controlled system.

Claims (57)

1. A computer-implemented method performed by a data processing apparatus, the method comprising:

displaying a state visualization on a touchscreen, the state visualization comprising a control for a controlled system and an indicator of a state of the controlled system, wherein the indicator is for an initial state of the controlled system;

receiving an indication of an initial touch input to the control;

displaying visual feedback to indicate the receiving of the initial touch input to the control;

determining that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control;

displaying, on the touchscreen, a first progress indicator while determining that touch input to the control has persisted for the threshold amount of time after the initial touch input to the control, wherein the visual depiction of the first progress indicator is based on the initial state of the controlled system;

sending an instruction to change state to the controlled system, the instruction based on the initial state of the controlled system;

receiving an updated state of the controlled system, wherein the updated state is different from the initial state;

changing the indicator of the state visualization to an indicator for the updated state of the controlled system;

receiving an indication of a second initial touch input to the control;

determining that the touch input to the control has persisted for a second threshold amount of time after the second initial touch input to the control;

displaying, on the touchscreen, a second progress indicator while determining that touch input to the control has persisted for the second threshold amount of time after the second initial touch input to the control, wherein the visual depiction of the second progress indicator is based on the updated state of the controlled system, and wherein at least one aspect of the visual depiction of the second progress indicator is different from at least one aspect of the visual depiction of first progress indicator;

sending a second instruction to change state to the controlled system, the instruction based on the updated state of the controlled system, wherein the second instruction is different from the instruction;

receiving a second updated state of the controlled system; and

changing the indicator of the state visualization to an indicator for the second updated state of the controlled system.

2. The computer-implemented method of claim 1 , wherein the second updated state of the controlled system is the initial state of the controlled system.

3. The computer-implemented method of claim 1 , wherein determining that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control further comprises:

starting a timer when the indication of the initial touch input to the control is received; and

running the timer for the threshold amount of time while the touch input persists to the control persists, wherein the timer expires after running for the threshold amount of time.

4. The computer-implemented method of claim 3 , further comprising activating the control when the timer expires.

5. The computer-implemented method of claim 1 , further comprising wherein displaying visual feedback to indicate the receiving of the initial touch input to the control further comprises one or more of changing a size of the state visualization, changing a color of the state visualization, changing a texture of the state visualization, and displaying a halo around the location of the initial touch input, and providing haptic feedback.

6. The computer-implemented method of claim 1 , further comprising providing haptic feedback to indicate the receiving of the initial touch input to the control.

7. The computer-implemented method of claim 1 , wherein the controlled system comprises a component of a smart home environment.

8. The computer-implemented method of claim 1 , wherein the threshold amount of time is greater than one second.

9. The computer-implemented method of claim 1 , further comprising displaying an additional visual indicator after sending the instruction to change state to the controlled system and before receiving an updated state of the controlled system, wherein the additional visual indicator is based on the instruction to change state sent to the controlled system.

10. The computer-implemented method of claim 1 , further comprising:

receiving an indication of a third initial touch input to the control;

determining that touch input to the control has not persisted for a third threshold amount of time after the third initial touch input to the control; and

not activating the control.

11. The computer-implemented method of claim 10 , wherein determining that touch input to the control has not persisted for a third threshold amount of time after the third initial touch input to the control further comprises:

starting a timer when the indication of the third initial touch input to the control is received;

running the timer for the amount of time the touch input to the control persists; and

resetting the timer when the touch input stops before the timer has run for the third threshold amount of time.

12. The computer-implemented method of claim 1 , wherein the indicator of the state of the controlled system comprises an icon visually representing the state of the controlled system.

13. The computer-implemented system of claim 1 , wherein the computing device is further adapted to render, for display on the touchscreen, the first progress indicator while determining that touch input to the control has persisted for the threshold amount of time after the initial touch input to the control.

14. The computer-implemented system of claim 13 , wherein the visual depiction of the first progress indicator is rendered based on the initial state of the controlled system, and wherein at least one aspect of the first progress indicator displayed when the initial state is a first state is different from the at least one aspect of the progress indicator displayed when the initial state is a second state.

15. A computer-implemented system for a multi-state press and hold user interface comprising:

a touchscreen adapted to display a state visualization, the state visualization comprising a control for a controlled system and an indicator for a state of the controlled system, receive touch input, and generate an indication of the received touch input; and

a computing device connected to the touchscreen, the processor adapted to render the state visualization comprising the control and the indicator the state of the controlled system for display on the touchscreen, receive an indication of an initial touch input to the control from the touchscreen, display visual feedback to indicate the receiving of the initial touch input to the control, determine that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control, display, on the touchscreen, a first progress indicator while determining that touch input to the control has persisted for the threshold amount of time after the initial touch input to the control, wherein the visual depiction of the first progress indicator is based on the initial state of the controlled system, send an instruction to change state to the controlled system, the instruction based on the initial state of the controlled system, receive an updated state of the controlled system wherein the updated state is different from the initial state, render an updated state visualization comprising an indicator for the updated state of the controlled system for display on the touchscreen, receive an indication of a second initial touch input to the control, determine that the touch input to the control has persisted for a second threshold amount of time after the second initial touch input to the control, display, on the touchscreen, a second progress indicator while determining that touch input to the control has persisted for the second threshold amount of time after the second initial touch input to the control, wherein the visual depiction of the second progress indicator is based on the updated state of the controlled system, and wherein at least one aspect of the visual depiction of the second progress indicator is different from at least one aspect of the visual depiction of first progress indicator, send a second instruction to change state to the controlled system wherein the second instruction is different from the instruction, the instruction based on the updated state of the controlled system, receive a second updated state of the controlled system, and change the indicator of the state visualization to an indicator for the second updated state of the controlled system.

16. The computer-implemented system of claim 15 , wherein the computing device is further adapted to determine that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control by starting a timer when the indication of the initial touch input to the control is received running the timer for the threshold amount of time while the touch input persists to the control persists, wherein the timer expires after running for the threshold amount of time.

17. The computer-implemented system of claim 16 , wherein the computing device is further adapted to activate the control when the timer expires.

18. A system comprising: one or more computers and one or more storage devices storing instructions which are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:

A computer-implemented method performed by a data processing apparatus, the method comprising:

displaying a state visualization on a touchscreen, the state visualization comprising a control for a controlled system and an indicator of a state of the controlled system, wherein the indicator is for an initial state of the controlled system;

receiving an indication of an initial touch input to the control;

displaying visual feedback to indicate the receiving of the initial touch input to the control;

determining that touch input to the control has persisted for a threshold amount of time after the initial touch input to the control;

displaying, on the touchscreen, a first progress indicator while determining that touch input to the control has persisted for the threshold amount of time after the initial touch input to the control, wherein the visual depiction of the first progress indicator is based on the initial state of the controlled system;

sending an instruction to change state to the controlled system, the instruction based on the initial state of the controlled system;

receiving an updated state of the controlled system, wherein the updated state is different from the initial state;

changing the indicator of the state visualization to an indicator for the updated state of the controlled system;

receiving an indication of a second initial touch input to the control;

determining that the touch input to the control has persisted for a second threshold amount of time after the second initial touch input to the control;

displaying, on the touchscreen, a second progress indicator while determining that touch input to the control has persisted for the second threshold amount of time after the second initial touch input to the control, wherein the visual depiction of the second progress indicator is based on the updated state of the controlled system, and wherein at least one aspect of the visual depiction of the second progress indicator is different from at least one aspect of the visual depiction of first progress indicator;

sending a second instruction to change state to the controlled system, the instruction based on the updated state of the controlled system, wherein the second instruction is different from the instruction;

receiving a second updated state of the controlled system; and

changing the indicator of the state visualization to an indicator for the second updated state of the controlled system.

Assignments (2)
CHANGE OF NAME Recorded Oct 20, 2017
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 044567/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2016
From: NOLD, JOHN JORDAN; VILDOSOLA, ALBERTO ABELARDO; VENTERS, JOE; EJIASI, CHIKEZIE
To: GOOGLE INC.
Reel/Frame 038112/0578 →
Cited By (25)
US 1,066,361 US 12,205,699 US 12,208,251 US 12,256,128 US 12,262,089 US 12,265,364 US 12,265,696 US 12,290,667 US 12,299,260 US 12,307,079 US 12,307,085 US 12,321,574 US 12,343,495 US 12,364,822 US 12,375,601 US 12,379,827 US 12,405,706 US 12,411,600 US 12,422,976 US 12,443,339 US 12,449,905 US 12,511,028 US 12,541,277 US 12,576,212 US 12,667,674