IP Library › Granted Patent US 10,613,748
Granted Patent B2
US 10,613,748 · App. 15/724,227 · Granted Apr 7, 2020

Stylus assist

Inventors: Zachary Alcorn (Sunnyvale, CA); Jennifer Chen (San Francisco, CA); Alexander Friedrich Kuscher (San Francisco, CA); Sebastien Gabriel (San Francisco, CA); Maria Cirimele (East Palo Alto, CA); Thomas Buckley (San Francisco, CA)
Assignee: GOOGLE LLC
G06F3/04883G06F3/03545G06F3/0481G06F3/04842G06F9/453G06F16/248G06F16/24578G06F16/332G06F17/276
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,613,748
App. No.
15/724,227
Granted
Apr 7, 2020
Kind
B2
Abstract

Methods for providing information related to selected content and a suggested completion of one or more written words are provided. In one aspect, a method includes invoking an assistant tool, displaying an assistant window on a device display, receiving an indication of a selection of content on the display, generating a query for information associated with the selected content, receiving ranked results from the query, and displaying the received results in the assistant window. In one aspect, a snapshot of the selected content is captured and displayed with the results. In one aspect, a method includes receiving an indication of one or more words being written on the display and providing at least one suggested completion of a word or sentence being written. Systems and machine-readable media are also provided.

Claims (62)

1. A computer-implemented method for providing information related to selected content, the method comprising:

displaying content on a display of an electronic device;

invoking an assistant tool on the electronic device;

in response to invoking the assistant tool, providing, on the display of the electronic device, an assistant window as a window overlaying a portion of the content

prompting, by the assistant window, a selection of the content;

receiving, from an input source of the electronic device, an initial stroke on the display of the electronic device, wherein the input source is a stylus and the stylus is configured to provide rotation and left/right incline that influences drawing of stylus ink on the display to align with a user's left or right handedness;

morphing, by the assistant tool, the initial stroke of the input source on the electronic device into a uniform stroke, wherein the uniform stroke is an indication of a selection of the content and the morphing includes morphing a highlighting stroke as the initial stroke to have a uniform height and straightness and morphing an enclosing stroke as the initial stroke to have a uniform width and closed shape;

generating, by the assistant tool, a query for information associated with a portion of the selected content including metadata associated with the selected content;

receiving, by the electronic device, at least one highest ranked result based on the query and the metadata,

wherein a result rank indicates relevance of the result to the portion of the selected content; and

providing, by the assistant tool, the received at least one highest ranked result for display in the assistant window and one or more interactive features related to the at least one highest ranked result.

2. The method of claim 1 , further comprising:

identifying, by the assistant tool, an area of the selected content;

capturing, by the assistant tool, a snapshot of the identified area; and

providing, by the assistant tool, the captured snapshot for display in the assistant window.

3. The method of claim 1 , wherein the indication from the input source is based on highlighting content for selection with stylus ink.

4. The method of claim 3 , further comprising:

analyzing, by the assistant tool, the content underneath the stylus ink to generate the query.

5. The method of claim 1 , wherein the indication from the input source is based on at least substantially enclosing the content for selection with stylus ink.

6. The method of claim 5 , further comprising:

analyzing, by the assistant tool, the content at least substantially enclosed by the stylus ink to generate the query.

7. The method of claim 1 , wherein the indication from the input source is based on underlining the content for selection with stylus ink.

8. The method of claim 7 , further comprising:

analyzing, by the assistant tool, the content underlined by the stylus ink to generate the query.

9. The method of claim 1 , wherein the indication from the input source is based on one or more words being written on the display.

10. The method of claim 9 , further comprising:

analyzing, by the assistant tool, the one or more written words to generate the query, wherein the received at least one highest ranked result for display in the assistant window are suggested completions to an incomplete word or a sentence on the display.

11. The method of claim 1 , wherein a virtual tip of the stylus maintains a defined slanted angle regardless of a tilt position of the stylus.

12. A system for providing information related to selected content, the system comprising:

a memory; and

a processor configured to execute instructions which, when executed, cause the processor to:

display content on a display of a client device;

invoke an assistant tool on the client device;

in response to invoking the assistant tool, provide an assistant window as a window overlaying a portion of the content on the display of the client device;

prompt, by the assistant window, a selection of the content

receive, from an input source of the client device, an indication of a selection of the content on the display, wherein the input source is a stylus and the stylus is configured to provide rotation and left/right incline that influences drawing of stylus ink on the display to align with a user's left or right handedness;

morph, by the assistant tool, an initial highlighting stroke of the input source with a unified height and provide, on the display, the morphed highlighting stroke having a uniform height and straightness;

morph, by the assistant tool, an initial enclosing stroke of the input source with a unified width and provide, on the display, the morphed enclosing stroke having a uniform width and closed shape;

generate, by the assistant tool, a query for information associated with a portion of the selected content including metadata associated with the selected content;

obtain, by the client device, at least one result based on the query and the metadata;

identify, by the assistant tool, an area of the selected content;

capture, by the assistant tool, a snapshot of the identified area; and

provide, by the assistant tool, the captured snapshot and the obtained at least one result from the query for display in the assistant window and one or more interactive features related to the at least one result.

13. The system of claim 12 , wherein the indication from the stylus is based on one of:

highlighting the content for selection with stylus ink;

at least substantially enclosing the content for selection with stylus ink;

underlining the content for selection with stylus ink; and

writing one or more words on the display with stylus ink.

14. A non-transitory machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for providing information related to selected content, the method comprising:

displaying content on a display of a mobile device;

invoking an assistant tool on the mobile device;

in response to invoking the assistant tool, providing an assistant window as a window overlaying a portion of the content on the display of the mobile device;

prompting, by the assistant window, a selection of the content

receiving an initial stroke of an input source on the display, wherein the input source is a stylus and the stylus is configured to provide rotation and left/right incline that influences drawing of stylus ink on the display to align with a user's left or right handedness;

morphing the initial stroke into a uniform stroke, wherein the uniform stroke is an indication of a selection of the content, wherein the morphing includes morphing a highlighting stroke as the initial stroke to have a uniform height and straightness and morphing an enclosing stroke as the initial stroke to have a uniform width and closed shape;

generating, by the assistant tool, a query for information associated with the selected content including metadata associated with the selected content;

receiving, by the mobile device, ranked results based on the query and the metadata, wherein a result rank is a confidence level of relevance to the selected content; and

providing, by the assistant tool, the received ranked results for display in the assistant window and one or more interactive features related to the ranked results.

15. The non-transitory machine-readable storage medium of claim 14 , further comprising:

selecting the content with the stylus;

displaying the selection with uniformly proportioned stylus ink; and

analyzing, by the assistant tool, the content indicated by the stylus ink.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 17, 2017
From: ALCORN, ZACHARY; CHEN, JENNIFER; KUSCHER, ALEXANDER FRIEDRICH; GABRIEL, SEBASTIEN; CIRIMELE, MARIA; BUCKLEY, THOMAS
To: GOOGLE LLC
Reel/Frame 043887/0532 →
Continuity (1)
Related Publication 20190102080A1 · Apr 4, 2019
Cited By (3)
US 12,265,667 US 12,505,137 US 12,694,048