IP Library Granted Patent US 11,249,616
Granted Patent B2
US 11,249,616 · App. 16/331,229 · Granted Feb 15, 2022

Assistive screenshots

Inventors: Haroon Baig (Mountain View, CA); Holger-Frederik Flier (Zurich, CH)
Assignee: GOOGLE LLC
G06F3/0482G06F3/0484G06F9/445G06F9/451G06F9/543G06F16/29G06F16/9537
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,249,616
App. No.
16/331,229
Granted
Feb 15, 2022
Kind
B2
Abstract

A method is implemented in a computing device having an operating system configured to capture screenshot images in response to entries of a pre-defined user input. In the method, an application executing on the computing device detects an entry of the pre-defined user input, identifies one or more executable features of the application that each use information corresponding to a current state or mode of the application to perform a respective set of one or more functions, generates a selectable link for each of the identified executable features, and presents, on the display, the generated selectable links such that a selection by the user of any one of the generated selectable links causes the respective set of functions to be performed.

Claims (53)

1. A method implemented in a computing device having a display device and an operating system, wherein the operating system is configured to capture screenshot images of screens shown on the display device in response to entries of a pre-defined user input, and wherein the method comprises:

detecting, by a mapping application executing on the computing device, an entry of the pre-defined user input, by a user of the computing device, that causes the operating system to capture a screenshot image that includes a display provided by the mapping application, wherein the mapping application presents a geographic area on the display device;

identifying, by the mapping application, one or more executable features of the mapping application that each use information, corresponding to the display provided by the mapping application, to perform a respective set of one or more functions, wherein identifying one or more executable features of the mapping application includes identifying a feature of the mapping application that downloads and saves non-image map data corresponding to the geographic area for later, offline access by the user;

generating, by the mapping application, a selectable link for each of the identified executable features; and

presenting, by the mapping application and on the display device, the generated selectable links, such that a selection by the user of any one of the generated selectable links causes the mapping application to perform the respective set of functions.

2. The method of claim 1 , wherein detecting an entry of the pre-defined user input includes:

determining, by a background process of the mapping application, that a new screenshot image has been stored in a memory of the computing device.

3. The method of claim 1 , wherein detecting an entry of the pre-defined user input includes:

utilizing, by a background process of the mapping application, an application programming interface (API) of the operating system to determine that the pre-defined user input was entered.

4. The method of claim 1 , wherein the mapping application is configured to make each of the one or more executable features available in response to a respective sequence of one or more user inputs being entered.

5. The method of claim 1 , wherein the mapping application presents a transit route on the display device.

6. The method of claim 5 , wherein identifying one or more executable features of the mapping application includes one or both of:

identifying a feature of the mapping application that saves non-image data specifying the transit route for later access by the user; and

identifying a feature of the mapping application that shares, with one or more other users, non-image data specifying the transit route.

7. The method of claim 5 , wherein identifying one or more executable features of the mapping application includes:

identifying a feature of the mapping application that shares, with one or more other users over a period of time, real-time information concerning progress of the user along the transit route.

8. The method of claim 1 , wherein the mapping application presents information concerning a place on the display device.

9. The method of claim 8 , wherein identifying one or more executable features of the mapping application includes:

identifying a feature of the mapping application that saves non-image data specifying the place for later access by the user.

10. The method of claim 8 , wherein identifying one or more executable features of the mapping application includes:

identifying a feature of the mapping application that shares, with one or more other users, non-image data specifying the place.

11. The method of claim 8 , wherein identifying one or more executable features of the mapping application includes:

identifying a feature of the mapping application that identifies and displays a route to the place from a location of the computing device.

12. The method of claim 8 , wherein identifying one or more executable features of the mapping application includes:

identifying a feature of the mapping application that identifies and displays a type of public transport that the user can use to reach the place from a location of the computing device.

13. The method of claim 1 , wherein presenting the generated selectable links includes causing the display device to show the generated selectable links in a menu list.

14. A non-transitory, computer-readable medium storing instructions of a mapping application that, when executed by one or more processors of a computing device, cause the computing device to:

detect an entry of a pre-defined user input, by a user of the computing device, that causes an operating system of the computing device to capture a screenshot image that includes a display provided by the mapping application, wherein the mapping application presents a geographic area on the display device, and wherein the instructions cause the computing device to detect the entry of the pre-defined user input either (i) by utilizing an application programming interface (API) of the operating system, or (ii) by determining that a new screenshot image has been stored in a memory of the computing device;

identify one or more executable features of the mapping application that each use information, corresponding to the display provided by the mapping application, to perform a respective set of one or more functions, wherein identifying one or more executable features of the mapping application includes identifying a feature of the mapping application that downloads and saves non-image map data corresponding to the geographic area for later, offline access by the user;

generate a selectable link for each of the identified executable features; and

present, on a display device, the generated selectable links, such that a selection by the user of any one of the generated selectable links causes mapping application to perform the respective set of functions.

15. The non-transitory, computer-readable medium of claim 14 , wherein the mapping application is configured to make each of the one or more executable features available in response to a respective sequence of one or more user inputs being entered.

16. The non-transitory, computer-readable medium of claim 15 , wherein:

the instructions of the mapping application cause the computing device to present the generated selectable links at least by causing the display device to show the generated selectable links in a menu list.

17. A method implemented in a computing device having a display device and an operating system, wherein the operating system is configured to capture screenshot images of screens shown on the display device in response to entries of a pre-defined user input, and wherein the method comprises:

detecting, by a mapping application executing on the computing device, an entry of the pre-defined user input, by a user of the computing device, that causes the operating system to capture a screenshot image that includes a display provided by the mapping application, wherein the mapping application presents a transit route on the display device;

identifying, by the mapping application, one or more executable features of the mapping application that each use information, corresponding to the display provided by the mapping application, to perform a respective set of one or more functions, wherein identifying one or more executable features of the mapping application includes one or both of (i) identifying a feature of the mapping application that saves non-image data specifying the transit route for later access by the user, and (ii) identifying a feature of the mapping application that shares, with one or more other users, non-image data specifying the transit route;

generating, by the mapping application, a selectable link for each of the identified executable features; and

presenting, by the mapping application and on the display device, the generated selectable links, such that a selection by the user of any one of the generated selectable links causes the mapping application to perform the respective set of functions.

18. The method of claim 17 , wherein detecting an entry of the pre-defined user input includes:

determining, by a background process of the mapping application, that a new screenshot image has been stored in a memory of the computing device.

19. The method of claim 17 , wherein detecting an entry of the pre-defined user input includes:

utilizing, by a background process of the mapping application, an application programming interface (API) of the operating system to determine that the pre-defined user input was entered.

20. The method of claim 17 , wherein the mapping application is configured to make each of the one or more executable features available in response to a respective sequence of one or more user inputs being entered.

21. The method of claim 17 , wherein presenting the generated selectable links includes causing the display device to show the generated selectable links in a menu list.

22. A non-transitory, computer-readable medium storing instructions of a mapping application that, when executed by one or more processors of a computing device, cause the computing device to:

detect an entry of a pre-defined user input, by a user of the computing device, that causes an operating system of the computing device to capture a screenshot image that includes a display provided by the mapping application, wherein the mapping application presents a transit route on the display device, and wherein the instructions cause the computing device to detect the entry of the pre-defined user input either (i) by utilizing an application programming interface (API) of the operating system, or (ii) by determining that a new screenshot image has been stored in a memory of the computing device;

identify one or more executable features of the mapping application that each use information, corresponding to the display provided by the mapping application, to perform a respective set of one or more functions, wherein identifying one or more executable features of the mapping application includes one or both of (i) identifying a feature of the mapping application that saves non-image data specifying the transit route for later access by the user, and (ii) identifying a feature of the mapping application that shares, with one or more other users, non-image data specifying the transit route;

generate a selectable link for each of the identified executable features; and

present, on a display device, the generated selectable links, such that a selection by the user of any one of the generated selectable links causes mapping application to perform the respective set of functions.

23. The non-transitory, computer-readable medium of claim 22 , wherein the mapping application is configured to make each of the one or more executable features available in response to a respective sequence of one or more user inputs being entered.

24. The non-transitory, computer-readable medium of claim 23 , wherein:

the instructions of the mapping application cause the computing device to present the generated selectable links at least by causing the display device to show the generated selectable links in a menu list.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 26, 2019
From: BAIG, HAROON; FLIER, HOLGER-FREDERIK
To: GOOGLE INC.
Reel/Frame 049005/0502 →
CHANGE OF NAME Recorded Apr 26, 2019
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 049014/0246 →
Continuity (1)
Related Publication 20190196674A1 · Jun 27, 2019