IP Library Granted Patent US 11,218,639
Granted Patent B1
US 11,218,639 · App. 16/601,550 · Granted Jan 4, 2022

Mobile interface for marking and organizing images

Inventors: M. Steven Walker (Andover, MA); Nathan Petersen (Andover, MA)
Assignee: Staples, Inc.
H04N5/232935G06K9/00671H04N5/232939H04N5/232945
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,218,639
App. No.
16/601,550
Granted
Jan 4, 2022
Kind
B1
Abstract

A system and method for providing a mobile interface for marking and organizing images is described herein. In some instances, the system may present, on a display device, an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device and a preview region including a series of one or more annotatable image previews. The system may receive an input instructing the wireless mobile electronic device to capture a second image using the image sensor of the wireless mobile electronic device, generate a second image preview representing the second image, and update the graphical user interface to include the second image preview at the preview region. The system may receive an input including an annotation using an input device of the wireless mobile electronic device and update the graphical user interface to represent the annotation at the preview region.

Claims (76)

1. A computer-implemented method comprising:

presenting, by a processor, on a display device of a wireless mobile electronic device, a graphical user interface including:

an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device, and

a preview region including a series of one or more annotatable image previews, a first image preview of the one or more annotatable image previews representing a first image in the series;

receiving, by the processor, an input instructing the wireless mobile electronic device to capture a second image using the image sensor of the wireless mobile electronic device;

generating, by the processor, a second image preview representing the second image;

updating, by the processor, the graphical user interface to include the second image preview at the preview region;

receiving, by the processor, an input using an input device of the wireless mobile electronic device, the input including an annotation;

determining, by the processor, from a plurality of annotation types, a type of the received annotation; and

updating, by the processor, the graphical user interface to represent the annotation at the preview region including overlaying a graphical indicator associated with the type of the received annotation over the second image preview.

2. The computer-implemented method of claim 1 , wherein updating the graphical user interface to represent the annotation at the preview region includes:

updating the graphical user interface to include a third image preview at the preview region, the third image preview representing a third image;

determining to group the second image and the third image into a group; and

updating the preview region in the graphical user interface to indicate a grouping of the second image preview and the third image preview.

3. The computer-implemented method of claim 2 , wherein

updating the preview region to indicate the grouping of the second image preview and the third image preview includes displaying the second image preview and the third image preview closer together than the first image preview and the second image preview.

4. The computer-implemented method of claim 1 , wherein:

generating the second image preview representing the second image includes generating a thumbnail image representing the second image, and

updating the graphical user interface at the preview region includes overlaying the graphical indicator over the thumbnail image.

5. The computer-implemented method of claim 1 , wherein updating the graphical user interface to represent the annotation at the preview region includes:

generating an annotation preview representing the annotation, and

updating the graphical user interface to represent the annotation preview inserted into the series of one or more annotatable image previews in the preview region.

6. The computer-implemented method of claim 5 , wherein:

updating the graphical user interface to include the second image preview at the preview region includes inserting the second image preview, by the processor, into the series of one or more annotatable image previews based on a time at which the second image was captured, and

updating the graphical user interface to represent the annotation preview includes inserting, by the processor, the annotation preview into the series of one or more annotatable image previews based on a time at which the annotation was received.

7. The computer-implemented method of claim 6 , further comprising:

receiving, by the processor, an input using the input device of the wireless mobile electronic device, the input including a second annotation;

determining, by the processor, that the second annotation is associated with the second image; and

modifying, by the processor, the second image preview in the preview region to include a second graphical indicator representing the second annotation.

8. The computer-implemented method of claim 1 , further comprising:

receiving, by the processor, an input using the input device instructing the processor to expand the series of one or more annotatable image previews; and

increasing, by the processor, a relative size of the series of one or more annotatable image previews within the graphical user interface, the series of one or more annotatable image previews being horizontally scrollable within the graphical user interface.

9. The computer-implemented method of claim 1 , wherein the graphical user interface further includes a graphical menu overlaid over the image region, the graphical menu including a set of graphical menu elements displayed radially around a central point in the graphical user interface, each of the set of graphical menu elements representing a type of annotation.

10. The computer-implemented method of claim 1 , wherein the annotation includes one or more of an audio file, a drawing on the second image, a tag corresponding to the second image, and a textual comment.

11. A system comprising:

a processor; and

a non-transitory computer readable memory storing instructions that, when executed by the processor, cause the system to:

present, on a display device of a wireless mobile electronic device, a graphical user interface including:

an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device, and

a preview region including a series of one or more annotatable image previews, a first image preview of the one or more annotatable image previews representing a first image in the series;

receive an input instructing the wireless mobile electronic device to capture a second image using the image sensor of the wireless mobile electronic device;

generate a second image preview representing the second image;

update the graphical user interface to include the second image preview at the preview region;

receive an input using an input device of the wireless mobile electronic device, the input including an annotation;

determine from a plurality of annotation types, a type of the received annotation; and

update the graphical user interface to represent the annotation at the preview region including overlaying a graphical indicator associated with the type of the received annotation over the second image preview.

12. The system of claim 11 , wherein:

generating the second image preview representing the second image includes generating a thumbnail image representing the second image, and

updating the graphical user interface at the preview region includes overlaying the graphical indicator over the thumbnail image.

13. The system of claim 11 , wherein updating the graphical user interface to represent the annotation at the preview region includes:

updating the graphical user interface to include a third image preview at the preview region, the third image preview representing a third image;

determining to group the second image and the third image into a group; and

updating the preview region in the graphical user interface to indicate a grouping of the second image preview and the third image preview.

14. The system of claim 13 , wherein updating the preview region to indicate the grouping of the second image preview and the third image preview includes displaying the second image preview and the third image preview closer together than the first image preview and the second image preview.

15. The system of claim 11 , wherein updating the graphical user interface to represent the annotation at the preview region includes:

generating an annotation preview representing the annotation, and

updating the graphical user interface to represent the annotation preview inserted into the series of one or more annotatable image previews in the preview region.

16. The system of claim 15 , wherein:

updating the graphical user interface to include the second image preview at the preview region includes inserting the second image preview, by the processor, into the series of one or more annotatable image previews based on a time at which the second image was captured, and

updating the graphical user interface to represent the annotation preview includes inserting, by the processor, the annotation preview into the series of one or more annotatable image previews based on a time at which the annotation was received.

17. The system of claim 16 , further comprising:

receiving, by the processor, an input using the input device of the wireless mobile electronic device, the input including a second annotation;

determining, by the processor, that the second annotation is associated with the second image; and

modifying, by the processor, the second image preview in the preview region to include a second graphical indicator representing the second annotation.

18. The system of claim 11 , further comprising:

receiving, by the processor, an input using the input device instructing the processor to expand the series of one or more annotatable image previews; and

increasing, by the processor, a relative size of the series of one or more annotatable image previews within the graphical user interface, the series of one or more annotatable image previews being horizontally scrollable within the graphical user interface.

19. The system of claim 11 , wherein the graphical user interface further includes a graphical menu overlaid over the image region, the graphical menu including a set of graphical menu elements displayed radially around a central point in the graphical user interface, each of the set of graphical menu elements representing a type of annotation.

20. A computer-implemented method comprising:

presenting, by a processor, on a display device of a mobile electronic device, a graphical user interface including a preview region displaying a first image preview representing a first image;

receiving, by the processor, an input instructing the mobile electronic device to capture a second image using an image sensor of the mobile electronic device;

generating, by the processor, a second image preview representing the second image;

updating, by the processor, the graphical user interface to include the second image preview at the preview region;

receiving, by the processor, an input using an input device of the mobile electronic device, the input including an annotation;

determining, by the processor, from a plurality of annotation types, a type of the received annotation; and

updating, by the processor, the graphical user interface to represent the annotation at the preview region including overlaying a graphical indicator associated with the type of the received annotation over the second image preview.

Assignments (8)
RELEASE OF SECURITY INTEREST Recorded Jun 19, 2024
From: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION (AS SUCCESSOR-IN-INTEREST TO WELLS FARGO BANK, NATIONAL ASSOCIATION)
To: STAPLES, INC.; WORKLIFE BRANDS LLC
Reel/Frame 067782/0659 →
SECURITY INTEREST Recorded Jun 12, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067711/0239 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: UBS AG, STAMFORD BRANCH, AS TERM LOAN AGENT
Reel/Frame 067687/0558 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067697/0639 →
RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 053323/0162 Recorded Jun 10, 2024
From: UBS AG, STAMFORD BRANCH, AS TERM LOAN AGENT
To: STAPLES, INC.
Reel/Frame 067681/0409 →
FIRST SUPPLEMENTAL PATENT SECURITY AGREEMENT Recorded Jul 27, 2020
From: STAPLES, INC.
To: UBS AG, STAMFORD BRANCH, AS TERM LOAN AGENT
Reel/Frame 053323/0162 →
SECURITY INTEREST Recorded Jul 21, 2020
From: STAPLES, INC.; WORKLIFE BRANDS LLC
To: WELLS FARGO BANK, NATIONAL ASSOCIATION
Reel/Frame 053265/0021 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 13, 2019
From: WALKER, M. STEVEN; PETERSEN, NATHAN
To: STAPLES, INC.
Reel/Frame 051276/0515 →
Cited By (2)
US 1,130,462 US 12,413,846