IP Library Granted Patent US 12,413,846
Granted Patent B1
US 12,413,846 · App. 18/444,420 · Granted Sep 9, 2025

Mobile interface for marking and organizing images

Inventors: M. Steven Walker (Andover, MA); Nathan Petersen (Andover, MA)
Assignee: Staples, Inc.
H04N23/632G06V20/20H04N23/633H04N23/635
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,413,846
App. No.
18/444,420
Granted
Sep 9, 2025
Kind
B1
Abstract

A system and method for providing a mobile interface for marking and organizing images is described herein. In some instances, the system may present, on a display device, an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device and a preview region including a series of one or more annotatable image previews. The system may receive an input instructing the wireless mobile electronic device to capture a second image using the image sensor of the wireless mobile electronic device, generate a second image preview representing the second image, and update the graphical user interface to include the second image preview at the preview region. The system may receive an input including an annotation using an input device of the wireless mobile electronic device and update the graphical user interface to represent the annotation at the preview region.

Claims (60)

1. A computer-implemented method comprising:

presenting, by a processor, on a display device of a wireless mobile electronic device, a graphical user interface including:

an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device;

a preview region including a set of image previews, a first image preview of the set of image previews representing a first image in the set of image previews; and

a first input element displayed overlayed over the image region to capture the capturable image;

receiving, by the processor, an input using an input device of the wireless mobile electronic device, the input including a selection of the first input element to capture the capturable image; and

updating, by the processor, the graphical user interface to represent the captured image at the preview region on the graphical user interface.

2. The computer-implemented method of claim 1 , wherein:

the preview region displays row of the set of image previews aligned on the graphical user interface, an assessment of a physical location including the set of image previews.

3. The computer-implemented method of claim 1 , further comprising:

receiving, by the processor, an input including an annotation for the captured image; and

displaying a graphical element representing the annotation in the preview region of the graphical user interface.

4. The computer-implemented method of claim 3 , wherein displaying the graphical element representing the annotation in the preview region of the graphical user interface includes:

overlaying the graphical element representing the annotation over an image preview of the captured image in the preview region.

5. The computer-implemented method of claim 4 , further comprising:

displaying a graphical representation of a grouping of a subset of the set of image previews in the preview region.

6. The computer-implemented method of claim 1 , further comprising:

responsive to receiving the input including the selection of the first input element, displaying one or more graphical annotation elements; and

responsive to receiving an input selecting the one or more graphical annotation elements, generating one or more annotations in association with the captured image.

7. The computer-implemented method of claim 6 , wherein:

each graphical annotation element of the one or more graphical annotation elements is associated with one of a plurality of types of annotation.

8. The computer-implemented method of claim 7 , wherein:

a graphical representation of each of the one or more annotations indicates a type of the annotation in the preview region.

9. The computer-implemented method of claim 6 , wherein:

the one or more graphical annotation elements replace the first input element in the graphical user interface based on the selection of the first input element.

10. The computer-implemented method of claim 1 , wherein:

the first input element is displayed at a first location on the graphical user interface; and

responsive to receiving the input including the selection of the first input element, one or more graphical annotation elements are displayed in the graphical user interface at one or more second locations, the one or more second locations being located radially from the first location on the graphical user interface.

11. The computer-implemented method of claim 1 , further comprising:

associating one or more safety issue flags with the captured image based on a user input in the graphical user interface, the graphical user interface being displayed on a first client device; and

providing a second graphical user interface on a second client device, the second graphical user interface indicating the one or more safety issue flags.

12. A system comprising:

one or more processors; and

a computer-readable memory storing instructions that, when executed, cause the system to perform operations comprising:

presenting, on a display device of a wireless mobile electronic device, a graphical user interface including:

an image region that displays a capturable image that is capturable by an image sensor of the wireless mobile electronic device;

a preview region including a set of image previews, a first image preview of the set of image previews representing a first image in the set of image previews; and

a first input element displayed overlayed over the image region to capture the capturable image;

receiving an input using an input device of the wireless mobile electronic device, the input including a selection of the first input element to capture the capturable image; and

updating the graphical user interface to represent the captured image at the preview region on the graphical user interface.

13. The system of claim 12 , wherein:

the preview region displays row of the set of image previews aligned on the graphical user interface, an assessment of a physical location including the set of image previews.

14. The system of claim 12 , wherein the operations further comprise:

receiving an input using the input device of the wireless mobile electronic device, the input indicating an annotation for the captured image; and

displaying a graphical element representing the annotation in the preview region of the graphical user interface.

15. The system of claim 14 , wherein displaying the graphical element representing the annotation in the preview region of the graphical user interface includes:

overlaying the graphical element representing the annotation over an image preview of the captured image in the preview region.

16. The system of claim 15 , wherein the operations further comprise:

displaying a graphical representation of a grouping of a subset of the set of image previews in the preview region.

17. The system of claim 12 , wherein the operations further comprise:

responsive to receiving the input including the selection of the first input element, displaying one or more graphical annotation elements; and

responsive to receiving an input selecting the one or more graphical annotation elements, generating one or more annotations in association with the captured image.

18. The system of claim 17 , wherein:

each graphical annotation element of the one or more graphical annotation elements is associated with one of a plurality of types of annotation; and

a graphical representation of each of the one or more annotations indicates a type of the annotation in the preview region.

19. The system of claim 17 , wherein:

the one or more graphical annotation elements replace the first input element in the graphical user interface based on the selection of the first input element.

20. The system of claim 12 , wherein:

the first input element is displayed at a first location on the graphical user interface; and

responsive to receiving the input including the selection of the first input element, one or more graphical annotation elements are displayed in the graphical user interface at one or more second locations, the one or more second locations being located radially from the first location on the graphical user interface.

Assignments (4)
SECURITY INTEREST Recorded Jun 12, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067711/0239 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 11, 2024
From: WALKER, M. STEVEN; PETERSEN, NATHAN
To: STAPLES, INC.
Reel/Frame 067689/0823 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: UBS AG, STAMFORD BRANCH, AS TERM LOAN AGENT
Reel/Frame 067687/0558 →
SECURITY INTEREST Recorded Jun 11, 2024
From: STAPLES, INC.
To: COMPUTERSHARE TRUST COMPANY, NATIONAL ASSOCIATION, AS NOTES AGENT
Reel/Frame 067697/0639 →
Continuity (3)
Continuation 17646842 · Jan 3, 2022
Continuation 16601550 · Oct 14, 2019
Provisional Application 62744844 · Oct 12, 2018
References Cited (26)
US 6683649B1 · Anderson · 2004 [cited by examiner]
US 8432414B2 · Vetterli et al. · 2013 [cited by applicant]
US 9117483B2 · Zaletel · 2015 [cited by applicant]
US 9583074B2 · Chau · 2017 [cited by applicant]
US 10783684B2 · Wu et al. · 2020 [cited by applicant]
US 11218639B1 · Walker · 2022 [cited by examiner]
US 11910082B1 · Walker · 2024 [cited by examiner]
US 20050257137A1 · Weber et al. · 2005 [cited by applicant]
US 20070236583A1 · Vuong · 2007 [cited by examiner]
US 20080268876A1 · Gelfand et al. · 2008 [cited by applicant]
US 20090319178A1 · Khosravy et al. · 2009 [cited by applicant]
US 20110164163A1 · Bilbrey et al. · 2011 [cited by applicant]
US 20130076963A1 · Sirpal · 2013 [cited by examiner]
US 20130222612A1 · Sako et al. · 2013 [cited by applicant]
US 20130222616A1 · Mendis · 2013 [cited by applicant]
US 20140125856A1 · Kim · 2014 [cited by examiner]
US 20150356063A1 · Jiang et al. · 2015 [cited by applicant]
US 20160240011A1 · Fedosov et al. · 2016 [cited by applicant]
US 20170046877A1 · Hustad · 2017 [cited by examiner]
US 20180143756A1 · Mildrew et al. · 2018 [cited by applicant]
US 20180165738A1 · Chilukuri et al. · 2018 [cited by applicant]
US 20180349008A1 · Manzari · 2018 [cited by examiner]
US 20190174070A1 · Jang · 2019 [cited by applicant]
US 20200159387A1 · Schoenfelder et al. · 2020 [cited by applicant]
Evernote, Wikipedia, https://en.wikipedia.org/wiki/Evernote, Oct. 3, 2019, 11 pgs. [cited by applicant]
Microsoft PowerPoint, Wikipedia, https://en.wikipedia.org/wiki/Microsoft_PowerPoint, Oct. 13, 2019, 50 pgs. [cited by applicant]