IP Library Granted Patent US 11,436,453
Granted Patent B2
US 11,436,453 · App. 17/342,830 · Granted Sep 6, 2022

Using augmented reality to perform complex print jobs

Inventors: David Parsons (Victor, NY); Andrew T. Martin (Honeoye Falls, NY); Shane Michael Jewitt (Webster, NY); Ken Hayward (Brockport, NY); Dragana Pavlovic (Littleton, MA); Michael J. Martin (Hamlin, NY); David C. Swift (Rush, NY)
Assignee: Xerox Corporation
G06K15/025G06K15/007G06K15/1836
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,436,453
App. No.
17/342,830
Granted
Sep 6, 2022
Kind
B2
Abstract

Systems and methods are provided for using augmented reality to create a printing template. The method includes capturing, using a camera of a mobile electronic device, a real world image of a surface. The method further includes, by a processor, receiving the real world image, processing the real world image to isolate and measure a portion of the surface on which print job content is to be applied, creating a printing template conforming to a shape and area of the isolated and measured portion of the surface, causing the real world image to be output on a display, and causing the display to output the printing template over the real world image, overlaid over the isolated and measured portion of the surface.

Claims (55)

1. A method for using augmented reality to create a printing template, the method comprising:

by a processor:

receiving, on a mobile electronic device, a real world image of a surface;

processing the real world image to isolate and measure a portion of the surface on which print job content is to be applied;

creating a printing template conforming to a shape and area of the isolated and measured portion of the surface,

wherein the printing template includes a plurality of separate template portions, wherein each of the separate template portions is configured to be applied to a unique portion of the print job content; and

causing a display to output the printing template over the real world image.

2. The method of claim 1 , wherein the mobile electronic device is communicatively coupled to the display.

3. The method of claim 1 , wherein each of the plurality of separate template portions has an area and measured dimensions.

4. The method of claim 1 , further comprising receiving a selection of a type of print job.

5. The method of claim 4 , wherein the type of print job comprises one or more of the following:

wall decals; wraps; window covers; stair risers; textiles; stickers; signage; and crafts.

6. The method of claim 5 , wherein processing the real world image further comprises automatically identifying and isolating the portion of the surface correlating with the type of print job selected.

7. The method as recited in claim 1 , further comprising, by the processor, applying the print job content to the printing template, causing the print job content to be displayed over the real world image, overlaid over the isolated and measured portion of the surface.

8. The method as recited in claim 1 , further comprising, by a graphical user interface, selecting the print job content.

9. The method of claim 8 , wherein selecting the print job content includes uploading an image.

10. The method of claim 8 , wherein selecting the print job content includes selecting content from a list of available content.

11. The method of claim 1 , further comprising, by a graphical user interface, ordering a finalized print of the print job content conforming to the printing template.

12. A system for using augmented reality to create complex printing templates, the system comprising:

a mobile electronic device including:

a memory;

a processor; and

a graphical user interface,

wherein the graphical user interface is configured to enable a user to select print job content, and

wherein the memory is configured to store software that, when run by the processor, causes the processor to:

receive a real world image;

process the real world image to isolate and measure a portion of the surface on which the print job content is to be applied;

create a printing template conforming to a shape and area of the isolated and measured portion of the surface,

 wherein the printing template includes a plurality of separate template portions, wherein each of the separate template portions is configured to be applied to a unique portion of the print job content; and cause a display to output the printing template over the real world image.

13. The system of claim 12 , further comprising the display, and

wherein the mobile electronic device is communicatively coupled to the display.

14. The system of claim 13 , wherein the software, when run by the processor, further causes the processor to apply the print job content to the printing template, causing the print job content to be displayed over the real world image, overlaid over the isolated and measured portion of the surface.

15. The system of claim 12 , wherein the software, when run by the processor, further causes the processor, when applying the print job content to the printing template, to:

determine a change in depth between each of the separate template portions; and

resize each of the unique portions of the print job content according to the change in depth.

16. The system of claim 12 , wherein the graphical user interface is further configured to enable the user to select a type of print job.

17. The system of claim 16 , wherein the type of print job comprises one or more of the following:

wall decals; wraps; window covers; stair risers; textiles; stickers; signage; and crafts.

18. The system of claim 16 , wherein selecting the print job content includes uploading an image.

19. A method for using augmented reality to create a printing template, the method comprising:

receiving a selection of a type of print job including one or more of the following: wall decals; wraps; window covers; stair risers; textiles; stickers; signage; and crafts; and

by a processor:

receiving a real world image;

processing the real world image to automatically identify, isolate, and measure a portion of the surface correlating with the type of print job selected and on which print job content is to be applied;

creating a printing template conforming to a shape and area of the isolated and measured portion of the surface; and

causing a display to output the printing template over the real world image.

20. The method of claim 19 , wherein the mobile electronic device is communicatively coupled to the display.

21. The method of claim 19 ,

wherein the printing template includes a plurality of separate template portions, wherein each of the separate template portions is configured to be applied to a unique portion of the print job content, and

wherein each of the plurality of separate template portions has an area and measured dimensions.

22. The method as recited in claim 19 , further comprising, by the processor, applying the print job content to the printing template, causing the print job content to be displayed over the real world image, overlaid over the isolated and measured portion of the surface.

23. The method as recited in claim 19 , further comprising, by a graphical user interface, selecting the print job content.

24. The method of claim 23 , wherein selecting the print job content includes uploading an image.

25. The method of claim 23 , wherein selecting the print job content includes selecting content from a list of available content.

26. The method of claim 19 , further comprising, by a graphical user interface, ordering a finalized print of the print job content conforming to the printing template.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2026
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 075020/0755 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS RECORDED AT RF 064760/0389 Recorded Feb 13, 2024
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: XEROX CORPORATION
Reel/Frame 068261/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
SECURITY INTEREST Recorded Jun 22, 2023
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 064760/0389 →
RELEASE OF SECURITY INTEREST IN PATENTS AT R/F 062740/0214 Recorded May 18, 2023
From: CITIBANK, N.A., AS AGENT
To: XEROX CORPORATION
Reel/Frame 063694/0122 →
SECURITY INTEREST Recorded Nov 10, 2022
From: XEROX CORPORATION
To: CITIBANK, N.A., AS AGENT
Reel/Frame 062740/0214 →