IP Library Granted Patent US 12,086,483
Granted Patent B1
US 12,086,483 · App. 18/171,076 · Granted Sep 10, 2024

Using LiDAR to define printable area for document printing

Inventors: Shoban Kumar Jayaraj Devadoss (Chennai, IN); Pandiarajan Subramanian (Chennai, IN); Jeffrey A. Chester (Norwalk, CT)
Assignee: Xerox Corporation
G06F3/1243G01S17/89G06F3/1208G06F3/1256G06T7/521
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,086,483
App. No.
18/171,076
Granted
Sep 10, 2024
Kind
B1
Abstract

Method and systems for using augmented reality to create a printing template are disclosed. A mobile electronic device that includes a depth sensor and a display device will acquire and display an image of an environment. The depth sensor will acquire a three-dimensional (3D) representation of a target area within the environment. The system will process the 3D representation to identify a border and generate a surface map of the target area. The system will identify content to be placed on the target area and generate a print job to print the content on a substrate that is sized to fit within the border and conformable to the surface map.

Claims (65)

1. A method for using augmented reality to create a printing template, the method comprising:

by a processor of a mobile electronic device that includes a depth sensor and a display device:

causing the display device to display an image of an environment, and

causing the depth sensor to acquire a three-dimensional (3D) representation of a target area of the environment that is within the image; and

by the processor of the mobile electronic device and/or a processor of another electronic device:

processing the 3D representation to identify a border and generate a surface map of the target area,

identifying content to be printed and placed on the target area in the environment,

by a position sensor of the mobile electronic device within a time that is proximate to a time at which the depth sensor acquires the 3D representation of the target area, capturing location data for the environment,

generating a print job that is configured to cause a print device to print the content on a substrate that is sized to fit within the border and conformable to the surface map,

including, in the print job, instructions to print the content on a first side of the substrate and to print a location corresponding to the location data on a second side of the substrate, and

causing the display device to show the content over the target area in the image.

2. The method of claim 1 , further comprising, by a print device, processing the print job to print the content on one or more substrates that are collectively sized to fit within the border and shaped to conform to the surface map.

3. The method of claim 1 further comprising, by one or more of the processors:

saving the image in association with the print job; and

including, in the print job, instructions to print the content on a first side of the substrate and to print the image on a second side of the substrate.

4. The method of claim 1 further comprising:

saving the image in association with the print job; and

after the print device has used the print job to print the content on one or more substrates, causing the display device to display the image with the content placed on the target area.

5. The method of claim 1 , further comprising, prior to causing the depth sensor to acquire the 3D representation, receiving, via a user interface of the mobile electronic device, a selection of the target area.

6. The method of claim 1 , wherein:

the depth sensor comprises a LiDAR system, and

causing the depth sensor to acquire the 3D representation of the target area comprises causing the LiDAR system to generate a 3D mesh of the target area.

7. The method of claim 1 , wherein generating the print job comprises applying the content to a printing template in which the content is scaled to fit within the border of the target area.

8. The method of claim 7 , wherein generating the print job further comprises distorting the content to fit the surface map of the target area.

9. The method of claim 1 further comprising, in connection with causing the depth sensor to acquire the 3D representation of the target area, outputting a prompt to guide a user of the mobile electronic device to move the device to a position that will enable the depth sensor to capture data for the target area from multiple angles.

10. A system for creating a printing template, the system comprising:

a mobile electronic device, comprising:

a depth sensor,

a position sensor, and

a display device; and

a memory containing programming instructions that are configured to cause one or more processors to:

cause the display to display an image of an environment,

cause the depth sensor to acquire a three-dimensional (3D) representation of a target area of the environment that is within the image,

process the 3D representation to identify a border and generate a surface map of the target area,

identify content to be printed and placed on the target area in the environment,

cause the position sensor to capture location data for the environment within a time that is proximate to a time at which the depth sensor acquires the 3D representation of the target area,

generate a print job that is configured to cause a print device to print the content on a substrate that is sized to fit within the border and conformable to the surface map,

include, in the print job, instructions to print the content on a first side of the substrate and to print a location corresponding to the location data on a second side of the substrate, and

cause the display device to show the content over the target area in the image.

11. The system of claim 10 , further comprising:

a print device; and

additional programming instructions that are configured to cause the print device to process the print job to print the content on one or more substrates that are collectively sized to fit within the border and shaped to conform to the surface map.

12. The system of claim 10 , further comprising additional programming instructions that are configured to cause the one or more processors to:

save the image in association with the print job; and

include, in the print job, instructions to print the content on a first side of the substrate and to print the image on a second side of the substrate.

13. The system of claim 10 , further comprising additional programming instructions configured to cause the one or more processors to:

save the image in association with the print job; and

after the print device has used the print job to print the content on one or more substrates, cause the display device to display the image with the content placed on the target area.

14. The system of claim 10 , further comprising additional programming instructions configured to cause the one or more processors to, prior to causing the depth sensor to acquire the 3D representation, prompt a user to select the target area.

15. The system of claim 10 , wherein:

the depth sensor comprises a LiDAR system, and

the instructions to cause the depth sensor to acquire the 3D representation of the target area comprise instructions to cause the LiDAR system to generate a 3D mesh of the target area.

16. The system of claim 10 , wherein the instructions to generate the print job comprise instructions to:

apply the content to a printing template in which the content is scaled to fit within the border of the target area; and

distort the content to fit the surface map of the target area.

17. The system of claim 10 , further comprising programming instructions to, in connection with causing the depth sensor to acquire the 3D representation of the target area, output a prompt to guide a user of the mobile electronic device to move the device to a position that will enable the depth sensor to capture data for the target area from multiple angles.

18. A computer program product comprising a memory and programming instructions that are configured to cause one or more processors to:

cause a display device of a mobile electronic device to display an image of an environment;

cause a depth sensor of the mobile electronic device to acquire a three-dimensional (3D) representation of a target area of the environment that is within the image;

process the 3D representation to identify a border and generate a surface map of the target area;

identify content to be printed and placed on the target area in the environment;

cause a position sensor of the mobile electronic device to capture location data for the environment within a time that is proximate to a time at which the depth sensor acquires the 3D representation of the target area;

generate a print job that is configured to cause a print device to print the content on a substrate that is sized to fit within the border and conformable to the surface map;

include, in the print job, instructions to print the content on a first side of the substrate and to print a location corresponding to the location data on a second side of the substrate; and

cause the display device to show the content over the target area in the image.

Assignments (5)
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2023
From: DEVADOSS, SHOBAN KUMAR JAYARAJ; SUBRAMANIAN, PANDIARAJAN; CHESTER, JEFFREY A.
To: XEROX CORPORATION
Reel/Frame 065103/0745 →