IP Library Granted Patent US 12,079,922
Granted Patent B2
US 12,079,922 · App. 18/152,068 · Granted Sep 3, 2024

System and method for translating a 2D image to a 3D image

Inventors: Gregory M. Youngblood (Minden, NV); Matthew Shreve (Mountain View, CA); Mark J. Stefik (Portola Valley, CA); Robert Thomas Krivacic (San Jose, CA); Lester D. Nelson (Santa Clara, CA); Jacob Le (Palo Alto, CA)
Assignee: XEROX CORPORATION
G06T15/10G06T15/04G06T15/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,079,922
App. No.
18/152,068
Granted
Sep 3, 2024
Kind
B2
Abstract

A system and method for translating a 2D image to a 3D image is provided. A 2D image having pixels grouped into tiles is obtained. Contour lines associated with an altitude value are located on the 2D image. The altitude values are determined. Each tile in the 2D image is represented using at least one voxel. A height map of the voxels is generated based on the contour lines and altitude values as a base layer for a 3D image. A terrain type of each of the voxels of the 3D image is determined and objects are placed in the 3D image. The 3D image is output.

Claims (50)

1. A system for translating a 2D image to a 3D image, comprising:

a database configured to store a 2D image comprising pixels grouped into tiles; and

a server comprising a central processing unit, memory, an input port to receive the 2D image from the database, and an output port, wherein the central processing unit is configured to:

locate on the 2D image contour lines each associated with an altitude value;

determine the altitude values based on the contour lines;

represent the tiles with voxels, comprising:

compare each tile to a set of layer expansion templates, wherein each layer expansion template represents a terrain texture and a terrain color;

identify one of the layer expansion templates that best matches each tile; and

generate each voxel corresponding to one of the tiles based on the identified layer expansion template that best matches that tile;

generate a height map of the voxels based on the contour lines and altitude values as a base layer for a 3D image;

place objects in the 3D image; and

output the 3D image.

2. The method according to claim 1 , wherein the central processing unit reads the altitude values using optical character recognition to determine the altitude values.

3. The method according to claim 1 , wherein the central processing unit sweeps a trained classifier over cropped regions of the 2D image to determine the altitude values.

4. The method according to claim 1 , wherein the central processing unit accesses object templates and selects the objects for placement in the 3D image via the object templates.

5. The method according to claim 1 , wherein the central processing unit accesses a map legend for use with the 3D image.

6. The method according to claim 1 , wherein the central processing unit accesses the layer expansion templates and identifies the terrain type provided via the accessed layer expansion templates.

7. The method according to claim 6 , wherein the central processing unit colors the voxels based on the terrain type using the layer expansion templates.

8. The method according to claim 6 , wherein the layer expansion templates provide instructions for the tiles of the 2D image to scale to the output voxel size of the 3D image.

9. The method according to claim 6 , wherein the layer expansion templates comprise color, texturing, and shadowing instructions for the tiles, which are each associated with the terrain type and object type.

10. The method according to claim 6 , wherein the central processing unit translates the 3D image back into the 2D image.

11. A method for translating a 2D image to a 3D image, comprising:

obtaining a 2D image comprising pixels grouped into tiles;

locating on the 2D image contour lines each associated with an altitude value;

determining the altitude values based on the contour lines;

representing the tiles with voxels, comprising:

comparing each tile to a set of layer expansion templates, wherein each layer expansion template represents a terrain texture and a terrain color;

identifying one of the layer expansion templates that best matches each tile; and

generating each voxel corresponding to one of the tiles based on the identified layer expansion template that best matches that tile;

generating a height map of the voxels based on the contour lines and altitude values as a base layer for a 3D image;

placing objects in the 3D image; and

outputting the 3D image.

12. The method according to claim 11 , further comprising:

reading the altitude values from contour lines using optical character recognition to determine the altitude values.

13. The method according to claim 11 , further comprising:

sweeping a trained classifier over cropped regions of the 2D image to determine the altitude values.

14. The method according to claim 13 , further comprising:

accessing object templates; and

selecting the objects for placement in the 3D image via the object templates.

15. The method according to claim 11 , further comprising:

accessing a map legend for use with the 3D image.

16. The method according to claim 11 , further comprising:

Accessing the layer expansion templates; and

applying the terrain type provided via the accessed layer expansion templates.

17. The method according to claim 16 , further comprising:

coloring the voxels based on the terrain type using the layer expansion templates.

18. The method according to claim 16 , wherein the layer expansion templates provide instructions for the tiles of the 2D image to scale to the output voxel size of the 3D image.

19. The method according to claim 16 , wherein the layer expansion templates comprise color, texturing, and shadowing instructions for the tiles, which are each associated with the terrain type and object type.

20. The method according to claim 11 , further comprising:

translating the 3D image back into the 2D image.

Assignments (7)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 6, 2026
From: XEROX CORPORATION
To: GENESEE VALLEY INNOVATIONS, LLC
Reel/Frame 075020/0755 →
SECOND LIEN NOTES PATENT SECURITY AGREEMENT Recorded Jul 2, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 071785/0550 →
FIRST LIEN NOTES PATENT SECURITY AGREEMENT Recorded Apr 11, 2025
From: XEROX CORPORATION
To: U.S. BANK TRUST COMPANY, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 070824/0001 →
SECURITY INTEREST Recorded Feb 13, 2024
From: XEROX CORPORATION
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 066741/0001 →
SECURITY INTEREST Recorded Nov 20, 2023
From: XEROX CORPORATION
To: JEFFERIES FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 065628/0019 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REMOVAL OF US PATENTS 9356603, 10026651, 10626048 AND INCLUSION OF US PATENT 7167871 PREVIOUSLY RECORDED ON REEL 064038 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 28, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064161/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 20, 2023
From: PALO ALTO RESEARCH CENTER INCORPORATED
To: XEROX CORPORATION
Reel/Frame 064038/0001 →