IP Library Granted Patent US 9,652,895
Granted Patent B2
US 9,652,895 · App. 14/626,799 · Granted May 16, 2017

Augmented reality image transformation

Inventors: Robert Sumner (Zürich, CH); Maurizio Nitti (Zürich, CH); Gerhard Roethlin (Horw, CH); Alessia Marra (Zürich, CH); Mattia Ryffel (Bern, CH); Gioacchino Noris (Zürich, CH); Kenny Mitchell (Addlestone, GB); Stephane Magnenat (Zürich, CH)
Assignee: Disney Enterprises, Inc.
G06T19/006G06T15/02G06T15/04G06T19/20G06T2219/2012
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,652,895
App. No.
14/626,799
Granted
May 16, 2017
Kind
B2
Abstract

There is provided a system and method for augmented reality image transformation. In one implementation, such a system includes a system processor, a system memory, and an image transformation engine stored in the system memory. The system processor is configured to execute the image transformation engine to receive image data corresponding to an image, to detect a feature on a surface of the image, and to synthesize a texture corresponding to the feature. The system processor is further configured to execute the image transformation engine to produce an augmented reality representation of the image having the texture for display to a user, the texture covering a surface of the augmented reality representation of the image corresponding to a portion of the feature that is not visible on the surface of the image.

Claims (31)

1. A system comprising:

a system processor;

a system memory; and

an image transformation engine stored in the system memory;

wherein the system processor is configured to execute the image transformation engine to:

receive image data corresponding to a two-dimensional (2D) representation of an image;

detect a hand drawn modification added by a user to the 2D representation of the image;

synthesize a texture corresponding to the hand drawn modification added by the user to the 2D representation of the image; and

produce a three-dimensional (3D) augmented reality representation of the image having the texture corresponding to the hand drawn modification added by the user for display to the user, wherein the texture corresponding to the hand drawn modification added by the user covers a surface of the 3D augmented reality representation of the image corresponding to a portion that is not visible in the 2D representation of the image, wherein the portion corresponds to a rear view of an object in the image, wherein the rear view is not visible in the 2D representation of the image.

2. The system of claim 1 , wherein the system processor is configured to execute the image transformation engine to utilize at least one of a pixel-copying technique and UV mapping to synthesize the texture corresponding to the hand drawn modification.

3. The system of claim 1 , wherein the system processor is configured to execute the image transformation engine to enable the user and another user remote from the user to collaboratively interact with the 3D augmented reality representation of the image.

4. The system of claim 1 , wherein the system processor is configured to execute the image transformation engine to enable the user to interact with a game associated with the image.

5. The system of claim 1 , wherein the image data is obtained from a three-dimensional physical object.

6. The system of claim 1 , wherein the image data is obtained from a first coloring book, the system processor being configured to execute the image transformation engine to enable the user to interact with a second coloring book through interaction by the user with the first coloring book.

7. A method for use by a system including a system processor and an image transformation engine stored in a system memory, the method comprising:

receiving, by the image transformation engine being executed by the system processor, image data corresponding to a two-dimensional (2D) representation of an image;

detecting, by the image transformation engine being executed by the system processor, a hand drawn modification added by a user to the 2D representation of the image;

synthesizing, by the image transformation engine being executed by the system processor, a texture corresponding to the hand drawn modification added by the user to the 2D representation of the image; and

producing, by the image transformation engine being executed by the system processor, a three-dimensional (3D) augmented reality representation of the image having the texture corresponding to the hand drawn modification added by the user for display to the user, wherein the texture corresponding to the hand drawn modification added by the user covers a surface of the 3D augmented reality representation of the image corresponding to a portion that is not visible in the 2D representation of the image, wherein the portion corresponds to a rear view of an object in the image, wherein the rear view is not visible in the 2D representation of the image.

8. The method of claim 7 , wherein synthesizing the texture corresponding to the hand drawn modification comprises utilizing at least one of a pixel-copying technique and UV mapping to synthesize the texture.

9. The method of claim 7 , further comprising enabling, by the image transformation engine being executed by the system processor, the user to interact with a game associated with the image.

10. The method of claim 7 , further comprising uploading, by the image transformation engine being executed by the system processor, the 3D augmented reality representation of the image to an augmented reality image library accessible to a community of users.

11. The method of claim 7 , further comprising enabling, by the image transformation engine being executed by the system processor, the user and another user remote from the user to collaboratively interact with the 3D augmented reality representation of the image.

12. The method of claim 7 , wherein the image data is obtained from a three-dimensional physical object.

13. The method of claim 7 , wherein the image data is obtained from a first coloring book, the method further comprising enabling, by the image transformation engine being executed by the system processor, the user to interact with a second coloring book through interaction by the user with the first coloring book.

14. A computer-readable non-transitory medium having stored thereon instructions, which when executed by a system processor, instantiate a method comprising:

receiving image data corresponding to a two-dimensional (2D) representation of an image;

detecting a hand drawn modification added by a user to the 2D representation of the image;

synthesizing a texture corresponding to the feature hand drawn modification added by the user to the 2D representation of the image; and

producing a three-dimensional (3D) augmented reality representation of the image having the texture corresponding to the hand drawn modification added by the user for display to the user, wherein the texture corresponding to the hand drawn modification added by the user covers a surface of the 3D augmented reality representation of the image corresponding to a portion that is not visible in the 2D representation of the image, wherein the portion corresponds to a rear view of an object in the image, wherein the rear view is not visible in the 2D representation of the image.

15. The computer-readable non-transitory medium of claim 14 , wherein synthesizing the texture corresponding to the hand drawn modification comprises utilizing at least one of a pixel-copying technique and UV mapping to synthesize the texture.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2015
From: MITCHELL, KENNY
To: THE WALT DISNEY COMPANY LIMITED
Reel/Frame 034997/0658 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 20, 2015
From: THE WALT DISNEY COMPANY LIMITED
To: DISNEY ENTERPRISES, INC
Reel/Frame 034997/0847 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2015
From: SUMNER, ROBERT; NITTI, MAURIZIO; ROETHLIN, GERHARD; MARRA, ALESSIA; RYFFEL, MATTIA; NORIS, GIOACCHINO; MAGNENAT, STEPHANE
To: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
Reel/Frame 034989/0403 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2015
From: THE WALT DISNEY COMPANY (SWITZERLAND) GMBH
To: DISNEY ENTERPRISES, INC
Reel/Frame 034989/0431 →
Continuity (2)
Provisional Application 61949185 · Mar 6, 2014
Related Publication 20150254903A1 · Sep 10, 2015