IP Library Granted Patent US 10,755,459
Granted Patent B2
US 10,755,459 · App. 15/297,938 · Granted Aug 25, 2020

Object painting through use of perspectives or transfers in a digital medium environment

Inventors: Zhili Chen (San Jose, CA); Srinivasa Madhava Phaneendra Angara (Noida, IN); Duygu Ceylan Aksit (Mountain View, CA); Byungmoon Kim (Sunnyvale, CA); Gahye Park (Goyang-si, KR)
Assignee: Adobe Inc.
G06T11/60G06F3/04815G06T11/001G06T2200/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,755,459
App. No.
15/297,938
Granted
Aug 25, 2020
Kind
B2
Abstract

Techniques and systems are described herein that support improved object painting in digital images through use of perspectives and transfers in a digital medium environment. In one example, a user interacts with a two-dimensional digital image in a user interface output by a computing device to apply digital paint. The computing device fits a three-dimensional model to an object within the image, e.g., the face. The object, as fit to the three-dimensional model, is used to support output of a plurality of perspectives of a view of the object with which a user may interact to digitally paint the object. As part of this, digital paint as specified through the user inputs is applied directly by the computing device to a two-dimensional texture map of the object. This may support transfer of digital paint by a computing device between objects by transferring the digital paint using respective two-dimensional texture maps.

Claims (52)

1. In a digital medium environment to transfer digital paint between two-dimensional digital image objects, a computing device comprising:

a processing system configured to perform one or more operations; and

a computer-readable storage medium having instructions stored thereon that, responsive to execution by the processing system, causes the processing system to perform operations including:

receiving at least one user input specifying digital paint to be applied to a two-dimensional texture map of the object in a two-dimensional digital image;

transferring the digital paint as applied to portions of a two-dimensional texture map of a source object to corresponding portions of the two-dimensional texture map of the object in the two-dimensional digital image, the transferring including restricting the transferring of the digital paint onto at least one corresponding portion of the corresponding portions based on a semantic label assigned to the at least one corresponding portion; and

displaying the object in a user interface as having the digital paint.

2. The computing device as described in claim 1 , wherein the digital paint is applied to the two-dimensional texture map of the source object by:

configuring the source object implemented in two dimensions to support manipulation in three-dimensional space;

changing a perspective of the configured source object as displayed in the user interface responsive to a user input to manipulate the configured source object in the three-dimensional space;

receiving a user input specifying digital paint to be applied to the source object through interaction with the changed perspective of the source object in the user interface;

painting the two-dimensional texture map of the source object on the two-dimension digital image directly based on the specified digital paint from the received user input; and

outputting a display of the source object in the as having the specified digital paint based on the two-dimensional texture map of the source object.

3. The computing device as described in claim 2 , wherein the operations further comprise receiving a user input to initiate painting of the source object and wherein the configuring is performed responsive to the receiving.

4. The computing device as described in claim 2 , wherein the configuring includes:

detecting landmarks of the source object,

fitting a three-dimensional model to the source object based on the landmarks to configure the source object to support manipulation in three-dimensional space in the user interface; and

wherein the changing of the perspective of the configured source object is based on the fitting to the three-dimensional model.

5. The computing device as described in claim 1 , wherein the semantic label assigned to the at least one corresponding portion identifies a particular portion of a face.

6. The computing device as described in claim 1 , wherein the object includes a face.

7. The computing device as described in claim 1 , wherein the source object and the object are both included in the two-dimensional image.

8. The computing device as described in claim 1 , wherein the source object is included in a two-dimensional digital image separate from the two-dimensional digital image that includes the object.

9. In a digital medium environment to transfer digital paint between two-dimensional digital image objects, a method implemented by a computing device, the method comprising:

receiving, by the computing device, at least one user input specifying digital paint to be applied to a two-dimensional texture map of an object in a two-dimensional digital image;

transferring, by the computing device, the digital paint as applied to portions of a source two-dimensional texture map of a source object to corresponding portions of a two-dimensional texture map of the object in the two-dimensional digital image, the transferring including restricting the transferring of the digital paint onto at least one corresponding portion of the corresponding portions based on a semantic label assigned to the at least one corresponding portion; and

displaying, by the computing device, the object in the two-dimensional digital image in a user interface as having the digital paint.

10. The method as described in claim 9 , wherein the digital paint is applied to portions of the source two-dimensional texture map by:

configuring, by the computing device, the source object implemented in two dimensions to support manipulation in three-dimensional space:

changing, by the computing device, a perspective of the configured source object as displayed in the user interface responsive to a user input to manipulate the configured source object in the three-dimensional space;

receiving, by the computing device, a user input specifying the digital paint to be applied to the configured source object through interaction with the changed perspective of the configured source object in the user interface; and

painting, by the computing device, the source two-dimensional texture map based on the specified digital paint as applied to the configured source object.

11. The method as described in claim 10 , wherein the source object and the object are both included in the two-dimensional digital image.

12. The method as described in claim 10 , wherein the source object is included in a two-dimensional digital image separate from the two-dimensional digital image that includes the object.

13. The method as described in claim 10 , wherein the configuring includes:

detecting, by the at least one computing device, landmarks of the source object;

fitting, by the at least one computing device, a three-dimensional model to the source object based on the landmarks to configure the source object to support manipulation in three-dimensional space; and

wherein the changing of the perspective of the configured object is based on the fitting to the three-dimensional model.

14. The method as described in claim 9 , wherein the object is a face.

15. The method as described in claim 9 , wherein the semantic label assigned to the at least one corresponding portion identifies a particular portion of a face.

16. In a digital medium environment to transfer digital paint between two-dimensional digital image objects, a system comprising:

means for digitally painting an object in a user interface by:

receiving a user input specifying digital paint to be applied to a two-dimensional texture map of the object in a two-dimensional digital image;

transferring the digital paint as applied to portions of a source two-dimensional texture map of a source object to corresponding portions of a two-dimensional texture map of the object in the two-dimensional digital image, the transferring including restricting the transferring of the digital paint onto at least one corresponding portion of the corresponding portions based on a semantic label assigned to the at least one corresponding portion; and

displaying, by the computing device, the object in the two-dimensional digital image in the user interface as having the digital paint.

17. The system as described in claim 16 , wherein the object is included in a different two-dimensional digital image from the two-dimensional digital image that includes the source object.

18. The system as described in claim 16 , wherein the object is a face.

19. The system as described in claim 16 , further comprising:

means for detecting landmarks of the source object implemented in two dimensions;

means for fitting a three-dimensional model to the source object based on the landmarks to configure the source object to support manipulation in three-dimensional space in the user interface; and

means for digitally painting the source object in the user interface by:

changing a perspective of the configured source object as displayed in the user interface responsive to a user input to manipulate the configured source object in the three-dimensional space, and

painting a two-dimensional texture map of the source object in the directly based on the user input.

20. The system as described in claim 16 , wherein the source object and the object are both included in the two-dimensional image.

Assignments (2)
CHANGE OF NAME Recorded Jan 21, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048103/0226 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 20, 2016
From: CHEN, ZHILI; ANGARA, SRINIVASA MADHAVA PHANEENDRA; CEYLAN AKSIT, DUYGU; KIM, BYUNGMOON; PARK, GAHYE
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 040075/0942 →
Continuity (1)
Related Publication 20180108160A1 · Apr 19, 2018