Layering of post-capture processing in a messaging system
Systems and methods described herein provide for retrieving, from a storage device, first image data previously captured by a client device. The systems and methods further detect a selection of a first image processing operation and perform the first image processing operation on the first image data to generate second image data. The systems and methods further detect a selection of a second image processing operation and perform the second image processing operation on the second image data to generate third image data. The systems and methods generate a message comprising the third image data.
1. A method, comprising:
detecting, by one or more hardware processors, a user selection of an image processing operation to modify a target facial feature with a media overlay;
performing, by the one or more hardware processors, the image processing operation on first image data using the media overlay to generate second image data, the second image data including a modified target facial feature of a first face;
causing, by the one or more hardware processors, display of the second image data on a user interface of a device;
performing, by the one or more hardware processors, different image processing operation on the second image data using a particular media overlay to generate particular image data, the particular image data including graphical elements that occlude multiple faces different from the first face; and
causing, by the one or more hardware processors, display of the particular image data on the user interface of the device, the particular image data comprising a composite image including the modified target facial features of the first face and the graphical elements that occlude the multiple faces.
2. The method of claim 1 , further comprising:
prior to detecting the user selection, accessing, by the one or more hardware processors, first image data; and
identifying, by the one or more hardware processors, based on the first image data, the target facial feature.
3. The method of claim 1 , wherein the graphical elements corresponding to the different image processing operation are different than the modified target facial features of the first face corresponding to the image processing operation.
4. The method of claim 1 , wherein the image processing operation on the first image data using the media overlay is performed using a machine learning model.
5. The method of claim 1 , further comprising:
using a machine learning model to generate a reference facial feature base on training data.
6. The method of claim 5 , wherein identifying the target facial feature comprises:
identifying, based on the training data, a facial landmark of a face included in an image represented by the first image data; and
determining, based on the facial landmark, that the reference facial feature aligns with the target facial feature.
7. The method of claim 1 , further comprising:
determining that the first image data represents a first face and a second face, the first face including the target facial feature;
detecting a first user selection of the first face to apply the image processing operation; and
based on the first user selection of the first face and the user selection of the image processing operation, performing the image processing operation on the first image data using the media overlay to generate the second image data.
8. The method of claim 7 , further comprising:
detecting a second user selection of the second face to apply a second image processing operation that corresponds to a second media overlay; and
performing the second image processing operation on the second image data using the second media overlay to generate third image data.
9. The method of claim 8 , further comprising:
causing display of the third image data on the user interface of the device.
10. The method of claim 1 , further comprising:
generating a message comprising the second image data; and
sending, to a server, the message for sharing with one or more other devices.
11. A system comprising:
one or more hardware processors;
a memory including instructions that, when executed by the one or more hardware processors, cause the one or more hardware processors to perform operations comprising:
detecting, by the one or more hardware processors, a user selection of an image processing operation to modify a target facial feature with a media overlay;
performing, by the one or more hardware processors, the image processing operation on first image data using the media overlay to generate second image data, the second image data including a modified target facial feature of a first face;
causing, by the one or more hardware processors, display of the second image data on a user interface of a device;
performing, by the one or more hardware processors, different image processing operation on the second image data using a particular media overlay to generate particular image data, the particular image data including graphical elements that occlude multiple faces different from the first face; and
causing, by the one or more hardware processors, display of the particular image data on the user interface of the device, the particular image data comprising a composite image including the modified target facial features of the first face and the graphical elements that occlude the multiple faces.
12. The system of claim 11 , wherein the operations further comprise:
prior to detecting the user selection, accessing, by the one or more hardware processors, first image data; and
identifying, by the one or more hardware processors, based on the first image data, the target facial feature.
13. The system of claim 11 , wherein the graphical elements corresponding to the different image processing operation are different than the modified target facial features of the first face corresponding to the image processing operation.
14. The system of claim 11 , wherein the image processing operation on the first image data using the media overlay is performed using a machine learning model.
15. The system of claim 11 , wherein the operations further comprise:
using a machine learning model to generate a reference facial feature base on training data.
16. The system of claim 15 , wherein identifying the target facial feature comprises:
identifying, based on the training data, a facial landmark of a face included in an image represented by the first image data; and
determining, based on the facial landmark, that the reference facial feature aligns with the target facial feature.
17. The system of claim 11 , wherein the operations further comprise:
determining that the first image data represents a first face and a second face, the first face including the target facial feature;
detecting a first user selection of the first face to apply the image processing operation; and
based on the first user selection of the first face and the user selection of the image processing operation, performing the image processing operation on the first image data using the media overlay to generate the second image data.
18. The system of claim 17 , wherein the operations further comprise:
detecting a second user selection of the second face to apply a second image processing operation that corresponds to a second media overlay; and
performing the second image processing operation on the second image data using the second media overlay to generate third image data.
19. The system of claim 18 , wherein the operations further comprise:
causing display of the third image data on the user interface of the device.
20. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:
accessing first image data;
detecting, by one or more hardware processors, a user selection of an image processing operation to modify a target facial feature with a media overlay;
performing, by the one or more hardware processors, the image processing operation on first image data using the media overlay to generate second image data, the second image data including a modified target facial feature of a first face;
causing, by the one or more hardware processors, display of the second image data on a user interface of a device;
performing, by the one or more hardware processors, different image processing operation on the second image data using a particular media overlay to generate particular image data, the particular image data including graphical elements that occlude multiple faces different from the first face; and
causing, by the one or more hardware processors, display of the particular image data on the user interface of the device, the particular image data comprising a composite image including the modified target facial features of the first face and the graphical elements that occlude the multiple faces.