Augmented reality content generators including 3D data in a messaging system

1. A method, comprising:

selecting a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect;

causing display of a carousel interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator of the set of augmented reality content generators;

receiving, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator for applying a first 3D effect;

generating a segmentation mask based on first image data;

applying the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data;

generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:

converting a single channel floating point texture to a raw depth map, and

generating multiple channels based at least in part on the raw depth map;

applying, to the first image data and the first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item, the first image data and the first depth data being captured with a camera; and

generating a message including the applied first augmented reality content generator to the first image data and the first depth data.

2. The method of claim 1 , further comprising:

receiving a swipe gesture via a touch screen of the client device; and

in response to receiving the swipe gesture, causing navigation through the plurality of selectable graphical items.

3. The method of claim 1 , wherein applying the first augmented reality content generator to the first image data generates second image data.

4. The method of claim 1 , further comprising:

rendering second image data by applying the first augmented reality content generator to the first image data; and

causing display of the rendered second image data, the rendered second image data comprising an interactive 3D effect.

5. The method of claim 1 , further comprising:

performing a background in-painting technique to eliminate a portrait from a background of the first image data.

6. The method of claim 1 , wherein generating the message further includes information related to a depth map and a portrait segmentation mask.

7. The method of claim 1 , wherein the first image data and the first depth data are captured by an optical sensor of a client device.

8. The method of claim 1 , wherein the 3D effect comprises an image processing operation on the image data or the depth data.

9. The method of claim 1 , further comprising:

rendering a view of the first image data and the first depth data based on the applied first 3D effect;

receiving movement data from a movement sensor;

updating a view of the first image data and the first depth data based at least in part on the movement data; and

rendering the updated view the first image data and the first depth data.

10. The method of claim 9 , wherein the updated view and the view are different views of the applied first 3D effect.

11. A system comprising:

a processor; and

a memory including instructions that, when executed by the processor, cause the processor to perform operations comprising:

selecting a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect;

causing display of a carousel interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator of the set of augmented reality content generators;

receiving, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator for applying a first 3D effect;

generating a segmentation mask based on first image data;

applying the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data;

generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:

converting a single channel floating point texture to a raw depth map, and

generating multiple channels based at least in part on the raw depth map;

applying, to the first image data and the first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item, the first image data and the first depth data being captured with a camera; and

generating a message including the applied first augmented reality content generator to the first image data and the first depth data.

12. The system of claim 11 , wherein the memory includes further instructions, which further cause the processor to perform further operations comprising:

receiving a swipe gesture via a touch screen of the client device; and

in response to receiving the swipe gesture, causing navigation through the plurality of selectable graphical items.

13. The system of claim 11 , wherein applying the first augmented reality content generator to the first image data generates second image data.

14. The system of claim 11 , wherein the memory includes further instructions, which further cause the processor to perform further operations comprising:

rendering second image data by applying the first augmented reality content generator to the first image data; and

causing display of the rendered second image data, the rendered second image data comprising an interactive 3D effect.

15. The system of claim 11 , wherein the memory includes further instructions, which further cause the processor to perform further operations comprising:

performing a background in-painting technique to eliminate a portrait from a background of the first image data.

16. The system of claim 11 , wherein generating the message further includes information related to a depth map and a portrait segmentation mask.

17. The system of claim 11 , wherein the first image data and the first depth data are captured by an optical sensor of a client device.

18. The system of claim 11 , wherein the 3D effect comprises an image processing operation on the image data or the depth data.

19. The system of claim 11 , wherein the memory includes further instructions, which further cause the processor to perform further operations comprising:

rendering a view of the first image data and the first depth data based on the applied first 3D effect;

receiving movement data from a movement sensor;

updating a view of the first image data and the first depth data based at least in part on the movement data; and

rendering the updated view the first image data and the first depth data.

20. A non-transitory computer-readable medium comprising instructions, which when executed by a computing device, cause the computing device to perform operations comprising:

selecting a set of augmented reality content generators from a plurality of available augmented reality content generators, the selected set of augmented reality content generators comprising at least one augmented reality content generator for applying a three-dimensional (3D) effect;

causing display of a carousel interface comprising a plurality of selectable graphical items, each selectable graphical item corresponding to a respective augmented reality content generator of the set of augmented reality content generators;

receiving, at a client device, a selection of a first selectable graphical item from the plurality of selectable graphical items, the first selectable graphical item comprising a first augmented reality content generator for applying a first 3D effect;

generating a segmentation mask based on first image data;

applying the segmentation mask on first depth data to reduce a set of artifacts in a depth map based on the first depth data;

generating a packed depth map based at least in part on the depth map, the generating the packed depth map comprising:

converting a single channel floating point texture to a raw depth map, and

generating multiple channels based at least in part on the raw depth map;

applying, to the first image data and the first depth data, the first augmented reality content generator corresponding to the selected first selectable graphical item, the first image data and the first depth data being captured with a camera; and

generating a message including the applied first augmented reality content generator to the first image data and the first depth data.