IP Library Granted Patent US 11,625,895
Granted Patent B2
US 11,625,895 · App. 17/386,998 · Granted Apr 11, 2023

3D paint effects in a messaging system

Inventors: Piers George Cowburn (London, GB); Kyle Goodrich (Venice, CA); Samuel Edward Hare (Los Angeles, CA); Maxim Maximov Lazarov (Culver City, CA); David Li (London, GB); Tony Mathew (Los Angeles, CA); Andrew James McPhee (Culver City, CA); Daniel Moreno (Los Angeles, CA); Isac Andreas Müller Sandvik (London, GB); Wentao Shang (Los Angeles, CA)
Assignee: Snap Inc.
G06T17/20G06T11/203G06T19/20G06T2219/2012G06T2219/2021
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,625,895
App. No.
17/386,998
Granted
Apr 11, 2023
Kind
B2
Abstract

Systems and methods are provided for determining a location of a selection in a space viewable in a camera view on a display of a computing device, detecting movement of the computing device, and generating a path based on the location of the selection and the movement of the computing device. The systems and methods further provide for generating a three-dimensional (3D) mesh along the path, populating the 3D mesh with selected options to generate a 3D paint object, and causing the generated 3D paint object to be displayed. The systems and methods further provide for receiving a request to send a message comprising an image or video overlaid by the 3D paint object, capturing the image or video overlaid by the displayed 3D paint object, generating the message comprising the image or video overlaid by the 3D paint object, and sending the message to another computing device.

Claims (49)

1. A method comprising:

generating, by a first computing device, a three-dimensional (3D) mesh along a path following movement of the first computing device using multiple X, Y, and Z coordinates calculated based on the movement of the first computing device;

populating, by the first computing device, the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the first computing device;

associating the generated 3D paint object with an object in the camera view;

causing, by the first computing device, display of the generated 3D paint object to move as the object in the camera view moves;

capturing, by a camera of the first computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;

generating, by the first computing device, a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and

sending, by the first computing device, the message to a second computing device.

2. The method of claim 1 , wherein the 3D paint object is generated in real time based on the movement of the first computing device.

3. The method of claim 1 , wherein the method further comprises:

receiving a request to send the generated 3D paint object to a third computing device; and

sending the 3D paint object to the third computing device, wherein the 3D paint object is overlaid on an image or video captured by the third computing device.

4. The method of claim 1 , wherein generating the 3D paint object further comprises tapering at least one of a beginning or an ending of a 3D paint line of the 3D paint object.

5. The method of claim 1 , wherein the 3D mesh comprises a cylindrical or polygon shape causing a 3D paint line of the 3D paint object to be in a cylindrical or polygon shape.

6. The method of claim 1 , wherein the texture type is a type particle and the 3D paint object comprises 3D particles along the path.

7. The method of claim 1 , wherein the 3D mesh comprises more than one shape and the 3D paint object is generated using more than one shape.

8. The method of claim 7 , wherein each shape of the more than one shape comprises a color and texture type.

9. The method of claim 1 , further comprising:

applying a smoothing algorithm to the path.

10. The method of claim 1 , wherein the 3D paint object is displayed on the second computing device as the generated 3D paint object is caused to move on the first computing device as the object in the camera view moves.

11. The method of claim 1 , wherein the object in the camera view is a face or body part.

12. The method of claim 1 , further comprising:

causing display on the first computing device of a second 3D paint object being drawn on a second computing device.

13. A computing device comprising:

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising:

generating a three-dimensional (3D) mesh along a path following movement of the computing device using multiple X, Y, and Z coordinates calculated based on the movement of the computing device;

populating the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the computing device;

associating the generated 3D paint object with an object in the camera view;

causing display of the generated 3D paint object to move as the object in the camera view moves;

capturing, by a camera of the computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;

generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and

sending the message to a second computing device.

14. The computing device of claim 13 , wherein the 3D paint object is generated in real time based on the movement of the first computing device.

15. The computing device of claim 13 , the operations further comprising:

receiving a request to send the generated 3D paint object to a third computing device; and

sending the 3D paint object to the third computing device, wherein the 3D paint object is overlaid on an image or video captured by the third computing device.

16. The computing device of claim 13 , wherein generating the 3D paint object further comprises tapering at least one of a beginning or an ending of a 3D paint line of the 3D paint object.

17. The computing device of claim 13 , wherein the 3D mesh comprises a cylindrical or polygon shape causing a 3D paint line of the 3D paint object to be in a cylindrical or polygon shape.

18. The computing device of claim 13 , wherein the texture type is a type particle and the 3D paint object comprises 3D particles along the path.

19. The computing device of claim 13 , wherein the 3D mesh comprises more than one shape and the 3D paint object is generated using more than one shape.

20. A non-transitory computer-readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

generating a three-dimensional (3D) mesh along a path following movement of the computing device using multiple X, Y, and Z coordinates calculated based on the movement of the computing device;

populating the 3D mesh with a selected color and texture type to generate a 3D paint object in a camera view of the computing device;

associating the generated 3D paint object with an object in the camera view;

causing display of the generated 3D paint object to move as the object in the camera view moves;

capturing, by a camera of the computing device, an image or video of the displayed 3D paint object associated with the object in the camera view;

generating a message comprising the image or video of the displayed 3D paint object associated with the object in the camera view; and

sending the message to a second computing device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 13, 2021
From: COWBURN, PIERS GEORGE; GOODRICH, KYLE; HARE, SAMUEL EDWARD; LAZAROV, MAXIM MAXIMOV; LI, DAVID; MATHEW, TONY; MCPHEE, ANDREW JAMES; MORENO, DANIEL; MÜLLER SANDVIK, ISAC ANDREAS; SHANG, WENTAO
To: SNAP INC.
Reel/Frame 057170/0230 →
Continuity (2)
Continuation 16832992 · Mar 27, 2020
Related Publication 20210358215A1 · Nov 18, 2021