IP Library › Granted Patent US 11,443,491
Granted Patent B2
US 11,443,491 · App. 17/249,092 · Granted Sep 13, 2022

3D object camera customization system

Inventors: Samuel Edward Hare (Los Angeles, CA); Andrew James McPhee (Culver City, CA); Maxim Maximov Lazarov (Culver City, CA); Wentao Shang (Los Angeles, CA); Kyle Goodrich (Venice, CA); Tony Mathew (Los Angeles, CA)
Assignee: Snap Inc.
G06T19/006G06T19/20H04L51/04H04N5/247H04N5/272G06T2200/24G06T2219/2016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,443,491
App. No.
17/249,092
Granted
Sep 13, 2022
Kind
B2
Abstract

Systems and methods are provided for capturing by a camera of a user device, a first image depicting a first environment of the user device; overlaying a first virtual object on a portion of the first image depicting the first environment; modifying a surface of the first virtual object using content captured by the user device; storing a second virtual object comprising the first virtual object with the modified surface; and generating for display the second virtual object on a portion of a second image depicting a second environment.

Claims (47)

1. A method comprising:

capturing, by a camera of a client device, a first image depicting a first environment of the client device and a user of the client device;

overlaying, by one or more processors of the client device, a first virtual object on a portion of the first image depicting the first environment, the first virtual object comprising a virtual garment positioned on top of the user depicted in the first image; and

modifying a surface of the first virtual object such that a portion of the virtual garment depicts a face of the user or surroundings of the user.

2. The method of claim 1 , further comprising:

storing a second virtual object comprising the first virtual object with the modified surface; and

generating, for display, the second virtual object on a portion of a second image depicting a second environment.

3. The method of claim 1 , wherein modifying the surface comprises:

identifying a first pixel of the portion of the image;

retrieving a pixel value of the first pixel; and

copying the retrieved pixel value to a surface pixel of the first virtual object.

4. The method of claim 1 , wherein the first virtual object is displayed within a camera feed captured using a messaging application of the client device of a second environment.

5. The method of claim 1 , wherein the first virtual object is stored in response to receiving input confirming a position of the first virtual object in the first image.

6. The method of claim 1 , wherein the client device is a first client device, and further comprising sending the first virtual object to a second client device via a messaging application of the first client device.

7. The method of claim 1 , wherein a second image depicting a second environment is captured by a second client device, and further comprising causing generating for display the first virtual object on the portion of the second image depicting the second environment, using a messaging application of the second client device, in response to receiving the first virtual object from the first client device.

8. The method of claim 1 further comprising:

receiving user input comprising a plurality of characters of a string; and

generating a second virtual object comprising the string as each character in the string is received in the user input, the second virtual object comprising a three-dimensional caption that includes a surface modified to represent one or more visual components of the first environment depicted in the first image.

9. The method of claim 1 , wherein:

modifying the surface of the first virtual object comprises presenting a second video on the first virtual object.

10. The method of claim 9 , wherein the client device is a first client device, and further comprising:

causing capturing a third video using a camera of a second client device; and

presenting the first virtual object with the second video on top of the third video on the second client device.

11. The method of claim 1 , wherein the camera of the client device comprises a front-facing camera of the client device, wherein the first image is a first of a plurality of images of a first video captured by the front-facing camera of the client device, wherein the face of the user is captured by the front-facing camera, further comprising:

displaying the first virtual object comprising the modified surface depicting the face of the user captured by the front-facing camera within a second video captured by a rear-facing camera of the client device.

12. The method of claim 1 , wherein the virtual garment comprises a virtual hat, wherein the virtual hat is positioned on top of a head of the user depicted in the first image.

13. A system comprising:

one or more processors;

a memory storing instructions which, when executed by the one or more processors, cause the one or more processors to perform operations comprising:

capturing, by a camera of a client device, a first image depicting a first environment of the client device and a user of the client device;

overlaying, by one or more processors of the client device, a first virtual object on a portion of the first image depicting the first environment, the first virtual object comprising a virtual garment positioned on top of the user depicted in the first image; and

modifying a surface of the first virtual object such that a portion of the virtual garment depicts a face of the user or surroundings of the user.

14. The system of claim 13 , wherein the operations further comprise:

storing a second virtual object comprising the first virtual object with the modified surface; and

generating, for display, the second virtual object on a portion of a second image depicting a second environment.

15. The system of claim 13 , wherein modifying the surface comprises:

identifying a first pixel of the portion of the image;

retrieving a pixel value of the first pixel; and

copying the retrieved pixel value to a surface pixel of the first virtual object.

16. The system of claim 13 , wherein the first virtual object is displayed within a camera feed captured using a messaging application of the client device of a second environment.

17. The system of claim 13 , wherein the first virtual object is stored in response to receiving input confirming a position of the first virtual object in the first image.

18. The system of claim 13 , wherein the client device is a first client device, and further comprising sending the first virtual object to a second client device via a messaging application of the first client device.

19. The system of claim 13 , wherein the virtual garment comprises a virtual hat, wherein the virtual hat is positioned on top of a head of the user depicted in the first image.

20. A non-transitory machine-readable medium storing non-transitory instructions which, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

capturing, by a camera of a client device, a first image depicting a first environment of the client device and a user of the client device;

overlaying, by one or more processors of the client device, a first virtual object on a portion of the first image depicting the first environment, the first virtual object comprising a virtual garment positioned on top of the user depicted in the first image; and

modifying a surface of the first virtual object such that a portion of the virtual garment depicts a face of the user or surroundings of the user.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 2, 2022
From: HARE, SAMUEL EDWARD; MCPHEE, ANDREW JAMES; LAZAROV, MAXIM MAXIMOV; SHANG, WENTAO; GOODRICH, KYLE; MATHEW, TONY
To: SNAP INC.
Reel/Frame 060700/0468 →
Continuity (2)
Continuation 16457461 · Jun 28, 2019
Related Publication 20210174600A1 · Jun 10, 2021
Cited By (9)
US 12,211,159 US 12,217,374 US 12,347,045 US 12,361,652 US 12,387,436 US 12,443,325 US 12,444,138 US 12,488,548 US 12,541,929