IP Library Granted Patent US 11,127,184
Granted Patent B1
US 11,127,184 · App. 15/980,419 · Granted Sep 21, 2021

Systems and methods for content creation

Inventors: Joshua Barton Dickens (Oakland, CA); Joe Howard (San Jose, CA)
Assignee: Facebook, Inc.
G06T13/40G06K9/00201G06K9/00744G06T7/50G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,127,184
App. No.
15/980,419
Granted
Sep 21, 2021
Kind
B1
Abstract

Systems, methods, and non-transitory computer-readable media can determine one or more graphical overlays to be applied to at least one object represented in a media content item; determine that a depth of the object as represented in one or more frames of the media content item satisfies a first threshold depth; and augment a representation of the object based at least in part on a first graphical overlay that corresponds to the first threshold depth.

Claims (61)

1. A computer-implemented method comprising:

determining, by a computing system, one or more graphical overlays to be applied to at least one object represented in a media content item;

determining, by the computing system, that a depth of the at least one object as represented in one or more frames of the media content item satisfies a first threshold depth; and

augmenting, by the computing system, a representation of the at least one object based at least in part on a first graphical overlay that corresponds to the first threshold depth, the augmenting further comprising:

determining, by the computing system, a segment of frames that represent a pre-rendered animation based on a first orientation associated with the at least one object;

causing, by the computing system, the representation of the at least one object as augmented by the first graphical overlay to animate based on the segment of frames;

determining, by the computing system, a second orientation associated with the at least one object; and

causing, by the computing system, the representation of the at least one object as augmented by the first graphical overlay to animate based on a different segment of frames that represent a pre-rendered animation associated with the second orientation.

2. The computer-implemented method of claim 1 , the method further comprising:

determining, by the computing system, that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a second threshold depth; and

augmenting, by the computing system, the representation of the at least one object based at least in part on a second graphical overlay that corresponds to the second threshold depth.

3. The computer-implemented method of claim 2 , the method further comprising:

determining, by the computing system, that the depth of the at least one object as represented in one or more subsequent frames of the media content item again satisfies the first threshold depth; and

augmenting, by the computing system, the representation of the at least one object based at least in part on the first graphical overlay that corresponds to the first threshold depth.

4. The computer-implemented method of claim 2 , the method further comprising:

determining, by the computing system, that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a third threshold depth; and

augmenting, by the computing system, the representation of the at least one object based at least in part on a third graphical overlay that corresponds to the third threshold depth.

5. The computer-implemented method of claim 1 , wherein the at least one object is augmented based at least in part on a third graphical overlay in response to determining at least one pre-defined gesture.

6. The computer-implemented method of claim 1 , wherein the media content item is one of: a video, looping video, or live content stream.

7. The computer-implemented method of claim 1 , wherein the first graphical overlay is at least one of: a mask applied to a human or an environmental animation.

8. A system comprising:

at least one processor; and

a memory storing instructions that, when executed by the at least one processor, cause the system to perform:

determining one or more graphical overlays to be applied to at least one object represented in a media content item;

determining that a depth of the at least one object as represented in one or more frames of the media content item satisfies a first threshold depth; and

augmenting a representation of the at least one object based at least in part on a first graphical overlay that corresponds to the first threshold depth, the augmenting further comprising:

determining a segment of frames that represent a pre-rendered animation based on a first orientation associated with the at least one object;

causing the representation of the at least one object as augmented by the first graphical overlay to animate based on the segment of frames;

determining a second orientation associated with the at least one object; and

causing the representation of the at least one object as augmented by the first graphical overlay to animate based on a different segment of frames that represent a pre-rendered animation associated with the second orientation.

9. The system of claim 8 , wherein the instructions further cause the system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a second threshold depth; and

augmenting the representation of the at least one object based at least in part on a second graphical overlay that corresponds to the second threshold depth.

10. The system of claim 9 , wherein the instructions further cause the system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item again satisfies the first threshold depth; and

augmenting the representation of the at least one object based at least in part on the first graphical overlay that corresponds to the first threshold depth.

11. The system of claim 9 , wherein the instructions further cause the system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a third threshold depth; and

augmenting the representation of the at least one object based at least in part on a third graphical overlay that corresponds to the third threshold depth.

12. The system of claim 8 , wherein the at least one object is augmented based at least in part on a third graphical overlay in response to determining at least one pre-defined gesture.

13. The system of claim 8 , wherein the media content item is one of: a video, looping video, or live content stream.

14. The system of claim 8 , wherein the first graphical overlay is at least one of: a mask applied to a human or an environmental animation.

15. A non-transitory computer-readable storage medium including instructions that, when executed by at least one processor of a computing system, cause the computing system to perform a method comprising:

determining one or more graphical overlays to be applied to at least one object represented in a media content item;

determining that a depth of the at least one object as represented in one or more frames of the media content item satisfies a first threshold depth; and

augmenting a representation of the at least one object based at least in part on a first graphical overlay that corresponds to the first threshold depth, the augmenting further comprising:

determining a segment of frames that represent a pre-rendered animation based on a first orientation associated with the at least one object;

causing the representation of the at least one object as augmented by the first graphical overlay to animate based on the segment of frames;

determining a second orientation associated with the at least one object; and

causing the representation of the at least one object as augmented by the first graphical overlay to animate based on a different segment of frames that represent a pre-rendered animation associated with the second orientation.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the instructions further cause the computing system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a second threshold depth; and

augmenting the representation of the at least one object based at least in part on a second graphical overlay that corresponds to the second threshold depth.

17. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions further cause the computing system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item again satisfies the first threshold depth; and

augmenting the representation of the at least one object based at least in part on the first graphical overlay that corresponds to the first threshold depth.

18. The non-transitory computer-readable storage medium of claim 16 , wherein the instructions further cause the computing system to perform:

determining that the depth of the at least one object as represented in one or more subsequent frames of the media content item satisfies a third threshold depth; and

augmenting the representation of the at least one object based at least in part on a third graphical overlay that corresponds to the third threshold depth.

19. The non-transitory computer-readable storage medium of claim 15 , wherein the at least one object is augmented based at least in part on a third graphical overlay in response to determining at least one pre-defined gesture.

20. The non-transitory computer-readable storage medium of claim 15 , wherein the media content item is one of: a video, looping video, or live content stream.

Assignments (2)
CHANGE OF NAME Recorded Dec 2, 2021
From: FACEBOOK, INC.
To: META PLATFORMS, INC.
Reel/Frame 058299/0088 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 13, 2020
From: DICKENS, JOSHUA BARTON; HOWARD, JOE
To: FACEBOOK, INC.
Reel/Frame 054366/0082 →