IP Library Granted Patent US 10,984,572
Granted Patent B1
US 10,984,572 · App. 16/986,617 · Granted Apr 20, 2021

System and method for integrating realistic effects onto digital composites of digital visual media

Inventors: Shaun T. Zacharia (New York, NY); Samuel Benjamin Shapiro (New York, NY); Alexander Prokofiev (South Plainfield, NJ); Luis Manuel Bracamontes Hernandez (New York, NY)
Assignee: Triple Lift, Inc.
G06T11/60G06T5/002G06T5/50G06T11/001G06F3/0482G06T2207/10016G06T2207/20201H04N21/6118
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,984,572
App. No.
16/986,617
Granted
Apr 20, 2021
Kind
B1
Abstract

A system and method for inserting a composited image or otherwise generated graphic into a selected video by way of a programmatic process. According to some embodiments, a system may comprise an Automated Placement Opportunity Identification (APOI) engine, a Placement Insertion Interface (PII) engine, a preview system, and an automated compositing service. The system finalizes a graphic composite into a video and provides a user with a preview for final export or further manipulation.

Claims (87)

1. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

creating, by the computer processor:

a shadow layer image comprising one or more shadows of one or more objects depicted in the base layer image, wherein the one or more shadows are disposed within the insert layer area; and/or

a reflection layer image comprising one or more reflections of one or more objects depicted in the base layer image, wherein the one or more reflections are disposed within the insert layer area;

combining, by the computer processor, the base layer image and the insert layer image to form a composite image; and

generating, by the computer processor, respective composite images for a sequence of base layer images corresponding to frames in a video using the insert image.

2. The method of claim 1 , wherein the base layer image comprises a frame of a video.

3. The method of claim 1 , wherein the placement area comprises a surface of an object depicted in the base layer image.

4. The method of claim 1 , wherein the insert layer image further comprises a transparent area surrounding the insert layer area.

5. The method of claim 1 , further comprising modifying, by the computer processor, the insert image to fit within the placement area.

6. The method of claim 1 , further comprising creating, by the computer processor, an alpha layer image having dimensions corresponding to dimensions of the base layer image, wherein the alpha layer image comprises an application area corresponding to the insert layer area for applying additional effect layers thereto.

7. The method of claim 6 , further comprising determining, by the computer processor, that a first object depicted in the base layer image appears closer than a second object within the placement area, and wherein the combining comprises depicting at least a portion of the first object in front of the insert image in the composite image.

8. The method of claim 1 , wherein the combining comprises blending the shadow layer image with the composite image.

9. The method of claim 1 , wherein the combining comprises blending the reflection layer image with the composite image.

10. The method of claim 1 , further comprising:

determining, by the computer processor, a motion blur index of one or more objects depicted in the base layer image;

generating, by the computer processor, a motion blur effect corresponding to the motion blur index; and

adding, by the computer processor, the motion blur effect to the insert image within the insert layer area to simulate motion over a period of time.

11. The method of claim 1 , further comprising:

determining, by the computer processor, a depth of field index of one or more objects depicted in the base layer image;

generating, by the computer processor, a depth of field effect corresponding to the depth of field index; and

adding, by the computer processor, the depth of field effect to the insert image within the insert layer area to simulate a difference in focus.

12. A system for compositing digital images, the system comprising:

a processor; and

a non-transitory computer-readable medium for storing computer-executable instructions that, when executed by the processor, program the processor to perform operations comprising:

receiving as input a base layer image and an insert image of the received plurality of images;

identifying a placement area in the base layer image for placing the insert image;

creating an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

creating:

a shadow layer image comprising one or more shadows of one or more objects depicted in the base layer image, wherein the one or more shadows are disposed within the insert layer area; and/or

a reflection layer image comprising one or more reflections of one or more objects depicted in the base layer image, wherein the one or more reflections are disposed within the insert layer area;

combining the base layer image and the insert layer image to form a composite image; and

generating respective composite images for a sequence of base layer images corresponding to frames in a video using the insert image.

13. The system of claim 12 , wherein the base layer image comprises a frame of a video.

14. The system of claim 12 , wherein the placement area comprises a surface of an object depicted in the base layer image.

15. The system of claim 12 , wherein the insert layer image further comprises a transparent area surrounding the insert layer area.

16. The system of claim 12 , wherein the operations further comprise modifying the insert image to fit within the placement area.

17. The system of claim 12 , wherein the operations further comprise creating an alpha layer image having dimensions corresponding to dimensions of the base layer image, wherein the alpha layer image comprises an application area corresponding to the insert layer area for applying additional effect layers thereto.

18. The system of claim 17 , wherein the operations further comprise determining that a first object depicted in the base layer image appears closer than a second object within the placement area, and wherein the combining comprises depicting at least a portion of the first object in front of the insert image in the composite image.

19. The system of claim 12 , wherein the combining comprises blending the shadow layer image with the composite image.

20. The system of claim 12 , wherein the combining comprises blending the reflection layer image with the composite image.

21. The system of claim 12 , wherein the operations further comprise:

determining a motion blur index of one or more objects depicted in the base layer image;

generating a motion blur effect corresponding to the motion blur index; and

adding the motion blur effect to the insert image within the insert layer area to simulate motion over a period of time.

22. The system of claim 12 , wherein the operations further comprise:

determining a depth of field index of one or more objects depicted in the base layer image;

generating a depth of field effect corresponding to the depth of field index; and

adding the depth of field effect to the insert image within the insert layer area to simulate a difference in focus.

23. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

creating, by the computer processor, an alpha layer image having dimensions corresponding to dimensions of the base layer image, wherein the alpha layer image comprises an application area corresponding to the insert layer area for applying additional effect layers thereto;

determining, by the computer processor, that a first object depicted in the base layer image appears closer than a second object within the placement area; and

combining, by the computer processor, the base layer image and the insert layer image to form a composite image, wherein the combining comprises depicting at least a portion of the first object in front of the insert image in the composite image.

24. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

creating, by the computer processor, a shadow layer image comprising one or more shadows of one or more objects depicted in the base layer image, wherein the one or more shadows are disposed within the insert layer area; and

combining, by the computer processor, the base layer image and the insert layer image to form a composite image.

25. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

creating, by the computer processor, a reflection layer image comprising one or more reflections of one or more objects depicted in the base layer image, wherein the one or more reflections are disposed within the insert layer area; and

combining, by the computer processor, the base layer image and the insert layer image to form a composite image.

26. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

determining, by the computer processor, a motion blur index of one or more objects depicted in the base layer image;

generating, by the computer processor, a motion blur effect corresponding to the motion blur index;

adding, by the computer processor, the motion blur effect to the insert image within the insert layer area to simulate motion over a period of time; and

combining, by the computer processor, the base layer image and the insert layer image to form a composite image.

27. A method of digital image composition, the method comprising:

receiving, by a computer processor, as input a base layer image and an insert image;

identifying, by the computer processor, a placement area in the base layer image for placing the insert image;

creating, by the computer processor, an insert layer image having dimensions corresponding to dimensions of the base layer image, wherein the insert layer image comprises the insert image placed within an insert layer area in the insert layer image corresponding to the placement area;

determining, by the computer processor, a depth of field index of one or more objects depicted in the base layer image;

generating, by the computer processor, a depth of field effect corresponding to the depth of field index;

adding, by the computer processor, the depth of field effect to the insert image within the insert layer area to simulate a difference in focus; and

combining, by the computer processor, the base layer image and the insert layer image to form a composite image.

Assignments (2)
PATENT SECURITY AGREEMENT Recorded May 6, 2021
From: TRIPLE LIFT, INC.
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 056178/0154 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2020
From: ZACHARIA, SHAUN T.; SHAPIRO, SAMUEL BENJAMIN; PROKOFIEV, ALEXANDER; BRACAMONTES HERNANDEZ, LUIS MANUEL
To: TRIPLE LIFT, INC.
Reel/Frame 053589/0492 →
Cited By (2)
US 12,217,142 US 12,457,380