IP Library › Granted Patent US 10,665,266
Granted Patent B2
US 10,665,266 · App. 15/934,818 · Granted May 26, 2020

Integrating a prerecorded video file into a video

Inventors: Richard Rabbat (Palo Alto, CA); Ernestine Fu (Northridge, CA); Kasey Wang (Palo Alto, CA)
Assignee: Gfycat, Inc.
G11B27/036G06T17/20G06T19/20
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,665,266
App. No.
15/934,818
Granted
May 26, 2020
Kind
B2
Abstract

In a device and method for integrating a prerecorded video file into a video, a video of a scene is displayed on a display device of a mobile electronic device. A prerecorded video file to render on the display device is received. A modified prerecorded video file is generated by modifying a visual appearance of the prerecorded video file, where the modifying is for integrating the modified prerecorded video file into the scene. The modified prerecorded video file is superimposed over the video, such that the video is partially obscured by the modified prerecorded video file. The modified prerecorded video file is played while displaying the video, such that the modified prerecorded video file and a non-obscured portion of the video are rendered simultaneously.

Claims (62)

1. A mobile electronic device comprising:

a camera;

a display device;

a data storage unit; and

a processor coupled with the data storage unit and the display device, the processor configured to:

display a live video of a scene on a display device of a mobile electronic device, wherein the live video is captured at the camera of the mobile electronic device;

receive a prerecorded video file to render on the display device;

receive a modification selection defining a modification of a visual appearance of the prerecorded video file, wherein the modification selection comprises a graphical modification of the prerecorded video file to visually integrate the prerecorded video file into the scene;

generate a modified prerecorded video file by modifying the visual appearance of the prerecorded video file according to the modification selection, wherein the modifying is for visually integrating the modified prerecorded video file into the scene;

superimpose the modified prerecorded video file over the live video, such that the live video is partially obscured by the modified prerecorded video file, wherein the modified prerecorded video file is positioned relative to an object within the live video; and

play the modified prerecorded video file while displaying the live video, such that the modified prerecorded video file and a non-obscured portion of the live video are rendered simultaneously.

2. The mobile electronic device of claim 1 , wherein the modification selection comprises a graphical object for placement into the live video of the scene, wherein the graphical object is a three-dimensional model.

3. The mobile electronic device of claim 2 , wherein the processor is further configured to:

superimpose the prerecorded video file onto a region of the graphical object to generate the modified prerecorded video file.

4. The mobile electronic device of claim 3 , wherein the processor is further configured to:

receive a mesh that conforms to the region of the graphical object;

apply the mesh to the prerecorded video file; and

superimpose the prerecorded video file onto the region of the graphical object as a texture based on the mesh.

5. The mobile electronic device of claim 2 , wherein the processor is further configured to:

maintain the modified prerecorded video file in an orientation orthogonal to a camera angle of the live video during the play of the modified prerecorded video file.

6. The mobile electronic device of claim 1 , wherein the processor is further configured to:

apply the graphical modification to the prerecorded video file to generate the modified prerecorded video file.

7. The mobile electronic device of claim 6 , wherein the graphical modification comprises at least one of:

blurring a portion of the prerecorded video file;

smoothing a portion of the prerecorded video file;

applying a filter to a portion of the prerecorded video file;

removing a background of the prerecorded video file;

color matching an outer portion of the prerecorded video file to the live video; and

adding a graphical object to the prerecorded video file.

8. A method for integrating a prerecorded video file into a video, the method comprising:

displaying a live video of a scene on a display device of a mobile electronic device, wherein the live video is captured at a camera of the mobile electronic device;

receiving a prerecorded video file to render on the display device;

receiving a modification selection defining a modification of a visual appearance of the prerecorded video file, wherein the modification selection comprises a graphical object for placement into the live video of the scene, wherein the graphical object is a three-dimensional model;

generating a modified prerecorded video file by modifying the visual appearance of the prerecorded video file, wherein the modifying is for integrating the modified prerecorded video file into the scene, the generating the modified prerecorded video file by modifying the visual appearance of the prerecorded video file comprising superimposing the prerecorded video file onto a region of the graphical object to generate the modified prerecorded video file;

superimposing the modified prerecorded video file over the live video, such that the live video is partially obscured by the modified prerecorded video file; and

playing the modified prerecorded video file while displaying the live video, such that the modified prerecorded video file and a non-obscured portion of the live video are rendered simultaneously.

9. The method of claim 8 , wherein the generating the modified prerecorded video file by modifying the visual appearance of the prerecorded video file further comprises:

receiving a mesh that conforms to the region of the graphical object;

applying the mesh to the prerecorded video file; and

superimposing the prerecorded video file onto the region of the graphical object as a texture based on the mesh.

10. The method of claim 8 , wherein the playing the modified prerecorded video file while displaying the live video comprises:

maintaining the modified prerecorded video file in an orientation orthogonal to a camera angle of the live video.

11. The method of claim 8 , wherein the modification selection comprises a graphical modification of the prerecorded video file.

12. The method of claim 11 , wherein the generating the modified prerecorded video file by modifying the visual appearance of the prerecorded video file comprises:

applying the graphical modification to the prerecorded video file to generate the modified prerecorded video file.

13. The method of claim 11 , wherein the graphical modification comprises at least one of:

blurring a portion of the prerecorded video file;

smoothing a portion of the prerecorded video file;

applying a filter to a portion of the prerecorded video file;

removing a background of the prerecorded video file; and

color matching an outer portion of the prerecorded video file to the live video.

14. A non-transitory computer readable storage medium having computer readable program code stored thereon for causing a computer system to perform a method for integrating a prerecorded video file into a video, the method comprising:

displaying a live video of a scene on a display device of a mobile electronic device, wherein the live video is captured at a camera of the mobile electronic device;

receiving a prerecorded video file to render on the display device;

receiving a modification selection defining a modification of a visual appearance of the prerecorded video file;

generating a modified prerecorded video file by modifying the visual appearance of the prerecorded video file based on the modification selection, wherein the modifying is for integrating the modified prerecorded video file into the scene;

superimposing the modified prerecorded video file over the live video, such that the live video is partially obscured by the modified prerecorded video file; and

playing the modified prerecorded video file while displaying the live video, such that the modified prerecorded video file and a non-obscured portion of the live video are rendered simultaneously, wherein the modified prerecorded video file is maintained in an orientation orthogonal to a camera angle of the live video during the playing of the modified prerecorded video file.

15. The non-transitory computer readable storage medium of claim 14 , wherein the modification selection comprises a graphical object for placement into the live video of the scene, wherein the generating the modified prerecorded video file by modifying a visual appearance of the prerecorded video file comprises:

superimposing the prerecorded video file onto a region of the graphical object to generate the modified prerecorded video file.

16. The non-transitory computer readable storage medium of claim 14 , wherein the modification selection comprises a graphical modification of the prerecorded video file, wherein the generating the modified prerecorded video file by modifying a visual appearance of the prerecorded video file comprises:

applying the graphical modification to the prerecorded video file to generate the modified prerecorded video file.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 3, 2022
From: GFYCAT, INC.
To: SNAP INC.
Reel/Frame 061963/0865 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 23, 2018
From: RABBAT, RICHARD; FU, ERNESTINE; WANG, KASEY
To: GFYCAT, INC.
Reel/Frame 045335/0726 →
Continuity (1)
Related Publication 20190295598A1 · Sep 26, 2019