IP Library › Granted Patent US 10,717,003
Granted Patent B2
US 10,717,003 · App. 16/177,998 · Granted Jul 21, 2020

Methods and systems for merging real world media within a virtual world

Inventor: Charles Chungyohl Lee (Austin, TX)
A63F13/428A63F13/213A63F13/833G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,717,003
App. No.
16/177,998
Granted
Jul 21, 2020
Kind
B2
Abstract

Embodiments disclosed herein provide systems and methods for blending real world choreographed media within a virtual world, wherein the choreographed real world media is inserted into a moving template within the virtual world. Embodiments utilize software and camera hardware configured to capture real world media, wherein the software may insert the real world media within a template to insert images of a user within the virtual world. Embodiments may allow media capturing choreographed movements to be placed within a moving template within the virtual world.

Claims (34)

1. A system for merging real world media into a virtual world, the system comprising:

a camera configured to record a performance video;

a game interface configured to create a virtual world with a reference video,

a match frame pair interface configured to merge the reference video and the performance video to create an output video, the output video including a first match frame pair and a second match frame pair, the first match frame pair including a performance frame zero associated with the performance video and a reference frame zero associated with the reference video, and the second match frame pair including a second performance frame number and a second reference frame number, wherein a first number of frames between the performance frame zero and the second performance frame number is a different number than a second number of frames between the reference frame zero and the second reference frame number.

2. The system of claim 1 , further comprising:

a template interface configured to create a template within the virtual world, the template being configured to be embedded within the reference video.

3. The system of claim 2 , further comprising:

a graphical user interface configured to alter the performance video, wherein via the graphical user interface a user is configured to align the reference frame zero and the performance frame zero based on a location of the template.

4. The system of claim 3 , wherein the template is configured to be rotated in the virtual world, wherein a first degree of rotation of the template within the virtual world is less than a second degree of rotation of an avatar within the virtual world.

5. The system of claim 2 , wherein a size of the template within the virtual world is configured to be changed.

6. The system of claim 2 , wherein the reference video includes an avatar.

7. The system of claim 2 , wherein the template is configured to replace an avatar.

8. The system of claim 1 , wherein the output video includes a third match frame pair, the third match frame pair including a third performance frame number and a third reference frame number, wherein a third number of frames between the second performance frame number and the third performance frame number is different than the first number of frames.

9. The system of claim 8 , wherein a fourth number of frames between the second reference frame number and the third reference frame number is different than the third number of frames.

10. The system of claim 1 , wherein the performance video includes real world movements of a user.

11. A method for merging real world media into a virtual world, the system comprising:

recording, via a camera, a performance video;

creating, via a game interface, a virtual world with a reference video,

merging, via a match frame pair interface, the reference video and the performance video to create an output video,

determining a first match frame pair and a second match frame pair for the output video, the first match frame pair including a performance frame zero associated with the performance video and a reference frame zero associated with the reference video, and the second match frame pair including a second performance frame number and a second reference frame number, wherein a first number of frames between the performance frame zero and the second performance frame number is a different number than a second number of frames between the reference frame zero and the second reference frame number.

12. The method of claim 11 , further comprising:

creating a template within the virtual world;

embedding the template within the reference video.

13. The method of claim 12 , further comprising:

altering the performance video;

aligning the reference frame zero and the performance frame zero based on a location of the template.

14. The method of claim 13 , further comprising:

rotating the template in the virtual world, wherein a first degree of rotation of the template within the virtual world is less than a second degree of rotation of an avatar within the virtual world.

15. The method of claim 12 , wherein a size of the template within the virtual world is configured to be changed.

16. The method of claim 12 , wherein the reference video includes an avatar.

17. The method of claim 12 , wherein the template is configured to replace an avatar.

18. The method of claim 11 , wherein the output video includes a third match frame pair, the third match frame pair including a third performance frame number and a third reference frame number, wherein a third number of frames between the second performance frame number and the third performance frame number is different than the first number of frames.

19. The method of claim 18 , wherein a fourth number of frames between the second reference frame number and the third reference frame number is different than the third number of frames.

20. The method of claim 11 , wherein the performance video includes real world movements of a user.

Continuity (3)
Continuation 15482989 · Apr 10, 2017
Provisional Application 62320669 · Apr 11, 2016
Related Publication 20190060752A1 · Feb 28, 2019