IP Library Granted Patent US 9,251,603
Granted Patent B1
US 9,251,603 · App. 14/091,468 · Granted Feb 2, 2016

Integrating panoramic video from a historic event with a video game

Inventor: Dmitry Kozko (Aventura, FL)
G06T11/00G06T19/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,251,603
App. No.
14/091,468
Granted
Feb 2, 2016
Kind
B1
Abstract

A panoramic video of a real world event can be received. The video can include perspective data linked with a video timeline. A perspective view associated with a graphics of a video game linked with a game timeline at a first time index can be determined. The perspective data of the panoramic video can be processed to obtain a video sequence matching the perspective view associated with the graphics at a second time index. The video timeline and the game timeline can be synchronized based on a common time index of each of the timelines. The graphics and the video sequence can be integrated into an interactive content, responsive to the synchronizing.

Claims (51)

1. A method for integrating panoramic video with a video game comprising:

receiving, via a computing device comprising hardware and software, a panoramic video captured by a camera of a moving vehicle of a real world event, wherein the video comprises of perspective data linked with a video timeline;

determining, via the computing device, a perspective view associated with a game vehicle of a graphics of a video game linked with a game timeline at a first time index, wherein the graphics includes an interactive graphics object for the game vehicle controlled by a user of the video game in which the game vehicle moves in a game environment per user input, wherein the graphics interactively shows the game vehicle in a third person perspective;

processing, via the computing device, the perspective data of the panoramic video to obtain a video sequence, from the panoramic video matching the perspective view associated with the graphics at a second time index, wherein the video sequence shows an interior of the moving vehicle in addition to showing at least one occupant of the moving vehicle;

synchronizing the video timeline and the game timeline based on a common time index of each of the timelines; and

integrating the graphics and the video sequence into an interactive content, responsive to the synchronizing, such that motion of the moving vehicle from the video sequence is synchronized to match motion of the game vehicle as controlled by the user, wherein the graphics showing the game vehicle in third person perspective and the video segment are concurrently included for presentation within a user interface of the video game responsive to the integrating step.

2. The method of claim 1 , further comprising:

presenting, via the computing device, the graphics and the video segment within the user interface.

3. The method of claim 1 , wherein changes of playback of the video segment during the video game using affects a portion of the gaming vehicle as shown in the user interface.

4. The method of claim 1 , further comprising:

embedding, via the computer, the perspective data within multiple frames of the video sequence.

5. The method of claim 1 , further comprising:

simultaneously presenting, via the computer, the interactive content on a computing device during a mass communication broadcast of the event.

6. The method of claim 1 , further comprising:

detecting, via the computing device, a change in the perspective view within the interactive content from a previous perspective to a subsequent perspective view; and

updating, via the computing device, the interactive content with a graphics and a video sequence matching the subsequent perspective view to maintain continuity of the content.

7. The method of claim 1 , further comprising:

overlaying, via the computing device, the video sequence within the interactive content, wherein the sequence obscures at least a portion of a computer based view.

8. The method of claim 1 , further comprising:

overlaying, via the computing device, the graphics within the interactive content, wherein the graphics obscures at least a portion of a video sequence.

9. The method of claim 1 , wherein the interactive content is a downloadable content associated with the video game, wherein the downloadable content is accessible responsive to a video game achievement.

10. A system for integrating panoramic video with a video game comprising:

a compositing engine configured to generate an interactive content comprising of a video game graphics and a video sequence, wherein the video game graphic includes an interactive graphics object for a game vehicle of a video game environment shown in a first viewing perspective, wherein the video sequence is captured by a camera of a moving vehicle of a real world event, wherein video sequence shows an interior of the moving vehicle from a second viewing perspective, which is different from the first viewing perspective, wherein movement of game vehicle is interactively controlled by user input, wherein the compositing engine time synchronizes the video sequence and the game vehicle such that motion of the moving vehicle from the video sequence is synchronized to match motion of the game vehicle as controlled by the user, wherein the video sequence is a portion of a panoramic video; and

a data store able to persist at least one of the interactive content and a panoramic video metadata.

11. The system of claim 10 , further comprising:

a computing device receiving the panoramic video, wherein the video segment comprises of perspective data linked with a video timeline;

the computing device determining a perspective view associated with a graphics of a video game linked with a game timeline at a first time index;

the computing device processing the perspective data of the panoramic video to obtain a video sequence matching the perspective view associated with the graphics at a second time index;

the computing device synchronizing the video timeline and the game timeline based on a common time index of each of the timelines; and

the computing device integrating the graphics and the video sequence into the interactive content, responsive to the synchronizing.

12. The system of claim 10 , further comprising:

a computing device presenting the interactive content within an user interface.

13. The system of claim 10 , wherein the video is obtained from a camera comprising of multiple different fixed directional lenses and a stitching lens.

14. The system of claim 10 , wherein

a computing device embedding the perspective data within multiple frames of the video sequence.

15. The system of claim 10 , further comprising:

a companion device simultaneously presenting the interactive content on a computing device during a mass communication broadcast of the event.

16. The system of claim 10 , further comprising:

a companion device detecting a change in the perspective view within the interactive content from a previous perspective to a subsequent perspective view; and

the companion device updating the interactive content with a graphics and a video sequence matching the subsequent perspective view to maintain continuity of the content.

17. The system of claim 10 , further comprising:

the companion device overlaying the video sequence within the interactive content, wherein the sequence obscures at least a portion of a computer based view.

18. The system of claim 10 , further comprising:

the companion device overlaying the graphics within the interactive content, wherein the graphics obscures at least a portion of a video sequence.

19. The system of claim 10 , wherein the interactive content is a downloadable content associated with the video game, wherein the downloadable content is accessible responsive to a video game achievement.

20. A non-transitory computer readable storage medium having computer usable program code embodied therewith, the computer usable program code comprising:

computer usable program code stored in a non-transitory storage medium, if said computer usable program code is executed by a processor it is operable to receive a panoramic video captured by a camera of a moving vehicle of a real world event, wherein the video comprises of perspective data linked with a video timeline;

computer usable program code stored in a non-transitory storage medium, if said computer usable program code is executed by a processor it is operable to determine a perspective view associated with a game vehicle of a graphics of a video game linked with a game timeline at a first time index, wherein the graphics includes an interactive graphics object for the game vehicle controlled by a user of the video game in which the game vehicle moves in a game environment per user input, wherein the graphics interactively shows the game vehicle in a third person perspective;

computer usable program code stored in a non-transitory storage medium, if said computer usable program code is executed by a processor it is operable to process the perspective data of the panoramic video to obtain a video sequence, from the panoramic video matching the perspective view associated with the graphics at a second time index, wherein the video sequence shows an interior of the moving vehicle in addition to showing at least one occupant of the moving vehicle;

computer usable program code stored in a non-transitory storage medium, if said computer usable program code is executed by a processor it is operable to synchronize the video timeline and the game timeline based on a common time index of each of the timelines such that motion of the moving vehicle from the video sequence is synchronized to match motion of the game vehicle as controlled by the user; and

computer usable program code stored in a non-transitory storage medium, if said computer usable program code is executed by a processor it is operable to integrate the graphics and the video sequence into an interactive content, responsive to the synchronizing.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2017
From: KOZKO, DMITRY
To: 360 RACING, LLC
Reel/Frame 041281/0155 →
CHANGE OF NAME Recorded Feb 16, 2017
From: 360 RACING, LLC
To: ULTRACAST, LLC
Reel/Frame 041281/0245 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2015
From: KOZKO, DMITRY
To: 360 LAB LLC.
Reel/Frame 035795/0210 →
Continuity (2)
Provisional Application 61853711 · Apr 10, 2013
Provisional Application 61854397 · Apr 23, 2013