IP Library › Granted Patent US 11,064,244
Granted Patent B2
US 11,064,244 · App. 17/020,413 · Granted Jul 13, 2021

Synchronizing text-to-audio with interactive videos in the video framework

Inventor: Shankar Sangoli (Langhorne, PA)
Assignee: Bank of America Corporation
H04N21/4307H04N21/47217H04N21/8545H04N21/8547
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,064,244
App. No.
17/020,413
Granted
Jul 13, 2021
Kind
B2
Abstract

A device configured to determine a time on a progress bar and to identify a timestamp in the video timing map based on the time on the progress bar. The device is further configured to identify a source scene identifier corresponding with the identified timestamp and to play a video scene corresponding with the identified source scene identifier. The device is further configured to identify a first animation identifier corresponding with the identified timestamp and to play a first animation associated with the first animation identifier. The device is further configured to determine that the first animation identifier is present in the audio sample buffer, to identify an audio sample associated with the first animation identifier, and to play the identified audio sample.

Claims (67)

1. An interactive video playing device, comprising:

a memory operable to store:

a video timing map comprising a plurality of timestamps, wherein each timestamp is associated with a source scene identifier for a video scene and an animation identifier for an animation; and

an audio sample buffer comprising a plurality of audio samples; and

a processor operably coupled to the memory, and configured to:

determine a time on a progress bar;

identify a timestamp in the video timing map based on the time on the progress bar;

identify a source scene identifier corresponding with the identified timestamp;

play a video scene corresponding with the identified source scene identifier;

identify a first animation identifier corresponding with the identified timestamp;

play a first animation associated with the first animation identifier;

play a first audio sample associated with the first animation.

2. The device of claim 1 , wherein the processor is further configured to:

determine the source scene identifier is associated with a background audio sample; and

play the background audio sample before playing the first animation.

3. The device of claim 2 , wherein the processor is further configured to reduce an audio level for the background audio sample before playing the first audio sample.

4. The device of claim 1 , wherein the processor is configured to:

determine that a second animation is scheduled to be played while the first animation is playing; and

play the second animation while the first animation is playing.

5. The device of claim 4 , wherein the processor is further configured to continue playing the first audio sample while the second animation is playing.

6. The device of claim 1 , wherein the processor is further configured to:

determine a second animation that is associated with the video scene is scheduled to be played before the first animation; and

play the second animation before playing the first animation.

7. The device of claim 1 , wherein identifying a timestamp in the video timing map comprises identifying a closest timestamp that precedes the time on the progress bar.

8. An interactive video playing method, comprising:

determining a time on a progress bar;

identifying a timestamp in a video timing map based on the time on the progress bar, wherein:

the video timing map comprising a plurality of timestamps; and

each timestamp is associated with a source scene identifier for a video scene and an animation identifier for an animation;

identifying a source scene identifier corresponding with the identified timestamp;

playing a video scene corresponding with the identified source scene identifier;

identifying a first animation identifier corresponding with the identified timestamp;

playing a first animation associated with the first animation identifier;

playing a first audio sample from an audio sample buffer, wherein the first audio sample is associated with the first animation.

9. The method of claim 8 , further comprising:

determining the source scene identifier is associated with a background audio sample; and

playing the background audio sample before playing the first animation.

10. The method of claim 9 , further comprising reducing an audio level for the background audio sample before playing the first audio sample.

11. The method of claim 8 , further comprising:

determining that a second animation is scheduled to be played while the first animation is playing; and

playing the second animation while the first animation is playing.

12. The method of claim 11 , further comprising continuing to play the first audio sample while the second animation is playing.

13. The method of claim 8 , further comprising:

determining a second animation that is associated with the video scene is scheduled to be played before the first animation; and

playing the second animation before playing the first animation.

14. The method of claim 8 , wherein identifying a timestamp in the video timing map comprises identifying a closest timestamp that precedes the time on the progress bar.

15. A computer program comprising executable instructions stored in a non-transitory computer readable medium that when executed by a processor causes the processor to:

determine a time on a progress bar;

identify a timestamp in a video timing map based on the time on the progress bar, wherein:

the video timing map comprising a plurality of timestamps; and

each timestamp is associated with a source scene identifier for a video scene and an animation identifier for an animation;

identify a source scene identifier corresponding with the identified timestamp;

play a video scene corresponding with the identified source scene identifier;

identify a first animation identifier corresponding with the identified timestamp;

play a first animation associated with the first animation identifier; and

play a first audio sample from an audio sample buffer, wherein the first audio sample is associated with the first animation.

16. The computer program of claim 15 , further comprising instructions that when executed by the processor causes the processor to:

determine the source scene identifier is associated with a background audio sample; and

play the background audio sample before playing the first animation.

17. The computer program of claim 16 , further comprising instructions that when executed by the processor causes the processor to reduce an audio level for the background audio sample before playing the first audio sample.

18. The computer program of claim 15 , further comprising instructions that when executed by the processor causes the processor to:

determine that a second animation is scheduled to be played while the first animation is playing; and

play the second animation while the first animation is playing.

19. The computer program of claim 18 , further comprising instructions that when executed by the processor causes the processor to continue playing the first audio sample while the second animation is playing.

20. The computer program of claim 15 , further comprising instructions that when executed by the processor causes the processor to:

determine a second animation that is associated with the video scene is scheduled to be played before the first animation; and

play the second animation before playing the first animation.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2020
From: SANGOLI, SHANKAR
To: BANK OF AMERICA CORPORATION
Reel/Frame 053764/0849 →
Continuity (2)
Continuation 16714495 · Dec 13, 2019
Related Publication 20210185382A1 · Jun 17, 2021