IP Library Granted Patent US 11,863,836
Granted Patent B2
US 11,863,836 · App. 18/140,236 · Granted Jan 2, 2024

Event-driven streaming media interactivity

Inventor: Steven Selfors (Miami, FL)
Assignee: Videokawa, Inc.
H04N21/4856G06F16/7867G06V10/768G06V20/49H04N21/44H04N21/47217H04N21/4882H04N21/84H04N21/8586G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,863,836
App. No.
18/140,236
Granted
Jan 2, 2024
Kind
B2
Abstract

Aspects described herein may provide systems, methods, and device for facilitating language learning using videos. Subtitles may be displayed in a first, target language or a second, native language during display of the video. On a pause event, both the target language subtitle and the native language subtitle may be displayed simultaneously to facilitate understanding. While paused, a user may select an option to be provided with additional contextual information indicating usage and context associated with one or more words of the target language subtitle. The user may navigate through previous and next subtitles with additional contextual information while the video is paused. Other aspects may allow users to create auto-continuous video loops of definable duration, and may allow users to generate video segments by searching an entire database of subtitle text, and may allow users create, save, share, and search video loops.

Claims (95)

1. A computer-implemented method comprising:

receiving, by a server and from a user device, a first search request corresponding to one or more keywords, wherein the first search request comprises the one or more keywords;

determining, by the server and based on searching subtitle content corresponding to a plurality of videos, video search results comprising one or more unique video identifiers of matching videos that contain subtitles matching at least one keyword of the one or more keywords;

generating, by the server and for a first video of the matching videos, video segment metadata defining a video segment comprising a contiguous portion of the first video and corresponding to a respective matched subtitle and at least a portion of surrounding video content, wherein the video segment metadata comprises:

first metadata comprising the unique video identifier of the first video;

second metadata indicating a video segment start time, wherein the video segment start time is determined based on the respective matched subtitle; and

third metadata comprising an indication of the respective matched subtitle;

returning, by the server and to the user device, search response data comprising:

the video segment metadata, corresponding to the first video of the matching videos; and

at least one other unique video identifier corresponding to at least one other video of the matching videos;

receiving a request for playback of the video segment of the first video, wherein the request for playback indicates a selection of the video segment corresponding to the respective matched subtitle; and

causing playback of the video segment corresponding to the respective matched subtitle, wherein playback of the video segment comprises:

retrieving a video stream of the first video using the unique video identifier of the first video; and

beginning playback of the first video at the video segment start time indicated by the video segment metadata.

2. The method of claim 1 , wherein the unique video identifier of the video segment is a universal resource locator (URL).

3. The method of claim 1 , wherein the first video comprises a full-length source video.

4. The method of claim 3 , wherein:

the video segment start time of the video segment is subsequent to a beginning time of the full-length source video.

5. The method of claim 3 , further comprising:

receiving, during playback of the video segment, a user command to navigate within the first video to a point prior to the video segment start time;

navigating within the first video to the point prior to the video segment start time; and

resuming playback of the first video at the point prior to the video segment start time.

6. The method of claim 3 , wherein the video segment metadata indicates a video segment end time, the method further comprising:

continuing playback of the full-length source video after playing to the video segment end time.

7. The method of claim 1 , wherein the video segment metadata indicates a video segment end time, the method further comprising playing the video segment in an auto-continuous loop by:

automatically repositioning a playback position to the video segment start time after playing to the video segment end time; and

automatically continuing playback of the video corresponding to the segment from the video segment start time until the video segment end time or for the video segment duration.

8. The method of claim 1 , wherein the video segment start time of the video segment is defined as a time offset surrounding the respective matched subtitle.

9. The method of claim 1 , wherein the video segment metadata comprises a duration parameter indicating a total length for a video segment.

10. The method of claim 1 , wherein the video segment start time is determined based on a predefined offset time before the respective matched subtitle.

11. The method of claim 1 , wherein the video segment start time is determined based on a first integer number of subtitles before the respective matched subtitle.

12. The method of claim 1 , wherein the indication of the respective matched subtitle comprises at least one of:

a subtitle identifier of the respective matched subtitle;

a subtitle start time of the respective matched subtitle; or

a subtitle end time of the respective matched subtitle.

13. The method of claim 1 , wherein the third metadata comprises an indication of a video segment name corresponding to the video segment.

14. The method of claim 1 , wherein the third metadata comprises an indication of a matched keyword corresponding to the respective matched subtitle.

15. The method of claim 1 , wherein generating the video segment metadata comprises generating a segment video thumbnail.

16. The method of claim 1 , wherein the third metadata comprises an indication of a segment video thumbnail corresponding to the video segment.

17. The method of claim 1 , wherein the search response data comprises:

a segment video thumbnail corresponding to the video segment; and

one or more video thumbnails corresponding to the at least one other video of the matching videos.

18. The method of claim 17 , wherein a display of the segment video thumbnail comprises a visual indication identifying the video segment as a video segment of a full-length source video.

19. The method of claim 1 , further comprising:

applying facets to categorize the search response data for each matching video based on the context of the search terms matched in the respective subtitles containing a match for the search terms,

wherein the search response data returned to the user device comprises information indicating categorization of the search response data based on the applied facets.

20. The method of claim 19 , wherein the facets comprise at least one of: priority, part of speech, or formality.

21. An apparatus, comprising:

one or more processors; and

memory storing instructions that, when executed by the one or more processors, cause the apparatus to:

receive, from a user device, a first search request corresponding to one or more keywords, wherein the first search request comprises the one or more keywords;

determine, based on searching subtitle content corresponding to a plurality of videos, video search results comprising one or more unique video identifiers of matching videos that contain subtitles matching at least one keyword of the one or more keywords;

generate, for a first video of the matching videos, video segment metadata defining a video segment comprising a contiguous portion of the first video and corresponding to a respective matched subtitle and at least a portion of surrounding video content, wherein the video segment metadata comprises:

first metadata comprising the unique video identifier of the first video;

second metadata indicating a video segment start time, wherein the video segment start time is determined based on the respective matched subtitle; and

third metadata comprising an indication of the respective matched subtitle;

return, to the user device, search response data comprising:

the video segment metadata, corresponding to the first video of the matching videos; and

at least one other unique video identifier corresponding to at least one other video of the matching videos;

receive a request for playback of the video segment of the first video, wherein the request for playback indicates a selection of the video segment corresponding to the respective matched subtitle; and

cause playback of the video segment corresponding to the respective matched subtitle, wherein playback of the video segment comprises:

retrieve a video stream of the first video using the unique video identifier of the first video; and

begin playback of the first video at the video segment start time indicated by the video segment metadata.

22. The apparatus of claim 21 , wherein the first video comprises a full-length source video, and wherein the video segment start time of the video segment is subsequent to a beginning time of the full-length source video.

23. The apparatus of claim 21 , wherein the instructions further cause the apparatus to:

receive, during playback of the video segment, a user command to navigate within the first video to a point prior to the video segment start time;

navigate within the first video to the point prior to the video segment start time; and

resume playback of the first video at the point prior to the video segment start time.

24. The apparatus of claim 21 , wherein the third metadata comprises an indication of a matched keyword corresponding to the respective matched subtitle.

25. The apparatus of claim 21 , wherein the search response data comprises:

a segment video thumbnail corresponding to the video segment; and

one or more video thumbnails corresponding to the at least one other video of the matching videos.

26. One or more non-transitory computer-readable media storing instructions that, when executed by one or more processors, cause a computing system to perform steps comprising:

receiving, from a user device, a first search request corresponding to one or more keywords, wherein the first search request comprises the one or more keywords;

determining, based on searching subtitle content corresponding to a plurality of videos, video search results comprising one or more unique video identifiers of matching videos that contain subtitles matching at least one keyword of the one or more keywords;

generating, for a first video of the matching videos, video segment metadata defining a video segment comprising a contiguous portion of the first video and corresponding to a respective matched subtitle and at least a portion of surrounding video content, wherein the video segment metadata comprises:

first metadata comprising the unique video identifier of the first video;

second metadata indicating a video segment start time, wherein the video segment start time is determined based on the respective matched subtitle; and

third metadata comprising an indication of the respective matched subtitle;

returning, to the user device, search response data comprising:

the video segment metadata, corresponding to the first video of the matching videos; and

at least one other unique video identifier corresponding to at least one other video of the matching videos;

receiving a request for playback of the video segment of the first video, wherein the request for playback indicates a selection of the video segment corresponding to the respective matched subtitle; and

causing playback of the video segment corresponding to the respective matched subtitle, wherein playback of the video segment comprises:

retrieving a video stream of the first video using the unique video identifier of the first video; and

beginning playback of the first video at the video segment start time indicated by the video segment metadata.

27. The computer-readable media of claim 26 , wherein the first video comprises a full-length source video, and wherein the video segment start time of the video segment is subsequent to a beginning time of the full-length source video.

28. The computer-readable media of claim 26 , wherein the instructions cause the computing system to perform further steps comprising:

receiving, during playback of the video segment, a user command to navigate within the first video to a point prior to the video segment start time;

navigating within the first video to the point prior to the video segment start time; and

resuming playback of the first video at the point prior to the video segment start time.

29. The computer-readable media of claim 26 , wherein the third metadata comprises an indication of a matched keyword corresponding to the respective matched subtitle.

30. The computer-readable media of claim 26 , wherein the search response data comprises:

a segment video thumbnail corresponding to the video segment; and

one or more video thumbnails corresponding to the at least one other video of the matching videos.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 27, 2023
From: SELFORS, STEVEN
To: FLICKRAY, INC.
Reel/Frame 063464/0987 →
CHANGE OF NAME Recorded Apr 27, 2023
From: FLICKRAY, INC.
To: VIDEOKAWA, INC.
Reel/Frame 063485/0016 →
Continuity (5)
Continuation 17670163 · Feb 11, 2022
Continuation 17319527 · May 13, 2021
Continuation In Part 16955523
Provisional Application 62608036 · Dec 20, 2017
Related Publication 20230262296A1 · Aug 17, 2023