IP Library Granted Patent US 12,356,048
Granted Patent B2
US 12,356,048 · App. 19/050,977 · Granted Jul 8, 2025

Event-driven streaming media interactivity

Inventor: Steven Selfors (Miami, FL)
Assignee: Videokawa, Inc.
H04N21/4856G06F16/7867G06V10/768G06V20/49H04N21/44H04N21/47217H04N21/4882H04N21/84H04N21/8586G06V2201/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,356,048
App. No.
19/050,977
Granted
Jul 8, 2025
Kind
B2
Abstract

Aspects described herein may provide systems, methods, and device for facilitating language learning using videos. Subtitles may be displayed in a first, target language or a second, native language during display of the video. On a pause event, both the target language subtitle and the native language subtitle may be displayed simultaneously to facilitate understanding. While paused, a user may select an option to be provided with additional contextual information indicating usage and context associated with one or more words of the target language subtitle. The user may navigate through previous and next subtitles with additional contextual information while the video is paused. Other aspects may allow users to create auto-continuous video loops of definable duration, and may allow users to generate video segments by searching an entire database of subtitle text, and may allow users create, save, share, and search video loops.

Claims (79)

1. A method comprising using at least one processor of a server to:

for each of a plurality of videos, store a unique video identifier and corresponding subtitle content;

receive, from a user device, a search request comprising one or more keywords;

search the subtitle content for the plurality of videos to identify one or more matching videos of the plurality of videos, wherein each of the one or more matching videos is associated with subtitle content that comprises a matching subtitle text portion that matches the one or more keywords;

for each of the one or more matching videos,

determine a start time within the matching video, so as to precede a subtitle time corresponding to the matching subtitle text portion, and

generate video segment metadata that defines a video segment, wherein the video segment metadata comprises the unique video identifier of the matching video, and the start time;

in response to the search request, return, to the user device from which the search request was received, search response data comprising the video segment metadata for at least one of the one or more matching videos;

receive, from the user device, a request for playback of one video segment returned in the search response data; and

in response to the request for playback of the one video segment,

retrieve a video stream of the video identified by the unique video identifier in the video segment metadata defining the one video segment, and

cause playback of the video stream to begin at the start time in the video segment metadata defining the one video segment.

2. The method of claim 1 , wherein the video segment metadata further comprises an indication of the matching subtitle text portion.

3. The method of claim 2 , wherein the indication of the matching subtitle text portion comprises subtitle text that includes the matching subtitle text portion.

4. The method of claim 1 , wherein the video segment metadata further comprises descriptive text metadata.

5. The method of claim 4 , wherein the descriptive text metadata comprises a video title of the matching video.

6. The method of claim 1 , wherein the unique video identifier comprises a uniform resource locator (URL).

7. The method of claim 1 , wherein each of the one or more matching videos is a full-length source video.

8. The method of claim 7 , wherein the start time is subsequent to a beginning time of the matching full-length source video.

9. The method of claim 7 , further comprising:

during playback of the one video segment, receiving a user command to navigate to a time point prior to the start time in the video segment metadata defining the one video segment;

navigating within the matching full-length source video, identified by the unique video identifier in the video segment metadata defining the one video segment, to the time point; and

resuming playback of the video stream from the time point.

10. The method of claim 1 , wherein the subtitle time is a subtitle time point of a subtitle associated with the matching subtitle text portion.

11. The method of claim 10 , wherein determining the start time comprises subtracting a time duration from the subtitle time point.

12. The method of claim 11 , wherein the subtitle time point is a start time point of the subtitle associated with the matching subtitle text portion.

13. The method of claim 11 , wherein the time duration comprises a number of seconds stored in the server.

14. The method of claim 1 , further comprising using the at least one processor to, for each of the one or more matching videos, determine an end time, so as to exceed the subtitle time, wherein the video segment metadata further comprises the end time.

15. The method of claim 14 , wherein determining the end time comprises adding a first time duration to a subtitle time point of a subtitle associated with the matching subtitle text portion.

16. The method of claim 14 , wherein a time duration between the start time and the end time is centered around the matching subtitle text portion.

17. The method of claim 15 , wherein the subtitle time point is an end time point of the subtitle associated with the matching subtitle text portion.

18. The method of claim 15 , wherein determining the start time comprises subtracting a second time duration from a subtitle start time point of the subtitle associated with the matching subtitle text portion, and wherein the second time duration is not equal to the first time duration.

19. The method of claim 1 , further comprising displaying an indication of a duration of the one video segment on the user device.

20. A system comprising:

at least one processor; and

software configured to, when executed by the at least one processor,

for each of a plurality of videos, store a unique video identifier and corresponding subtitle content,

receive, from a user device, a search request comprising one or more keywords,

search the subtitle content for the plurality of videos to identify one or more matching videos of the plurality of videos, wherein each of the one or more matching videos is associated with subtitle content that comprises a matching subtitle text portion that matches the one or more keywords,

for each of the one or more matching videos,

determine a start time within the matching video, so as to precede a subtitle time corresponding to the matching subtitle text portion, and

generate video segment metadata that defines a video segment, wherein the video segment metadata comprises the unique video identifier of the matching video, and the start time,

in response to the search request, return, to the user device from which the search request was received, search response data comprising the video segment metadata for at least one of the one or more matching videos,

receive, from the user device, a request for playback of one video segment returned in the search response data, and

in response to the request for playback of the one video segment,

retrieve a video stream of the video identified by the unique video identifier in the video segment metadata defining the one video segment, and

cause playback of the video stream to begin at the start time in the video segment metadata defining the one video segment.

21. The system of claim 20 , wherein the video segment metadata further comprises subtitle text that includes the matching subtitle text portion, and wherein the unique video identifier comprises a uniform resource locator (URL).

22. The system of claim 20 , wherein each of the one or more matching videos is a full-length source video, wherein the start time is subsequent to a beginning time of the matching full-length source video, and wherein the software is further configured to:

during playback of the one video segment, receiving a user command to navigate to a time point prior to the start time in the video segment metadata defining the one video segment;

navigating within the matching full-length source video, identified by the unique video identifier in the video segment metadata defining the one video segment, to the time point; and

resuming playback of the video stream from the time point.

23. A non-transitory computer-readable medium having instructions stored thereon, wherein the instructions, when executed by a processor, cause the processor to:

for each of a plurality of videos, store a unique video identifier and corresponding subtitle content;

receive, from a user device, a search request comprising one or more keywords;

search the subtitle content for the plurality of videos to identify one or more matching videos of the plurality of videos, wherein each of the one or more matching videos is associated with subtitle content that comprises a matching subtitle text portion that matches the one or more keywords;

for each of the one or more matching videos,

determine a start time within the matching video, so as to precede a subtitle time corresponding to the matching subtitle text portion, and

generate video segment metadata that defines a video segment, wherein the video segment metadata comprises the unique video identifier of the matching video, and the start time;

in response to the search request, return, to the user device from which the search request was received, search response data comprising the video segment metadata for at least one of the one or more matching videos;

receive, from the user device, a request for playback of one video segment returned in the search response data; and

in response to the request for playback of the one video segment,

retrieve a video stream of the video identified by the unique video identifier in the video segment metadata defining the one video segment, and

cause playback of the video stream to begin at the start time in the video segment metadata defining the one video segment.

24. The non-transitory computer-readable medium of claim 23 , wherein the video segment metadata further comprises subtitle text that includes the matching subtitle text portion, wherein the unique video identifier comprises a uniform resource locator (URL), wherein each of the one or more matching videos is a full-length source video, wherein the start time is subsequent to a beginning time of the matching full-length source video, and wherein the instructions further cause the processor to:

during playback of the one video segment, receive a user command to navigate to a time point prior to the start time in the video segment metadata defining the one video segment;

navigate within the matching full-length source video, identified by the unique video identifier in the video segment metadata defining the one video segment, to the time point; and

resume playback of the video stream from the time point.

25. A method comprising using at least one processor of at least one server to:

receive search text, comprising one or more keywords, from a user;

search subtitles within a video catalogue to identify at least one search hit, comprising a full-length video, for which the subtitle at least partially matches the one or more keywords;

define a video segment corresponding to the at least one search hit by determining a video segment start time in the full-length video that is prior to the matching subtitle;

transmit a search result for display to the user from which the search text was received, the search result comprising a video segment thumbnail image of the video segment; and

when a gesture is applied to the video segment thumbnail image, initiate streaming of the full-length video and begin playing the full-length video from the video segment start time.

26. The method of claim 25 , wherein the video segment is further defined by a unique video identifier.

27. The method of claim 25 , wherein the search result further comprises a video title of the full-length video.

28. The method of claim 25 , wherein determining the video segment start time comprises subtracting a time duration from a subtitle time point of the matching subtitle.

29. The method of claim 25 , wherein the video segment is further defined by determining a video segment end time in the video that is after an end time of the matching subtitle.

30. The method of claim 29 , wherein determining the video segment end time comprises adding a time duration to a subtitle time point of the matching subtitle.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2025
From: SELFORS, STEVEN
To: FLICKRAY, INC.
Reel/Frame 070745/0619 →
CHANGE OF NAME Recorded Apr 4, 2025
From: FLICKRAY, INC.
To: VIDEOKAWA, INC.
Reel/Frame 070745/0908 →
Continuity (8)
Continuation 18806365 · Aug 15, 2024
Continuation 18514215 · Nov 20, 2023
Continuation 18140236 · Apr 27, 2023
Continuation 17670163 · Feb 11, 2022
Continuation 17319527 · May 13, 2021
Continuation In Part 16955523
Provisional Application 62608036 · Dec 20, 2017
Related Publication 20250184574A1 · Jun 5, 2025
References Cited (78)
US 5481296A · Cragun et al. · 1996 [cited by applicant]
US 5561457A · Cragun et al. · 1996 [cited by applicant]
US 5614940A · Cobbley et al. · 1997 [cited by applicant]
US 5859662A · Cragun et al. · 1999 [cited by applicant]
US 6175840B1 · Chen et al. · 2001 [cited by applicant]
US 6484156B1 · Gupta et al. · 2002 [cited by applicant]
US 6631522B1 · Erdelyi · 2003 [cited by applicant]
US 7466334B1 · Baba · 2008 [cited by applicant]
US 7965923B2 · Sarukkai · 2011 [cited by applicant]
US 8078034B2 · Champel et al. · 2011 [cited by applicant]
US 8140544B2 · Barton et al. · 2012 [cited by applicant]
US 8171509B1 · Girouard et al. · 2012 [cited by applicant]
US 8341152B1 · Bates · 2012 [cited by applicant]
US 8479246B2 · Hudson et al. · 2013 [cited by applicant]
US 8620139B2 · Li et al. · 2013 [cited by applicant]
US 8649661B2 · Kang et al. · 2014 [cited by applicant]
US 8774596B2 · Kurupacheril et al. · 2014 [cited by applicant]
US 9015147B2 · Curtis · 2015 [cited by applicant]
US 9031927B2 · Kaushal et al. · 2015 [cited by applicant]
US 9042703B2 · Gibbon et al. · 2015 [cited by applicant]
US 9047375B2 · Jin et al. · 2015 [cited by applicant]
US 9171545B2 · Basso et al. · 2015 [cited by applicant]
US 9237386B2 · Oztaskent et al. · 2016 [cited by applicant]
US 9275150B2 · English et al. · 2016 [cited by applicant]
US 9459527B1 · Broxton et al. · 2016 [cited by applicant]
US 9535990B2 · Skolicki · 2017 [cited by applicant]
US 9544528B2 · Gharachorloo et al. · 2017 [cited by applicant]
US 9560414B1 · Chalasani et al. · 2017 [cited by applicant]
US 9628873B2 · Hu et al. · 2017 [cited by applicant]
US 9743144B2 · Gibbon et al. · 2017 [cited by applicant]
US 10116981B2 · Jassin et al. · 2018 [cited by applicant]
US 10133819B2 · Goikhman et al. · 2018 [cited by applicant]
US 10162889B2 · Checkley et al. · 2018 [cited by applicant]
US 10311101B2 · Liu · 2019 [cited by applicant]
US 10467289B2 · Ambwani et al. · 2019 [cited by applicant]
US 10509822B2 · Ong et al. · 2019 [cited by applicant]
US 10606887B2 · Soni et al. · 2020 [cited by applicant]
US 10642892B2 · Xiao et al. · 2020 [cited by applicant]
US 10791375B2 · Kaushal et al. · 2020 [cited by applicant]
US 10878280B2 · Koval et al. · 2020 [cited by applicant]
US 20030149988A1 · Ellis et al. · 2003 [cited by applicant]
US 20040128342A1 · Maes et al. · 2004 [cited by applicant]
US 20040152055A1 · Gliessner et al. · 2004 [cited by applicant]
US 20050015807A1 · Young · 2005 [cited by applicant]
US 20050050515A1 · Shah et al. · 2005 [cited by applicant]
US 20050162551A1 · Baker · 2005 [cited by applicant]
US 20060002684A1 · Champel et al. · 2006 [cited by applicant]
US 20060122984A1 · Byers et al. · 2006 [cited by applicant]
US 20090300475A1 · Tavory et al. · 2009 [cited by applicant]
US 20110285726A1 · Redmann · 2011 [cited by applicant]
US 20120072958A1 · Smyth et al. · 2012 [cited by applicant]
US 20120254932A1 · Hudson et al. · 2012 [cited by applicant]
US 20120275761A1 · Li et al. · 2012 [cited by applicant]
US 20120276504A1 · Chen et al. · 2012 [cited by applicant]
US 20130177891A1 · Hammerschmidt · 2013 [cited by applicant]
US 20140038142A1 · Chang · 2014 [cited by applicant]
US 20140178046A1 · Abe · 2014 [cited by applicant]
US 20150093093A1 · Abecassis · 2015 [cited by applicant]
US 20150100300A1 · Nazarian et al. · 2015 [cited by applicant]
US 20150339382A1 · Skolicki · 2015 [cited by examiner]
US 20160133154A1 · Cortes et al. · 2016 [cited by applicant]
US 20160149956A1 · Birnbaum et al. · 2016 [cited by applicant]
US 20170004139A1 · Wong et al. · 2017 [cited by applicant]
US 20170270203A1 · Liu · 2017 [cited by applicant]
US 20180007443A1 · Cannistraro et al. · 2018 [cited by applicant]
Qiu et al., Improving News Video Annotation with Semantic Context, Digital Image Computing: Techniques and Applications, 2010, 6 pages. [cited by applicant]
Karthikeyan et al., Searching Video Segments through Transcript, Metadata, and SVG Objects, National Chemical Laboratory, Pune 411 008, India, 2002, 1 page. [cited by applicant]
Vanderplank, Robert. Deja vu? A decade of research on language laboratories, television and video in language learning, In: Language teaching. Dec. 10, 2009, Retrieved on Mar. 4, 2019 [online] http:J/kllc.ir/Content/Use… [cited by applicant]
International Search Report and Written Opinion for PCT App No. PCT/US2018/062609, dated Mar. 25, 2019. [cited by applicant]
FluentU, Language Immersion Online I Learn a Language with Videos, retrieved May 28, 2020, 8 pages [online] https://www.fluentu.com/en/. [cited by applicant]
SourceNext, Windows version Main features I Learn English with movies Super subtitles | SourceNext General Site, retrieved May 28, 2020, 5 pages [online] https://www.sourcenext.com/product/chj/pc/function/#L1. [cited by applicant]
Google, Search helps you find key moments in videos, [online] https://blog.google/products/search/key-moments-video-search/. [cited by applicant]
Prashant, Baheti, Search helps you find key moments in videos, Google Blog, Sep. 17, 2019, pp. 1-5, [online] https://blog.google/products/search/key-moments-video-search/. [cited by applicant]
Google, How Google's featured snippets work, website visited Dec. 9, 2022, pp. 1-2, [online] https://support.google.com/websearch/answer/9351707. [cited by applicant]
YouTube, How to Tie a Tie (Mirrored/Slowly)—Full Windsor Knot, Jul. 28, 2010, pp. 1-5, [online] https://www.google.com/search?q=how+to+tie+a+tie. [cited by applicant]
YouTube, Google Search Central, Video Key Moments on Google Search, Nov. 9, 2021. [online] https:// www.youtube.com/watch?v=rsFLlewWSrl. [cited by applicant]
Google, set limits in google ads—Google Search, retrieved Apr. 22, 2023, 3 pages, [online] https://www.google.com/search?client=safari&rls=en&q=set+limits+in+google+ads&ie=UTF-8&oe=UTF-8. [cited by applicant]
Google, how to code in swift—Google Search, retrieved Apr. 27, 2023, 3 pages, [online] https://www.google.com/search?q=how+to+code+in+swift&tbm=vid. [cited by applicant]