IP Library Granted Patent US 12,222,951
Granted Patent B2
US 12,222,951 · App. 18/238,791 · Granted Feb 11, 2025

Aiding discovery of program content by providing deeplinks into most interesting moments via social media

Inventors: Ant Oztaskent (Surrey, GB); Gjokica Zafirovski (London, GB)
Assignee: GOOGLE LLC
G06F16/24578G06F3/0482G06F3/04842G06F16/435G06F16/5846G06F16/7867G06F16/9535G06F16/9536G06F16/9537G06F16/9538H04N21/4782H04N21/64322H04N21/812G06Q50/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,222,951
App. No.
18/238,791
Granted
Feb 11, 2025
Kind
B2
Abstract

A computerized method, system for, and computer-readable medium operable to: retrieve program details data about at least one media program. Retrieve social media posts involving the at least one media program. Match the retrieved program details data with the retrieved social media posts to find matching locations. Store time offset data corresponding to the matched locations within the at least one media program into at least one micropost. Rank the at least one media program by the number of microposts corresponding to the at least one media program. Present the at least one media program, each of the at least one media program with at least one micropost, wherein the at least one micropost comprises a link to the original social media page hosting the social media post and a video deeplink that plays a time off-set video, the time off-set video starting from the stored time offset data.

Claims (55)

1. A method for presenting media content, the method comprising:

comparing, for each of a plurality of media programs, subtitle data for a media program of the plurality of media programs with text data from each of a plurality of social media posts;

determining, based on comparing the subtitle data with the text data, a plurality of different portions of the subtitle data for the media program that match at least one of the plurality of social media posts; and

causing at least one of the plurality of media programs to be presented for selection by a user based on the plurality of different portions of the subtitle data for each media program that match at least one social media post.

2. The method of claim 1 , further comprising:

identifying, for each social media post with the text data determined to match a portion of the subtitle data of one of the plurality of media programs, timestamp data associated with the subtitle data that matches the text data;

identifying time offset data corresponding to the subtitle data that matches the text data based on the timestamp data; and

creating at least one micropost using the time offset data corresponding to the subtitle data that matches the text data within the at least one of the plurality of media programs to generate a video deeplink that plays a time-offset video starting from the time offset data.

3. The method of claim 2 , wherein identifying time offset data comprises determining a time offset value in an episode of the media program which the at least one social media post matches where the text data from a matching location begins, wherein the time offset value comprises a time offset value where the text data exactly begins and a time offset value starting from a beginning of a sentence where the text data exactly begins and a time offset value starting from the beginning of a scene where the text data exactly begins.

4. The method of claim 2 , wherein ranking the plurality of media programs comprises:

determining microposts that refer to a same matched locations;

grouping the microposts that refer to the same matched locations; and

ranking the plurality of media programs based on a number of groups of microposts associated with each of the plurality of media programs.

5. The method of claim 2 , wherein causing at least one of the plurality of media programs to be presented for selection by a user based on ranking comprises:

causing the at least one of the plurality of media programs to be presented in a program panel in a user interface presented by a user device, wherein the user interface loads a predetermined number of program panels on a screen at one time, and wherein the program panel comprises a title of each media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

causing a clicked item on the user interface to be presented by the user device presenting the user interface.

6. The method of claim 5 , wherein selection of the at least one program link causes an episode of a corresponding media program to be presented by the user device, selection of the at least one social media affirmation button facilitates sharing of the at least one media program to at least one social media service, selection of the at least one program summary news byte causes a news item that to be loaded by the user device, and selection of the at least one loading area causes more program panels to be loaded in the user interface.

7. The method of claim 5 , wherein selection of the video deeplink causes the media program corresponding to the video deeplink to be presented by the user device from a starting point corresponding to the time offset data until an ending point corresponding to an end of a scene discussed in the at least one micropost.

8. A system for presenting ranked media content, the system comprising:

a hardware processor that is configured to:

compare, for each of a plurality of media programs, subtitle data for a media program of the plurality of media programs with text data from each of a plurality of social media posts;

determine, based on comparing the subtitle data with the text data, a plurality of different portions of the subtitle data for the media program that match at least one of the plurality of social media posts; and

cause at least one of the plurality of media programs to be presented for selection by a user based on the plurality of different portions of the subtitle data for each media program that match at least one social media post.

9. The system of claim 8 , wherein the hardware processor is further configured to:

identify, for each social media post with the text data determined to match a portion of the subtitle data of one of the plurality of media programs, timestamp data associated with the subtitle data that matches the text data;

identify time offset data corresponding to the subtitle data that matches the text data based on the timestamp data; and

create at least one micropost using the time offset data corresponding to the subtitle data that matches the text data within the at least one of the plurality of media programs to generate a video deeplink that plays a time-offset video starting from the time offset data.

10. The system of claim 9 , wherein identifying time offset data comprises determining a time offset value in an episode of the media program which the at least one social media post matches where the text data from a matching location begins, wherein the time offset value comprises a time offset value where the text data exactly begins and a time offset value starting from a beginning of a sentence where the text data exactly begins and a time offset value starting from the beginning of a scene where the text data exactly begins.

11. The system of claim 9 , wherein ranking the plurality of media programs comprises:

determining microposts that refer to a same matched locations;

grouping the microposts that refer to the same matched locations; and

ranking the plurality of media programs based on a number of groups of microposts associated with each of the plurality of media programs.

12. The system of claim 9 , wherein causing at least some of the plurality of media programs to be presented for selection by a user based on ranking comprises:

causing the at least one of the plurality of media programs to be presented in a program panel in a user interface presented by a user device, wherein the user interface loads a predetermined number of program panels on a screen at one time, and wherein the program panel comprises a title of each media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

causing a clicked item on the user interface to be presented by the user device presenting the user interface.

13. The system of claim 12 , wherein selection of the at least one program link causes an episode of a corresponding media program to be presented by the user device, selection of the at least one social media affirmation button facilitates sharing of the at least one media program to at least one social media service, selection of the at least one program summary news byte causes a news item that to be loaded by the user device, and selection of the at least one loading area causes more program panels to be loaded in the user interface.

14. The system of claim 12 , wherein selection of the video deeplink causes the media program corresponding to the video deeplink to be presented by the user device from a starting point corresponding to the time offset data until an ending point corresponding to an end of a scene discussed in the at least one micropost.

15. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for presenting ranked media content, the method comprising:

comparing, for each of a plurality of media programs, subtitle data for a media program of the plurality of media programs with text data from each of a plurality of social media posts;

determining, based on comparing the subtitle data with the text data, a plurality of different portions of the subtitle data for the media program that match at least one of the plurality of social media posts; and

causing at least one of the plurality of media programs to be presented for selection by a user based on the plurality of different portions of the subtitle data for each media program that match at least one social media post.

16. The non-transitory computer-readable medium of claim 15 , wherein the method further comprises:

identifying, for each social media post with the text data determined to match a portion of the subtitle data of one of the plurality of media programs, timestamp data associated with the subtitle data that matches the text data;

identifying time offset data corresponding to the subtitle data that matches the text data based on the timestamp data; and

creating at least one micropost using the time offset data corresponding to the subtitle data that matches the text data within the at least one of the plurality of media programs to generate a video deeplink that plays a time-offset video starting from the time offset data.

17. The non-transitory computer-readable medium of claim 16 , wherein identifying time offset data comprises determining a time offset value in an episode of the media program which the at least one social media post matches where the text data from a matching location begins, wherein the time offset value comprises a time offset value where the text data exactly begins and a time offset value starting from a beginning of a sentence where the text data exactly begins and a time offset value starting from the beginning of a scene where the text data exactly begins.

18. The non-transitory computer-readable medium of claim 16 , wherein ranking the plurality of media programs comprises:

determining microposts that refer to a same matched locations;

grouping the microposts that refer to the same matched locations; and

ranking the plurality of media programs based on a number of groups of microposts associated with each of the plurality of media programs.

19. The non-transitory computer-readable medium of claim 16 , wherein causing at least some of the plurality of media programs to be presented for selection by a user based on ranking comprises:

causing the at least one of the plurality of media programs to be presented in a program panel in a user interface presented by a user device, wherein the user interface loads a predetermined number of program panels on a screen at one time, and wherein the program panel comprises a title of each media program, at least one program link, at least one social media affirmation button, the at least one micropost, at least one program summary news byte, and at least one loading area; and

causing a clicked item on the user interface to be presented by the user device presenting the user interface.

20. The non-transitory computer-readable medium of claim 19 , wherein selection of the at least one program link causes an episode of a corresponding media program to be presented by the user device, selection of the at least one social media affirmation button facilitates sharing of the at least one media program to at least one social media service, selection of the at least one program summary news byte causes a news item that to be loaded by the user device, and selection of the at least one loading area causes more program panels to be loaded in the user interface.

21. The non-transitory computer-readable medium of claim 19 , wherein selection of the video deeplink causes the media program corresponding to the video deeplink to be presented by the user device from a starting point corresponding to the time offset data until an ending point corresponding to an end of a scene discussed in the at least one micropost.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 3, 2024
From: OZTASKENT, ANT; ZAFIROVSKI, GJOKICA
To: GOOGLE INC.
Reel/Frame 067903/0067 →
ENTITY CONVERSION Recorded Jul 3, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 068105/0830 →
Continuity (5)
Continuation 17496967 · Oct 8, 2021
Continuation 15707660 · Sep 18, 2017
Continuation 14987354 · Jan 4, 2016
Continuation 13601722 · Aug 31, 2012
Related Publication 20230401220A1 · Dec 14, 2023
References Cited (120)
US 5561457A · Cragun et al. · 1996 [cited by applicant]
US 5561467A · Takeuchi et al. · 1996 [cited by applicant]
US 6173287B1 · Eberman et al. · 2001 [cited by applicant]
US 6332144B1 · deVries et al. · 2001 [cited by applicant]
US 7257774B2 · Denoue et al. · 2007 [cited by applicant]
US 7669123B2 · Zuckerberg et al. · 2010 [cited by applicant]
US 7689104B2 · Ono et al. · 2010 [cited by applicant]
US 8204897B1 · Djabarov et al. · 2012 [cited by applicant]
US 8260852B1 · Cselle · 2012 [cited by applicant]
US 8321463B2 · Cierniak et al. · 2012 [cited by applicant]
US 8396879B1 · Cierniak et al. · 2013 [cited by applicant]
US 8656266B2 · Cierniak · 2014 [cited by applicant]
US 8775350B1 · Hall et al. · 2014 [cited by applicant]
US 9176949B2 · Bullock et al. · 2015 [cited by applicant]
US 9454518B1 · Grimm · 2016 [cited by applicant]
US 9998797B2 · Maruyama et al. · 2018 [cited by applicant]
US 10063910B1 · Yelton · 2018 [cited by examiner]
US 10529377B2 · Zhang et al. · 2020 [cited by applicant]
US 20030005457A1 · Faibish et al. · 2003 [cited by applicant]
US 20030061214A1 · Alpha · 2003 [cited by applicant]
US 20040021685A1 · Denoue et al. · 2004 [cited by applicant]
US 20060218179A1 · Gardner et al. · 2006 [cited by applicant]
US 20060271977A1 · Lerman et al. · 2006 [cited by applicant]
US 20070033228A1 · Fassett et al. · 2007 [cited by applicant]
US 20070038567A1 · Allaire et al. · 2007 [cited by applicant]
US 20070078671A1 · Dave et al. · 2007 [cited by applicant]
US 20070186754A1 · Cho et al. · 2007 [cited by applicant]
US 20070245243A1 · Lanza et al. · 2007 [cited by applicant]
US 20070255831A1 · Hayashi et al. · 2007 [cited by applicant]
US 20080005064A1 · Sarukkai · 2008 [cited by applicant]
US 20080027921A1 · Chandrasekar et al. · 2008 [cited by applicant]
US 20080177752A1 · Kulkarni et al. · 2008 [cited by applicant]
US 20090006371A1 · Denoue et al. · 2009 [cited by applicant]
US 20090007167A1 · Artom · 2009 [cited by applicant]
US 20090083383A1 · Piper et al. · 2009 [cited by applicant]
US 20090106235A1 · Tankovich et al. · 2009 [cited by applicant]
US 20090119598A1 · Oztaskent · 2009 [cited by applicant]
US 20090164904A1 · Horowitz et al. · 2009 [cited by applicant]
US 20090319436A1 · Andra et al. · 2009 [cited by applicant]
US 20100082727A1 · Zalewski · 2010 [cited by applicant]
US 20100083307A1 · Zalewski · 2010 [cited by applicant]
US 20100121867A1 · Gosejacob · 2010 [cited by applicant]
US 20100153848A1 · Saha · 2010 [cited by applicant]
US 20100162093A1 · Ciemniak · 2010 [cited by applicant]
US 20100169327A1 · Lindsay et al. · 2010 [cited by applicant]
US 20100169906A1 · Takahashi · 2010 [cited by applicant]
US 20100241968A1 · Tarara et al. · 2010 [cited by applicant]
US 20100306708A1 · Trenz et al. · 2010 [cited by applicant]
US 20100319031A1 · Lee et al. · 2010 [cited by applicant]
US 20110029512A1 · Folgner et al. · 2011 [cited by applicant]
US 20110043652A1 · King et al. · 2011 [cited by applicant]
US 20110106718A1 · Roberts et al. · 2011 [cited by applicant]
US 20110167077A1 · Govani et al. · 2011 [cited by applicant]
US 20110246471A1 · Rakib · 2011 [cited by applicant]
US 20110246495A1 · Mallinson · 2011 [cited by applicant]
US 20110258545A1 · Hunter · 2011 [cited by applicant]
US 20110289098A1 · Oztaskent et al. · 2011 [cited by applicant]
US 20110307464A1 · Ghosh · 2011 [cited by applicant]
US 20120036085A1 · Srivastava · 2012 [cited by applicant]
US 20120089905A1 · Chafy et al. · 2012 [cited by applicant]
US 20120166453A1 · Broder · 2012 [cited by applicant]
US 20120311624A1 · Oskolkov et al. · 2012 [cited by applicant]
US 20120330968A1 · Lee et al. · 2012 [cited by applicant]
US 20130004141A1 · Wu et al. · 2013 [cited by applicant]
US 20130031100A1 · Graham et al. · 2013 [cited by applicant]
US 20130080427A1 · Cross et al. · 2013 [cited by applicant]
US 20130145269A1 · Latulipe et al. · 2013 [cited by applicant]
US 20130201833A1 · Masputra et al. · 2013 [cited by applicant]
US 20130204833A1 · Pang et al. · 2013 [cited by applicant]
US 20140068654A1 · Marlow et al. · 2014 [cited by applicant]
US 20140140680A1 · Jo · 2014 [cited by applicant]
US 20140201180A1 · Fatourechi et al. · 2014 [cited by applicant]
US 20140237510A1 · Phillips · 2014 [cited by examiner]
US 20140333720A1 · Huang et al. · 2014 [cited by applicant]
US 20150110470A1 · Zhang et al. · 2015 [cited by applicant]
US 20160149956A1 · Birnbaum · 2016 [cited by examiner]
US 20160283097A1 · Voss · 2016 [cited by applicant]
US 20170220677A1 · Kazi et al. · 2017 [cited by applicant]
US 20180158489A1 · Avedissian et al. · 2018 [cited by applicant]
US 20190052939A1 · Wang · 2019 [cited by examiner]
WO WO2004095426 · 2004 [cited by applicant]
WO WO2009105486 · 2009 [cited by applicant]
WO WO2009148756 · 2009 [cited by applicant]
WO WO2011079477 · 2011 [cited by applicant]
WO WO2012151218 · 2012 [cited by applicant]
Examination Report dated Jan. 9, 2018 in European Patent Application No. 13832958.6. [cited by applicant]
Examination Report dated Dec. 2, 2016 in European Patent Application No. 13832958.6. [cited by applicant]
Extended European Search Report dated Mar. 2, 2016 in European Patent Application No. 13832958.6. [cited by applicant]
Fose, Luanne, “Youtube Tips Introduction”, last updated Oct. 1, 2010, pp. 1-7, available at: http://www.calpoly.edu/˜lfose/tutorials/YouTube_Tips_Tutorial.pdf, last accessed May 19, 2015. [cited by applicant]
International Search Report and Written Opinion dated Oct. 18, 2013 in International Patent Application No. PCT/US2013/049918. [cited by applicant]
Madden, et al., “A Classification Scheme for Content Analyses of YouTube Video Comments”, Journal of Documentation, vol. 60, No. 5, Sep. 2013, pp. 693-714. [cited by applicant]
Notice of Allowance dated Feb. 8, 2023 in U.S. Appl. No. 17/163,887. [cited by applicant]
Notice of Allowance dated Mar. 21, 2013 in U.S. Appl. No. 13/762,535. [cited by applicant]
Notice of Allowance dated Apr. 12, 2023 in U.S. Appl. No. 17/496,967. [cited by applicant]
Notice of Allowance dated May 24, 2017 in U.S. Appl. No. 14/987,354. [cited by applicant]
Notice of Allowance dated Jun. 9, 2021 in U.S. Appl. No. 15/707,660. [cited by applicant]
Notice of Allowance dated Sep. 1, 2015 in U.S. Appl. No. 13/601,722. [cited by applicant]
Notice of Allowance dated Oct. 2, 2020 in U.S. Appl. No. 15/189,658. [cited by applicant]
Office Action dated Jan. 9, 2020 in U.S. Appl. No. 15/707,660. [cited by applicant]
Office Action dated Jan. 28, 2015 in U.S. Appl. No. 13/762,535. [cited by applicant]
Office Action dated Feb. 7, 2020 in U.S. Appl. No. 15/189,658. [cited by applicant]
Office Action dated Apr. 11, 2019 in U.S. Appl. No. 15/189,658. [cited by applicant]
Office Action dated Apr. 29, 2019 in KR Patent Application No. 10-2015-7007696. [cited by applicant]
Office Action dated May 28, 2020 in U.S. Appl. No. 15/189,658. [cited by applicant]
Office Action dated Jun. 3, 2013 in U.S. Appl. No. 13/762,535. [cited by applicant]
Office Action dated May 18, 2017 in CN Patent Application No. 201380055449.1. [cited by applicant]
Office Action dated Jun. 27, 2019 in U.S. Appl. No. 15/707,660. [cited by applicant]
Office Action dated Jul. 8, 2020 in U.S. Appl. No. 15/707,660. [cited by applicant]
Office Action dated Jul. 25, 2019 in U.S. Appl. No. 15/189,658. [cited by applicant]
Office Action dated Aug. 27, 2014 in U.S. Appl. No. 13/762,535. [cited by applicant]
Office Action dated Sep. 25, 2015 in U.S. Appl. No. 13/762,535. [cited by applicant]
Office Action dated Sep. 30, 2019 in KR Patent Application No. 10-2015-7007696. [cited by applicant]
Office Action dated Oct. 3, 2022 in U.S. Appl. No. 17/496,967. [cited by applicant]
Office Action dated Oct. 5, 2022 in U.S. Appl. No. 17/163,887. [cited by applicant]
Office Action dated Oct. 9, 2014 in U.S. Appl. No. 13/601,722. [cited by applicant]
Office Action dated Dec. 10, 2020 in U.S. Appl. No. 15/707,660. [cited by applicant]
Office Action dated Dec. 16, 2013 in U.S. Appl. No. 13/762,535. [cited by applicant]
Office Action dated Dec. 19, 2013 in U.S. Appl. No. 13/601,722. [cited by applicant]
Office Action dated Dec. 20, 2016 in U.S. Appl. No. 14/987,354. [cited by applicant]
Sawada, K., et al., “Clustering of Videos on a Video Sharing Site Using User-Contributed Comments”, In Proceedings of the 44th Hawall International Conference on System Sciences, Kauai, HI, USA, Jan. 4-7, 2011, pp. 1-7. [cited by applicant]