IP Library Granted Patent US 12,219,223
Granted Patent B2
US 12,219,223 · App. 18/238,805 · Granted Feb 4, 2025

Methods, systems, and media for presenting supplemental content relating to media content based on state information that indicates a subsequent visit to the content interface

Inventors: Ingrid McAulay Trollope (Richmond, GB); Ant Oztaskent (Greenwich, GB); Yaroslav Volovich (Cambridge, GB)
Assignee: Google LLC
H04N21/8358G06T1/0021G10L19/018H04N1/32144H04N1/32776H04N1/32782H04N1/32784H04N19/467H04N21/233H04N21/4126H04N21/41265H04N21/41407H04N21/42203H04N21/436H04N21/8126H04N21/8405H04N21/435H04N21/4394H04N21/4755H04N21/812
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,219,223
App. No.
18/238,805
Granted
Feb 4, 2025
Kind
B2
Abstract

In accordance with some implementations of the disclosed subject matter, mechanisms for presenting recommended media content items are provided. In some implementations, a method for providing media guidance is provided, the method comprising: receiving a request for supplemental content relating to a program being presented by a media device; causing a content interface to be presented on a mobile device; identifying the program that is being presented on a media device; determining keywords associated with the program, wherein each of the keywords is associated with a particular portion of the program; obtaining and storing supplemental content items corresponding to the program based on the keywords; causing the content interface to present a first supplemental content item; receiving state information associated with the mobile device that indicates a subsequent visit to the content interface; and causing the content interface to present a second supplemental content item based on the state information.

Claims (52)

1. A method for providing media guidance, the method comprising:

causing, using a hardware processor, a plurality of recommendation interfaces to be presented on a media device associated with a mobile device, wherein at least one of the plurality of recommendation interfaces relates to a media content item being presented by the media device;

determining, using the hardware processor, that state information associated with the mobile device indicates a subsequent visit to the plurality of recommendation interfaces and indicates that the mobile device returned from a state in which presentation of the plurality of recommendation interfaces was previously inhibited; and

causing, using the hardware processor, the plurality of recommendation interfaces to be updated based on the media content item being presented by the media device.

2. The method of claim 1 , wherein the plurality of recommendation interfaces each include one of a plurality of supplemental content items, and wherein at least one of the plurality of supplemental content items relates to the media content item being presented by the media device.

3. The method of claim 2 , wherein a first supplemental content item from the plurality of supplemental content items is updated with a second supplemental content item from the plurality of supplemental content items, and wherein the second supplemental content item relates to the media content item being presented by the media device.

4. The method of claim 3 , further comprising:

storing the plurality of supplemental content items, media information, and a plurality of keywords in a data source indexed by media content item and time within the media content item;

selecting the first supplemental content item from the data source based on a first time determined from a request for supplemental content relating to the media content item being presented by the media device; and

selecting the second supplemental content item from the data source based on a second time determined from the state information.

5. The method of claim 3 , wherein the second supplemental content item is caused to be presented in response to determining that the state information was received prior to an end of the media content item and in response to determining that the state information was received within a predetermined time from the presentation of the plurality of recommendation interfaces.

6. The method of claim 1 , further comprising:

identifying the media content item that is being presented on the media device; and

obtaining the plurality of recommendation interfaces corresponding to the media content item.

7. The method of claim 1 , further comprising causing the plurality of recommendation interfaces to be presented in response to detecting a presence of the media device on a local area network, wherein the media device and the mobile device are connected to the local area network.

8. The method of claim 1 , further comprising receiving an audio fingerprint of audio information corresponding to the media content item being presented on the media device, wherein the media content item is identified based on the audio fingerprint.

9. The method of claim 1 , further comprising:

extracting an audio stream from a plurality of media content items;

generating, for each of the plurality of media content items, at least one audio fingerprint from at least a portion of the audio stream that corresponds to one of the plurality of media content items;

storing the at least one audio fingerprint in a data source indexed by media content item;

comparing the at least one audio fingerprint with the at least one stored audio fingerprint; and

identifying the media content item that is being presented on the media device based on comparing the at least one audio fingerprint with the at least one stored audio fingerprint comparison.

10. A system for providing media guidance, the system comprising:

a hardware processor that is configured to:

cause a plurality of recommendation interfaces to be presented on a media device associated with a mobile device, wherein at least one of the plurality of recommendation interfaces relates to a media content item being presented by the media device;

determine that state information associated with the mobile device indicates a subsequent visit to the plurality of recommendation interfaces and indicates that the mobile device returned from a state in which presentation of the plurality of recommendation interfaces was previously inhibited; and

cause the plurality of recommendation interfaces to be updated based on the media content item being presented by the media device.

11. The system of claim 10 , wherein the plurality of recommendation interfaces each include one of a plurality of supplemental content items, and wherein at least one of the plurality of supplemental content items relates to the media content item being presented by the media device.

12. The system of claim 11 , wherein a first supplemental content item from the plurality of supplemental content items is updated with a second supplemental content item from the plurality of supplemental content items, and wherein the second supplemental content item relates to the media content item being presented by the media device.

13. The system of claim 12 , wherein the hardware processor is further configured to:

store the plurality of supplemental content items, media information, and a plurality of keywords in a data source indexed by media content item and time within the media content item;

select the first supplemental content item from the data source based on a first time determined from a request for supplemental content relating to the media content item being presented by the media device; and

select the second supplemental content item from the data source based on a second time determined from the state information.

14. The system of claim 12 , wherein the second supplemental content item is caused to be presented in response to determining that the state information was received prior to an end of the media content item and in response to determining that the state information was received within a predetermined time from the presentation of the plurality of recommendation interfaces.

15. The system of claim 10 , wherein the hardware processor is further configured to:

identify the media content item that is being presented on the media device; and

obtain the plurality of recommendation interfaces corresponding to the media content item.

16. The system of claim 10 , wherein the hardware processor is further configured to cause the plurality of recommendation interfaces to be presented in response to detecting a presence of the media device on a local area network, and wherein the media device and the mobile device are connected to the local area network.

17. The system of claim 10 , wherein the hardware processor is further configured to receive an audio fingerprint of audio information corresponding to the media content item being presented on the media device, and wherein the media content item is identified based on the audio fingerprint.

18. The system of claim 10 , wherein the hardware processor is further configured to:

extract an audio stream from a plurality of media content items;

generate, for each of the plurality of media content items, at least one audio fingerprint from at least a portion of the audio stream that corresponds to one of the plurality of media content items;

store the at least one audio fingerprint in a data source indexed by media content item;

compare the at least one audio fingerprint with the at least one stored audio fingerprint; and

identify the media content item that is being presented on the media device based on comparing the at least one audio fingerprint with the at least one stored audio fingerprint.

19. A non-transitory computer-readable medium containing computer executable instructions that, when executed by a processor, cause the processor to perform a method for providing media guidance, the method comprising:

causing a plurality of recommendation interfaces to be presented on a media device associated with a mobile device, wherein at least one of the plurality of recommendation interfaces relates to a media content item being presented by the media device;

determining that state information associated with the mobile device indicates a subsequent visit to the plurality of recommendation interfaces and indicates that the mobile device returned from a state in which presentation of the plurality of recommendation interfaces was previously inhibited; and

causing the plurality of recommendation interfaces to be updated based on the media content item being presented by the media device.

20. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises:

identifying the media content item that is being presented on the media device; and

obtaining the plurality of recommendation interfaces corresponding to the media content item.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: TROLLOPE, INGRID MCAULAY; OZTASKENT, ANT; VOLOVICH, YAROSLAV
To: GOOGLE INC.
Reel/Frame 067552/0803 →
CHANGE OF NAME Recorded May 29, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 067567/0028 →
Continuity (7)
Continuation 17825326 · May 26, 2022
Continuation 17174502 · Feb 12, 2021
Continuation 15911502 · Mar 5, 2018
Continuation 15345342 · Nov 7, 2016
Continuation 14190999 · Feb 26, 2014
Provisional Application 61922212 · Dec 31, 2013
Related Publication 20230403444A1 · Dec 14, 2023
References Cited (109)
US 7028327B1 · Dougherty et al. · 2006 [cited by applicant]
US 7631192B1 · Matsuo · 2009 [cited by applicant]
US 7840980B2 · Gutta · 2010 [cited by applicant]
US 8185543B1 · Choudhry et al. · 2012 [cited by applicant]
US 8205223B2 · Pack et al. · 2012 [cited by applicant]
US 8320819B2 · Räbinä et al. · 2012 [cited by applicant]
US 8392951B2 · Park et al. · 2013 [cited by applicant]
US 8528036B2 · Bruce et al. · 2013 [cited by applicant]
US 8694533B2 · Oztaskent et al. · 2014 [cited by applicant]
US 8929657B2 · Jung · 2015 [cited by applicant]
US 20020147984A1 · Tomsen et al. · 2002 [cited by applicant]
US 20050114882A1 · Sakamaki et al. · 2005 [cited by applicant]
US 20050149988A1 · Grannan · 2005 [cited by applicant]
US 20070124756A1 · Covell et al. · 2007 [cited by applicant]
US 20070150462A1 · Nonaka et al. · 2007 [cited by applicant]
US 20070183355A1 · Kuchibhotla et al. · 2007 [cited by applicant]
US 20080098432A1 · Hardracker et al. · 2008 [cited by applicant]
US 20080134328A1 · Yang et al. · 2008 [cited by applicant]
US 20080163325A1 · Yamamoto et al. · 2008 [cited by applicant]
US 20080226119A1 · Candelore et al. · 2008 [cited by applicant]
US 20080229363A1 · Lanfermann et al. · 2008 [cited by applicant]
US 20090276805A1 · Andrews et al. · 2009 [cited by applicant]
US 20100031293A1 · Ohde et al. · 2010 [cited by applicant]
US 20100082585A1 · Barsook et al. · 2010 [cited by applicant]
US 20110022633A1 · Bernosky et al. · 2011 [cited by applicant]
US 20110043652A1 · King et al. · 2011 [cited by applicant]
US 20110102444A1 · Matsumoto · 2011 [cited by applicant]
US 20110103763A1 · Tse et al. · 2011 [cited by applicant]
US 20110125735A1 · Petrou · 2011 [cited by applicant]
US 20110258211A1 · Kalisky et al. · 2011 [cited by applicant]
US 20110282906A1 · Wong · 2011 [cited by applicant]
US 20110289098A1 · Oztaskent et al. · 2011 [cited by applicant]
US 20120008821A1 · Sharon et al. · 2012 [cited by applicant]
US 20120096499A1 · Dasher et al. · 2012 [cited by applicant]
US 20120117057A1 · Adimatyam et al. · 2012 [cited by applicant]
US 20120167144A1 · Avison-Fell · 2012 [cited by applicant]
US 20120227074A1 · Hill et al. · 2012 [cited by applicant]
US 20120240144A1 · Rose · 2012 [cited by applicant]
US 20120311623A1 · Davis et al. · 2012 [cited by applicant]
US 20120311641A1 · Allard · 2012 [cited by applicant]
US 20130036442A1 · Wingert · 2013 [cited by applicant]
US 20130047178A1 · Moon et al. · 2013 [cited by applicant]
US 20130104172A1 · Lee et al. · 2013 [cited by applicant]
US 20130111514A1 · Slavin · 2013 [cited by examiner]
US 20130151728A1 · Currier · 2013 [cited by examiner]
US 20130179436A1 · Yun et al. · 2013 [cited by applicant]
US 20140013350A1 · Pan · 2014 [cited by examiner]
US 20140089423A1 · Jackels · 2014 [cited by applicant]
US 20140253472A1 · Ayoub et al. · 2014 [cited by applicant]
US 20140255003A1 · Abramson · 2014 [cited by applicant]
US 20140282677A1 · Mantell et al. · 2014 [cited by applicant]
US 20150193433A1 · Dykeman et al. · 2015 [cited by applicant]
US 20170147095A1 · Nicholls et al. · 2017 [cited by applicant]
CN 1735162 · 2006 [cited by applicant]
CN 101883230 · 2010 [cited by applicant]
CN 101981574 · 2011 [cited by applicant]
CN 102833617 · 2012 [cited by applicant]
CN 102868934 · 2013 [cited by applicant]
EP 2388721 · 2011 [cited by applicant]
JP 2006270869 · 2006 [cited by applicant]
JP 2010154415 · 2010 [cited by applicant]
JP 2011243204 · 2011 [cited by applicant]
JP 2013016030 · 2013 [cited by applicant]
KR 20060077988 · 2006 [cited by applicant]
KR 20110125917 · 2011 [cited by applicant]
WO WO2012014130 · 2012 [cited by applicant]
WO WO2012139240 · 2012 [cited by applicant]
WO WO2012166739 · 2012 [cited by applicant]
WO WO2013040533 · 2013 [cited by applicant]
Decision to Refuse a European Patent Application dated Nov. 15, 2018 in EP Patent Application No. 14725797.6. [cited by applicant]
Digital Living Network Alliance, “DLNA Guidelines Part 1: Architecture and Protocols”, Technical Report, Dec. 2011, pp. 1-27. [cited by applicant]
Examination Report dated Mar. 16, 2020 in IN Patent Application No. 3412/KOLNP/2015. [cited by applicant]
Examination Report dated Apr. 13, 2017 in EP Patent Application No. 14725797.6. [cited by applicant]
International Search Report and Written Opinion of the International Search Authority dated Jul. 28, 2014 in International Patent Application No. PCT/US2014/024255. [cited by applicant]
Notice of Allowance dated Feb. 1, 2022 in U.S. Appl. No. 17/174,502. [cited by applicant]
Notice of Allowance dated Mar. 25, 2020 in KR Patent Application No. 10-2015-7028591. [cited by applicant]
Notice of Allowance dated Apr. 13, 2023 in U.S. Appl. No. 17/825,326. [cited by applicant]
Notice of Allowance dated Apr. 17, 2015 in U.S. Appl. No. 13/827,413. [cited by applicant]
Notice of Allowance dated Jun. 5, 2015 in U.S. Appl. No. 13/826,910. [cited by applicant]
Notice of Allowance dated Jul. 5, 2016 in U.S. Appl. No. 14/190,999. [cited by applicant]
Notice of Allowance dated Oct. 9, 2020 in U.S. Appl. No. 15/911,502. [cited by applicant]
Notice of Allowance dated Oct. 27, 2017 in U.S. Appl. No. 15/345,342. [cited by applicant]
Notice of Allowance dated Nov. 9, 2016 in U.S. Appl. No. 15/005,470. [cited by applicant]
Office Action dated Jan. 23, 2018 in U.S. Appl. No. 15/431,431. [cited by applicant]
Office Action dated Jan. 30, 2015 in U.S. Appl. No. 13/826,910. [cited by applicant]
Office Action dated Feb. 1, 2016 in U.S. Appl. No. 14/190,999. [cited by applicant]
Office Action dated Mar. 13, 2018 in JP Patent Application No. 2016-501451. [cited by applicant]
Office Action dated Mar. 22, 2019 in U.S. Appl. No. 15/911,502. [cited by applicant]
Office Action dated Mar. 25, 2015 in U.S. Appl. No. 13/834,394. [cited by applicant]
Office Action dated Apr. 17, 2018 in CN Patent Application No. 201480021167.4. [cited by applicant]
Office Action dated Apr. 23, 2020 in CN Patent Application No. 201480021167.4. [cited by applicant]
Office Action dated May 5, 2017 in U.S. Appl. No. 15/345,342. [cited by applicant]
Office Action dated Jun. 12, 2020 in U.S. Appl. No. 15/911,502. [cited by applicant]
Office Action dated Jun. 29, 2017 in U.S. Appl. No. 15/431,431. [cited by applicant]
Office Action dated Jul. 5, 2018 in U.S. Appl. No. 15/431,431. [cited by applicant]
Office Action dated Jul. 25, 2019 in CN Patent Application No. 201480021167.4. [cited by applicant]
Office Action dated Jul. 27, 2016 in U.S. Appl. No. 15/005,470. [cited by applicant]
Office Action dated Jul. 29, 2014 in U.S. Appl. No. 13/826,910. [cited by applicant]
Office Action dated Sep. 6, 2019 in U.S. Appl. No. 15/911,502. [cited by applicant]
Office Action dated Sep. 16, 2021 in U.S. Appl. No. 17/174,502. [cited by applicant]
Office Action dated Sep. 27, 2017 in U.S. Appl. No. 15/431,431. [cited by applicant]
Office Action dated Sep. 30, 2022 in U.S. Appl. No. 17/825,326. [cited by applicant]
Office Action dated Dec. 9, 2014 in U.S. Appl. No. 13/827,413. [cited by applicant]
Office Action dated Dec. 16, 2019 in CA Patent Application No. 2,908,549. [cited by applicant]
Office Action dated Dec. 21, 2018 in CA Patent Application No. 2,908,549. [cited by applicant]
Office Action dated Dec. 27, 2019 in U.S. Appl. No. 15/911,502. [cited by applicant]
Summons to Attend Oral Proceedings dated Feb. 2, 2018 in EP Patent Application No. 14725797.6. [cited by applicant]
Universal Plug N Play Forum, “UPnP Device Architecture Version 1.1”, Technical Report, Oct. 15, 2008, pp. 1-136. [cited by applicant]
YouTube, “Pharos Demonstration—Audiovisual Tunable Search—Part C”, last updated Jan. 16, 2010, pp. 1, available at: https://www.youtube.com/watch?v=ZpxyNi6Ht50. [cited by applicant]