IP Library Granted Patent US 12,627,863
Granted Patent B2
US 12,627,863 · App. 18/788,277 · Granted May 12, 2026

Searching and displaying multimedia search results

Inventors: Jim Funk (Los Altos, CA); Brandon Noffsinger (Colorado Springs, CO)
Assignee: ROKU, INC.
H04N21/4828G06F16/24565G06F16/43G06F16/438G06F16/48G06F16/951G06F16/9535H04N21/237H04N21/2387H04N21/4126H04N21/4668H04N21/47208H04N21/47217H04N21/8405
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,627,863
App. No.
18/788,277
Granted
May 12, 2026
Kind
B2
Abstract

A system and method for searching and displaying multimedia search results is disclosed herein. An embodiment operates by supplying a video stream to a primary display. An information request soliciting information associated with content of the video stream on the primary display is received. In response, a plurality of tag data relating to the video stream is supplied to a secondary display, wherein the plurality of tag data are visually and concurrently indicated on a single progress bar of the video stream being displayed on the secondary display, and whereby the tag content data is displayed on the display screen of the secondary display when one of the plurality of tag types is selected.

Claims (31)

1 . A computer-implemented method, comprising:

supplying, by at least one computer processor, a video stream to a primary display;

receiving an information request associated with content of the video stream; and

in response to receiving the information request, supplying to a secondary display a plurality of tag data relating to the video stream, wherein the plurality of tag data comprises a plurality of different tag sources, different tag types, tag timestamps, and tag content data, wherein the plurality of tag data are visually and concurrently indicated on a single progress bar of the video stream being displayed on the secondary display, and whereby the tag content data is displayed on the secondary display when a tag type of the different tag types is selected.

2 . The computer-implemented method of claim 1 , wherein the tag content data is displayed as an overlay on a display screen of the secondary display.

3 . The computer-implemented method of claim 1 , wherein the tag type comprises one of a user tag, a friend tag, and a global tag.

4 . The computer-implemented method of claim 3 , wherein the user tag is a tag generated by a user of the primary display or the secondary display.

5 . The computer-implemented method of claim 4 , wherein the global tag is an aggregation of tags generated by other users.

6 . The computer-implemented method of claim 3 , wherein each of the different tag types is visually distinguished from each other on the single progress bar of the video stream.

7 . The computer-implemented method of claim 1 , wherein the tag timestamps comprise location information of at least one tag information on the single progress bar of the video stream.

8 . A system, comprising:

one or more memories; and

at least one processor each coupled to at least one of the memories and configured to perform operations comprising:

supplying a video stream to a primary display;

receiving an information request associated with content of the video stream; and

in response to receiving the information request, supplying to a secondary display a plurality of tag data relating to the video stream, wherein the plurality of tag data comprises a plurality of different tag sources, different tag types, tag timestamps, and tag content data, wherein the plurality of tag data are visually and concurrently indicated on a single progress bar of the video stream being displayed on the secondary display, and whereby the tag content data is displayed on the secondary display when a tag type of the different tag types is selected.

9 . The system of claim 8 , wherein the tag content data is displayed as an overlay on a display screen of the secondary display.

10 . The system of claim 8 , wherein the tag type comprises one of a user tag, a friend tag, and a global tag.

11 . The system of claim 10 , wherein the user tag is a tag generated by a user of the primary display or the secondary display.

12 . The system of claim 11 , wherein the global tag is an aggregation of tags generated by other users.

13 . The system of claim 10 , wherein each of the tag types is visually distinguished from each other on the single progress bar of the video stream.

14 . The system of claim 8 , wherein the tag timestamps comprise location information of at least one tag information on the single progress bar of the video stream.

15 . A non-transitory processor-readable medium having one or more instructions operational on a computing device which, when executed by a processor, cause the processor to perform operations comprising:

supplying a video stream to a primary display;

receiving an information request associated with content of the video stream; and

in response to receiving the information request, supplying to a secondary display a plurality of tag data relating to the video stream, wherein the plurality of tag data comprises a plurality of different tag sources, different tag types, tag timestamps, and tag content data, wherein the plurality of tag data are visually and concurrently indicated on a single progress bar of the video stream being displayed on the secondary display, and whereby the tag content data is displayed on the secondary display when a tag type of the different tag types is selected.

16 . The non-transitory processor-readable medium of claim 15 , wherein the tag content data is displayed as an overlay on a display screen of the secondary display.

17 . The non-transitory processor-readable medium of claim 15 , wherein the tag type comprises one of a user tag, a friend tag, and a global tag.

18 . The non-transitory processor-readable medium of claim 17 , wherein the user tag is a tag generated by a user of the primary display or the secondary display.

19 . The non-transitory processor-readable medium of claim 18 , wherein the global tag is an aggregation of tags generated by other users.

20 . The non-transitory processor-readable medium of claim 17 , wherein each of the tag types is visually distinguished from each other on the single progress bar of the video stream.

Assignments (2)
SECURITY INTEREST Recorded Sep 18, 2024
From: ROKU, INC.
To: CITIBANK, N.A.
Reel/Frame 068982/0377 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 15, 2024
From: FUNK, JIM; NOFFSINGER, BRANDON
To: ROKU, INC.
Reel/Frame 068294/0792 →
Continuity (7)
Continuation 18139576 · Apr 26, 2023
Continuation 17327486 · May 21, 2021
Continuation 14558648 · Dec 2, 2014
Continuation 14536339 · Nov 7, 2014
Continuation In Part 13778068 · Feb 26, 2013
Continuation In Part 13431932 · Mar 27, 2012
Related Publication 20240388768A1 · Nov 21, 2024
References Cited (194)
US 4363489A · Chodak et al. · 1982 [cited by applicant]
US 5801747A · Bedard · 1998 [cited by applicant]
US 5933811A · Angles et al. · 1999 [cited by applicant]
US 6331877B1 · Bennington et al. · 2001 [cited by applicant]
US 6519693B1 · Debey · 2003 [cited by examiner]
US 6567984B1 · Allport · 2003 [cited by applicant]
US 6754662B1 · Li · 2004 [cited by applicant]
US 7305406B2 · Liu et al. · 2007 [cited by applicant]
US 7319806B1 · Willner · 2008 [cited by examiner]
US 7627888B2 · Ganesan et al. · 2009 [cited by applicant]
US 7742740B2 · Goldberg et al. · 2010 [cited by applicant]
US 7778980B2 · Bodin et al. · 2010 [cited by applicant]
US 7802286B2 · Brooks et al. · 2010 [cited by applicant]
US 7840986B2 · Ali et al. · 2010 [cited by applicant]
US 7849135B2 · Agrawal et al. · 2010 [cited by applicant]
US 7895624B1 · Thomas et al. · 2011 [cited by applicant]
US 7929029B2 · Morimoto et al. · 2011 [cited by applicant]
US 7953730B1 · Bleckner et al. · 2011 [cited by applicant]
US 8005913B1 · Carlander · 2011 [cited by applicant]
US 8094891B2 · Andreasson · 2012 [cited by applicant]
US 8159959B2 · Ohlfs et al. · 2012 [cited by applicant]
US 8171112B2 · Shum et al. · 2012 [cited by applicant]
US 8265612B2 · Athsani et al. · 2012 [cited by applicant]
US 8584165B1 · Kane et al. · 2013 [cited by applicant]
US 8615776B2 · Hill et al. · 2013 [cited by applicant]
US 8640166B1 · Craner · 2014 [cited by applicant]
US 9116990B2 · Sun et al. · 2015 [cited by applicant]
US 9137578B2 · Garner · 2015 [cited by applicant]
US 9519645B2 · Funk et al. · 2016 [cited by applicant]
US 10261999B2 · Funk et al. · 2019 [cited by applicant]
US 11061957B2 · Funk et al. · 2021 [cited by applicant]
US 11681741B2 · Funk et al. · 2023 [cited by applicant]
US 20010037240A1 · Marks et al. · 2001 [cited by applicant]
US 20010054059A1 · Marks et al. · 2001 [cited by applicant]
US 20020007368A1 · Lee et al. · 2002 [cited by applicant]
US 20020042923A1 · Asmussen et al. · 2002 [cited by applicant]
US 20020078449A1 · Gordon et al. · 2002 [cited by applicant]
US 20020100063A1 · Herigstad · 2002 [cited by examiner]
US 20020107973A1 · Lennon et al. · 2002 [cited by applicant]
US 20020135608A1 · Hamada et al. · 2002 [cited by applicant]
US 20020174430A1 · Ellis et al. · 2002 [cited by applicant]
US 20020184650A1 · Stone · 2002 [cited by applicant]
US 20030018748A1 · McKenna, Jr. · 2003 [cited by applicant]
US 20030088687A1 · Begeja et al. · 2003 [cited by applicant]
US 20030093790A1 · Logan et al. · 2003 [cited by applicant]
US 20030110503A1 · Perkes · 2003 [cited by applicant]
US 20030131355A1 · Berenson et al. · 2003 [cited by applicant]
US 20030132953A1 · Johnson et al. · 2003 [cited by applicant]
US 20030184598A1 · Graham · 2003 [cited by examiner]
US 20030193518A1 · Newnam et al. · 2003 [cited by applicant]
US 20030208763A1 · McElhatten et al. · 2003 [cited by applicant]
US 20030221194A1 · Thiagarajan · 2003 [cited by examiner]
US 20040049779A1 · Sjoblom · 2004 [cited by examiner]
US 20040070593A1 · Neely et al. · 2004 [cited by applicant]
US 20040078383A1 · Mercer et al. · 2004 [cited by applicant]
US 20040078816A1 · Johnson · 2004 [cited by applicant]
US 20040098744A1 · Gutta · 2004 [cited by applicant]
US 20040098747A1 · Kay et al. · 2004 [cited by applicant]
US 20040117831A1 · Ellis et al. · 2004 [cited by applicant]
US 20040170386A1 · Mikawa · 2004 [cited by applicant]
US 20040194131A1 · Ellis et al. · 2004 [cited by applicant]
US 20050132401A1 · Boccon-Gibod · 2005 [cited by examiner]
US 20050160461A1 · Baumgartner et al. · 2005 [cited by applicant]
US 20050177624A1 · Oswald et al. · 2005 [cited by applicant]
US 20050204387A1 · Knudson et al. · 2005 [cited by applicant]
US 20050273499A1 · Goodman et al. · 2005 [cited by applicant]
US 20060064716A1 · Sull et al. · 2006 [cited by applicant]
US 20060159109A1 · Lamkin et al. · 2006 [cited by applicant]
US 20060173985A1 · Moore · 2006 [cited by applicant]
US 20060235885A1 · Steele et al. · 2006 [cited by applicant]
US 20060236243A1 · Brain · 2006 [cited by applicant]
US 20060248013A1 · Ebert et al. · 2006 [cited by applicant]
US 20060265427A1 · Cohen et al. · 2006 [cited by applicant]
US 20060282855A1 · Margulis · 2006 [cited by examiner]
US 20060282864A1 · Gupte · 2006 [cited by examiner]
US 20070014534A1 · Kim · 2007 [cited by examiner]
US 20070033166A1 · Trowbridge et al. · 2007 [cited by applicant]
US 20070037240A1 · Martin et al. · 2007 [cited by applicant]
US 20070038931A1 · Allaire et al. · 2007 [cited by applicant]
US 20070078884A1 · Ott, IV et al. · 2007 [cited by applicant]
US 20070089143A1 · LeFevre · 2007 [cited by examiner]
US 20070097975A1 · Rakers et al. · 2007 [cited by applicant]
US 20070112817A1 · Danninger · 2007 [cited by applicant]
US 20070124779A1 · Casey et al. · 2007 [cited by applicant]
US 20070129109A1 · Silverbrook et al. · 2007 [cited by applicant]
US 20070130126A1 · Lucovsky et al. · 2007 [cited by applicant]
US 20070130610A1 · Aarnio et al. · 2007 [cited by applicant]
US 20070156589A1 · Zimler et al. · 2007 [cited by applicant]
US 20070162424A1 · Jeh et al. · 2007 [cited by applicant]
US 20070188665A1 · Watson et al. · 2007 [cited by applicant]
US 20070204311A1 · Hasek et al. · 2007 [cited by applicant]
US 20070220554A1 · Barton et al. · 2007 [cited by applicant]
US 20070220583A1 · Bailey et al. · 2007 [cited by applicant]
US 20070244902A1 · Seide et al. · 2007 [cited by applicant]
US 20070266401A1 · Hallberg · 2007 [cited by applicant]
US 20070300252A1 · Acharya et al. · 2007 [cited by applicant]
US 20080033922A1 · Cisler et al. · 2008 [cited by applicant]
US 20080046928A1 · Poling et al. · 2008 [cited by applicant]
US 20080083003A1 · Biniak et al. · 2008 [cited by applicant]
US 20080089551A1 · Heather · 2008 [cited by examiner]
US 20080098450A1 · Wu et al. · 2008 [cited by applicant]
US 20080123954A1 · Ekstrand · 2008 [cited by examiner]
US 20080133311A1 · Madriz Ottolina · 2008 [cited by applicant]
US 20080151888A1 · Ahmed · 2008 [cited by applicant]
US 20080155057A1 · Khedouri et al. · 2008 [cited by applicant]
US 20080163318A1 · Chen et al. · 2008 [cited by applicant]
US 20080235608A1 · Prabhu · 2008 [cited by applicant]
US 20090037954A1 · Nagano · 2009 [cited by applicant]
US 20090082095A1 · Walker et al. · 2009 [cited by applicant]
US 20090094520A1 · Kulas · 2009 [cited by applicant]
US 20090100147A1 · Igarashi · 2009 [cited by applicant]
US 20090116817A1 · Kim · 2009 [cited by examiner]
US 20090119254A1 · Cross et al. · 2009 [cited by applicant]
US 20090129741A1 · Kim · 2009 [cited by examiner]
US 20090133090A1 · Busse · 2009 [cited by applicant]
US 20090142036A1 · Branam et al. · 2009 [cited by applicant]
US 20090154899A1 · Barrett et al. · 2009 [cited by applicant]
US 20090156181A1 · Athsani et al. · 2009 [cited by applicant]
US 20090157480A1 · Smith · 2009 [cited by applicant]
US 20090165043A1 · Ou et al. · 2009 [cited by applicant]
US 20090165054A1 · Rudolph · 2009 [cited by applicant]
US 20090183221A1 · Klein et al. · 2009 [cited by applicant]
US 20090216745A1 · Allard · 2009 [cited by examiner]
US 20090228937A1 · Williams · 2009 [cited by applicant]
US 20090239514A1 · Kenagy et al. · 2009 [cited by applicant]
US 20090282021A1 · Bennett · 2009 [cited by applicant]
US 20090327892A1 · Douillet et al. · 2009 [cited by applicant]
US 20100037260A1 · Fukuda · 2010 [cited by examiner]
US 20100057924A1 · Rauber et al. · 2010 [cited by applicant]
US 20100070057A1 · Sugiyama · 2010 [cited by applicant]
US 20100092152A1 · Son · 2010 [cited by examiner]
US 20100113148A1 · Haltovsky et al. · 2010 [cited by applicant]
US 20100131495A1 · Murdock et al. · 2010 [cited by applicant]
US 20100153885A1 · Yates · 2010 [cited by applicant]
US 20100248839A1 · Davis et al. · 2010 [cited by applicant]
US 20100251304A1 · Donoghue et al. · 2010 [cited by applicant]
US 20100304727A1 · Agrawal et al. · 2010 [cited by applicant]
US 20110023068A1 · Zeldis et al. · 2011 [cited by applicant]
US 20110126249A1 · Makhlouf · 2011 [cited by applicant]
US 20110179453A1 · Poniatowski · 2011 [cited by applicant]
US 20110184940A1 · Fazil · 2011 [cited by applicant]
US 20110184963A1 · Singh Thakur et al. · 2011 [cited by applicant]
US 20110191314A1 · Howes et al. · 2011 [cited by applicant]
US 20110214147A1 · Kashyap et al. · 2011 [cited by applicant]
US 20110225417A1 · Maharajh et al. · 2011 [cited by applicant]
US 20110252100A1 · Raciborski et al. · 2011 [cited by applicant]
US 20110276396A1 · Rathod · 2011 [cited by applicant]
US 20110289530A1 · Dureau et al. · 2011 [cited by applicant]
US 20110307927A1 · Nakano et al. · 2011 [cited by applicant]
US 20110314084A1 · Saretto et al. · 2011 [cited by applicant]
US 20110321072A1 · Patterson et al. · 2011 [cited by applicant]
US 20110321093A1 · McRae · 2011 [cited by applicant]
US 20120072432A1 · Crosa et al. · 2012 [cited by applicant]
US 20120078953A1 · Araya · 2012 [cited by applicant]
US 20120079529A1 · Harris et al. · 2012 [cited by applicant]
US 20120096499A1 · Dasher et al. · 2012 [cited by applicant]
US 20120110623A1 · Hill et al. · 2012 [cited by applicant]
US 20120131627A1 · Chittella · 2012 [cited by applicant]
US 20120159549A1 · Douillet et al. · 2012 [cited by applicant]
US 20120173383A1 · Badawiyeh et al. · 2012 [cited by applicant]
US 20120192217A1 · Jeong et al. · 2012 [cited by applicant]
US 20120197987A1 · Mori et al. · 2012 [cited by applicant]
US 20120204201A1 · Cassidy et al. · 2012 [cited by applicant]
US 20120210358A1 · Anthru et al. · 2012 [cited by applicant]
US 20120221645A1 · Anthru et al. · 2012 [cited by applicant]
US 20120226536A1 · Kidron · 2012 [cited by applicant]
US 20120297423A1 · Kanojia et al. · 2012 [cited by applicant]
US 20120304223A1 · Sargent et al. · 2012 [cited by applicant]
US 20120311623A1 · Davis et al. · 2012 [cited by applicant]
US 20130060660A1 · Maskatia et al. · 2013 [cited by applicant]
US 20130074109A1 · Skelton et al. · 2013 [cited by applicant]
US 20130081084A1 · Scheer · 2013 [cited by applicant]
US 20130133007A1 · White et al. · 2013 [cited by applicant]
US 20130174035A1 · Grab · 2013 [cited by applicant]
US 20130239024A1 · Lewis et al. · 2013 [cited by applicant]
US 20130263189A1 · Funk et al. · 2013 [cited by applicant]
US 20130268975A1 · Korst et al. · 2013 [cited by applicant]
US 20130304547A1 · Adler · 2013 [cited by examiner]
US 20140033038A1 · Callanan · 2014 [cited by examiner]
US 20140201802A1 · Boss et al. · 2014 [cited by applicant]
US 20140223481A1 · Fundament · 2014 [cited by applicant]
US 20150066913A1 · Funk et al. · 2015 [cited by applicant]
US 20150073871A1 · Hu et al. · 2015 [cited by applicant]
US 20150088869A1 · Funk et al. · 2015 [cited by applicant]
US 20150339312A1 · Lin et al. · 2015 [cited by applicant]
US 20160127763A1 · Patel et al. · 2016 [cited by applicant]
US 20210279270A1 · Funk et al. · 2021 [cited by applicant]
US 20230267143A1 · Funk et al. · 2023 [cited by applicant]
Anonymous, “Ninja and Pringo Partner to Boost Adoption of Mobile Social Networking”, Marketwire, May 13, 2008, 2 pgs. [cited by applicant]
Anonymous, “TWAIN—Linking Applications and Images”, Computer Technology Review, vol. 13, No. 6, May 1993, 5 pgs. [cited by applicant]
Anonymous, “Update: Memeo® Enhances Photo Sharing Offering with PC, Mac and iPhoneTM Products”, Marketwire, Sep. 16, 2008, 2 pgs. [cited by applicant]
Dumais et al., “Stuff I've Seen: A System for Personal Information Retrieval and Re-Use”, ACM SIGIR'03, Jul. 28-Aug. 1, 2003, pp. 72-79. [cited by applicant]
Cesar, “Social Television and User Interaction”, ACM Computers in Entertainment, 6(1), 10 pages (May 2008). [cited by applicant]
The Play Team, MiTV: Rethinking Interactive TV, Proceedings of the Seventh International Conference on Virtual Systems and Multimedia (VSMM), IEEE, 5 pages, (2001). [cited by applicant]