IP Library Granted Patent US 10,362,344
Granted Patent B1
US 10,362,344 · App. 16/028,055 · Granted Jul 23, 2019

Systems and methods for providing media content related to a viewer indicated ambiguous situation during a sporting event

Inventors: Thomas Kang-Po Yan (Lexington, MA); Hong-Qi Jia (Dedham, MA); Peter Boonstra (Arlington, MA); Kerui Chen (Somerville, MA)
Assignee: ROVI GUIDES, INC.
H04N21/2353H04N21/2187H04N21/233H04N21/23424
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,362,344
App. No.
16/028,055
Granted
Jul 23, 2019
Kind
B1
Abstract

A media guidance application may provide similar media content based on user utterances responsive to ambiguous determinations at sporting events. The media guidance application may detect a user utterance and may identify a situation within the sporting event that the user was referring to. The media guidance application may compare metadata of the identified situation/segment with metadata of a plurality of historical ambiguous events, and determine, based on the comparing, a historical ambiguous event that corresponds to the segment/situation. The media guidance application may generate for display video including the historical ambiguous event that corresponds to the segment.

Claims (85)

1. A method for providing similar media content based on user utterances responsive to ambiguous determinations at sporting events, the method comprising:

detecting, during playback of the sporting event, a user utterance that references an ambiguous determination by an officiator of a sporting event;

determining a segment of the sporting event that corresponds to the ambiguous determination;

extracting, from the one or more of audio stream, video stream, and subtitle stream of the sporting event, metadata that corresponds to the segment;

transmitting a request for metadata entries each describing content of a corresponding historical ambiguous event, wherein the request includes at least a portion of the metadata that corresponds to the segment;

receiving, in response to the request, one or more historical ambiguous events that corresponds to the segment; and

generating for display video comprising a historical ambiguous event of the one or more historical ambiguous events.

2. The method of claim 1 , wherein detecting the user utterance that references the ambiguous determination by an officiator of a sporting event comprises:

detecting, using a microphone, the user utterance;

transforming the user utterance into a plurality of keywords; and

comparing the plurality of keywords with words that are associated with ambiguous determinations associated with the sporting event; and

in response to determining, based on the comparing, that the plurality of keywords matches the words that are associated with the ambiguous determinations associated with the sporting event, determining that the user utterance references the ambiguous determination by the officiator of the sporting event.

3. The method of claim 1 , wherein determining the segment of the sporting event that corresponds to the ambiguous determination comprises:

determining a time within the sporting event that corresponds to a time of the user utterance; and

retrieving a segment interval associated with the sporting event; and

determining the segment of the sporting event based on the segment interval.

4. The method of claim 1 , wherein determining a segment of the sporting event that corresponds to the ambiguous determination comprises:

determining a time within the sporting event that corresponds to a time of the user utterance;

scanning the sporting event backwards from the time within the sporting event that corresponds to the time of the user utterance until the officiator of the sporting event is in focus;

setting a time within the sporting event when the officiator of the sporting event is in focus as an end time of the segment;

scanning the sporting event backwards from the time within the sporting event that the officiator of the sporting event is in focus until a next time the officiator of the sporting event is in focus; and

setting the next time the officiator of the sporting event is in focus as a start time of the segment.

5. The method of claim 1 , wherein detecting, during playback of the sporting event, a user utterance that references an ambiguous determination by an officiator of a sporting event comprises:

accessing one or more of the audio stream and the subtitle stream of the sporting event;

determining a time within one or more of the audio stream and the subtitle stream corresponding to a time of the user utterance;

comparing one or more of subtitle data and audio data immediately prior to the time of the user utterance with data of the user utterance; and

in response to determining, based on the comparing, that one or more of the subtitle data and the audio data matches the data of the utterance, detecting the user utterance that references the ambiguous determination by the officiator of the sporting event.

6. The method of claim 1 , wherein extracting metadata that corresponds to the segment comprises:

analyzing one or more of the subtitle stream and the audio stream of the segment;

extracting, based on the analyzing from the one or more of the subtitle stream and the audio stream, one or more keywords associated with the segment.

7. The method of claim 6 , wherein analyzing one or more of the subtitle stream and the audio stream of the segment comprises:

scanning the video stream for a time when the sporting event resumed after the user utterance; and

analyzing the one or more of the subtitle stream and the audio stream between a time the user utterance and the time when the sporting event resumed.

8. The method of claim 6 , wherein extracting the one or more keywords associated with the ambiguous determination comprises:

comparing each keyword of the one or more keywords associated with the ambiguous determination with each of a plurality of keywords known to be associated with ambiguous determinations; and

extracting those keywords of the one or more keywords that match one or more of the plurality of keywords known to be associated with the ambiguous determinations.

9. The method of claim 1 , further comprising:

determining that a plurality of historical ambiguous events was received in response to the request;

selecting the historical ambiguous event of the plurality of ambiguous events based on a number of an amount of extracted keywords matching a number of keywords associated with the historical ambiguous event.

10. The method of claim 1 , further comprising:

generating for display one or more indications for the one or more historical ambiguous events; and

in response to a user selection of an indication of the one or more indications, generating for simultaneous display a historical ambiguous event corresponding to the selected indication and a media segment associated with the ambiguous determination.

11. A system for providing similar media content based on user utterances responsive to ambiguous determinations at sporting events, the system comprising:

control circuitry configured to:

detect, during playback of the sporting event, a user utterance that references an ambiguous determination by an officiator of a sporting event;

determine a segment of the sporting event that corresponds to the ambiguous determination;

extract, from the one or more of audio stream, video stream, and subtitle stream of the sporting event, metadata that corresponds to the segment;

transmit a request for metadata entries each describing content of a corresponding historical ambiguous event, wherein the request includes at least a portion of the metadata that corresponds to the segment;

receive, in response to the request, one or more historical ambiguous events that corresponds to the segment; and

generate for display video comprising a historical ambiguous event of the one or more historical ambiguous events.

12. The system of claim 11 , wherein the control circuitry is further configured, when detecting the user utterance that references the ambiguous determination by an officiator of a sporting event, to:

detect, using a microphone, the user utterance;

transform the user utterance into a plurality of keywords; and

compare the plurality of keywords with words that are associated with ambiguous determinations associated with the sporting event; and

in response to determining, based on the comparing, that the plurality of keywords matches the words that are associated with the ambiguous determinations associated with the sporting event, determine that the user utterance references the ambiguous determination by the officiator of the sporting event.

13. The system of claim 11 , wherein the control circuitry is further configured, when determining the segment of the sporting event that corresponds to the ambiguous determination, to:

determine a time within the sporting event that corresponds to a time of the user utterance; and

retrieve a segment interval associated with the sporting event; and

determine the segment of the sporting event based on the segment interval.

14. The system of claim 11 , wherein the control circuitry is further configured, when determining a segment of the sporting event that corresponds to the ambiguous determination, to:

determine a time within the sporting event that corresponds to a time of the user utterance;

scan the sporting event backwards from the time within the sporting event that corresponds to the time of the user utterance until the officiator of the sporting event is in focus;

set a time within the sporting event when the officiator of the sporting event is in focus as an end time of the segment;

scan the sporting event backwards from the time within the sporting event that the officiator of the sporting event is in focus until a next time the officiator of the sporting event is in focus; and

set the next time the officiator of the sporting event is in focus as a start time of the segment.

15. The system of claim 11 , wherein the control circuitry is further configured, when detecting, during playback of the sporting event, a user utterance that references an ambiguous determination by an officiator of a sporting event, to:

access one or more of the audio stream and the subtitle stream of the sporting event;

determine a time within one or more of the audio stream and the subtitle stream corresponding to a time of the user utterance;

compare one or more of subtitle data and audio data immediately prior to the time of the user utterance with data of the user utterance; and

in response to determining, based on the comparing, that one or more of the subtitle data and the audio data matches the data of the utterance, detect the user utterance that references the ambiguous determination by the officiator of the sporting event.

16. The system of claim 11 , wherein the control circuitry is further configured, when extracting metadata that corresponds to the segment, to:

analyze one or more of the subtitle stream and the audio stream of the segment;

extract, based on the analyzing from the one or more of the subtitle stream and the audio stream, one or more keywords associated with the segment.

17. The system of claim 16 , wherein the control circuitry is further configured, when analyzing one or more of the subtitle stream and the audio stream of the segment, to:

scan the video stream for a time when the sporting event resumed after the user utterance; and

analyze the one or more of the subtitle stream and the audio stream between a time the user utterance and the time when the sporting event resumed.

18. The system of claim 16 , wherein the control circuitry is further configured, when extracting the one or more keywords associated with the ambiguous determination, to:

compare each keyword of the one or more keywords associated with the ambiguous determination with each of a plurality of keywords known to be associated with ambiguous determinations; and

extract those keywords of the one or more keywords that match one or more of the plurality of keywords known to be associated with the ambiguous determinations.

19. The system of claim 11 , wherein the control circuitry is further configured to:

determine that a plurality of historical ambiguous events was received in response to the request;

select the historical ambiguous event of the plurality of ambiguous events based on a number of an amount of extracted keywords matching a number of keywords associated with the historical ambiguous event.

20. The system of claim 11 , wherein the control circuitry is further configured to:

generate for display one or more indications for the one or more historical ambiguous events; and

in response to a user selection of an indication of the one or more indications, generate for simultaneous display a historical ambiguous event corresponding to the selected indication and a media segment associated with the ambiguous determination.

Assignments (7)
CHANGE OF NAME Recorded Oct 3, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069106/0129 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2018
From: KANG-PO YANG, THOMAS; JIA, HONG-QI; BOONSTRA, PETER; CHEN, KERUI
To: ROVI GUIDES, INC.
Reel/Frame 046273/0437 →
Cited By (3)
US 12,192,578 US 12,279,009 US 12,464,192