IP Library Granted Patent US 10,805,686
Granted Patent B2
US 10,805,686 · App. 16/118,191 · Granted Oct 13, 2020

Systems and methods for generating a media-based result to an ambiguous query

Inventors: Stuart Bryant (Datchet, GB); Aaron James Biggs (Reading, GB); Penelope Jane Warburg (Leatherhead, GB); Sallianne E. Sorget (Eureka, MO); Michael Galante (Reading, GB); Corey Tulis (Portland, OR)
Assignee: Rovi Guides, Inc.
H04N21/4828G06F16/732G06F16/735G06F16/738G10L15/1822H04N21/4316H04N21/44008H04N21/44213H04N21/4532H04N21/8455
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,805,686
App. No.
16/118,191
Granted
Oct 13, 2020
Kind
B2
Abstract

Systems and methods are described herein for providing a search result based on an ambiguous voice query. The system comprises receiving an ambiguous voice query relating to an object from a user, retrieving a viewing history of the user for about a list of media assets viewed by the user, determining, from the list of media asset, a media asset that is likely to contain the object based at least in part on metadata of the media asset and the ambiguous voice query, searching content of the determined media asset to identify a segment within the media asset that contains the object, and generating a display of information about the object identified from the segment.

Claims (69)

1. A method for providing a search result based on an ambiguous voice query, comprising:

receiving an ambiguous voice query relating to an object from a user;

retrieving a viewing history of the user, wherein the viewing history comprises a list of media assets viewed by the user;

determining, from the list of media assets, that none of the media assets in the list of media assets are likely to contain the object based at least in part on metadata of the media assets and the ambiguous voice query; and

in response to determining that none of the media assets in the list of media assets are likely to contain the object:

determining from a profile associated with the user, a social network associated with the user;

searching, through the social network associated with the user, a plurality of trending topics;

comparing a term parsed from the ambiguous voice query to the plurality of trending topics;

determining based on the comparison, that the term matches a trending topic in the plurality of trending topics;

identifying an additional media asset associated with the trending topic;

searching content of the additional media asset to identify a segment within the additional media asset that contains the object; and

generating a display of information about the object identified from the segment.

2. The method of claim 1 , wherein determining, from the list of media assets, that none of the media assets in the list of media assets are likely to contain the object based at least in part on metadata of the media assets and the ambiguous voice query comprises:

transmitting a query based on the term to a media asset database storing media assets and metadata associated with the media assets;

receiving from the media asset database storing media assets, a result of the query; and

determining, based on the result of the query, that the term does not match metadata corresponding to any of the media assets in the list of media assets.

3. The method of claim 1 , wherein searching content of the additional media asset to identify the segment within the additional media asset that contains the object comprises:

searching, starting at the beginning of the additional media asset, for a first video frame that contains the object;

determining a starting playback position corresponding to the first video frame;

searching, for a second video frame that is a last instance in which the object continuously appears since the starting playback position; and

determining an ending playback position corresponding to the second video frame.

4. The method of claim 1 , further comprising:

determining, from metadata corresponding to the additional media asset, a keyword associated with the object;

generating a search query based on the keyword; and

transmitting the search query to a data source to obtain information related to the object.

5. The method of claim 1 , wherein generating the display of information about the object identified from the segment comprises:

determining a position of the object within at least one video frame of the additional media asset; and

generating for display, an overlay containing the information about the object at the position of the object.

6. The method of claim 1 , further comprising:

determining from the profile associated with the user, that a second object that is related to the user, wherein the second object shares a common attribute with the object;

searching through user generated media in a period of time to retrieve a set of media that corresponds to the second object;

performing an image comparison between the set of media that corresponds to the second object and the object; and

generating for display, a comparative view of the second object and the object.

7. A system for providing a search result based on an ambiguous voice query, comprising:

a user input interface configured to receive an ambiguous voice query relating to an object from a user; and

control circuitry configured to:

retrieve a viewing history of the user, wherein the viewing history comprises a list of media assets viewed by the user;

determine, from the list of media assets, that none of the media assets in the list of media assets are likely to contain the object based at least in part on metadata of the media assets and the ambiguous voice query; and

in response to determining that none of the media assets in the list of media assets are likely to contain the object:

determine from a profile associated with the user, a social network associated with the user;

search, through the social network associated with the user, a plurality of trending topics;

compare a term parsed from the ambiguous voice query to the plurality of trending topics;

determine based on the comparison, that the term matches a trending topic in the plurality of trending topics;

identify an additional media asset associated with the trending topic;

search content of the additional media asset to identify a segment within the additional media asset that contains the object; and

generate a display of information about the object identified from the segment.

8. The system of claim 7 , wherein the control circuitry is configured to determine, from the list of media assets, that none of the media assets in the list of media assets are likely to contain the object based at least in part on metadata of the media assets and the ambiguous voice query by:

transmitting a query based on the term parsed to a media asset database storing media assets and metadata associated with the media assets;

receiving from the media asset database storing media assets, a result of the query; and

determining, based on the result of the query, that the term does not match metadata corresponding any of the media assets in the list of media assets.

9. The system of claim 7 , wherein the control circuitry is configured to search content of the additional media asset to identify the segment within the additional media asset that contains the object by:

searching, starting at the beginning of the additional media asset, for a first video frame that contains the object;

determining a starting playback position corresponding to the first video frame;

searching, for a second video frame that is a last instance in which the object continuously appears since the starting playback position; and

determining an ending playback position corresponding to the second video frame.

10. The system of claim 7 , the control circuitry further configured to:

determine, from metadata corresponding to the additional media asset, a keyword associated with the object;

generate a search query based on the keyword; and

transmit the search query to a data source to obtain information related to the object.

11. The system of claim 7 , wherein the control circuitry is configured to generate the display of information about the object identified from the segment by:

determining a position of the object within at least one video frame of the additional media asset; and

generating for display, an overlay containing the information about the object at the position of the object.

12. The system of claim 7 , the control circuitry further configured to:

determine from the profile associated with the user, that a second object that is related to the user, wherein the second object shares a common attribute with the object;

search through user generated media in a period of time to retrieve a set of media that corresponds to the second object;

perform an image comparison between the set of media that corresponds to the second object and the object; and

generate for display, a comparative view of the second object and the object.

13. The method of claim 1 , wherein the list of media assets does not comprise the additional media asset.

14. The system of claim 7 , wherein the list of media assets does not comprise the additional media asset.

Assignments (9)
PARTIAL RELEASE OF SECURITY INTEREST IN PATENTS Recorded Oct 27, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: ROVI PRODUCT CORPORATION (AS SUCCESSOR-IN-INTEREST TO ROVI GUIDES, INC.)
Reel/Frame 061786/0768 →
CHANGE OF NAME Recorded Oct 23, 2022
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 061746/0981 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2022
From: ADEIA GUIDES INC.
To: ROVI PRODUCT CORPORATION
Reel/Frame 061747/0001 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2018
From: BRYANT, STUART; BIGGS, AARON JAMES; WARBURG, PENELOPE JANE; SORGET, SALLIANNE E.; GALANTE, MICHAEL; TULIS, COREY
To: ROVI GUIDES, INC.
Reel/Frame 046761/0335 →