IP Library Granted Patent US 11,087,161
Granted Patent B2
US 11,087,161 · App. 16/257,479 · Granted Aug 10, 2021

Methods and systems for determining accuracy of sport-related information extracted from digital video frames

Inventors: Jeffrey Scott (Oakland, CA); Markus Kurt Peter Cremer (Orinda, CA); Nishit Umesh Parekh (Woodland Hills, CA); Dewey Ho Lee (Berkeley, CA)
Assignee: Gracenote, Inc.
G06K9/3266G06K9/00724G06T7/13H04N21/2187
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,087,161
App. No.
16/257,479
Granted
Aug 10, 2021
Kind
B2
Abstract

A computing system determines accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, the extracted sport-related information including an attribute that changes over the time sequence. The computing system (a) detects, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence and (b) makes a determination of whether the detected pattern is an expected pattern of change associated with the sport event. If the determination is that the detected pattern is the expected pattern, then, responsive to making the determination, the computing system takes a first action that corresponds to the sport-related information being accurate. Whereas, if the determination is that the detected pattern is not the expected pattern, then, responsive to making the determination, the computing system takes a second action that corresponds to the sport-related information being inaccurate.

Claims (80)

1. A method for determining accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, wherein the extracted sport-related information includes an attribute that changes over the time sequence, the method comprising:

detecting by a computing system, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence, wherein the computing system comprises a processing unit and the computing system has access to mapping data that indicates, for each of a plurality of sport events, an expected pattern of change of the attribute;

identifying, by the computing system, the sport event represented by the digital video frames;

determining, by the computing system, the expected pattern of change of the attribute indicated by the mapping data for the identified sport event;

making a determination, by the computing system, of whether the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data for the identified sport event;

if the determination is that the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data of the identified sport event, then, responsive to making the determination, the computing system taking a first action that corresponds to the sport-related information being accurate; and

if the determination is that the detected pattern of change of the attribute over the time sequence is not the expected pattern of change of the attribute indicated by the mapping data for the identified sport event, then, responsive to making the determination, the computing system taking a second action that corresponds to the sport-related information being inaccurate.

2. The method of claim 1 , wherein the attribute is a score associated with the sport event.

3. The method of claim 1 , wherein the attribute is a time depicted by the digital video frames in accordance with the sport event.

4. The method of claim 1 ,

wherein the sport-related information includes (i) a first instance of the attribute as extracted from a first digital video frame of the digital video frames and (ii) a second instance of the attribute as extracted from a second digital video frame of the digital video frames, and

wherein detecting the pattern of change of the attribute comprises determining at least a difference between the first and second instances of the attribute.

5. The method of claim 4 , wherein the second digital video frame immediately follows the first digital video frame in the time sequence.

6. The method of claim 4 , further comprising:

determining, by the computing system, a time period between the first and second digital video frames in the time sequence,

wherein making the determination comprises making a determination of whether the determined difference corresponds to an expected difference between the first and second instances of the attribute over the determined time period.

7. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting a rate of increase of the attribute,

wherein making the determination comprises making a determination of whether the detected rate of increase of the attribute is (i) below a threshold rate of increase of the attribute or rather (ii) at or above the threshold rate of increase of the attribute,

wherein the computing system takes the first action if the determination is that the detected rate of increase of the attribute is below the threshold rate of increase of the attribute, and

wherein the computing system takes the second action if the determination is that the detected rate of increase of the attribute is at or above the threshold rate of increase of the attribute.

8. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting a rate of decrease of the attribute,

wherein making the determination comprises making a determination of whether the detected rate of decrease of the attribute is (i) below a threshold rate of decrease of the attribute or rather (ii) at or above the threshold rate of decrease of the attribute,

wherein the computing system takes the first action if the determination is that the detected rate of decrease of the attribute is below the threshold rate of decrease of the attribute, and

wherein the computing system takes the second action if the determination is that the detected rate of decrease of the attribute is at or above the threshold rate of decrease of the attribute.

9. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting a particular change of the attribute, and

wherein making the determination comprises making a determination of whether the particular change corresponds to an increase of the attribute or rather to a decrease of the attribute.

10. The method of claim 9 ,

wherein the computing system takes the first action if the determination is that the particular change corresponds to the increase of the attribute, and

wherein the computing system takes the second action if the determination is that the particular change corresponds to the decrease of the attribute.

11. The method of claim 9 ,

wherein the computing system takes the first action if the determination is that the particular change corresponds to the decrease of the attribute, and

wherein the computing system takes the second action if the determination is that the particular change corresponds to the increase of the attribute.

12. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting that the attribute increased,

wherein making the determination comprises making a determination of whether the attribute increased beyond an upper limit of the attribute,

wherein the computing system takes the first action if the determination is that the attribute did not increase beyond the upper limit of the attribute, and

wherein the computing system takes the second action if the determination is that the attribute increased beyond the upper limit of the attribute.

13. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting that the attribute decreased,

wherein making the determination comprises making a determination of whether the attribute decreased beyond a lower limit of the attribute,

wherein the computing system takes the first action if the determination is that the attribute did not decrease beyond the lower limit of the attribute, and

wherein the computing system takes the second action if the determination is that the attribute decreased beyond the lower limit of the attribute.

14. The method of claim 1 ,

wherein detecting the pattern of change of the attribute comprises detecting the attribute changed by a particular increment,

wherein making the determination comprises making a determination of whether the particular increment matches an expected increment of change for the attribute,

wherein the computing system takes the first action if the determination is that the particular increment matches the expected increment, and

wherein the computing system takes the second action if the determination is that the particular increment does not match the expected increment.

15. The method of claim 1 ,

wherein taking the first action comprises one or more of the following:

(i) storing an indication that the sport-related information is accurate,

(ii) causing presentation of the sport-related information,

(iii) outputting a report related to the sport-related information being accurate,

(iv) updating a user-account based on the sport-related information, and

(v) causing presentation of supplemental content based on the sport-related information, and

wherein taking the second action comprises one or more of the following:

(i) storing an indication that the sport-related information is inaccurate,

(ii) deleting the sport-related information,

(iii) outputting a report related to the sport-related information being inaccurate, and

(iv) triggering a machine-driven procedure to again extract the sport-related information from the time sequence of digital video frames that represent the sport event.

16. A computing system comprising:

a processing unit;

non-transitory data storage; and

program instructions stored in the non-transitory data storage and executable by the processing unit to carry out operations for determining accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, wherein the extracted sport-related information includes an attribute that changes over the time sequence, the operations comprising:

detecting, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence, wherein the computing system has access to mapping data that indicates, for each of a plurality of sport events, an expected pattern of change of the attribute,

identifying the sport event represented by the digital video frames,

determining the expected pattern of change of the attribute indicated by the mapping data for the identified sport event,

making a determination of whether the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data for the identified sport event,

if the determination is that the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data for the identified sport event, then, responsive to making the determination, taking a first action that corresponds to the sport-related information being accurate, and

if the determination is that the detected pattern of change of the attribute over the time sequence is not the expected pattern of change of the attribute indicated by the mapping data for the identified sport event, then, responsive to making the determination, taking a second action that corresponds to the sport-related information being inaccurate.

17. The computing system of claim 16 , wherein the attribute is (i) a score associated with the sport event or (ii) a time depicted by the digital video frames in accordance with the sport event.

18. A non-transitory computer readable medium having stored thereon instructions executable by a processing unit to cause a computing system to perform operations for determining accuracy of sport-related information extracted from a time sequence of digital video frames that represent a sport event, wherein the extracted sport-related information includes an attribute that changes over the time sequence, the operations comprising:

detecting, based on the extracted sport-related information, a pattern of change of the attribute over the time sequence, wherein the computing system has access to mapping data that indicates, for each of a plurality of sport events, an expected pattern of change of the attribute;

identifying the sport event represented by the digital video frames;

determining the expected pattern of change of the attribute indicated by the mapping data for the identified sport event;

making a determination of whether the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data for the identified sport event;

if the determination is that the detected pattern of change of the attribute over the time sequence is the expected pattern of change of the attribute indicated by the mapping data for the identified sport event, then, responsive to making the determination, taking a first action that corresponds to the sport-related information being accurate; and

if the determination is that the detected pattern of change of the attribute over the time sequence is not the expected pattern of change of the attribute indicated by the mapping data for the identified sport event, then, responsive to making the determination, taking a second action that corresponds to the sport-related information being inaccurate.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 25, 2019
From: SCOTT, JEFFREY; CREMER, MARKUS KURT PETER; PAREKH, NISHIT UMESH; LEE, DEWEY HO
To: GRACENOTE, INC.
Reel/Frame 048135/0686 →
Continuity (1)
Related Publication 20200242386A1 · Jul 30, 2020