Apparatus and methods for data collection, analysis and validation including error correction in a content delivery network
Methods and apparatus for collection, validation, analysis, and automated error correction of data regarding user interaction with content. In one embodiment, statistical methods are used to arrive at expected values for the collected data. The data is compared to the expected value and must meet one or more acceptance criteria (e.g., be within a prescribed range) to be considered valid. The prescribed range is determined by the network operator, or a computer program adapted to generate this value. The invention enables a network operator to assess a large volume of data without requiring significant amounts of manual monitoring and/or error correction. The ability to collect, validate and analyze data across multiple platforms is also provided. Still further, an automated system capable of learning evaluation and error correction patterns is disclosed.
1. A method of providing data collection in a network, said method comprising:
collecting a plurality of data relating to interaction of a plurality of users with content or with an apparatus controlling said content;
deriving an expected value for said plurality of data;
based at least in part on said expected value, configuring a range of acceptable values for said plurality of data;
comparing said plurality of data to said range of acceptable values; and
transmitting said plurality of data to at least one entity for analysis of said plurality of data when said plurality of data is determined to be within said range.
2. The method of claim 1 , wherein said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of individual instances of said plurality of data expected to be collected over a given period of time.
3. The method of claim 1 , wherein said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of user devices within a given geographic area from which said plurality of data is expected to be collected.
4. The method of claim 1 , wherein said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of user devices expected to be tuned to each channel over a given period of time.
5. The method of claim 1 , wherein said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of user devices expected to be tuned to each network over a given period of time.
6. The method of claim 1 , wherein said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of programs expected to be viewed, requested, provided, and/or made available on a given channel.
7. The method of claim 1 , wherein said network comprises a content delivery network, said apparatus controlling said content comprises a content server, said data comprises a total number of tuning events received at said content server, and said act of deriving an expected value for said plurality of data comprises deriving a value for an average number of tuning events expected to be received at said content server.
8. In a content delivery network comprising a plurality of users receiving content at a respective plurality of user devices via one or more platforms, a method of collecting data comprising:
collecting data relating to an interaction of said plurality of users with said content received at said respective plurality of user devices via said one or more platforms;
comparing values of individual ones of a plurality of data fields in said data to one or more acceptance criteria for each of said individual ones of said plurality of data fields; and
transmitting said data to at least one entity for analyzing said data when said one or more acceptance criteria are met.
9. The method of claim 8 , further comprising deriving said one or more acceptance criteria.
10. The method of claim 9 , wherein said act of deriving comprises generating a value for an average number of advertisements delivered to a portion of said plurality of users within a given advertisement zone via said one or more platforms.
11. The method of claim 9 , wherein said act of deriving comprises generating a value for an average number of advertisements received at said plurality of user devices via said one or more platforms.
12. The method of claim 9 , wherein said act of deriving comprises generating a value for an average number of each type of a plurality of tune-out events occurring at individual ones of said plurality of user devices.
13. The method of claim 9 , wherein said act of deriving comprises generating a value for an average number of each type of a plurality of channel changing events occurring at individual ones of said plurality of user devices.
14. The method of claim 9 , wherein said act of deriving comprises generating a value for an average number of each of: tune-in, tune-out, and tune-away events occurring at individual ones of said plurality of user devices.
15. Non-transitory computer readable apparatus comprising a medium configured to store a computer program thereon, said computer program comprising a plurality of instructions which are configured to, when executed:
collect a plurality of data records, individual ones of said plurality of said data records each comprising a plurality of data fields having values contained therein, said values each configured to be validated;
compare said values of said plurality of data fields for each of said collected plurality of data to one or more accepted values specific to individual ones of said plurality of data fields;
transmit said plurality of data to at least one entity for analysis when said values of each of said plurality of data fields are within a predetermined range of said one or more accepted values therefor; and
implement a substantially automated error correction process of individual ones of said data fields which are determined to have values that are not within said predetermined range of said one or more accepted values therefor.
16. The apparatus of claim 15 , wherein at least one of said values of said plurality of data fields comprises a value indicative of an amount of data provided to a particular client device over a given time window.
17. The apparatus of claim 15 , wherein said predetermined range of said one or more accepted values comprises a range of content types of which said values are expected to be.
18. The apparatus of claim 15 , wherein at least one of said values of said plurality of data fields comprises a value indicative of a number of records expected to be received at a particular client device over a given time window.
19. The apparatus of claim 15 , wherein at least one of said values of said plurality of data fields comprises a value indicative of a number of records which contain a null value in a required field and said predetermined range of said one or more accepted values therefor is zero.
20. The apparatus of claim 15 , wherein at least one of said values of said plurality of data fields comprises a value indicative of a number of records which contain a value that is not present in any other of said plurality of collected data records.
21. Apparatus configured to provide data collection in a network, said apparatus comprising:
a data processing apparatus; and
computerized logic in data communication with said data processing apparatus, said logic configured to:
collect a plurality of data relating to interaction of a plurality of users with content or with an apparatus configured to control said content;
derive an expected value for said plurality of data;
based at least in part on said expected value, configure a range of acceptable values for said plurality of data;
compare said plurality of data to said range of acceptable values; and
based at least on said comparison:
transmit said plurality of data to at least one entity for analysis of said plurality of data when said plurality of data is determined to be within said range; or
when said plurality of data is determined not to be within said range:
generate at least one error message;
implement an error correction process to correct said plurality of data; and
transmit corrected data to said at least one entity for analysis.
22. The apparatus of claim 21 , wherein said error correction process comprises a test thereof, when said error correction process fails said test, said computerized logic being further configured to:
accept manual correction to said plurality of data; and
update an error correction profile to improve said error correction process based on said manual correction.
23. The apparatus of claim 22 , wherein said range of acceptable values is based at least in part on said updated error correction profile.
24. The apparatus of claim 21 , wherein said range of acceptable values is based at least in part on a regression analysis.
25. The apparatus of claim 24 , wherein a regression period of said regression analysis is set based on a statistical significance of said regression analysis.