IP Library Granted Patent US 9,848,089
Granted Patent B2
US 9,848,089 · App. 14/701,235 · Granted Dec 19, 2017

Methods and apparatus to generate an overall performance index

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,848,089
App. No.
14/701,235
Granted
Dec 19, 2017
Kind
B2
Abstract

Methods, apparatus, systems and articles of manufacture are disclosed to generate an overall performance index. The overall performance index is generated from data values from multiple different datasources that measure the same aspect of network performance of wireless providers of interest. The data values are used to generate metrics that measure the same aspect of network performance. The metrics are indexed and combined to generate an overall performance index.

Claims (91)

1. A method to generate an overall performance index, the method comprising:

accessing a first set of data values for wireless providers of interest from a first datasource, where the first set of data values indicate a first measure of a first aspect of network performance, the first datasource measures the first aspect of the network performance using a first specific collection method, the first specific collection method being drive test measurement;

accessing a second set of data values for the wireless providers of interest from a second datasource, different from the first datasource, where the second set of data values indicate a second measure of the first aspect of network performance, the second datasource measures the first aspect of the network performance using a second specific collection method, different than the first specific collection method;

generating a first metric from the first set of data values and a second metric from the second set of data values;

generating a first indexed metric for the first metric using the first set of data values by:

calculating a mean of the first set of data values;

calculating a standard deviation of the first set of data values;

subtracting the mean from the first metric to obtain a difference;

dividing 20 by the standard deviation to obtain a quotient;

multiplying the difference by the quotient to obtain a product; and

adding 100 to the product;

generating a second indexed metric for the second metric using the second set of data values;

generating an overall performance index for the wireless providers of interest by combining the first and second indexed metrics; and

generating a report showing the overall performance index for the wireless providers of interest, where the report identifies the relative performance between the wireless providers of interest and prioritizes elements of the network that need the most improvement.

2. The method of claim 1 wherein the first metric is a data metric or a voice metric.

3. The method of claim 2 wherein the data metric includes at least one of a data accessibility metric, a data retainability metric, a data throughput metric, a passive data coverage metric or an active data coverage metric.

4. The method of claim 3 wherein the data throughput metric is calculated for a small data transfer amount, a medium data transfer amount and a large data transfer amount.

5. The method of claim 1 wherein the first datasource is a Nielsen Drive Test (NDT) Datasource and the second datasource is a Nielsen Mobile Performance Datasource.

6. The method of claim 1 wherein the overall performance index is for a geographic area.

7. The method of claim 1 wherein the second specific collection method includes mobile performance measurements.

8. A method to generate an overall performance index, the method comprising:

accessing a first set and a second set of data values for wireless providers of interest from a first datasource, where the first set of data values indicate a first measure of a first aspect of network performance and the second set of data values indicate a first measure of a second aspect of network performance, and where the first datasource measures the first aspect of the network performance using a first specific collection method, the first specific collection method being drive test measurement;

accessing a third set and a fourth set of data values for wireless providers of interest from a second datasource, different from the first datasource, where the third set of data values indicate a second measure of the first aspect of network performance and the fourth set of data values indicate a second measure of the second aspect of network performance;

generating a first metric from the first set of data values, a second metric from the second set of data values, a third metric from the third set of data values and a fourth metric from the fourth set of data values;

generating a first indexed metric for the first metric using the first set of data values;

generating a second indexed metric for the second metric using the second set of data values;

generating a third indexed metric for the third metric using the third set of data values;

generating a fourth indexed metric for the fourth metric using the fourth set of data values;

generating a cross datasource index for the first aspect of network performance by combining the first index metric with the third indexed metric;

generating a cross datasource index for the second aspect of network performance by combining the second indexed metric with the fourth indexed metric;

weighting the cross datasource indexes for the first and second aspects of network performance;

generating an overall performance index for respective ones of the wireless providers of interest by combining the weighted cross datasource index for the first aspect of network performance with the weighted cross datasource index for the second aspect of network performance; and

generating a report showing the overall performance indexes for the respective ones of the wireless providers of interest, where the report identifies the relative performance between the wireless providers of interest and prioritizes elements of the network that need the most improvement.

9. The method of claim 8 wherein weights are assigned to the cross datasource index for the first aspect of network performance and the cross datasource index for the second aspect of network performance based on the impact on overall network satisfaction of the first aspect of network performance and the impact on overall network satisfaction of the second aspect of network performance.

10. The method of claim 8 wherein weights are assigned to the cross datasource index for the first aspect of network performance and the cross datasource index for the second aspect of network performance based on the frequency of behavior by a customer population of the first aspect of network performance and the frequency of behavior by the customer population of the second aspect of network performance.

11. The method of claim 8 wherein the overall performance index is generated for four wireless providers of interest.

12. The method of claim 8 wherein the first metric is a data metric or a voice metric.

13. The method of claim 12 wherein the voice metric includes at least one of a voice accessibility metric or a voice retainability metric.

14. The method of claim 12 wherein the data metric includes at least one of a data accessibility metric, a data retainability metric, a data throughput metric, a passive data coverage metric or an active data coverage metric.

15. The method of claim 14 wherein the data throughput metric is calculated for a small data transfer amount, a medium data transfer amount and a large data transfer amount.

16. The method of claim 8 wherein the first datasource is a Nielsen Drive Test (NDT) Datasource and the second datasource is a Nielsen Mobile Performance Datasource.

17. The method of claim 8 wherein the overall performance index is for a specific geographic area.

18. The method of claim 17 wherein the specific geographic area is an area serviced by a single cell tower, an area of a city, an area covered by one or more zip codes, an area of a state, or an area of a country.

19. An apparatus comprising:

a metric identifier to identify first and second metrics in a first datasource and third and fourth metrics in a second datasource, where the first and third metrics describe a first aspect of network performance and the second and fourth metrics describe a second aspect of network performance for a wireless provider for a geographic area, the first datasource including a first set and second set of data values for indicating a first measure of the first network performance aspect collected using a first specific collection method, the first specific collection method being drive test measurement, the second datasource including a third set and fourth set of data values for indicating a second measure of the first network performance aspect collected using a second, different specific collection method;

a metric accumulator to accumulate data values for the first, second, third and fourth metrics identified by the metric identifier for the geographic area;

a metric combiner to:

generate a first indexed metric for the first metric using the first set of data values;

generate a second indexed metric for the second metric using the second set of data values;

generate a third indexed metric for the third metric using the third set of data values;

generate a fourth indexed metric for the fourth metric using the fourth set of data values;

generate a cross datasource index for the first aspect of network performance by combining the first index metric with the third indexed metric;

generate a cross datasource index for the second aspect of network performance by combining the second indexed metric with the fourth indexed metric;

weight the cross datasource indexes for the first and second aspects of network performance;

generate an overall performance index for respective ones of the wireless providers for the geographic area by combining the weighted cross datasource index for the first aspect of network performance with the weighted cross datasource index for the second aspect of network performance; and

a report generator to generate a report showing the overall performance index for the wireless provider for the geographic area, where the report prioritizes elements of the network that need the most improvement.

20. The apparatus of claim 19 wherein the metrics identified include at least one of a data accessibility metric, a data retainability metric, a data throughput metric, a passive data coverage metric, an active data coverage metric, a voice accessibility metric or a voice retainability metric.

21. The apparatus of claim 20 wherein the data throughput metric is calculated for a small data transfer amount, a medium data transfer amount and a large data transfer amount.

22. The apparatus of claim 21 wherein the data throughput metric includes a data transfer time and a latency time.

23. The apparatus of claim 19 wherein the at least two datasources include a Nielsen Drive Test (NDT) Datasource and a Nielsen Mobile Performance Datasource.

24. The apparatus of claim 19 , wherein each of the indexed metrics is generated by:

calculating a mean of the data values for the metric;

calculating the standard deviation of the of data values for the metric;

subtracting the mean from the metric to obtain a difference;

dividing 20 by the standard deviation to obtaining a quotient;

multiplying the difference by the quotient Q to obtain a product;

adding 100 to the product.

25. A tangible computer readable medium comprising computer readable instructions which, when executed, cause a processor to at least:

access a first set and a second set of data values for wireless providers of interest from a first datasources, where the first set of data values indicate a first measure of a first aspect of network performance and the second set of data values indicate a first measure of a second aspect of network performance, where the first datasource measures the first aspect of the network performance using a first specific collection method, the first specific collection method being drive test measurement;

access a third set and a fourth set of data values for wireless providers of interest from a second datasources, different from the first datasource, where the third set of data values indicate a second measure of the first aspect of network performance and the fourth set of data values indicate a second measure of the second aspect of network performance, where the second datasource measures the first aspect of the network performance using a second specific collection method different than the first specific collection method;

generate a first metric from the first set of data values, a second metric from the second set of data values, a third metric from the third set of data values and a fourth metric from the fourth set of data values;

generate a first indexed metric for the first metric using the first set of data values;

generate a second indexed metric for the second metric using the second set of data values;

generate a third indexed metric for the third metric using the third set of data values;

generate a fourth indexed metric for the fourth metric using the fourth set of data values;

generate a cross datasource index for the first aspect of network performance by combining the first indexed metric with the third indexed metric;

generating a cross datasource index for the second aspect of network performance by combining the second indexed metric with the fourth indexed metric;

weight the cross datasource indexes for the first and second aspects of network performance;

generate an overall performance index for respective ones of the wireless providers of interest by combining the weighted cross datasource index for the first aspect of network performance with the weighted cross datasource index for the second aspect of network performance; and

generate a report showing the overall performance index for the respective ones of the wireless providers of interest, where the report identifies the relative performance between the wireless providers of interest and prioritizes elements of the network that need the most improvement.

26. The storage medium as defined in claim 25 , wherein the first metric is a data metric or a voice metric.

27. The storage medium as defined in claim 26 , wherein the data metric includes at least one of a data accessibility metric, a data retainability metric, a data throughput metric, a passive data coverage metric or an active data coverage metric.

28. The storage medium of claim 25 , wherein the first datasource is a Nielsen Drive Test (NDT) Datasource and the second datasource is a Nielsen Mobile Performance Datasource.

29. The storage medium as defined in claim 25 , wherein the first indexed metric is generated by:

calculating a mean of the first set of data values;

calculating a standard deviation of the first set of data values;

subtracting the mean from the first metric to obtain a difference;

dividing 20 by the standard deviation to obtain a quotient;

multiplying the difference by the quotient to obtain a product;

adding 100 to the product.

30. The storage medium of claim 25 , wherein the second specific collection method includes mobile performance measurements.

Assignments (8)
RELEASE (REEL 054066 / FRAME 0064) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063605/0001 →
RELEASE (REEL 053473 / FRAME 0001) Recorded May 11, 2023
From: CITIBANK, N.A.
To: A. C. NIELSEN COMPANY, LLC; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE MEDIA SERVICES, LLC; THE NIELSEN COMPANY (US), LLC; NETRATINGS, LLC
Reel/Frame 063603/0001 →
SECURITY INTEREST Recorded May 8, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: ARES CAPITAL CORPORATION
Reel/Frame 063574/0632 →
SECURITY INTEREST Recorded Apr 28, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: CITIBANK, N.A.
Reel/Frame 063561/0381 →
SECURITY AGREEMENT Recorded Jan 31, 2023
From: GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; GRACENOTE, INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 063560/0547 →
CORRECTIVE ASSIGNMENT TO CORRECT THE PATENTS LISTED ON SCHEDULE 1 RECORDED ON 6-9-2020 PREVIOUSLY RECORDED ON REEL 053473 FRAME 0001. ASSIGNOR(S) HEREBY CONFIRMS THE SUPPLEMENTAL IP SECURITY AGREEMENT. Recorded Oct 7, 2020
From: A.C. NIELSEN (ARGENTINA) S.A.; A.C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A
Reel/Frame 054066/0064 →
SUPPLEMENTAL SECURITY AGREEMENT Recorded Jun 9, 2020
From: A. C. NIELSEN COMPANY, LLC; ACN HOLDINGS INC.; ACNIELSEN CORPORATION; ACNIELSEN ERATINGS.COM; AFFINNOVA, INC.; ART HOLDING, L.L.C.; ATHENIAN LEASING CORPORATION; CZT/ACN TRADEMARKS, L.L.C.; EXELATE, INC.; GRACENOTE, INC.; GRACENOTE DIGITAL VENTURES, LLC; GRACENOTE MEDIA SERVICES, LLC; NETRATINGS, LLC; NIELSEN AUDIO, INC.; NIELSEN CONSUMER INSIGHTS, INC.; NIELSEN CONSUMER NEUROSCIENCE, INC.; NIELSEN FINANCE CO.; NIELSEN FINANCE LLC; NIELSEN INTERNATIONAL HOLDINGS, INC.; NIELSEN MOBILE, LLC; NIELSEN UK FINANCE I, LLC; NMR INVESTING I, INC.; TCG DIVESTITURE INC.; TNC (US) HOLDINGS, INC.; THE NIELSEN COMPANY (US), LLC; VIZU CORPORATION; VNU MARKETING INFORMATION, INC.; NMR LICENSING ASSOCIATES, L.P.; NIELSEN HOLDING AND FINANCE B.V.; THE NIELSEN COMPANY B.V.; VNU INTERNATIONAL B.V.
To: CITIBANK, N.A.
Reel/Frame 053473/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2015
From: BHATIA, ROHIT; PÉREZ, AMILCAR; GREENAWALD, MICHAEL; BARAI, KUNAL; ULLMANN, JOEL; ALBINO, AUSTIN
To: THE NIELSEN COMPANY (US), LLC
Reel/Frame 035665/0429 →