Granted Patent B2

US 9,330,393 · App. 13/539,152 · Granted May 3, 2016

Abstract

Claims (61)

1. A method of distributing data over a network to a remote computing system, the method comprising:

providing a first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, the storage device comprising at least one memory;

providing software for installation on the remote computing system, the software to communicate over the network with the first computing device, and the remote computing system configured to perform transcription based on data received from the first computing device;

storing, by a feedback module of the first computing device, in at least one database of the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;

receiving, by a result module of the first computing device, over the network from the remote computing system, a request for a result for a task, the request comprising a desired accuracy level;

determining, by the first computing device, an accuracy for the result using the respective individual accuracy for each of a first plurality of feedback computing devices selecting the result, each respective individual accuracy retrieved from the storage device; and

providing, by the result module, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing comprising providing, over the network, the result to the software on the remote computing system, the providing of the result to cause display of the result by the software on a web page in a user interface of the remote computing system, the providing of the result to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the result, of text to include in the transcription.

2. The method of claim 1 , wherein each respective individual accuracy is determined based on a comparison of prior results for the respective feedback computing device with prior results for a second plurality of feedback computing devices.

3. The method of claim 2 , wherein at least a portion of the first plurality of feedback computing devices is present in the second plurality of feedback computing devices.

4. The method of claim 1 , wherein the task is selection of one of a plurality of choices presented in a web page on a display of a feedback computing device, and the result is a selected one of the choices.

5. The method of claim 4 , wherein the choices are a list of potential titles for a content item, and the result is a single title selected from the list of titles.

6. A method of distributing data over a network to a remote computing system, the method comprising:

providing a first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, the storage device comprising at least one memory;

providing software for installation on the remote computing system, the software to communicate over the network with the first computing device, and the remote computing system configured to perform transcription based on data received from the first computing device;

storing, by a feedback module of the first computing device, in at least one database of the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;

receiving, by a result module of the first computing device, over the network from the remote computing system, an automated request for a result for a task, the request comprising a desired accuracy level, wherein the task is selection of one of a plurality of choices presented at a feedback computing device, and the result is a selected one of the choices;

presenting, by the first computing device, the result to a first plurality of feedback computing devices, wherein a first subset of the first plurality of feedback computing devices select the result, by user input on the respective feedback computing device, and a second subset of the first plurality of feedback computing devices do not select the result;

determining, by the first computing device, an accuracy for the result using a respective individual accuracy for each of the first subset of the first plurality of feedback computing devices, each respective individual accuracy retrieved from the storage device; and

providing, by the result module, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing comprising providing, over the network, the result to the software on the remote computing system, the providing of the result to cause display of the result by the software on a web page in a user interface of the remote computing system, the providing of the result to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the result, of text to include in the transcription.

7. The method of claim 6 , wherein each respective individual accuracy is determined based on a comparison of prior results for prior tasks performed by the respective feedback computing device with prior results for the prior tasks performed by a second plurality of feedback computing devices.

8. The method of claim 7 , wherein at least a portion of the first plurality of feedback computing devices is present in the second plurality of feedback computing devices.

9. The method of claim 6 , wherein the selection comprises reviewing titles presented on a display, the choices are a list of potential titles for a content item, and the result is a single title selected from the list of titles.

10. The method of claim 6 , wherein a number of the first plurality of feedback computing devices is increased until accuracy of the result is equal to or greater than the desired accuracy level.

11. The method of claim 1 , wherein a respective cost per task is associated with each of the first plurality of feedback computing devices, the method additionally comprising:

determining a total cost based on the respective cost per task for each of the first plurality of feedback computing devices.

12. The method of claim 11 , wherein the total cost is a sum of the respective cost per task for each of the first plurality of feedback computing devices.

13. The method of claim 11 , further comprising increasing a number of the first plurality of feedback computing devices until the total cost exceeds a maximum cost.

14. The method of claim 11 , such that where total cost exceeds a maximum cost, the result is not provided.

15. A non-transitory computer-storage medium storing instructions configured to instruct, for distributing data over a network to a remote computing system, a first computing device to:

communicate over the network with software on the remote computing system, the remote computing system configured to perform transcription based on data received from the first computing device, the first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, and the storage device comprising at least one memory;

store, by a feedback module of the first computing device, in at least one database of the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;

receive, by a result module of the first computing device, over the network, from the remote computing system, a request for a result for a task, the request comprising a desired accuracy level, wherein the task is selection by user input of one of a plurality of choices presented on a web page at a feedback computing device, and the result is a selected one of the choices;

determine, by the first computing device, an accuracy for the result using a respective individual accuracy for each of a plurality of feedback computing devices selecting the result, wherein a respective cost per task is associated with each of the plurality of feedback computing devices, and each respective individual accuracy is retrieved from the storage device;

determine, by the at least one processor, a total cost for providing the result based on the respective cost per task for each of the plurality of feedback computing devices; and

provide, by the result module, to the software on the remote computing system, over the network, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result to cause display of the result by the software on a web page in a user interface of the remote computing system, the providing of the result to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the result, of text to include in the transcription.

16. A system for distributing data over a network to a remote computing system, the system comprising:

a storage device comprising memory storing at least one database comprising a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device; at least one processor coupled to the storage device; and

memory storing instructions configured to instruct the at least one processor to:

communicate over the network with software on the remote computing system, the remote computing system configured to perform transcription based on received data;

receive, by a result module, over the network from the remote computing system, a request for a result for a task, the request comprising a desired accuracy level;

present the result to a plurality of feedback computing devices, wherein a first subset of the plurality of feedback computing devices select the result, by user input on the respective feedback computing device, and a second subset of the plurality of feedback computing devices do not select the result;

determine an accuracy for the result using a respective individual accuracy for each of the first subset of the plurality of feedback computing devices, each respective individual accuracy retrieved from the at least one database; and

provide, by the result module over the network, to the software on the remote computing system, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result to cause display of the result by the software on a web page in a user interface of the remote computing system, the providing of the result to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the result, of text to include in the transcription.

17. A non-transitory computer-storage medium storing instructions configured to instruct, for distributing data over a network to a remote computing system, a first computing device to:

communicate over the network with software on the remote computing system, the remote computing system configured to perform transcription based on data received from the first computing device, the first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, and the storage device comprising at least one memory;

store, by a feedback module of the first computing device, in at least one database of the storage device, a plurality of individual accuracies, each individual accuracy for a respective feedback computing device, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;

receive, by a result module of the first computing device, over the network from the remote computing system, a request for a result for a task, the request comprising a desired accuracy level;

present, by the first computing device, over a network, the result to a plurality of feedback computing devices, wherein a first subset of the plurality of feedback computing devices select the result, by user input on the respective feedback computing device, and a second subset of the plurality of feedback computing devices do not select the result;

determine, by the first computing device, an accuracy for the result using a respective individual accuracy for each of the first subset of the plurality of feedback computing devices, each respective individual accuracy retrieved from the storage device; and

provide, by the result module, to the software on the remote computing system, the result when the accuracy of the result is equal to or greater than the desired accuracy level, the providing of the result to cause display of the result by the software on a web page in a user interface of the remote computing system, the providing of the result to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the result, of text to include in the transcription.

18. A method of distributing data over a network to a remote computing system, the method comprising:

providing a first computing device comprising at least one processor and a storage device coupled to the at least one processor for storage of data, the storage device comprising at least one memory;

providing software for installation on the remote computing system, the software to communicate over the network with the first computing device, and the remote computing system configured to perform transcription based on data received from the first computing device;

receiving, over a network, feedback from each of a plurality of feedback computing devices that has reviewed titles for content items, the feedback comprising selection of a result by user input on each respective feedback computing device;

determining a plurality of individual accuracies, one for each of the plurality of feedback computing devices, based on the feedback, and each individual accuracy proportional to a number of prior results for prior tasks performed by the respective feedback computing device that are with a consensus of feedback computing devices that have also performed the prior tasks, the prior results automatically obtained based on user input during operation of the respective feedback computing device;

storing, by a feedback module, in at least one database of the storage device, the plurality of individual accuracies;

receiving, by a result module of the first computing device, over the network from the remote computing system, a request for a selection of a single title from a list of potential titles for a content item, the request comprising a desired accuracy level;

determining, by the first computing device, an accuracy for the single title selection using the plurality of individual accuracies;

increasing, by the at least one processor, a number of feedback computing devices used in the determining the accuracy until the accuracy for the single title selection is equal to or greater than the desired accuracy level; and

providing, by the result module, to the software on the remote computing system, in response to the request, the single title selection when the accuracy for the single title selection is equal to or greater than the desired accuracy level, the providing of the selection to cause display of the selection by the software on a web page in a user interface of the remote computing system, the providing of the selection to enable transcription of data by the remote computing system, and the transcription comprising automatic selection, based on the selection, of text to include in the transcription.

19. The method of claim 1 , wherein the consensus is based on a frequency of a content material being selected.

Assignments (9)