SYSTEMS AND METHODS FOR EVALUATING DEVELOPERS OF A DEVICE APPLICATION
Systems, methods, and computer readable storage mediums for evaluating a developer of a device application are disclosed. A method includes receiving a classification for an application developer and determining, based on the classification, one or more tests to verify the classification. The method further includes assigning a job, based on the classification, to the developer, the job determined by a machine readable specification. The method further includes determining a quality of a completed job and updating the classification of the application developer based on the quality of the completed job.
1 . A method for evaluating a developer of a device application, the method comprising:
receiving a classification for an application developer;
determining, based on the classification, one or more tests to verify the classification;
assigning a job, based on the classification, to the developer, the job determined by a machine readable specification;
determining a quality of a completed job; and
updating the classification of the application developer based on the quality of the completed job.
2 . The method of claim 1 , wherein the updating comprises comparing the completed job to the machine readable specification.
3 . The method of claim 1 , wherein evaluating the developer comprises generating a test based on an experience of the developer.
4 . The method of claim 3 , wherein the test is further based on one or more pending machine readable specifications.
5 . The method of claim 3 , wherein evaluating further comprises:
automatically determining a result of the test; and
comparing the result to the classification.
6 . The method of claim 3 , further comprising determining a difficulty of the job based on the machine readable specification; and
wherein assigning comprises matching:
the job to the experience; and
the classification to the difficulty of the job.
7 . The method of claim 2 wherein the comparing is performed automatically by a computing system.
8 . A computer system configured to evaluate a developer for a device application, the computer system comprising:
a processor coupled to a memory, the processor configured to:
receive a classification for an application developer;
determine, based on the classification, one or more tests to verify the classification;
assign a job, based on the classification, to the developer, the job determined by a machine readable specification;
determine a quality of a completed job; and
update the classification of the application developer based on the quality of the completed job.
9 . The computer system of claim 8 , wherein the update comprises compare the completed job to the machine readable specification.
10 . The computer system of claim 8 , wherein evaluate the developer comprises generate a test based on an experience of the developer.
11 . The computer system of claim 10 , wherein the test is further based on one or more pending machine readable specifications.
12 . The computer system of claim 10 , wherein evaluate the developer further comprises:
automatically determine a result of the test; and
compare the result to the classification.
13 . The computer system of claim 10 , wherein the processor is further configured to determine a difficulty of the job based on the machine readable specification; and
wherein assign comprises the processor further configured to match:
the job to the experience; and
the classification to the difficulty of the job.
14 . The computer system of claim 9 , wherein the compare is performed automatically by the processor.
15 . A computer readable storage medium having data stored therein representing software executable by a computer, the software comprising instructions that, when executed, cause the computer readable storage medium to perform:
receiving a classification for an application developer;
determining, based on the classification, one or more tests to verify the classification;
assigning a job, based on the classification, to the developer, the job determined by a machine readable specification;
determining a quality of a completed job; and
updating the classification of the application developer based on the quality of the completed job.
16 . The computer readable storage medium of claim 15 , wherein the updating comprises comparing the completed job to the machine readable specification.
17 . The computer readable storage medium of claim 15 , wherein evaluating the developer comprises generating a test based on an experience of the developer.
18 . The computer readable storage medium of claim 17 , wherein the test is further based on one or more pending machine readable specifications.
19 . The computer readable storage medium of claim 17 , wherein evaluating further comprises:
automatically determining a result of the test; and
comparing the result to the classification.
20 . The computer readable storage medium of claim 16 , wherein the instructions further cause the computer readable storage medium to perform determining a difficulty of the job based on the machine readable specification; and
wherein assigning comprises matching:
the job to the experience; and
the classification to the difficulty of the job.