METHOD AND A SYSTEM FOR GENERATING A DIGITAL TASK LABEL BY MACHINE LEARNING ALGORITHM

1 . A computer-implemented method for generating a digital task label by a machine learning algorithm (MLA), the method being executable by a server communicatively coupled to a crowdsourced digital platform, the method comprising:

at a training phase:

acquiring, by the server, a digital training task to be executed on the crowdsourced digital platform;

acquiring, by the server, a plurality of digital training task labels responsive to the digital training task having been submitted by a plurality of workers of the crowdsourced digital platform, a given digital training label having been submitted by a given worker in response to a given digital training task using the crowdsourced digital platform;

acquiring, by the server, a worker activity history associated with each of the worker from the plurality of workers, the worker activity history including previously submitted digital task labels by each of the worker;

training, by the server, the MLA, the training including:

inputting, by the server, the digital training task into the MLA, the MLA being configured to generate a task vector representation corresponding to a vectorial representation of the digital training task;

inputting, by the server, the worker activity histories into the MLA, the MLA being configured to generate a respective worker vector representation corresponding to a vectorial representation of a given worker activity history for a given worker from the plurality of workers;

generating a triplet of training objects, the triplet of training object including: the task vector representation, a given worker vector representation and a given digital training task label associated with the given worker vector representation;

using the triplet of training objects to train the MLA to predict a given digital task label for a given digital task's task vector representation and a given worker vector representation;

at an in-use phase:

acquiring, by the server, the given digital task;

determining, by the server, the given digital task's task vector representation;

predicting, using the MLA, a plurality of digital task labels to the given digital task, based on a set of worker vector representations and the given digital task's task vector representation;

determining, by the server, the digital task label corresponding to at least one digital task label of the plurality of digital task labels to the given digital task.

2 . The method of claim 1 , wherein determining the digital task label comprises executing a majority vote of the plurality of digital task labels to the given digital task.

3 . The method of claim 1 , wherein the method further comprises determining for each of the worker of the plurality of workers, a respective quality score corresponding to a previous success rate in providing correct digital task labels, the previous success rate being determined based on the respective worker activity history.

4 . The method of claim 3 , wherein the set of worker vector representations comprises a subset of the plurality of workers meeting a predetermined condition.

5 . The method of claim 4 , wherein the predetermined condition corresponds to the subset of the plurality of workers comprising one or more workers having a previous success rate above a predetermined threshold.

6 . The method of claim 3 , wherein the given digital task is a first type of digital task, and the predetermined condition corresponds to the subset of the plurality of workers comprising one or more workers having a previous success rate above a predetermined threshold for the first type of digital task.

7 . The method of claim 1 , wherein generating the worker vector representation for the given worker comprises:

determining, for the given worker, a latent parameter indicative of a degree of bias of the given worker towards one or more latent features included within the digital training task, the latent parameter being determined by an analysis of a confusion matrix associated with the given worker;

generating the worker representation based on the latent parameter.

8 . The method of claim 7 , wherein generating the task vector representation of the training digital task comprises:

determining, for the training digital task, one or more latent features affecting the selection of the given training label by the given worker;

generating the task vector representation based on the one or more latent features.

9 . The method of claim 8 , wherein the one or more latent features include at least one of:

a font size associated with the content of the training digital task;

an image size associated with the content of the training digital task;

a number of possible selectable labels associated with the training digital task;

a location of the possible selectable labels within the content of the training digital task.

10 . A system for generating a digital task label by a machine learning algorithm (MLA), the system comprising a server communicatively coupled to a crowdsourced digital platform, the server comprising a processor configured to:

at a training phase:

acquire, a digital training task to be executed on the crowdsourced digital platform;

acquire, a plurality of digital training task labels responsive to the digital training task having been submitted by a plurality of workers of the crowdsourced digital platform, a given digital training label having been submitted by a given worker in response to a given digital training task using the crowdsourced digital platform;

acquire, a worker activity history associated with each of the worker from the plurality of workers, the worker activity history including previously submitted digital task labels by each of the worker;

train, the MLA, to train the MLA, the processor being configured to:

input, the digital training task into the MLA, the MLA being configured to generate a task vector representation corresponding to a vectorial representation of the digital training task;

input, the worker activity histories into the MLA, the MLA being configured to generate a respective worker vector representation corresponding to a vectorial representation of a given worker activity history for a given worker from the plurality of workers;

generate a triplet of training objects, the triplet of training object including: the task vector representation, a given worker vector representation and a given digital training task label associated with the given worker vector representation;

use the triplet of training objects to train the MLA to predict a given digital task label for a given digital task's task vector representation and a given worker vector representation;

at an in-use phase:

acquire, the given digital task;

determine, the given digital task's task vector representation;

predict, by executing the MLA, a plurality of digital task labels to the given digital task, based on a set of worker vector representations and the given digital task's task vector representation;

determine, the digital task label corresponding to at least one digital task label of the plurality of digital task labels to the given digital task.

11 . The system of claim 10 , wherein to determine the digital task label, the processor is configured to execute a majority vote of the plurality of digital task labels to the given digital task.

12 . The system of claim 10 , wherein the processor is further configured to determine for each of the worker of the plurality of workers, a respective quality score corresponding to a previous success rate in providing correct digital task labels, the previous success rate being determined based on the respective worker activity history.

13 . The system of claim 12 , wherein the set of worker vector representations comprises a subset of the plurality of workers meeting a predetermined condition.

14 . The system of claim 13 , wherein the predetermined condition corresponds to the subset of the plurality of workers comprising one or more workers having a previous success rate above a predetermined threshold.

15 . The system of claim 12 , wherein the given digital task is a first type of digital task, and the predetermined condition corresponds to the subset of the plurality of workers comprising one or more workers having a previous success rate above a predetermined threshold for the first type of digital task.

16 . The system of claim 10 , wherein to generate the worker vector representation for the given worker, the processor is configured to:

determine, for the given worker, a latent parameter indicative of a degree of bias of the given worker towards one or more latent features included within the digital training task, the latent parameter being determined by an analysis of a confusion matrix associated with the given worker;

generate the worker representation based on the latent parameter.

17 . The method of claim 16 , wherein to generate the task vector representation of the training digital task, the processor is configured to:

determine, for the training digital task, one or more latent features affecting the selection of the given training label by the given worker;

generate the task vector representation based on the one or more latent features.

18 . The method of claim 17 , wherein the one or more latent features include at least one of:

a font size associated with the content of the training digital task;

an image size associated with the content of the training digital task;

a number of possible selectable labels associated with the training digital task;

a location of the possible selectable labels within the content of the training digital task.