Domain adaptation and fusion using weakly supervised target-irrelevant data

1. A method comprising:

receiving, by a system comprising one or more processors, a request to perform an image classification task in a target domain, the image classification task including identifying a feature in images in the target domain;

transferring classification information related to the feature from a source domain contained in a source neural network to the target domain, the transferring comprising:

receiving a plurality of pairs of task-irrelevant images, each image pair comprising a task-irrelevant image in the source domain and a task-irrelevant image in the target domain, the task-irrelevant image in the source domain having a fixed correspondence to the task-irrelevant image in the target domain; and

training the source neural network based at least in part on labeled images in the source domain and concurrently training a target neural network to perform the image classification task in the target domain, the training based on the plurality of pairs of task-irrelevant images; and

performing the image classification task in the target domain, the performing including applying the target neural network to an image in the target domain and outputting an identified feature.

2. The method of claim 1 , wherein the fixed correspondence is a spatial relation.

3. The method of claim 1 , wherein the labeled images in the source domain include task-relevant images in the source domain.

4. The method of claim 3 , wherein labeled images in the source domain include simulated data.

5. The method of claim 1 , further comprising training a joint neural network using only the pairs of task-irrelevant images and task-relevant labeled data in the source domain.

6. The method of claim 1 , wherein the request is received from an integrated perception system (IPS) that monitors a geographic location and the identified feature is output to the IPS.

7. A system comprising:

a memory having computer readable instructions; and

one or more processors for executing the computer readable instructions, the computer readable instructions controlling the one or more processors to perform operations comprising:

receiving a request to perform an image classification task in a target domain, the image classification task including identifying a feature in images in the target domain;

transferring classification information related to the feature from a source domain contained in a source neural network to the target domain, the transferring comprising:

receiving a plurality of pairs of task-irrelevant images, each image pair comprising a task-irrelevant image in the source domain and a task-irrelevant image in the target domain, the task-irrelevant image in the source domain having a fixed correspondence to the task-irrelevant image in the target domain; and

training the source neural network based at least in part on labeled images in the source domain and concurrently training a target neural network to perform the image classification task in the target domain, the training based on the plurality of pairs of task-irrelevant images; and

performing the image classification task in the target domain, the performing including applying the target neural network to an image in the target domain and outputting an identified feature.

8. The system of claim 7 , wherein the fixed correspondence is a spatial relation.

9. The system of claim 7 , wherein the labeled images in the source domain include task-relevant images in the source domain.

10. The system of claim 9 , wherein labeled images in the source domain include simulated data.

11. The system of claim 7 , wherein the operations further comprise training a joint neural network using only the pairs of task-irrelevant images and task-relevant labeled data in the source domain.

12. The system of claim 7 , wherein the request is received from an integrated perception system (IPS) that monitors a geographic location and the identified feature is output to the IPS.

13. A computer program product comprising a non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by a processor to cause the processor to perform operations comprising:

receiving a request to perform an image classification task in a target domain, the image classification task including identifying a feature in images in the target domain;

transferring classification information related to the feature from a source domain contained in a source neural network to the target domain, the transferring comprising:

receiving a plurality of pairs of task-irrelevant images, each image pair comprising a task-irrelevant image in the source domain and a task-irrelevant image in the target domain, the task-irrelevant image in the source domain having a fixed correspondence to the task-irrelevant image in the target domain; and

training the source neural network based at least in part on labeled images in the source domain and concurrently training a target neural network to perform the image classification task in the target domain, the training based on the plurality of pairs of task-irrelevant images; and

performing the image classification task in the target domain, the performing including applying the target neural network to an image in the target domain and outputting an identified feature.

14. The computer program product of claim 13 , wherein the operations further comprise training a joint neural network using only the pairs of task-irrelevant images and task-relevant labeled data in the source domain.