Active learning system and method
Disclosed are systems and methods for training an active learning system. In one example, a method for training an active learning system includes the steps of generating a point cloud based on a first image captured at a first pose, projecting the point cloud into a second image captured at a second pose to determine an overlap ratio between the point cloud and the second image, and using the second image to train the active learning system based on probabilities associated with the points of the point cloud projected into the second image and the overlap ratio.
1 . An active learning system comprising:
a processor; and
a memory in communication with the processor, the memory including a training module with instructions that, when executed by the processor, cause the processor to:
generate a point cloud based on a first image captured at a first pose, wherein the point cloud comprises a plurality of points having probabilities associated with the points, the probabilities indicating a confidence that the points are correctly providing depth,
project the point cloud into a second image comprising an adjacent frame with respect to the first image captured at a second pose to determine an overlap ratio between the point cloud and the second image, and
use the second image to train the active learning system in a self-supervised fashion when (i) an overall confidence of the point cloud determined from the probabilities satisfies a confidence criterion and (ii) the overlap ratio satisfies an overlap criterion.
2 . The active learning system of claim 1 , wherein the training module further includes instructions that, when executed by the processor, cause the processor to use the second image to train the active learning system when the overlap ratio is above a lower threshold and below an upper threshold.
3 . The active learning system of claim 1 , wherein the overlap ratio is a percent of pixels of the second image that the point cloud projects onto.
4 . The active learning system of claim 1 , wherein the training module further includes instructions that, when executed by the processor, cause the processor to use the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are below a probability threshold.
5 . The active learning system of claim 1 , wherein the training module further includes instructions that, when executed by the processor, cause the processor to move the active learning system to a third pose based on at least one of the probabilities associated with the points of the point cloud projected into the second image and the overlap ratio.
6 . The active learning system of claim 5 , wherein the training module further includes instructions that, when executed by the processor, cause the processor to:
not use the second image to train the active learning system when the overlap ratio is below a lower threshold or above an upper threshold, and
move the active learning system to the third pose.
7 . The active learning system of claim 5 , wherein the training module further includes instructions that, when executed by the processor, cause the processor to:
not use the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are above a probability threshold and
move the active learning system to the third pose.
8 . A method for training an active learning system comprising steps of:
generating a point cloud based on a first image captured at a first pose, wherein the point cloud comprises a plurality of points having probabilities associated with the points, the probabilities indicating a confidence that the points are correctly providing depth;
projecting the point cloud into a second image comprising an adjacent frame with respect to the first image captured at a second pose to determine an overlap ratio between the point cloud and the second image; and
using the second image to train the active learning system in a self-supervised fashion when (i) an overall confidence of the point cloud determined from the probabilities satisfies a confidence criterion and (ii) the overlap ratio satisfies an overlap criterion.
9 . The method of claim 8 , further comprising the step of using the second image to train the active learning system when the overlap ratio is above a lower threshold and below an upper threshold.
10 . The method of claim 8 , wherein the overlap ratio is a percent of pixels of the second image that the point cloud projects onto.
11 . The method of claim 8 , further comprising the step of using the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are below a probability threshold.
12 . The method of claim 8 , further comprising the step of moving the active learning system to a third pose based on at least one of the probabilities associated with the points of the point cloud projected into the second image and the overlap ratio.
13 . The method of claim 12 , further comprising the steps of:
not using the second image to train the active learning system when the overlap ratio is below a lower threshold or above an upper threshold; and
moving the active learning system to the third pose.
14 . The method of claim 12 , further comprising the steps of:
not using the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are above a probability threshold; and
moving the active learning system to the third pose.
15 . A non-transitory computer-readable medium including instructions for training an active learning system, the instructions, when executed by a processor, cause the processor to:
generate a point cloud based on a first image captured at a first pose, wherein the point cloud comprises a plurality of points having probabilities associated with the points, the probabilities indicating a confidence that the points are correctly providing depth;
project the point cloud into a second image comprising an adjacent frame with respect to the first image captured at a second pose to determine an overlap ratio between the point cloud and the second image; and
use the second image to train the active learning system in a self-supervised fashion when (i) an overall confidence of the point cloud determined from the probabilities satisfies a confidence criterion and (ii) the overlap ratio satisfies an overlap criterion.
16 . The non-transitory computer-readable medium of claim 15 , further including instructions that, when executed by the processor, cause the processor to use the second image to train the active learning system when the overlap ratio is above a lower threshold and below an upper threshold.
17 . The non-transitory computer-readable medium of claim 15 , further including instructions that, when executed by the processor, cause the processor to use the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are below a probability threshold.
18 . The non-transitory computer-readable medium of claim 15 , further including instructions that, when executed by the processor, cause the processor to move the active learning system to a third pose based on at least one of the probabilities associated with the points of the point cloud projected into the second image and the overlap ratio.
19 . The non-transitory computer-readable medium of claim 18 , further including instructions that, when executed by the processor, cause the processor to:
not use the second image to train the active learning system when the overlap ratio is below a lower threshold or above an upper threshold; and
move the active learning system to the third pose.
20 . The non-transitory computer-readable medium of claim 18 , further including instructions that, when executed by the processor, cause the processor to:
not use the second image to train the active learning system when the probabilities associated with the points of the point cloud projected into the second image are above a probability threshold; and
move the active learning system to the third pose.