Method, system and apparatus for detecting item facings

1. A method by an imaging controller of detecting item facings from image sensor data, the method comprising:

obtaining, at the imaging controller, the image sensor data corresponding to a support structure containing at least one item;

identifying, by a feature detector of the imaging controller, a set of matched keypoint pairs from keypoints of the image sensor data;

determining, by a peak detector of the imaging controller, a separation distance between the keypoints of each matched keypoint pair;

detecting, by the peak detector, a count of item instances represented in the image sensor data based on the separation distances; and

presenting item facing detection output including the count of item instances.

2. The method of claim 1 , further comprising:

obtaining point cloud data corresponding to the image sensor data;

wherein determining the separation distance includes registering the matched keypoint pairs to the point cloud data.

3. The method of claim 1 , wherein identifying the matched keypoint pairs comprises:

generating, by the feature detector of the imaging controller, respective feature descriptors for a plurality of keypoints from the image sensor data; and

comparing the feature descriptors.

4. The method of claim 3 , wherein identifying the matched keypoint pairs further comprises, for each of a plurality of keypoint pairs:

determining a difference metric; and

when the difference metric is below a threshold, identifying the keypoint pair as a matched keypoint pair.

5. The method of claim 1 , further comprising:

allocating, by a boundary generator of the imaging controller, each keypoint to a cluster; and

generating an item boundary corresponding to the cluster;

wherein the item facing detection output includes the item boundary.

6. The method of claim 5 , wherein the allocating comprises:

assigning an affinity value to each of a plurality of pairs of the keypoints based on (i) whether the pair is a matched keypoint pair, and (ii) the separation distance between the pair.

7. The method of claim 1 , wherein detecting the count of item instances comprises:

for each separation distance, incrementing a corresponding one of a set of histogram scores; and

detecting at least one peak in the set of histogram scores.

8. The method of claim 1 , wherein the separation distance is a separation distance in a first physical dimension associated with the support structure.

9. The method of claim 8 , further comprising:

determining, by the peak detector, a further separation distance for each matched keypoint pair in a second physical dimension associated with the support structure; and

detecting, by the peak detector, a count of item instances represented in the image sensor data based on the separation distances in the first and second physical dimensions.

10. A computing device, comprising:

a feature detector configured to:

obtain image sensor data corresponding to a support structure containing at least one item; and

identify a set of matched keypoint pairs from keypoints of the image sensor data;

a peak detector configured to:

determine a separation distance between the keypoints of each matched keypoint pair;

detect a count of item instances represented in the image sensor data based on the separation distances; and

a boundary generator configured to present item facing detection output including the count of item instances.

11. The computing device of claim 10 , wherein the feature detector is further configured to:

obtain point cloud data corresponding to the image sensor data; and

in order to determine the separation distance, register the matched keypoint pairs to the point cloud data.

12. The computing device of claim 10 , wherein the feature detector is configured, in order to identify the matched keypoint pairs, to:

generate respective feature descriptors for a plurality of keypoints from the image sensor data; and

compare the feature descriptors.

13. The computing device of claim 12 , wherein the feature detector is further configured, in order to identify the matched keypoint pairs, to:

for each of a plurality of keypoint pairs, determine a difference metric; and

when the difference metric is below a threshold, identify the keypoint pair as a matched keypoint pair.

14. The computing device of claim 10 , wherein the boundary generator is further configured to:

allocate each keypoint to a cluster; and

generate an item boundary corresponding to the cluster;

wherein the item facing detection output includes the item boundary.

15. The computing device of claim 14 , wherein the boundary generator is further configured, in order to allocate each keypoint to a cluster, to:

assign an affinity value to each of a plurality of pairs of the keypoints based on (i) whether the pair is a matched keypoint pair, and (ii) the separation distance between the pair.

16. The computing device of claim 10 , wherein the peak detector is further configured, in order to detect the count of item instances, to:

for each separation distance, increment a corresponding one of a set of histogram scores; and

detect at least one peak in the set of histogram scores.

17. The computing device of claim 10 , wherein the separation distance is a separation distance in a first physical dimension associated with the support structure.

18. The computing device of claim 17 , wherein the peak detector is further configured to:

determine a further separation distance for each matched keypoint pair in a second physical dimension associated with the support structure; and

detect a count of item instances represented in the image data based on the separation distances in the first and second physical dimensions.

19. A non-transitory computer-readable medium storing computer executable instructions that when executed by a processor cause the processor to perform the operations of:

obtaining image sensor data corresponding to a support structure containing at least one item;

identifying a set of matched keypoint pairs from keypoints of the image sensor data;

determining a separation distance between the keypoints of each matched keypoint pair;

detecting a count of item instances represented in the image sensor data based on the separation distances; and

presenting item facing detection output including the count of item instances.

20. The non-transitory computer-readable medium of claim 19 , wherein the instructions further comprise:

for each separation distance, incrementing a corresponding one of a set of histogram scores; and

detecting at least one peak in the set of histogram scores.