Directional Guidance and Layout Compliance for Item Collection
A method in a mobile computing device includes: obtaining order collection data containing (i) item identifiers corresponding to a set of target items and a set of non-target items, (ii) a reference layout indicating, within a region of a facility, respective positions of the target items and the non-target items, and (iii) item recognition data for the target items and the non-target items; controlling an image sensor of the mobile computing device to acquire an image of a portion of the region; based on the item recognition data, detecting an item from the image; when the detected item is a target item, controlling an output assembly of the mobile computing device to present a prompt to collect the detected item; and when the detected item is a non-target item, controlling the output assembly to present a directional guide towards a selected target item based on the reference layout.
1 . A method in a mobile computing device, comprising:
obtaining order collection data containing (i) item identifiers corresponding to a set of target items and a set of non-target items, (ii) a reference layout indicating, within a region of a facility, respective positions of the target items and the non-target items, and (iii) item recognition data for the target items and the non-target items;
controlling an image sensor of the mobile computing device to acquire an image of a portion of the region;
based on the item recognition data, detecting an item from the image;
when the detected item is a target item, controlling an output assembly of the mobile computing device to present a prompt to collect the detected item; and
when the detected item is a non-target item, controlling the output assembly to present a directional guide towards a selected target item based on the reference layout.
2 . The method of claim 1 , further comprising:
controlling a display to present the acquired image;
wherein the prompt to collect the detected item includes an overlay on the image at the position of the detected item.
3 . The method of claim 1 , further comprising:
controlling a data capture module to scan the detected item; and
updating a collection status indicator associated with the detected item.
4 . The method of claim 3 , further comprising:
determining whether the collection status indicators of each of the target items indicate that the target items have been collected; and
when determination is affirmative, reporting completion to a server.
5 . The method of claim 1 , wherein controlling the output assembly to generate the directional prompt includes:
determining a position of the selected target item relative to the detected item from the reference layout; and
generating the directional prompt indicating a direction from the position of the detected item towards the position of the selected target item.
6 . The method of claim 1 , further comprising:
storing an item identifier of the detected item in an observed layout;
repeating the image sensor control and item detection to detect a further detected item; and
updating the observed layout with an item identifier of the further detected item.
7 . The method of claim 6 , further comprising:
determining the directional guide based on a comparison between the observed layout and the reference layout.
8 . The method of claim 6 , further comprising:
obtaining motion data from a motion sensor, the motion data indicating a direction of movement of the mobile computing device; and
determining a position of the further detected item based on the motion data.
9 . The method of claim 6 , further comprising:
determining that the observed layout does not match the reference layout; and
generating a non-compliance alert.
10 . A computing device, comprising:
an image sensor;
an output assembly; and
a processor configured to:
obtain order collection data containing (i) item identifiers corresponding to a set of target items and a set of non-target items, (ii) a reference layout indicating, within a region of a facility, respective positions of the target items and the non-target items, and (iii) item recognition data for the target items and the non-target items;
control the image sensor to acquire an image of a portion of the region;
based on the item recognition data, detect an item from the image;
when the detected item is a target item, control the output assembly to present a prompt to collect the detected item; and
when the detected item is a non-target item, control the output assembly to present a directional guide towards a selected target item based on the reference layout.
11 . The computing device of claim 10 , wherein the processor is further configured to:
control a display of the output assembly to present the acquired image;
wherein the prompt to collect the detected item includes an overlay on the image at the position of the detected item.
12 . The computing device of claim 1 , wherein the processor is further configured to:
control a data capture module to scan the detected item; and
update a collection status indicator associated with the detected item.
13 . The computing device of claim 3 , wherein the processor is further configured to:
determine whether the collection status indicators of each of the target items indicate that the target items have been collected; and
when determination is affirmative, report completion to a server.
14 . The computing device of claim 1 , wherein the processor is further configured, in order to control the output assembly to generate the directional prompt, to:
determine a position of the selected target item relative to the detected item from the reference layout; and
generate the directional prompt indicating a direction from the position of the detected item towards the position of the selected target item.
15 . The computing device of claim 1 , wherein the processor is further configured to:
store an item identifier of the detected item in an observed layout;
repeat the image sensor control and item detection to detect a further detected item; and
update the observed layout with an item identifier of the further detected item.
16 . The computing device of claim 6 , wherein the processor is further configured to:
determine the directional guide based on a comparison between the observed layout and the reference layout.
17 . The computing device of claim 6 , further comprising: a motion sensor;
wherein the processor is further configured to:
obtaining motion data from the motion sensor, the motion data indicating a direction of movement of the mobile computing device; and
determine a position of the further detected item based on the motion data.
18 . The computing device of claim 6 , wherein the processor is further configured to:
determine that the observed layout does not match the reference layout; and
generate a non-compliance alert.
19 . A non-transitory computer readable medium storing computer readable instructions executable by a processor to:
obtain order collection data containing (i) item identifiers corresponding to a set of target items and a set of non-target items, (ii) a reference layout indicating, within a region of a facility, respective positions of the target items and the non-target items, and (iii) item recognition data for the target items and the non-target items;
control an image sensor to acquire an image of a portion of the region;
based on the item recognition data, detect an item from the image;
when the detected item is a target item, control an output assembly to present a prompt to collect the detected item; and
when the detected item is a non-target item, control the output assembly to present a directional guide towards a selected target item based on the reference layout.