Non-transitory computer readable recording medium, setting method, detection method, setting apparatus, and detection apparatus
A non-transitory computer-readable recording medium has stored therein a setting program that causes a computer to execute a process, the process including acquiring a video from a camera, identifying a depth indicating a distance from the camera to each of constituent elements of the video acquired from the camera, generating a three-dimensional in-store model, generating skeleton information on a person who moves inside the store from the video acquired from the camera, setting a range and a direction of an aisle in the store in the generated three-dimensional in-store model based on a change in the generated skeleton information and setting a detection line in the storage based on the range and the direction of the aisle in the store, the detection line for detecting that the person has extended a hand to a product.
1. A non-transitory computer-readable recording medium having stored therein a setting program that causes a computer to execute a process, the process comprising:
acquiring a video from a camera that is set in a store that has a storage in which a product is stored;
identifying a depth indicating a distance from the camera to each of constituent elements of the video acquired from the camera, by inputting the acquired video into a machine learning model;
generating a three-dimensional in-store model that is configured with the identified depth indicating the distance from the camera to each of the constituent elements of the video;
generating skeleton information on a person who moves inside the store from the video acquired from the camera;
setting a range and a direction of an aisle in the store in the generated three-dimensional in-store model based on a change in the generated skeleton information; and
setting a detection line in the storage based on the range and the direction of the aisle in the store, the detection line for detecting that the person has extended a hand to a product.
2. The non-transitory computer-readable recording medium according to claim 1 , wherein the setting the range and the direction of the aisle in the store includes
identifying a change of a position of a foot included in the skeleton information on the person; and
setting, as the range of the aisle, a polygon that includes a change of the identified position of the foot.
3. The non-transitory computer-readable recording medium according to claim 1 , wherein the setting the range and the direction of the aisle in the store includes
identifying a change of a position of a foot included in the skeleton information on the person; and
setting the direction based on a displacement directional vector that is based on the change of the position of the foot.
4. A non-transitory computer-readable recording medium having stored therein a detection program that causes a computer to execute a process, the process comprising:
identifying a detection line for detecting that a person has extended a hand to a product, the detection line being included in setting information, the setting information being set in a storage, based on range and a direction of an aisle in a store, the range and the direction being included in a three-dimensional in-store model that is configured with a depth indicating a distance from a camera that is set in the store to each of constituent elements of a video from the camera;
identifying a part corresponding to a hand of the person based on skeleton information on the person generated from a video in which an inside of the store is captured; and
detecting that the person has extended the hand to a product that is stored in the storage, based on a positional relationship between the identified part corresponding to the hand of the person and the detection line included in the setting information.
5. A setting method comprising:
acquiring a video from a camera that is set in a store that has a storage in which a product is stored;
identifying a depth indicating a distance from the camera to each of constituent elements of the video acquired from the camera, by inputting the acquired video into a machine learning model;
generating a three-dimensional in-store model that is configured with the identified depth indicating the distance from the camera to each of the constituent elements of the video;
generating skeleton information on a person who moves inside the store from the video acquired from the camera;
setting a range and a direction of an aisle in the store in the generated three-dimensional in-store model based on a change in the generated skeleton information; and
setting a detection line in the storage based on the range and the direction of the aisle in the store, the detection line for detecting that the person has extended a hand to a product, by using a processor.
6. The setting method according to claim 5 , wherein the setting the range and the direction of the aisle in the store includes
identifying a change of a position of a foot included in the skeleton information on the person; and
setting, as the range of the aisle, a polygon that includes a change of the identified position of the foot.
7. The setting method according to claim 5 , wherein setting the range and the direction of the aisle in the store includes
identifying a change of a position of a foot included in the skeleton information on the person; and
setting the direction based on a displacement directional vector that is based on the change of the position of the foot.
8. A setting apparatus comprising:
a memory; and
a processor coupled to the memory and configured to:
acquire a video from a camera that is set in a store that has a storage in which a product is stored;
identify a depth indicating a distance from the camera to each of constituent elements of the video acquired from the camera, by inputting the acquired video into a machine learning model;
generate a three-dimensional in-store model that is configured with the identified depth indicating the distance from the camera to each of the constituent elements of the video;
generate skeleton information on a person who moves inside the store from the video acquired from the camera;
set a range and a direction of an aisle in the store in the generated three-dimensional in-store model based on a change in the generated skeleton information; and
set a detection line in the storage based on the range and the direction of the aisle in the store, the detection line for detecting that the person has extended a hand to a product.
9. The setting apparatus according to claim 8 , wherein the processor is further configured to
identify a change of a position of a foot included in the skeleton information on the person; and
set, as the range of the aisle, a polygon that includes a change of the identified position of the foot.
10. A setting apparatus according to claim 8 , wherein the processor is further configured to
identify a change of a position of a foot included in the skeleton information on the person; and
set the direction based on a displacement directional vector that is based on the change of the position of the foot.