Analysis device, analysis system, analysis method, and computer-readable medium
One aspect of the present disclosure relates to an analysis device including one or more memories and one or more processors. The one or more processors are configured to estimate an arrangement region of a group of products of a same type based on a sales floor image, and notify information on a display state of the group of products in the arrangement region estimated.
1 . An analysis device, comprising:
one or more memories; and
one or more processors, wherein
the one or more processors are configured to:
estimate an arrangement region of a group of products having a same product name within a sales floor image, based on the sales floor image;
generate data to display boundary information indicating the estimated arrangement region of the group of products; and
notify a user terminal of information on a display state of the group of products in the arrangement region estimated, to display the arrangement region and the product name on the user terminal in a manner that visually associates the arrangement region with the product name by displaying, at the user terminal, the boundary information indicating the estimated arrangement region in visual association with the displayed product name, the information on the display state including both the product name of the group of products in the arrangement region and the generated data to display the boundary information indicating the estimated arrangement region.
2 . The analysis device according to claim 1 , wherein the sales floor image is a sales floor image including displayed products of multiple types, and the one or more processors estimate the arrangement region for each of the types based on the sales floor image including the products of multiple types.
3 . The analysis device according to claim 1 , wherein the one or more processors estimate, based on the arrangement region estimated, the display state in the arrangement region, and notify the information on the display state estimated.
4 . The analysis device according to claim 1 , wherein the one or more processors perform the estimation using a first trained machine learning model.
5 . The analysis device according to claim 4 , wherein the first trained machine learning model outputs, in response to input of the sales floor image including displayed products of multiple types, data indicating multiple arrangement regions respectively corresponding to the products of multiple types.
6 . The analysis device according to claim 4 , wherein the first trained machine learning model is a machine learning model that is trained through supervised learning using training data including the sales floor image and an annotation in relation to information of the arrangement region of the group of products.
7 . The analysis device according to claim 1 , wherein an image showing the arrangement region estimated is superimposed on the sales floor image.
8 . The analysis device according to claim 1 , wherein the user terminal is a terminal used in a store in which the sales floor image is taken.
9 . The analysis device according to claim 1 , wherein the information includes information indicating the arrangement region estimated.
10 . The analysis device according to claim 1 , wherein the sales floor image is a sales floor image from which a moving object is removed.
11 . The analysis device according to claim 1 , wherein the arrangement region of the group of products is a region where same products are disposed together.
12 . The analysis device according to claim 1 , wherein the one or more processors use a second trained machine learning model, and estimate either or both of a point and an orientation in a region of the products in the arrangement region estimated and estimate either or both of a number of products and an alignment degree of products of the group of products based on either or both of the point and the orientation estimated.
13 . The analysis device according to claim 1 , wherein in response to the display state satisfying a predetermined condition, the one or more processors notify the information on the display state, the information on the display state including information indicative of the estimated arrangement region.
14 . The analysis device according to claim 1 , wherein in response to determining that the estimated arrangement region has a small number of products, the one or more processors notify the estimated arrangement region of the group of products, the product name of the group of products, and a content of work for the arrangement region.
15 . An analysis system, comprising:
the analysis device according to claim 1 ; and
an image-taking device configured to take the sales floor image.
16 . An analysis method performed by one or more processors, the analysis method comprising:
estimating an arrangement region of a group of products having a same product name within a sales floor image, based on the sales floor image;
generating data to display boundary information indicating the estimated arrangement region of the group of products; and
notifying a user terminal of information on a display state of the group of products in the arrangement region estimated, to display the arrangement region and the product name on the user terminal in a manner that visually associates the arrangement region with the product name by displaying, at the user terminal, the boundary information indicating the estimated arrangement region in visual association with the displayed product name, the information on the display state including both the product name of the group of products in the arrangement region and the generated data to display the boundary information indicating the estimated arrangement region.
17 . A computer-readable medium that is non-transitory and stores a program that causes one or more processors to execute a process including:
estimating an arrangement region of a group of products having a same product name within a sales floor image, based on the sales floor image;
generating data to display boundary information indicating the estimated arrangement region of the group of products; and
notifying a user terminal of information on a display state of the group of products in the arrangement region estimated, to display the arrangement region and the product name on the user terminal in a manner that visually associates the arrangement region with the product name by displaying, at the user terminal, the boundary information indicating the estimated arrangement region in visual association with the displayed product name, the information on the display state including both the product name of the group of products in the arrangement region and the generated data to display the boundary information indicating the estimated arrangement region.
18 . The analysis device according to claim 1 , wherein the product name included in the notified information is information that uniquely identifies an individual product.
19 . The analysis device according to claim 1 , wherein the product name included in the notified display state is indicated by product identification information previously allocated to the product name.
20 . The analysis device according to claim 19 , wherein the product identification information is a product number previously allocated to the product name.
21 . The analysis device according to claim 1 , wherein the one or more processors are configured to associate the boundary information indicating the estimated arrangement region with the product name of the group of products in the estimated arrangement region, and generate the information including the boundary information indicating the estimated arrangement region associated with the product name.
22 . The analysis device according to claim 1 , wherein displaying the boundary information indicating the estimated arrangement region displays the boundary information adjacent to a display relating to the product name of the group of products in the estimated arrangement region.
23 . The analysis device according to claim 1 , wherein
the boundary information indicating the arrangement region is displayed on the user terminal in a manner that indicates a position of the group of products in a display shelf, and
the product name is displayed on the user terminal in a manner that visually indicates a correspondence between the boundary information indicating the arrangement region being displayed on the user terminal and the product name.
24 . The analysis device according to claim 1 , wherein the boundary information indicating the arrangement region is visually associated with the product name by displaying a mapping between the boundary information indicating the arrangement region and the product name.
25 . The analysis device according to claim 24 , wherein the mapping is indicated by displaying the product name adjacent to the boundary information indicating the arrangement region.
26 . The analysis device according to claim 1 , wherein
the one or more processors are configured to estimate arrangement regions of groups of products and generate the data to display each boundary information indicating a corresponding one of the estimated arrangement regions, each group of products having a same product name, within the sales floor image, based on the sales floor image, and
the estimated arrangement regions and respective product names of the groups of products are displayed in a manner that visually associates the boundary information indicating the corresponding one of the estimated arrangement regions with a corresponding one of the product names based on the generated data.
27 . The analysis device according to claim 1 , wherein
the one or more processors are configured to associate the arrangement region with each of the product name and at least two different types of information related to products having the product name, and
the arrangement region and the at least two different types of information are displayed in a manner that visually associates the boundary information indicating the arrangement region with each of the at least two different types of information.
28 . The analysis device according to claim 27 , wherein one of the at least two types of information relates to an amount of the products having the product name and another one of the at least two types of information relates to a position of the products having the product name.
29 . The analysis device according to claim 1 , wherein the sales floor image is taken by an image-taking device attached to a movable device moving around a sales floor.
30 . The analysis device according to claim 1 , wherein the one or more processors are configured to store log data related to the display state of the group of products in the arrangement region in association with the sales floor image.
31 . The analysis device according to claim 1 , wherein the boundary information displayed in the visual association with the product name is a boundary line enclosing the estimated arrangement region of the group of products having the product name.