Article deduction apparatus, article deduction method, and program

1. An article deduction apparatus comprising:

a memory storing instructions; and

a processor configured to execute the instructions to:

acquire weight change data being data based on a change in a detected value of a weight sensor provided on a shelf on which a plurality of articles can be placed and movement data indicating a movement of a hand of a person positioned in a shelf-front space being a space in front of the shelf;

output article determination information of the article deduced to be taken out by the hand, by using the weight change data and the movement data; and

cause a storage to store the article determination information in association with person determination information for determining the person, wherein the person determination information is a feature value of the face acquired from an image of a person.

2. The article deduction apparatus according to claim 1 , wherein the processor is further configured to execute the instructions to:

generate the movement data by using a detected value of a depth sensor a detection range of which includes the shelf-front space; and

when a relation between a height of a shelf in which a change in a detected value of the weight sensor has occurred and a detected value of a depth sensor that can acquire the movement data satisfies a criterion, output the article determination information associated with the shelf.

3. The article deduction apparatus according to claim 2 , wherein

a plurality of shelves with different heights exist,

at least one piece of the article determination information is associated with each of the plurality of shelves, and

the weight change data indicate a variation in a weight for each of the plurality of shelves.

4. The article deduction apparatus according to claim 1 , wherein

the processor is further configured to execute the instructions to output the article determination information associated with, out of a plurality of partial areas of the shelf, the partial area in which a change in a weight satisfies a criterion.

5. The article deduction apparatus according to claim 1 , wherein

the processor is further configured to execute the instructions to acquire the person determination information from a person tracking apparatus tracking a movement of the person.

6. The article deduction apparatus according to claim 1 , wherein the processor is further configured to execute the instructions to:

repeatedly acquire a first image being an image including at least part of the shelf-front space; and

deduce the article taken out by the hand, by further using an image of the article included in the first image.

7. The article deduction apparatus according to claim 2 , wherein the processor is further configured to execute the instructions to:

repeatedly acquire a second image being an image of the shelf captured from a front; and

determine the article determination information of the article taken out by the hand, by further using a change in the second image.

8. The article deduction apparatus according to claim 1 , wherein

a plurality of weight sensors are provided separately from one another on the shelf, and the processor is further configured to execute the instructions to generate the weight change data by using detected values of the plurality of weight sensors.

9. The article deduction apparatus according to claim 1 , wherein

the shelf is installed in a store,

the person is a customer, and

the processor is further configured to execute the instructions to:

perform checkout processing by using the article determination information; and

output an electronic receipt based on the checkout processing.

10. An article deduction method comprising, by a computer:

acquiring weight change data being data based on a change in a detected value of a weight sensor provided on a shelf on which a plurality of articles can be placed and movement data indicating a movement of a hand of a person positioned in a shelf-front space being a space in front of the shelf;

outputting article determination information of the article deduced to be taken out by the hand, by using the weight change data and the movement data; and

causing a storage to store the article determination information in association with person determination information for determining the person, wherein the person determination information is a feature value of the face acquired from an image of a person.

11. The article deduction method according to claim 10 , further comprising:

generating the movement data by using a detected value of a depth sensor a detection range of which includes the shelf-front space; and

when a relation between a height of a shelf in which a change in a detected value of the weight sensor has occurred and a detected value of a depth sensor that can acquire the movement data satisfies a criterion, outputting the article determination information associated with the shelf.

12. The article deduction method according to claim 10 , further comprising

outputting the article determination information associated with, out of a plurality of partial areas of the shelf, the partial area in which a change in a weight satisfies a criterion.

13. The article deduction method according to claim 10 , further comprising

acquiring the person determination information from a person tracking apparatus tracking a movement of the person.

14. The article deduction method according to claim 10 , further comprising:

repeatedly acquiring a first image being an image including at least part of the shelf-front space; and

deducing the article taken out by the hand, by further using an image of the article included in the first image.

15. The article deduction method according to claim 10 , wherein

a plurality of weight sensors are provided separately from one another on the shelf, and

the method further comprises generating the weight change data by using detected values of the plurality of weight sensors.

16. A non-transitory computer-readable medium storing a program for causing a computer to perform operations, the operations comprising:

acquiring weight change data being data based on a change in a detected value of a weight sensor provided on a shelf on which a plurality of articles can be placed and movement data indicating a movement of a hand of a person positioned in a shelf-front space being a space in front of the shelf;

outputting article determination information of the article deduced to be taken out by the hand, by using the weight change data and the movement data; and

causing a storage to store the article determination information in association with person determination information for determining the person, wherein the person determination information is a feature value of the face acquired from an image of a person.

17. The non-transitory computer-readable medium according to claim 16 , wherein the operations further comprise:

generating the movement data by using a detected value of a depth sensor a detection range of which includes the shelf-front space; and,

when a relation between a height of a shelf in which a change in a detected value of the weight sensor has occurred and a detected value of a depth sensor that can acquire the movement data satisfies a criterion, outputting the article determination information associated with the shelf.

18. The non-transitory computer-readable medium according to claim 16 , wherein

the operations further comprise outputting the article determination information associated with, out of a plurality of partial areas of the shelf, the partial area in which a change in a weight satisfies a criterion.

19. The non-transitory computer-readable medium according to claim 16 , wherein

the operations further comprise acquiring the person determination information from a person tracking apparatus tracking a movement of the person.

20. The non-transitory computer-readable medium according to claim 16 , wherein the operations further comprise:

repeatedly acquiring a first image being an image including at least part of the shelf-front space; and

deducing the article taken out by the hand, by further using an image of the article included in the first image.