Visual recognition and sensor fusion weight detection system and method
Disclosed are visual recognition and sensor fusion weight detection system and method. An example method includes: tracking, by a sensor system, objects and motions within a selected area of a store; activating, by the sensor system, a first computing device positioned in the selected area in response to detecting a presence of a customer within the selected area: identifying, by the sensor system, the customer and at least one item carried by the customer; transmitting, by the sensor system, identifying information of the customer and the at least one item to a computing server system via a communication network; measuring, by the first computing device, a weight of the at least one item; transmitting, by the first computing device, the weight to the computing server system via the communication network; and generating, by the computing server system, via the communication network, transaction information of the at least one item.
1. A method, performed by a computer system comprising a processor and a non-transitory computer-readable medium, comprising:
detecting a location of a user within a region based on sensor data captured by a plurality of sensors of a weight detection system;
determining that the user is within a threshold distance of a computing device of the weight detection system based on the detected location of the user;
responsive to determining that the user is within the threshold distance of the computing device, activating the computing device to measure a weight of an item;
weighing an item using the computing device;
identifying the item based on the weight of the item and based on an image captured by a camera of the weight detection system; and
transmitting identifying information of the item to a computing server system of the of the weight detection system via a communication network.
2. The method of claim 1 , wherein determining that the user is within the threshold distance of the computing device comprises:
determining that the user is within the threshold distance of the computing device for a threshold period of time.
3. The method of claim 1 , wherein the region is a selected area within a store.
4. The method of claim 3 , wherein the selected area within the store is a visually-designated area within the store.
5. The method of claim 1 , wherein the plurality of sensors comprises a weight sensor or an infrared sensor.
6. The method of claim 1 , wherein detecting the location of the user comprises:
applying a visual recognition algorithm to an image captured by a camera.
7. The method of claim 1 , wherein the computing device is a device that is coupled to a shopping cart.
8. The method of claim 1 , further comprising:
identifying the user based on the sensor data captured by the plurality of sensors.
9. The method of claim 1 , wherein identifying the item comprises:
identifying a motion of the item based on the sensor data.
10. The method of claim 1 , further comprising:
transmitting the weight of the item to the computing server system.
11. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform operations comprising:
detecting a location of a user within a region based on sensor data captured by a plurality of sensors of a weight detection system;
determining that the user is within a threshold distance of a computing device of the weight detection system based on the detected location of the user;
responsive to determining that the user is within the threshold distance of the computing device, activating the computing device to measure a weight of an item;
weighing an item using the computing device;
identifying the item based on the weight of the item and based on an image captured by a camera of the weight detection system; and
transmitting identifying information of the item to a computing server system of the of the weight detection system via a communication network.
12. The computer-readable medium of claim 11 , wherein determining that the user is within the threshold distance of the computing device comprises:
determining that the user is within the threshold distance of the computing device for a threshold period of time.
13. The computer-readable medium of claim 11 , wherein the region is a selected area within a store.
14. The computer-readable medium of claim 13 , wherein the selected area within the store is a visually-designated area within the store.
15. The computer-readable medium of claim 11 , wherein the plurality of sensors comprises a weight sensor or an infrared sensor.
16. The computer-readable medium of claim 11 , wherein detecting the location of the user comprises:
applying a visual recognition algorithm to an image captured by a camera.
17. The computer-readable medium of claim 11 , wherein the computing device is a device that is coupled to a shopping cart.
18. The computer-readable medium of claim 11 , the operations further comprising:
identifying the user based on the sensor data captured by the plurality of sensors.
19. The computer-readable medium of claim 11 , wherein identifying the item comprises:
identifying a motion of the item based on the sensor data.
20. The computer-readable medium of claim 11 , the operations further comprising:
transmitting the weight of the item to the computing server system.