Frictionless and unassisted return processing
Images capture an object that a person carries into a frictionless store as a potential frictionless return item. When the potential frictionless return item is placed on a shelf or a countertop in a designated area, the potential frictionless return item is identified as a returned item. A transaction history linked to an account of the person is retrieved and the returned item matched to a previously purchased item in the transaction history. Assuming return conditions are met, the account is automatically credited an item price associated with the previously purchased item and a user interface is automatically initiated on a registered mobile device of the person providing a receipt for the refund and the return. The person may then leave the store or continue shopping in the frictionless store and the person and any items taken by the person are tracked for frictionless purchase.
1 . A method, performed by a server that comprises a set of trackers including an item tracker, a person tracker, and a pose tracker, the method comprising:
tracking a registered consumer and an item held by the registered consumer upon entry of the registered consumer into a frictionless store, wherein the item is a potential item associated with the frictionless store, wherein tracking the registered consumer comprises controlling a camera to capture images of the registered consumer, at least one image capturing the registered consumer placing the item in a designated area of the frictionless store;
performing, using the person tracker, image recognition on the images, wherein the image recognition causes the registered consumer to be identified and distinguished from at least one other consumer;
identifying, using the pose tracker, limbs of the registered consumer in successive frames of the images;
tracking, using the set of trackers, the limbs of the registered consumer and the item across consecutive frames of the images;
monitoring, using the set of trackers, a bounding box placed around the registered consumer within the images to enable identification of attributes associated with the registered consumer;
identifying, using the person tracker and the pose tracker, a direction of movement of the registered consumer within the frictionless store;
determining, using the item tracker in cooperation with the pose tracker, an item identifier associated with the item, based on the tracking of the identified limbs of the registered consumer and the item across successive frames;
assigning an item code associated with the item identifier when the item is placed in the designated area of the frictionless store by the registered consumer;
verifying that the item code is associated with a previous purchase made by the registered consumer at the frictionless store; and
processing a refund for an item price associated with the previous purchase, without any action required of the registered consumer, by automatically crediting an account of the registered consumer.
2 . The method of claim 1 further comprising:
sending a receipt for the refund to a mobile application processing on a mobile device operated by the registered consumer.
3 . The method of claim 1 further comprising:
detecting the registered consumer at a transaction terminal; and
causing currency to be dispensed from the transaction terminal to complete the refund when the registered consumer has requested currency as a refund type for the refund.
4 . The method of claim 1 , wherein processing the refund further includes monitoring the registered consumer after leaving the designated area, and applying a credit representing the item price against any other item prices for other items that the registered consumer carries out of the frictionless store by using the account that was credited the refund.
5 . The method of claim 1 , wherein verifying further includes ensuring that the item code conforms to a refund policy associated with the frictionless store or the previous purchase.
6 . The method of claim 5 , wherein ensuring further includes sending a message to a mobile device operated by the registered consumer providing an explanation when the item code fails to conform to the refund policy, and instructing the registered consumer to take the item back from the designated area.
7 . The method of claim 1 , wherein verifying further includes retrieving a transaction history for the registered consumer for a predefined period of time, and matching the item code in the transaction history to the previous purchase.
8 . The method of claim 1 , wherein processing the refund further includes instructing the registered consumer through a user interface of a mobile device operated by the registered consumer to travel to a transaction terminal of the frictionless store to receive the refund.
9 . The method of claim 8 further comprising:
detecting the registered consumer standing in front of the transaction terminal through at least one of the images; and
instructing the transaction terminal to dispense a cash and coin amount for the refund to the registered consumer.
10 . The method of claim 1 , wherein tracking the registered consumer further includes identifying a second item picked up by the registered consumer before reaching the designated area, and obtaining second item information for the second item.
11 . The method of claim 10 , wherein processing the refund further includes applying a credit amount equal to the refund against a price associated with the second item based on the second item information and updating the account accordingly.