IP Library Granted Patent US 10,636,024
Granted Patent B2
US 10,636,024 · App. 15/985,413 · Granted Apr 28, 2020

Self-service method and device

Inventors: Matthew Robert Scott (Shenzhen, CN); Dinglong Huang (Shenzhen, CN); Kai Fu (Shenzhen, CN)
Assignee: Shenzhen Malong Technologies Co., Ltd.
G06Q20/208G06F16/583G06K7/1092G06K9/00671G07G1/0036G07G1/0072G07G1/0081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,636,024
App. No.
15/985,413
Granted
Apr 28, 2020
Kind
B2
Abstract

Provided are a self-service method and device. The method includes: acquiring by a camera video data associated with a shopping cart at a distance from a shelf less than a preset value; determining whether an article is being placed into the shopping cart, based on identification of the video data; if yes, acquiring an ID of the shopping cart, determining the placed article and associating the ID with the article; displaying a total sum of all articles associated with the ID to the user when detecting the shopping cart corresponding to the ID is located in a preset payment area in the shopping mall; and executing a permitting procedure for allowing the shopping cart corresponding to the ID to pass upon reception of a message fed back from the payment area and indicating that the total sum corresponding to the ID has been cleared.

Claims (45)

1. A computer-implemented method, comprising:

in response to a shopping cart being within a preset distance from a shelf, acquiring video data associated with the shopping cart;

determining, based on the video data, an article being placed into the shopping cart;

determining one or more product types associated with the shelf at a present period of time;

retrieving pre-stored images of the one or more product types;

identifying a product type of the article based on a two-stage matching procedure, comprising (1) performing a first matching procedure between an image of the article and the pre-stored images of the one or more product types associated with the shelf at the present period of time; and (2) in response to a nonmatch at the first matching procedure, performing a second matching procedure between the image of the article and pre-stored images of all product types;

acquiring an ID of the shopping cart;

associating the ID of the shopping cart with the product type of the article;

in response to the shopping cart being in a payment area, displaying to a user the product type of the article based on the ID of the shopping cart; and

executing a permitting procedure for allowing the shopping cart to pass the payment area based on a payment of the article.

2. The method according to claim 1 , further comprising:

acquiring the ID of the shopping cart from an electronic tag reader associated with the shelf.

3. The method according to claim 1 , further comprising:

capturing the image of the article from the video data.

4. The method according to claim 1 , further comprising:

capturing the image of the article directly from the article.

5. The method according to claim 1 , further comprising:

in response to another nonmatch in the second matching procedure, generating a prompt message to prompt the user to make payment in an alternative method.

6. A system, comprising:

a camera configured to acquire, in response to a shopping cart being within a preset distance from a shelf, video data associated with the shopping cart;

a determining module configured to determine, based on the video data, an article being placed into the shopping cart;

an associating module configured to identify a product type of the article based on a two-stage matching procedure, comprising (1) performing a first matching procedure between an image of the article and pre-stored images of one or more product types associated with the shelf at a present period of time; and (2) in response to a nonmatch at the first matching procedure, performing a second matching procedure between the image of the article and pre-stored images of all product types;

a displaying module configured to display, in response to the shopping cart being in a payment area, to a user the product type of the article; and

an executing module configured to execute a permitting procedure for allowing the shopping cart to pass the payment area based on a payment of the article.

7. The system according to claim 6 , wherein

the associating module is further configured to

acquire an ID of the shopping cart via an electronic tag reader.

8. The system according to claim 6 , wherein the camera is further configured to

shoot the article to capture the image of the article.

9. The system according to claim 6 , wherein the camera is further configured to capture the image of the article from the video data.

10. The system according to claim 6 , further comprising:

a prompting module configured to generate a prompt message to prompt the user to make payment in an alternative method.

11. A non-transitory computer-readable medium storing a program causing a computer to execute a process, the process comprising:

in response to a shopping cart being within a preset distance from a shelf, acquiring video data associated with the shopping cart;

determining, based on the video data, an article being placed into the shopping cart;

capturing an image of the article from the video data;

determining one or more product types associated with the shelf at a present period of time;

retrieving pre-stored images of the one or more product types;

identifying a product type of the article based on a two-stage matching procedure, comprising (1) performing a first matching procedure between the image of the article and the pre-stored images of the one or more product types associated with the shelf at the present period of time; and (2) in response to a nonmatch at the first matching procedure, performing a second matching procedure between the image of the article and pre-stored images of all product types;

acquiring an ID of the shopping cart;

associating the ID of the shopping cart with the product type of the article;

in response to the shopping cart being in a payment area, displaying to a user the product type of the article based on the ID of the shopping cart; and

enabling, based on the product type of the article, the user to make a payment of the article.

12. The medium according to claim 11 , the process further comprising:

executing a permitting procedure for allowing the shopping cart to leave the payment area based on the payment of the article.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2022
From: SHENZHEN MALONG TECHNOLOGIES CO., LTD.
To: SHANGHAI YUEPU INVESTMENT CENTER (LIMITED PARTNERSHIP)
Reel/Frame 059786/0687 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2018
From: SCOTT, MATTHEW ROBERT; HUANG, DINGLONG; FU, KAI
To: SHENZHEN MALONG TECHNOLOGIES CO., LTD.
Reel/Frame 045870/0527 →
Priority Claims (1)
CN 2017 1 1204094 · Nov 27, 2017 · national
Continuity (1)
Related Publication 20190164142A1 · May 30, 2019