IP Library › Granted Patent US 12,272,116
Granted Patent B2
US 12,272,116 · App. 17/728,762 · Granted Apr 8, 2025

Method and apparatus for determining item name, computer device, and storage medium

Inventors: Yugeng Lin (Shenzhen, CN); Dianping Xu (Shenzhen, CN); Bolun Cai (Shenzhen, CN); Yanhua Cheng (Shenzhen, CN); Chen Ran (Shenzhen, CN); Minhui Wu (Shenzhen, CN); Mei Jiang (Shenzhen, CN); Yike Liu (Shenzhen, CN); Lijian Mei (Shenzhen, CN); Huajie Huang (Shenzhen, CN); Xiaoyi Jia (Shenzhen, CN); Jinchang Xu (Shenzhen, CN); Zhikang Tan (Shenzhen, CN); Haoyu Li (Shenzhen, CN)
Assignee: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
G06V10/761G06F16/55G06F16/56G06F16/5866G06T7/0002G06V10/267G06V10/764G06V30/158G06V30/19107G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,272,116
App. No.
17/728,762
Granted
Apr 8, 2025
Kind
B2
Abstract

A method includes: obtaining a first image including a target item; selecting a plurality of reference images corresponding to the first image from a database; performing word segmentation on item text information corresponding to the plurality of reference images to obtain a plurality of words; and extracting a key word meeting a reference condition from the plurality of words, and determining the extracted key word as an item name of the target item.

Claims (83)

1. A method for determining an item name of a target item, applied to a computing device, the method comprising:

obtaining a first image including the target item;

selecting a plurality of reference images according to the first image from a database, the database including a plurality of images and item information corresponding to the plurality of images, the item information corresponding to the images being used for describing items included in the images, and the item information corresponding to the images including item text information;

performing word segmentation on the item text information corresponding to the plurality of reference images to obtain a plurality of words; and

extracting a key word meeting a reference condition from the plurality of words, and determining the extracted key word as the item name of the target item,

wherein performing the word segmentation comprises:

performing clustering processing on the plurality of reference images to obtain a plurality of image stacks, each image stack including at least two reference images;

obtaining a similarity between each image stack and the first image according to similarities between reference images in each image stack and the first image;

selecting an image stack having a highest similarity with the first image from the plurality of image stacks, and determining the selected image stack as a target image stack; and

performing word segmentation on item text information corresponding to the plurality of reference images in the target image stack to obtain a plurality of words.

2. The method according to claim 1 , wherein extracting the key word comprises:

determining an average value of word vectors of the plurality of words as a center vector; and

determining a distance between each word vector in the word vectors and the center vector, and determining a word corresponding to a word vector having a smallest distance as the key word meeting the reference condition.

3. The method according to claim 1 , wherein performing the word segmentation further comprises:

performing word segmentation on the item text information corresponding to the plurality of reference images according to a plurality of reference lengths, to obtain a word whose length is equal to each reference length separately.

4. The method according to claim 1 , wherein extracting the key word comprises:

determining appearance frequency of the plurality of words in the item text information corresponding to the plurality of reference images; and

selecting, from the plurality of words, a word having a largest length and whose appearance frequency is higher than a first threshold, and determining the selected word as the key word meeting the reference condition; or

selecting, from the plurality of words, a word having the highest appearance frequency, and determining the selected word as the key word meeting the reference condition.

5. The method according to claim 1 , wherein obtaining the first image comprises:

obtaining an original image including the target item;

performing item detection on the original image to determine a region in which the target item is located in the original image; and

extracting an image of the region from the original image to obtain the first image.

6. The method according to claim 1 , wherein the database includes images belonging to a plurality of categories; and selecting the plurality of reference images comprises:

determining a target category to which the first image belongs; and

selecting a plurality of reference images belonging to the target category and according to the first image from the database.

7. The method according to claim 6 , wherein determining the target category comprises:

obtaining a similarity between each category in the plurality of categories and the first image separately; and

determining a category having a highest similarity with the first image in the plurality of categories as the target category.

8. The method according to claim 7 , wherein the database includes a plurality of sub-databases, different sub-databases correspond to different categories, and each sub-database includes at least one image belonging to a corresponding category and item information corresponding to the at least one image; and

obtaining the similarity comprises:

for each sub-database in the plurality of sub-databases, performing:

obtaining a similarity between each image in the sub-database and the first image;

selecting a plurality of second images from the sub-database according to the similarity between each image and the first image, a similarity between the second image and the first image being higher than a similarity between another image in the sub-database and the first image; and

determining an average similarity corresponding to the plurality of second images, and determining the average similarity as a similarity between a category corresponding to the sub-database and the first image.

9. The method according to claim 1 , wherein performing the clustering processing comprises:

establishing an association relationship between any two reference images in response to that a similarity between any two reference images in the plurality of reference images is higher than a second threshold; and

forming reference images having an association relationship in the plurality of reference images into an image stack, to obtain the plurality of image stacks.

10. The method according to claim 1 , further comprising:

performing searching according to the item name, to obtain item information corresponding to the item name; and

displaying the item information in a current display interface.

11. The method according to claim 10 , further comprising:

selecting a reference image having a highest quality score from the plurality of reference images, and using the selected reference image as a presentation image of the target item; and

displaying the presentation image in the display interface.

12. An apparatus for determining an item name of a target item, the apparatus comprising: a memory storing computer program instructions; and a processor coupled to the memory and configured to execute the computer program instructions and perform:

obtaining a first image including the target item;

selecting a plurality of reference images according to the first image from a database, the database including a plurality of images and item information corresponding to the plurality of images, the item information corresponding to the images being used for describing items included in the images, and the item information corresponding to the images including item text information;

performing word segmentation on the item text information corresponding to the plurality of reference images to obtain a plurality of words; and

extracting a key word meeting a reference condition from the plurality of words, and determining the extracted key word as the item name of the target item,

wherein performing the word segmentation comprises:

performing clustering processing on the plurality of reference images to obtain a plurality of image stacks, each image stack including at least two reference images;

obtaining a similarity between each image stack and the first image according to similarities between reference images in each image stack and the first image;

selecting an image stack having a highest similarity with the first image from the plurality of image stacks, and determining the selected image stack as a target image stack; and

performing word segmentation on item text information corresponding to the plurality of reference images in the target image stack to obtain a plurality of words.

13. The apparatus of claim 12 , wherein extracting the key word includes:

determining an average value of word vectors of the plurality of words as a center vector; and

determining a distance between each word vector in the word vectors and the center vector, and determining a word corresponding to a word vector having a smallest distance as the key word meeting the reference condition.

14. The apparatus of claim 12 , wherein performing the word segmentation further includes:

performing word segmentation on the item text information corresponding to the plurality of reference images according to a plurality of reference lengths, to obtain a word whose length is equal to each reference length separately.

15. The apparatus of claim 12 , wherein extracting the key word includes:

determining appearance frequency of the plurality of words in the item text information corresponding to the plurality of reference images; and

selecting, from the plurality of words, a word having a largest length and whose appearance frequency is higher than a first threshold, and determining the selected word as the key word meeting the reference condition; or

selecting, from the plurality of words, a word having the highest appearance frequency, and determining the selected word as the key word meeting the reference condition.

16. The apparatus of claim 12 , wherein obtaining the first image includes:

obtaining an original image including the target item;

performing item detection on the original image to determine a region in which the target item is located in the original image; and

extracting an image of the region from the original image to obtain the first image.

17. The apparatus of claim 12 , wherein the database includes images belonging to a plurality of categories; and selecting the plurality of reference images includes:

determining a target category to which the first image belongs; and

selecting a plurality of reference images belonging to the target category and according to the first image from the database.

18. The apparatus of claim 12 , wherein determining the target category includes:

obtaining a similarity between each category in the plurality of categories and the first image separately; and

determining a category having a highest similarity with the first image in the plurality of categories as the target category.

19. A non-transitory computer-readable storage medium storing computer program instructions executable by at least one processor to perform:

obtaining a first image including the target item;

selecting a plurality of reference images according to the first image from a database, the database including a plurality of images and item information corresponding to the plurality of images, the item information corresponding to the images being used for describing items included in the images, and the item information corresponding to the images including item text information;

performing word segmentation on the item text information corresponding to the plurality of reference images to obtain a plurality of words; and

extracting a key word meeting a reference condition from the plurality of words, and determining the extracted key word as the item name of the target item,

wherein performing the word segmentation comprises:

performing clustering processing on the plurality of reference images to obtain a plurality of image stacks, each image stack including at least two reference images;

obtaining a similarity between each image stack and the first image according to similarities between reference images in each image stack and the first image;

selecting an image stack having a highest similarity with the first image from the plurality of image stacks, and determining the selected image stack as a target image stack; and

performing word segmentation on item text information corresponding to the plurality of reference images in the target image stack to obtain a plurality of words.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 25, 2022
From: LIN, YUGENG; XU, DIANPING; CAI, BOLUN; CHENG, YANHUA; RAN, CHEN; WU, MINHUI; JIANG, MEI; LIU, YIKE; MEI, LIJIAN; HUANG, HUAJIE; JIA, XIAOYI; XU, JINCHANG; TAN, ZHIKANG; LI, HAOYU
To: TENCENT TECHNOLOGY (SHENZHEN) COMPANY LIMITED
Reel/Frame 059791/0134 →
Priority Claims (1)
CN 202010299942.X · Apr 16, 2020 · national
Continuity (2)
Continuation PCTCN2021079510 · Mar 8, 2021
Related Publication 20220254143A1 · Aug 11, 2022
References Cited (19)
US 10706098B1 · Ramesh · 2020 [cited by examiner]
US 11037307B2 · Chen et al. · 2021 [cited by applicant]
US 20070168357A1 · Mo · 2007 [cited by examiner]
US 20090164213A1 · Lennington · 2009 [cited by examiner]
US 20130138636A1 · Jin · 2013 [cited by examiner]
US 20140355825A1 · Kim et al. · 2014 [cited by applicant]
CN 101542531A · 2009 [cited by applicant]
CN 101751439A · 2010 [cited by applicant]
CN 102855298A · 2013 [cited by applicant]
CN 103955543A · 2014 [cited by applicant]
CN 106815351A · 2017 [cited by applicant]
CN 107016368A · 2017 [cited by applicant]
CN 107122349A · 2017 [cited by applicant]
CN 111506758A · 2020 [cited by applicant]
TW 201828109A · 2018 [cited by applicant]
TW I660310B · 2019 [cited by applicant]
The World Intellectual Property Organization (WIPO) International Search Report for PCT/CN2021/079510 Jun. 2, 2021 3 Pages (including translation). [cited by applicant]
Taiwan Intellectual Property Office Examination report for Application No. 110109220 Jan. 25, 2022 14 pages. [cited by applicant]
The State Intellectual Property Office of the People's Republic of China (SIPO) Office Action 2 for 202010299942.X Sep. 9, 2023 8 Pages (including translation). [cited by applicant]