IP Library Granted Patent US 9,811,749
Granted Patent B2
US 9,811,749 · App. 14/602,021 · Granted Nov 7, 2017

Detecting a label from an image

Inventors: Lun Zhang (Beijing, CN); Rufeng Chu (Beijing, CN); Chunhui Zhang (Hangzhou, CN)
Assignee: Alibaba Group Holding Limited
G06K9/18G06K9/2063G06K9/3216G06K9/50G06K9/64G06K2209/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,811,749
App. No.
14/602,021
Granted
Nov 7, 2017
Kind
B2
Abstract

Determining a label from an image is disclosed, including: obtaining an image; determining a first portion of the image associated with a special mark; determining a second portion of the image associated with a label based at least in part on the first portion of the image associated with the special mark; and applying character recognition to the second portion of the image associated with the label to determine a value associated with the label.

Claims (55)

1. A system, comprising:

one or more processors configured to:

determine a first location associated with a special mark in an image by determining a portion of the image that matches a special mark pattern, wherein:

the special mark comprises a shape; and

the special mark comprises a pixel ratio comprising a ratio of at least a number of pixels of a first color to a number of pixels of a second color within at least one line of pixels associated with the shape;

use the special mark as a reference to locate a second location associated with a label in the image by searching for the label in the image within a predetermined area associated with the first location associated with the special mark in the image;

apply recognition to the second location associated with the label in the image to determine a value associated with the label; and

perform a search using the value associated with the label; and

one or more memories coupled to the one or more processors and configured to provide the one or more processors with instructions.

2. The system of claim 1 , wherein the image is obtained based at least in part on one or more of the following: receiving the image via a camera, receiving the image via a scanner, and downloading the image.

3. The system of claim 1 , wherein to determine the first location associated with the special mark in the image further comprises to:

determine that the portion of the image matches the shape associated with the special mark pattern; and

compare content of the portion of the image that is enclosed by one or more boundaries associated with the shape to a designated content associated with the special mark pattern.

4. The system of claim 1 , wherein to determine the first location associated with the special mark in the image further comprises to:

determine that the portion of the image matches the shape associated with the special mark pattern;

determine that a line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern; and

in response to the determination that the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern, determine that the portion of the image is associated with the first location associated with the special mark.

5. The system of claim 1 , wherein the one or more processors are further configured to, prior to applying recognition to the second location associated with the label in the image to determine the value associated with the label, extract a portion of the image associated with the label from the image.

6. The system of claim 1 , wherein to perform the search using the value associated with the label comprises to submit the value associated with the label as a search query to a search engine.

7. The system of claim 6 , wherein the one or more processors are further configured to present one or more search results at a user interface.

8. The system of claim 1 , wherein to locate the second location associated with the label in the image within the predetermined area associated with the first location associated with the special mark in the image comprises to search for the label in the predetermined area of the image near the first location associated with the special mark.

9. A method, comprising:

determining, using one or more processors, a first location associated with a special mark in an image by determining a portion of the image that matches a special mark pattern, wherein:

the special mark comprises a shape; and

the special mark comprises a pixel ratio comprising a ratio of at least a number of pixels of a first color to a number of pixels of a second color within at least one line of pixels associated with the shape;

using the special mark as a reference to locate a second location associated with a label in the image by searching for the label in the image within a predetermined area associated with the first location associated with the special mark in the image;

applying recognition to the second location associated with the label in the image to determine a value associated with the label; and

performing a search using the value associated with the label.

10. The method of claim 9 , wherein the image is obtained based at least in part on one or more of the following: receiving the image via a camera, receiving the image via a scanner, and downloading the image.

11. The method of claim 9 , wherein determining the first location associated with the special mark in the image further comprises:

determining that the portion of the image matches the shape associated with the special mark pattern; and

comparing content of the portion of the image that is enclosed by one or more boundaries associated with the shape to a designated content associated with the special mark pattern.

12. The method of claim 9 , wherein determining the first location associated with the special mark in the image further comprises:

determining that the portion of the image matches the shape associated with the special mark pattern;

determining that a line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern; and

in response to the determination that the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern, determining that the portion of the image is associated with the first location associated with the special mark.

13. The method of claim 9 , further comprising, prior to applying recognition to the second location associated with the label in the image to determine the value associated with the label, extracting a portion of the image associated with the label from the image.

14. The method of claim 9 , wherein performing the search using the value associated with the label comprises submitting the value associated with the label as a search query to a search engine.

15. The method of claim 14 , further comprising presenting one or more search results at a user interface.

16. The method of claim 9 , wherein locating the second location associated with the label in the image within the predetermined area associated with the first location associated with the special mark in the image comprises searching for the label in the predetermined area of the image near the first location associated with the special mark.

17. A computer program product, the computer program product comprises a non-transitory computer readable storage medium storing instructions which when executed perform the following steps:

determining a first location associated with a special mark in an image by determining a portion of the image that matches a special mark pattern, wherein:

the special mark comprises a shape; and

the special mark comprises a pixel ratio comprising a ratio of at least a number of pixels of a first color to a number of pixels of a second color within at least one line of pixels associated with the shape;

using the special mark as a reference to locate a second location associated with a label in the image by searching for the label in the image within a predetermined area associated with the first location associated with the special mark in the image;

applying recognition to the second location associated with the label in the image to determine a value associated with the label; and

performing a search using the value associated with the label.

18. The method of claim 9 , wherein determining the first location associated with the special mark in the image includes:

determining that the portion of the image matches the shape associated with the special mark pattern;

determining that a line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern; and

in response to the determination that the line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern, determining that the portion of the image is associated with the first location associated with the special mark.

19. The computer program product of claim 17 , wherein determining the first location associated with the special mark in the image includes:

determining that the portion of the image matches the shape associated with the special mark pattern;

determining that a line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern; and

in response to the determination that the line of pixels within the portion of the image that matches the shape associated with the special mark pattern also matches the pixel ratio associated with the special mark pattern, determining that the portion of the image is associated with the first location associated with the special mark.

Priority Claims (1)
CN 2012 1 0360774 · Sep 21, 2012 · national
Continuity (2)
Continuation 14021564 · Sep 9, 2013
Related Publication 20150199581A1 · Jul 16, 2015