IP Library › Granted Patent US 12,254,638
Granted Patent B2
US 12,254,638 · App. 17/637,801 · Granted Mar 18, 2025

Method and system of recognizing object edges and computer-readable storage medium

Inventors: Qingsong Xu (Hangzhou, CN); Qing Li (Hangzhou, CN)
Assignee: Hangzhou Glority Software Limited
G06T7/13G06V10/44G06V10/761G06T2207/20084G06T2207/20164
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,254,638
App. No.
17/637,801
Granted
Mar 18, 2025
Kind
B2
Abstract

A method and system of recognizing object edges and a computer-readable storage medium are provided. The method includes: obtaining an input image; recognizing the input image and obtaining a relative position of each object vertex and a corresponding image vertex thereof; determining a reference position of each object vertex in the input image according to the relative position of each object vertex and the corresponding image vertex thereof; performing corner point detection in a predetermined area where the reference position of the object vertex is located for each object vertex; determining an actual position of each object vertex in the input image according to a result of the corner point detection; and sequentially connecting adjacent object vertices to form edge lines to obtain the edges of the object with edges in the input image according to the actual position of each object vertex in the input image.

Claims (34)

1. A method of recognizing object edges, comprising:

obtaining an input image, wherein the input image comprises an object with edges, and the edges of the object comprise a plurality of object vertices, wherein the plurality of object vertices comprise a first object vertex and a second object vertex;

recognizing, through an object vertex recognition model, the input image and obtaining a first relative position between the first object vertex and a first image vertex, and obtaining a second relative position between the second object vertex and a second image vertex;

determining a reference position of each of the object vertices in the input image according to the relative position of each of the object vertices and the corresponding image vertex thereof;

performing a corner point detection in a predetermined area where the reference position of the object vertex is located for each of the object vertices;

determining an actual position of each of the object vertices in the input image according to a result of the corner point detection; and

sequentially connecting adjacent object vertices to form edge lines to obtain the edges of the object with edges in the input image according to the actual position of each of the object vertices in the input image.

2. The method of recognizing object edges according to claim 1 , wherein the predetermined area where the reference position of the object vertex is located is a circular area with a pixel point at the reference position of the object vertex as a center of the circle and a first predetermined pixel as a radius, and

the step of performing the corner point detection in the predetermined area where the reference position of the object vertex is located for each of the object vertices further comprises:

performing the corner point detection on the pixel point in the circular area corresponding to each of the object vertices; treating all of the pixel points whose feature value variation ranges are greater than a predetermined threshold as candidate corner points during a process of the corner point detection; and determining a target corner point corresponding to each of the object vertices among the candidate corner points.

3. The method of recognizing object edges according to claim 2 , wherein the step of determining the target corner point corresponding to each of the object vertices among the candidate corner points further comprises:

step A 1 , sorting the candidate corner points in a descending order according to the feature value variation ranges, wherein the candidate corner point ranked first is determined as the target corner point, and the candidate corner point ranked second is determined as a current corner point to be selected;

step A 2 , determining whether all distances between the current corner point to be selected and all current target corner points are greater than a second predetermined pixel, wherein step A 3 is performed if all distances between the current corner point to be selected and all current target corner points are greater than the second predetermined pixel is determined, otherwise, step A 4 is performed;

step A 3 , determining the current corner point to be selected as the target corner point; and

step A 4 , discarding the current corner point to be selected, determining the candidate corner point ranked next as the current corner point to be selected, and performing step A 2 again.

4. The method of recognizing object edges according to claim 3 , wherein a range of the second predetermined pixel is ≥50 pixels.

5. The method of recognizing object edges according to claim 2 , wherein a range of the first predetermined pixel is 10 to 20 pixels.

6. The method of recognizing object edges according to claim 2 , wherein the step of determining the actual position of each of the object vertices in the input image according to the result of the corner point detection further comprises:

for each of the object vertices, if the result of the corner point detection of the object vertex comprises a corner point, determining a position of the corner point as the actual position of the object vertex in the input image; or if the result of the corner point detection of the object vertex does not comprise a corner point, determining the reference position of the object vertex in the input image as the actual position of the object vertex in the input image.

7. The method of recognizing object edges according to claim 1 , wherein the step of obtaining the first relative position between the first object vertex and a first image vertex, and obtaining a second relative position between the second object vertex and a second image vertex further comprises:

obtaining the first relative position between the first object vertex and the first image vertex closest to the first object vertex in the input image.

8. The method of recognizing object edges according to claim 7 , wherein the step of determining the reference position of each of the object vertices in the input image according to the relative position of each of the object vertices and the corresponding image vertex thereof further comprises:

converting the first relative position of the first object vertex and the first image vertex closest to the first object vertex in the input image into coordinates of the first object vertex in a target coordinate system to obtain the reference position of the first object vertex in the input image for each of the object vertices.

9. The method of recognizing object edges according to claim 8 , wherein an origin of the target coordinate system is a position point of the input image.

10. The method of recognizing object edges according to claim 1 , further comprising:

correcting the object with edges by using the edge lines.

11. The method of recognizing object edges according to claim 10 , wherein four object vertices are provided and four edge lines are provided, which are a first line, a second line, a third line, and a fourth line in sequence, the first line and the third line are arranged in a first direction, the second line and the fourth line are arranged in a second direction, and the first direction is perpendicular to the second direction,

the step of correcting the object with edges by using the edge lines further comprises:

obtaining projection lengths of the first line and the third line in the second direction separately and obtaining projection lengths of the second line and the fourth line in the first direction separately;

calculating an average value of the projection lengths of the first line and the third line in the second direction to act as a corrected length of the object with edges in the second direction; and

calculating an average value of the projection lengths of the second line and the fourth line in the first direction to act as a corrected length of the object with edges in the first direction.

12. The method of recognizing object edges according to claim 1 , wherein the object vertex recognition model is a neural network model.

13. A system of recognizing object edges, comprising a processor and a memory, wherein the memory stores a command, and the steps of the method according to claim 1 are implemented when the command is executed by the processor.

14. A non-transitory computer-readable storage medium, wherein the non-transitory computer-readable storage medium stores a command, and the steps of the method according to claim 1 are implemented when the command is executed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2022
From: XU, QINGSONG; LI, QING
To: HANGZHOU GLORITY SOFTWARE LIMITED
Reel/Frame 059153/0595 →
Priority Claims (1)
CN 202010995134.7 · Sep 21, 2020 · national
Continuity (1)
Related Publication 20230267619A1 · Aug 24, 2023
References Cited (45)
US 7301564B2 · Fan · 2007 [cited by examiner]
US 10115031B1 · Pashintsev · 2018 [cited by examiner]
US 11200734B2 · Huang · 2021 [cited by examiner]
US 20050123180A1 · Luo et al. · 2005 [cited by applicant]
US 20060056732A1 · Holmes · 2006 [cited by applicant]
US 20080205764A1 · Iwai et al. · 2008 [cited by applicant]
US 20130182969A1 · Pan et al. · 2013 [cited by applicant]
US 20130329134A1 · Inamoto · 2013 [cited by applicant]
US 20160155011A1 · Sulc et al. · 2016 [cited by applicant]
US 20170270662A1 · Kato et al. · 2017 [cited by applicant]
US 20170372134A1 · Zagaynov · 2017 [cited by examiner]
US 20180165815A1 · Okada et al. · 2018 [cited by applicant]
US 20210034856A1 · Torres · 2021 [cited by examiner]
US 20220335704A1 · Xu · 2022 [cited by examiner]
CN 102005038 · 2011 [cited by applicant]
CN 104268864 · 2015 [cited by applicant]
CN 105096299 · 2015 [cited by applicant]
CN 105654097 · 2016 [cited by applicant]
CN 107123188 · 2017 [cited by applicant]
CN 108627092 · 2018 [cited by applicant]
CN 108629343 · 2018 [cited by applicant]
CN 108764143 · 2018 [cited by applicant]
CN 108875723 · 2018 [cited by applicant]
CN 109118473 · 2019 [cited by applicant]
CN 109711416 · 2019 [cited by applicant]
CN 109859226 · 2019 [cited by applicant]
CN 110738602A · 2020 [cited by examiner]
CN 111091123 · 2020 [cited by applicant]
CN 111401266 · 2020 [cited by applicant]
CN 111598091 · 2020 [cited by applicant]
CN 111680685 · 2020 [cited by applicant]
CN 111680688 · 2020 [cited by applicant]
CN 112132163 · 2020 [cited by applicant]
EP 0156343 · 1985 [cited by applicant]
JP 2016109669 · 2016 [cited by applicant]
JP 2019124683 · 2019 [cited by applicant]
KR 20130007950 · 2013 [cited by applicant]
KR 102079121 · 2020 [cited by applicant]
Wang; Wei et al., “An improved algorithm for Harris corner detection”, Optics and Precision Engineering, Oct. 2008, with English abstract, pp. 1995-2001, vol. 16, No. 10. [cited by applicant]
Xing; Xiaomin et al., “Edge Detection Method Combining Corner Points to Realize the Image Location of the Tower Sign in the Transmission Line”, Jilin Electric Power, Jun. 2020, with English abstract, pp. 32-36, vol. 48,… [cited by applicant]
Otto Lappi et al., “Pursuit Eye-Movements in Curve Driving Differentiate between Future Path and Tangent Point Models”, PloS one, Jul. 22, 2013, pp. 1-16, vol. 8, Issue 7. [cited by applicant]
“Office Action of China Counterpart Application”, issued on Nov. 22, 2023, p. 1-p. 10. [cited by applicant]
“Notice of allowance of China Counterpart Application”, issued on Feb. 29, 2024, p. 1-p. 6. [cited by applicant]
“International Search Report (Form PCT/ISA/210) of PCT/CN2021/115482,” mailed on Nov. 17, 2021, pp. 1-4. [cited by applicant]
“Written Opinion of the International Searching Authority (Form PCT/ISA/237) of PCT/CN2021/115482,” mailed on Nov. 17, 2021, pp. 1-5. [cited by applicant]