IP Library Granted Patent US 12,567,224
Granted Patent B2
US 12,567,224 · App. 18/361,972 · Granted Mar 3, 2026

Method and device for locating target region, and computer-readable storage medium

Inventors: Boxiong Huang (Ningde, CN); Guannan Jiang (Ningde, CN); Zhiyu Wang (Ningde, CN)
Assignee: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
G06V10/25G06T7/50G06T7/73G06V10/44G06V20/70G06T2207/20084G06V2201/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,567,224
App. No.
18/361,972
Granted
Mar 3, 2026
Kind
B2
Abstract

Some embodiments of this application disclose a method and device for locating a target region on an image, and a computer-readable storage medium. The method includes: obtaining coordinates of target points in a to-be-detected image based on a feature point recognition model; and locating the target region based on the coordinates of the target points. The to-be-detected image includes an unstably imaged target region. A target object in the target region includes a stably imaged first section and an unstably imaged second section. The target points include a feature point on the first section. The method can improve accuracy and efficiency of locating the target region.

Claims (56)

1 . A method for locating a target region on an image, comprising:

obtaining coordinates of target points in a to-be-detected image based on a feature point recognition model, wherein the to-be-detected image comprises an unstably imaged target region, a target object in the target region comprises a stably imaged first section and an unstably imaged second section, and the target points comprise a feature point on the first section; and

locating the target region based on the coordinates of the target points;

wherein before obtaining coordinates of the target points in the to-be-detected image based on the feature point recognition model, the method further comprises:

training the feature point recognition model based on training data, wherein the training data comprises labeled feature points, and the labeled feature points comprise the feature point on the first section; and

wherein training the feature point recognition model based on the training data comprises:

obtaining the training data, wherein the training data comprises a training image set and a feature point dataset:

inputting the training data into a to-be-trained neural network model to perform feature extraction and obtain an estimate of coordinates of the feature point:

determining a function value of a first loss function based on the estimate of the coordinates of the feature point and a ground truth corresponding to the estimate of the coordinates of the feature point in the training dataset, wherein the function value of the first loss function is used to indicate a deviation between the estimate of the coordinates of the feature point and the ground truth;

updating a parameter of the to-be-trained neural network model based on the function value of the first loss function; and

determining that the function value of the first loss function has converged to a first threshold, and then using a current neural network model as the feature point recognition model.

2 . The method according to claim 1 , wherein obtaining the training data comprises:

generating a training image based on a depth map that comprises the target region; and

labeling feature points for the training image to obtain the training image set.

3 . The method according to claim 1 , wherein obtaining the training data comprises:

sorting feature points on a training image to obtain the feature point dataset.

4 . The method according to claim 1 , wherein the feature point dataset comprises the coordinates and a serial number of the feature point.

5 . The method according to claim 1 , wherein the feature point dataset comprises a descriptor of the feature point and a relative positional relationship between feature points.

6 . The method according to claim 1 , wherein before obtaining coordinates of target points in the to-be-detected image based on the feature point recognition model, the method further comprises:

obtaining an original image; and

converting the original image into an image in a PNG format to obtain the to-be-detected image.

7 . The method according to claim 1 , wherein the feature point dataset is stored in a JSON format.

8 . The method according to claim 1 , wherein, after determining that the function value of the first loss function has converged to the first threshold, the method further comprises:

inputting the training image set as a test set into the feature point recognition model to obtain an estimate of the feature point; and

calculating an accuracy metric based on the estimate of the feature point and the ground truth of the coordinates of the feature point corresponding to the training image set.

9 . The method according to claim 8 , wherein the accuracy metric is a Euclidean square root mean value of the estimate of the feature point and the ground truth of the coordinates of the feature point corresponding to the training image set.

10 . The method according to claim 1 , wherein the to-be-trained neural network model comprises a backbone feature extraction neural network, and the backbone feature extraction neural network is a ResNet 18 neural network.

11 . The method according to claim 1 , wherein the first loss function is a Smooth L1 loss function.

12 . The method according to claim 1 , wherein

the to-be-detected image is an image of an adapter strip and an electrode post that are welded in a battery cell; and

the target region comprises a weld region of the electrode post and the adapter strip.

13 . The method according to claim 12 , wherein the target object is the adapter strip, the adapter strip comprises a tab connecting portion and an electrode post connecting portion, one end of the tab connecting portion is connected to the electrode post connecting portion, the first section is the tab connecting portion, and the target points comprise coordinate points located at two ends of the tab connecting portion.

14 . A device, comprising a processor and a memory;

wherein the memory is configured to store a program, and the processor is configured to call the program from the memory and run the program;

wherein the program, when executed, causes the device to perform a method for locating a target region on an image that comprises:

obtaining coordinates of target points in a to-be-detected image based on a feature point recognition model, wherein the to-be-detected image comprises an unstably imaged target region, a target object in the target region comprises a stably imaged first section and an unstably imaged second section, and the target points comprise a feature point on the first section; and

locating the target region based on the coordinates of the target points;

wherein before obtaining coordinates of the target points in the to-be-detected image based on the feature point recognition model, the method further comprises:

training the feature point recognition model based on training data, wherein the training data comprises labeled feature points, and the labeled feature points comprise the feature point on the first section; and

wherein training the feature point recognition model based on the training data comprises:

obtaining the training data, wherein the training data comprises a training image set and a feature point dataset:

inputting the training data into a to-be-trained neural network model to perform feature extraction and obtain an estimate of coordinates of the feature point:

determining a function value of a first loss function based on the estimate of the coordinates of the feature point and a ground truth corresponding to the estimate of the coordinates of the feature point in the training dataset, wherein the function value of the first loss function is used to indicate a deviation between the estimate of the coordinates of the feature point and the ground truth;

updating a parameter of the to-be-trained neural network model based on the function value of the first loss function; and

determining that the function value of the first loss function has converged to a first threshold, and then using a current neural network model as the feature point recognition model.

15 . A non-transitory computer-readable storage medium, configured to store a computer program, which when executed on a computer, causes the computer to perform a method for locating a target region on an image that comprises:

obtaining coordinates of target points in a to-be-detected image based on a feature point recognition model, wherein the to-be detected image comprises an unstably imaged target region, a target object in the target region comprises a stably imaged first section and an unstably imaged second section, and the target points comprise a feature point on the first section; and

locating the target region based on the coordinates of the target points;

wherein before obtaining coordinates of the target points in the to-be-detected image based on the feature point recognition model, the method further comprises:

training the feature point recognition model based on training data, wherein the training data comprises labeled feature points, and the labeled feature points comprise the feature point on the first section; and

wherein training the feature point recognition model based on the training data comprises:

obtaining the training data, wherein the training data comprises a training image set and a feature point dataset:

inputting the training data into a to-be-trained neural network model to perform feature extraction and obtain an estimate of coordinates of the feature point:

determining a function value of a first loss function based on the estimate of the coordinates of the feature point and a ground truth corresponding to the estimate of the coordinates of the feature point in the training dataset, wherein the function value of the first loss function is used to indicate a deviation between the estimate of the coordinates of the feature point and the ground truth:

updating a parameter of the to-be-trained neural network model based on the function value of the first loss function; and

determining that the function value of the first loss function has converged to a first threshold, and then using a current neural network model as the feature point recognition model.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2024
From: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
To: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
Reel/Frame 068338/0402 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 31, 2023
From: HUANG, BOXIONG; JIANG, GUANNAN; WANG, ZHIYU
To: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
Reel/Frame 064430/0940 →
Priority Claims (1)
CN 202211032985.7 · Aug 26, 2022 · national
Continuity (2)
Continuation PCTCN2023082669 · Mar 21, 2023
Related Publication 20240071030A1 · Feb 29, 2024
References Cited (36)
US 5259038A · Sakou et al. · 1993 [cited by applicant]
US 20050278098A1 · Breed · 2005 [cited by applicant]
US 20240005469A1 · Jiang · 2024 [cited by examiner]
CN 107424176A · 2017 [cited by applicant]
CN 108875731A · 2018 [cited by applicant]
CN 109949227A · 2019 [cited by applicant]
CN 110245566A · 2019 [cited by applicant]
CN 111126258A · 2020 [cited by applicant]
CN 111178235A · 2020 [cited by applicant]
CN 111191714 · 2020 [cited by examiner]
CN 111310775A · 2020 [cited by applicant]
CN 112184711A · 2021 [cited by applicant]
CN 112308046A · 2021 [cited by applicant]
CN 112541395A · 2021 [cited by applicant]
CN 112548273 · 2021 [cited by examiner]
CN 112381183A · 2021 [cited by applicant]
CN 112949519A · 2021 [cited by applicant]
CN 113221639A · 2021 [cited by applicant]
CN 113723264A · 2021 [cited by applicant]
CN 113920491A · 2022 [cited by applicant]
CN 114093462A · 2022 [cited by applicant]
CN 114140647A · 2022 [cited by applicant]
CN 114241548A · 2022 [cited by applicant]
CN 114842293A · 2022 [cited by applicant]
EP 4027300 · 2022 [cited by examiner]
KR 20220061360A · 2022 [cited by applicant]
WO 2022052601A1 · 2022 [cited by applicant]
WO 2022053001A1 · 2022 [cited by applicant]
Extended European Search Report of EP application No. 23740921.4, dated Jul. 18, 2024. [cited by applicant]
Notice of Grant of Patent for Invention for CN application No. 202211032985.7, dated May 16, 2024. [cited by applicant]
Wu Tong et al. “Weld Defect Inspection of Battery Pack Based on Deep Learning of Linear Array Image”, Laser and Optoelectronics Progress, vol. 57, No. 22, Nov. 2020. [cited by applicant]
Lifu Li et al. “Capacity Fading Detection of Rectangular LiFePO4 Battery by Tomographic Image”, pre-publication of IEEE Instrumentation and Measurement Society, Dec. 31, 2018. [cited by applicant]
Fist Office Action of CN application No. 202211032985.7, mailed Jun. 7, 2023. [cited by applicant]
International Search Report for International Application PCT/CN2023/082669, mailed Jun. 21, 2023. [cited by applicant]
Written Opinion of International Search Authority for International Application PCT/CN2023/082669, mailed Jun. 21, 2023. [cited by applicant]
Qiu, P.; Zhao, H. P.; Zhu, C. R.; . “Robust local feature point extraction method for partially occluded targets” Modern Electronic Technology, vol. 22, No. 1, Nov. 15, 2013 pp. 76-80. [cited by applicant]