IP Library Granted Patent US 11,836,962
Granted Patent B2
US 11,836,962 · App. 18/295,513 · Granted Dec 5, 2023

Image processing method and system

Inventors: Zhiyu Wang (Ningde, CN); Lu Li (Ningde, CN); Jin Wei (Ningde, CN)
Assignee: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
G06V10/44G06T7/10G06V10/764G06T2207/20084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,836,962
App. No.
18/295,513
Granted
Dec 5, 2023
Kind
B2
Abstract

The present application relates to an image processing method and system. The method includes: determining an enhanced image of a target object of an input image based on a segmentation algorithm, where the enhanced image of the target object comprises an image in which each pixel classified as the target object is displayed in an enhanced manner; and determining a positioning image of the target object by applying an integral image algorithm to the enhanced image of the target object.

Claims (49)

1. An image processing method, comprising:

determining whether each pixel of an input image belongs to a target object of the input image using a segmentation algorithm, wherein the target object is composed of pixels belonging to the target object;

determining an enhanced image of the target object, wherein the enhanced image of the target object is an image in which each pixel of the target object is displayed in an enhanced manner; and

determining a positioning image of the target object by applying an integral image algorithm to the enhanced image of the target object;

wherein determining whether each pixel of the input image belongs to the target object of the input image using the segmentation algorithm comprises:

inputting the input image into a deep convolutional neural network to perform a pixel-level feature extraction on the input image; and

determining whether the pixel belongs to the target object based on a feature value of the pixel;

wherein determining the enhanced image of the target object comprises:

performing a feature extraction on the input image to determine a pixel feature graph;

performing a feature extraction on the input image to determine a context feature graph;

determining context relation information of each pixel based on the pixel feature graph and the context feature graph; and

determining the enhanced image of the target object according to the context relation information of each pixel of the input image;

wherein each pixel of the input image carries weight information, and determining the enhanced image of the target object according to the context relation information of each pixel of the input image comprises:

changing weight information of the pixels belonging to the target object, so that the target object is displayed in the enhanced manner.

2. The method according to claim 1 , wherein determining the positioning image of the target object by applying the integral image algorithm to the enhanced image of the target object comprises:

determining an integral image according to the enhanced image of the target object; and

determining the positioning image of the target object by using the integral image.

3. The method according to claim 2 , wherein determining the integral image according to the enhanced image of the target object comprises:

applying a scale factor to the enhanced image of the target object.

4. The method according to claim 1 , wherein the method further comprises:

calculating a loss rate between the enhanced image of the target object and the input image based on a loss function; and

feeding back the calculated loss rate to the segmentation algorithm to update the segmentation algorithm.

5. The method according to claim 1 , wherein the segmentation algorithm is implemented by a deep convolutional neural network HRNet18.

6. An image processing system, comprising:

a memory storing computer-executable instructions; and

a processor coupled to the memory,

wherein the computer-executable instructions, when executed by the processor, cause the system to perform the following operations:

determining whether each pixel of an input image belongs to a target object of the input image using a segmentation algorithm, wherein the target object is composed of pixels belonging to the target object;

determining an enhanced image of the target object, wherein the enhanced image of the target object is an image in which each pixel of the target object is displayed in an enhanced manner; and

determining a positioning image of the target object by applying an integral image algorithm to the enhanced image of the target object;

wherein determining whether each pixel of the input image belongs to the target object of the input image using the segmentation algorithm comprises:

inputting the input image into a deep convolutional neural network to perform a pixel-level feature extraction on the input image; and

determining whether the pixel belongs to the target object based on a feature value of the pixel;

wherein determining the enhanced image of the target object comprises:

performing a feature extraction on the input image to determine a pixel feature graph;

performing a feature extraction on the input image to determine a context feature graph;

determining context relation information of each pixel based on the pixel feature graph and the context feature graph; and

determining the enhanced image of the target object according to the context relation information of each pixel of the input image;

wherein each pixel of the input image carries weight information, and determining the enhanced image of the target object according to the context relation information of each pixel of the input image comprises:

changing weight information of the pixels belonging to the target object, so that the target object is displayed in the enhanced manner.

7. The system according to claim 6 , wherein determining the positioning image of the target object by applying the integral image algorithm to the enhanced image of the target object comprises:

determining an integral image according to the enhanced image of the target object; and

determining the positioning image of the target object by using the integral image.

8. The system according to claim 7 , wherein determining the integral image according to the enhanced image of the target object comprises:

applying a scale factor to the enhanced image of the target object.

9. The system according to claim 6 , wherein the computer-executable instructions, when executed by the processor, further cause the system to perform the following operations:

calculating a loss rate between the enhanced image of the target object and the input image based on a loss function; and

feeding back the calculated loss rate to the segmentation algorithm to update the segmentation algorithm.

10. The system according to claim 6 , wherein the segmentation algorithm is implemented by a deep convolutional neural network HRNet18.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2024
From: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
To: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
Reel/Frame 068338/0723 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2023
From: WANG, ZHIYU; LI, LU; WEI, JIN
To: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
Reel/Frame 063219/0189 →
Continuity (2)
Continuation PCTCN2021136052 · Dec 7, 2021
Related Publication 20230237763A1 · Jul 27, 2023