IP Library Patent Application 18309531
Patent Application
App. No. 18/309,531

DATA ANNOTATION METHOD AND SYSTEM FOR IMAGE SEGMENTATION AND IMAGE SEGMENTATION APPARATUS

Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US None
App. No.
18/309,531
Abstract

A data annotation method for image segmentation includes performing training using an annotated training sample set to obtain a data annotation model, inputting an original image sample to the data annotation model to obtain an automatic annotation result corresponding to the original image sample, visually presenting the automatic annotation result together with the original image sample based on a preset annotation strategy, receiving correction to the automatic annotation result and converting the received correction into a corrected annotation result based on the annotation strategy, and optimizing the data annotation model using the corrected annotation result and the original image sample together as a new annotated training sample.

Claims (64)

1 . A data annotation method for image segmentation, comprising:

performing training using an annotated training sample set, to obtain a data annotation model;

inputting an original image sample to the data annotation model to obtain an automatic annotation result corresponding to the original image sample;

visually presenting the automatic annotation result together with the original image sample based on a preset annotation strategy;

receiving correction to the automatic annotation result, and converting the received correction into a corrected annotation result based on the annotation strategy; and

optimizing the data annotation model using the corrected annotation result and the original image sample together as a new annotated training sample.

2 . The method of claim 1 , wherein the annotation strategy comprises:

indicating one or more predefined segmentation objects using one or more colors in a first group, respectively; and

indicating one or more annotation correction actions using one or more colors in a second group, respectively.

3 . The method of claim 2 , wherein the one or more annotation correction actions comprise one or more of the following:

addition, configured to add an annotation of a segmentation object that is not recognized by the data annotation model;

deletion, configured to delete a wrong annotation;

supplementation, configured to annotate situations that are not defined in the annotation strategy; and

modification, used to modify an identifier of an object recognized by the data annotation model but incorrectly identified.

4 . The method of claim 2 , wherein visually presenting the automatic annotation result together with the original image sample based on the preset annotation strategy comprises:

analyzing the automatic annotation result to obtain an object class of an annotation and a location of the annotation in the original image sample; and

displaying, in an overlaying manner in the location in the original image sample, the annotation using a color defined in the annotation strategy for the object class.

5 . The method of claim 1 , wherein receiving the correction to the automatic annotation result, and converting the received correction into the corrected annotation result based on the annotation strategy comprises:

visually presenting a process of the correction together with the automatic annotation result and the original image sample based on the annotation strategy.

6 . The method of claim 1 , further comprising:

performing an accuracy rate test on the automatic annotation result of the data annotation model; and

in response to an accuracy rate exceeding a threshold, reducing a frequency at which the data annotation model is optimized.

7 . The method of claim 6 ,

wherein the threshold is a first threshold;

the method further comprising:

in response to the accuracy rate exceeding a second threshold greater than the first threshold, using the automatic annotation result of the data annotation model and the corresponding original image sample together as another new annotated training sample.

8 . The method of claim 7 , further comprising:

in response to the accuracy rate exceeding a third threshold greater than the second threshold, stopping optimization of the data annotation model.

9 . An image segmentation apparatus, comprising:

a storage device storing computer instructions; and

a processing unit configured to execute the computer instructions to:

perform training using an annotated training sample set, to obtain a data annotation model;

input an original image sample to the data annotation model to obtain an automatic annotation result corresponding to the original image sample;

visually present the automatic annotation result together with the original image sample based on a preset annotation strategy;

receive correction to the automatic annotation result, and convert the received correction into a corrected annotation result based on the annotation strategy; and

optimize the data annotation model using the corrected annotation result and the original image sample together as a new annotated training sample.

10 . The apparatus of claim 9 , wherein the annotation strategy comprises:

indicating one or more predefined segmentation objects using one or more colors in a first group, respectively; and

indicating one or more annotation correction actions using one or more colors in a second group, respectively.

11 . The apparatus of claim 10 , wherein the one or more annotation correction actions comprise one or more of the following:

addition, configured to add an annotation of a segmentation object that is not recognized by the data annotation model;

deletion, configured to delete a wrong annotation;

supplementation, configured to annotate situations that are not defined in the annotation strategy; and

modification, used to modify an identifier of an object recognized by the data annotation model but incorrectly identified.

12 . The apparatus of claim 10 , wherein the processing unit is further configured to execute the computer instructions to visually present the automatic annotation result together with the original image sample based on the preset annotation strategy by:

analyzing the automatic annotation result to obtain an object class of an annotation and a location of the annotation in the original image sample; and

displaying, in an overlaying manner in the location in the original image sample, the annotation using a color defined in the annotation strategy for the object class.

13 . The apparatus of claim 10 , wherein the processing unit is further configured to execute the computer instructions to receive the correction to the automatic annotation result, and convert the received correction into the corrected annotation result based on the annotation strategy by:

visually presenting a process of the correction together with the automatic annotation result and the original image sample based on the annotation strategy.

14 . The apparatus of claim 10 , wherein the processing unit is further configured to execute the computer instructions to:

perform an accuracy rate test on the automatic annotation result of the data annotation model; and

in response to an accuracy rate exceeding a threshold, reduce a frequency at which the data annotation model is optimized.

15 . The apparatus of claim 14 , wherein:

the threshold is a first threshold; and

the processing unit is further configured to execute the computer instructions to:

in response to the accuracy rate exceeding a second threshold greater than the first threshold, use the automatic annotation result of the data annotation model and the corresponding original image sample together as another new annotated training sample.

16 . The apparatus of claim 15 , wherein the processing unit is further configured to execute the computer instructions to:

in response to the accuracy rate exceeding a third threshold greater than the second threshold, stop optimization of the data annotation model.

17 . A non-transitory computer-readable storage medium storing one or more instructions that, when executed by one or more processors, cause the one or more processors to:

perform training using an annotated training sample set, to obtain a data annotation model;

input an original image sample to the data annotation model to obtain an automatic annotation result corresponding to the original image sample;

visually present the automatic annotation result together with the original image sample based on a preset annotation strategy;

receive correction to the automatic annotation result, and convert the received correction into a corrected annotation result based on the annotation strategy; and

optimize the data annotation model using the corrected annotation result and the original image sample together as a new annotated training sample.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 6, 2024
From: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
To: CONTEMPORARY AMPEREX TECHNOLOGY (HONG KONG) LIMITED
Reel/Frame 068338/0402 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 28, 2023
From: JIANG, GUANNAN; CHEN, FEI; LI, LU
To: CONTEMPORARY AMPEREX TECHNOLOGY CO., LIMITED
Reel/Frame 063483/0572 →