IP Library Granted Patent US 12,596,834
Granted Patent B2
US 12,596,834 · App. 18/196,431 · Granted Apr 7, 2026

Method of processing data for personal information protection and apparatus using the same

Inventors: Wonseok Ahn (Seongnam-si, KR); BoGun Park (Seoul, KR)
Assignee: XPERIX INC.
G06F21/6245G06T7/11G06V10/776G06T2207/20021G06T2207/30201
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,596,834
App. No.
18/196,431
Granted
Apr 7, 2026
Kind
B2
Abstract

Provided are a method of processing data for protecting personal information and an apparatus using the same. The method of processing data, which is a method for providing a data processor terminal with processing target data, includes acquiring a first original image and a second original image, segmenting the first original image into a plurality of regions including a first region, segmenting the second original image into a plurality of regions including a second region, generating a first processing target image including at least a partial region of the first region and at least a partial region of the second region, and providing the generated first processing target image to a data processor terminal.

Claims (89)

1 . A method of processing data which is a method for providing a data processor terminal with processing target data, the method comprising:

acquiring a first original image and a second original image;

segmenting the first original image into a plurality of regions including a first region;

segmenting the second original image into a plurality of regions including a second region;

generating a first processing target image including at least a partial region of the first region and at least a partial region of the second region;

providing the generated first processing target image to a data processor terminal; and

acquiring labeling information of the first processing target image from the data processor terminal,

wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes generating a second processing target image including the first region, and

wherein the first processing target image and the second processing target image include the first region which is the same, and

wherein when the first processing target image is provided to a first data processor terminal, the second processing target image is provided to a second data processor terminal, and a third processing target image including the first region is provided to a third data processor terminal, further comprising:

acquiring first labeling information of the first region included in the first processing target image from the first data processor terminal;

acquiring second labeling information of the first region included in the second processing target image from the second data processor terminal; and

acquiring third labeling information of the first region included in the third processing target image from the third data processor terminal,

wherein the first labeling information, the second labeling information, and the third labeling information are compared to determine whether the first labeling information, the second labeling information, and the third labeling information are true values.

2 . The method of claim 1 , wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes,

when the first region is related to security information,

performing masking on the at least a partial region of the first region.

3 . The method of claim 1 , wherein:

the segmenting of the first original image into the plurality of regions including the first region includes segmenting the first region into a plurality of sub regions including a first sub region and a second sub region when the first region is related to security information, and

the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes:

generating the first processing target image using the first sub region, and

wherein the second sub region is used for generation of the second processing target image different from the first processing target image.

4 . The method of claim 1 , wherein, when the first original image and the second original image are faces,

the first region includes a first feature of the face,

the second region includes a second feature, which is different from the first feature, of the face, and

the first processing target image includes the first region including the first feature and the second region including the second feature.

5 . The method of claim 1 , further comprising, when labeling information of the first region has been acquired in advance:

acquiring labeling information of the first region from the data processor terminal;

comparing the labeling information of the first region having been acquired in advance with the labeling information of the first region acquired from the data processor terminal; and

evaluating a reliability of the data processor terminal based on a result of the comparison.

6 . The method of claim 1 , wherein, when the plurality of regions acquired by segmenting the first original image include a third region, and the first processing target image includes the first region, the second region, and the third region,

the acquiring of the labeling information of the first processing target image from the data processor terminal includes:

acquiring a processed image including labeling information of the first processing target image;

restoring at least a part of the first original image based on the processed image; and

acquiring labeling information of the first region and labeling information of the third region from the restored at least a part of the first original image.

7 . A non-transitory computer-readable recording medium having a program recorded thereon to perform or control performance of operations comprising:

acquiring a first original image and a second original image;

segmenting the first original image into a plurality of regions including a first region;

segmenting the second original image into a plurality of regions including a second region;

generating a first processing target image including at least a partial region of the first region and at least a partial region of the second region;

providing the generated first processing target image to a data processor terminal; and

acquiring labeling information of the first processing target image from the data processor terminal

wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes generating a second processing target image including the first region, and

wherein the first processing target image and the second processing target image include the first region which is the same, and

wherein when the first processing target image is provided to a first data processor terminal, the second processing target image is provided to a second data processor terminal, and a third processing target image including the first region is provided to a third data processor terminal, further comprising:

acquiring first labeling information of the first region included in the first processing target image from the first data processor terminal;

acquiring second labeling information of the first region included in the second processing target image from the second data processor terminal; and

acquiring third labeling information of the first region included in the third processing target image from the third data processor terminal,

wherein the first labeling information, the second labeling information, and the third labeling information are compared to determine whether the first labeling information, the second labeling information, and the third labeling information are true values.

8 . The non-transitory computer-readable recording medium of claim 7 , wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes,

when the first region is related to security information,

performing masking on the at least a partial region of the first region.

9 . The non-transitory computer-readable recording of claim 7 , wherein:

the segmenting of the first original image into the plurality of regions including the first region includes segmenting the first region into a plurality of sub regions including a first sub region and a second sub region when the first region is related to security information, and

the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes:

generating the first processing target image using the first sub region, and wherein the second sub region is used for generation of the second processing target image different from the first processing target image.

10 . The non-transitory computer-readable recording medium of claim 7 , wherein, when the first original image and the second original image are faces,

the first region includes a first feature of the face,

the second region includes a second feature, which is different from the first feature, of the face, and

the first processing target image includes the first region including the first feature and the second region including the second feature.

11 . The non-transitory computer-readable recording medium of claim 7 , the operations further comprising when labelling information of the first region has been acquired in advance:

acquiring labeling information of the first region from the data processor terminal;

comparing the labeling information of the first region having been acquired in advance with the labeling information of the first region acquired from the data processor terminal; and

evaluating a reliability of the data processor terminal based on a result of the comparison.

12 . The non-transitory computer-readable recording medium of claim 7 , wherein, when the plurality of regions acquired by segmenting the first original image include a third region, and the first processing target image includes the first region, the second region, and the third region,

the acquiring of the labeling information of the first processing target image from the data processor terminal includes:

acquiring a processed image including labeling information of the first processing target image;

restoring at least a part of the first original image based on the processed image; and

acquiring labeling information of the first region and labeling information of the third region from the restored at least a part of the first original image.

13 . An apparatus for processing data which is an apparatus for providing a data processor terminal with processing target data, the apparatus comprising:

a memory unit; and

a control unit configured to perform an operation based on an instruction included in the memory unit,

wherein the control unit is configured to:

acquire a first original image and a second original image;

segment the first original image into a plurality of regions including a first region;

segment the second original image into a plurality of regions including a second region;

generate a first processing target image including at least a partial region of the first region and at least a partial region of the second region;

provide the generated first processing target image to a data processor terminal; and

acquire labeling information of the first processing target image from the data processor terminal,

wherein the control unit is configured to generate a second processing target image including the first region,

wherein the first processing target image and the second processing target image include the first region which is the same,

wherein when the first processing target image is provided to a first data processor terminal, the second processing target image is provided to a second data processor terminal, and a third processing target image including the first region is provided to a third data processor terminal,

wherein the control unit is configured to:

acquire first labeling information of the first region included in the first processing target image from the first data processor terminal;

acquire second labeling information of the first region included in the second processing target image from the second data processor terminal; and

acquire third labeling information of the first region included in the third processing target image from the third data processor terminal, and

wherein the first labeling information, the second labeling information, and the third labeling information are compared to determine whether the first labeling information, the second labeling information, and the third labeling information are true values.

14 . The method of claim 3 , wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes arranging the first sub region within the first processing target image such that a user of the data processor terminal has difficulty identifying the first region, when labeling information of the first region has been acquired in advance.

15 . The non-transitory computer-readable recording medium of claim 9 , wherein the generating of the first processing target image including the at least a partial region of the first region and the at least a partial region of the second region includes arranging the first sub region within the first processing target image such that a user of the data processor terminal has difficulty identifying the first region, when labeling information of the first region has been acquired in advance.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 26, 2023
From: PARK, BOGUN
To: XPERIX INC.
Reel/Frame 065034/0681 →
CHANGE OF NAME Recorded Jul 3, 2023
From: SUPREMA ID INC.
To: XPERIX INC.
Reel/Frame 064194/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2023
From: AHN, WONSEOK; PARK, PETER
To: SUPREMA ID INC.
Reel/Frame 063671/0084 →
Priority Claims (1)
KR 10-2022-0151671 · Nov 14, 2022 · national
Continuity (1)
Related Publication 20240160777A1 · May 16, 2024
References Cited (12)
US 11164046B1 · Kim · 2021 [cited by examiner]
US 20160148070A1 · Tate · 2016 [cited by examiner]
KR 101887415B1 · 2018 [cited by applicant]
KR 102357801B1 · 2022 [cited by applicant]
KR 20220060722A · 2022 [cited by applicant]
Ma et al.,AdaDeld: Adjust Your Identity Attribute Freely, Aug. 2022, University of Chinese Academy of Sciences, pp. 210-216 (Year 2022). [cited by examiner]
Li et al. SF-GAN: Face De-Identification Method Without Losing Facial Attribute Information, Jan. 2021, IEEE Signal Processing Letters, vol. 28, pp. 1-5 (year 2021). [cited by examiner]
European Search Report dated Oct. 27, 2023 as received in application No. 23172373.5. [cited by applicant]
Ma et al. “AdaDeld: Adjust You Identity Attribute Freely” Aug. 21, 2022. [cited by applicant]
Li et al. “SF-GAN: Face De-Identification Method Without Losing Facial Attribute Information” 2021. [cited by applicant]
Cecilia Summers et al., Improved Mixed-Example Data Augmentation, IEEE Winter Conference on Applications of Computer Vision, Jan. 19, 2019. [cited by applicant]
Korean Office Action issued in corresponding application No. 10-2022-0151671, dated Nov. 14, 2023. [cited by applicant]