IP Library › Granted Patent US 12,541,952
Granted Patent B2
US 12,541,952 · App. 18/132,183 · Granted Feb 3, 2026

Apparatus for collecting a training image of a deep learning model and a method for the same

Inventors: Jin Sol Kim (Hwaseong-si, KR); Se Jeong Lee (Suwon-si, KR); Jung Woo Heo (Suwon-si, KR)
Assignees: HYUNDAI MOTOR COMPANY; KIA CORPORATION
G06V10/774G06V10/764G06V10/778G06V10/95G06V20/56
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,541,952
App. No.
18/132,183
Granted
Feb 3, 2026
Kind
B2
Abstract

Provided are an apparatus for collecting a training image of a deep learning model and a method for the same. The apparatus may include a camera sensor configured to capture an image of a surrounding of a vehicle and a controller configured to determine an entropy of each pixel in the image. The controller may also be configured to determine an entropy of each class in the image based on the entropy of each pixel in the image and determine whether to collect the image based on the entropy of each class.

Claims (55)

1 . An apparatus for collecting a training image of a deep learning model, the apparatus comprising:

a camera sensor configured to capture an image of a surrounding of a vehicle; and

a controller configured to:

determine an entropy of each pixel in the image,

determine an entropy of each class in the image based on the entropy of each pixel in the image, and

determine whether to collect the image based on the entropy of each class,

wherein the controller is configured to:

determine pixels constituting a first class in the image; and

determine, as entropy of the first class, an entropy average of the pixels constituting the first class.

2 . The apparatus of claim 1 , wherein the controller is configured to:

collect the image as the training image of the deep learning model when the entropy of each class is within a preset range.

3 . The apparatus of claim 2 , wherein the controller is configured to:

determine a priority of the training images collected, and

store a preset number of training images in a storage based on the priority.

4 . The apparatus of claim 3 , wherein the controller is configured to:

determine the entropy average of each class included in each training image, and

assign a highest priority to a training image having a highest entropy average.

5 . The apparatus of claim 3 , wherein the controller is configured to:

determine an entropy of a specific class among classes included in each training image, and

assign a highest priority to a training image having a highest entropy of the specific class.

6 . The apparatus of claim 3 , wherein the controller is configured to:

determine, when the training images are additionally collected in a state that the preset number of training images are stored in the storage, the preset number of training images in a higher priority order with respect to the training images stored and the training images additionally collected.

7 . The apparatus of claim 6 , wherein the controller is configured to:

substitute the preset number of training images stored in the storage with the preset number of training images determined.

8 . The apparatus of claim 3 , wherein the controller is configured to:

periodically transmit, to a wireless communication device in a start-off state of the vehicle, the training images stored in the storage.

9 . The apparatus of claim 8 , wherein the controller is configured to:

transmit, to the wireless communication device in a start-on state of the vehicle, a message for requesting to prepare for receiving the training images, and

receive, from the wireless communication device in the start-off state of the vehicle, a message for indicating that preparing for receiving the training images is completed.

10 . A method for collecting a training image of a deep learning model, the method comprising:

taking, by a camera sensor, an image of a surrounding of a vehicle;

determining, by a controller, an entropy of each pixel in the image;

determining, by the controller, an entropy of each class in the image based on the entropy of each pixel in the image; and

determining, by the controller, whether to collect the image based on the entropy of each class,

wherein determining the entropy of the class in the image includes:

determining, by the controller, pixels constituting a first class in the image, and

determining, by the controller, as entropy of the first class, an entropy average of pixels constituting the first class.

11 . The method of claim 10 , wherein determining whether to collect the image includes:

collecting, by the controller, the image as the training image of the deep learning model when all entropy of each class satisfies a preset range.

12 . The method of claim 11 , wherein determining whether to collect the image further includes:

determining, by the controller, a priority of the training images collected, and

storing, by the controller, a preset number of training images in a storage based on the priority.

13 . The method of claim 12 , wherein determining the priority of the training images collected include:

determining, by the controller, the entropy average of each class included in each training image, and

assigning, by the controller, a highest priority to a training image having a highest entropy average.

14 . The method of claim 12 , wherein determining the priority of the training images collected includes:

determining, by the controller, an entropy of a specific class among classes included in each training image, and

assigning, by the controller, a highest priority to a training image having a highest entropy of the specific class.

15 . The method of claim 12 , wherein storing the preset number of the training images further includes:

determining, by the controller, when the training images are additionally collected in a state that the preset number of the training images are stored in the storage, the preset number of training images in a higher priority order with respect to the training images stored and the training images additionally collected, and

substituting, by the controller, the preset number of training images stored in the storage with the preset number of training images determined.

16 . The method of claim 12 , wherein determining whether to collect the image further includes:

transmitting, by the controller to a wireless communication device in a start-on state of the vehicle, a message for requesting to prepare for receiving the training images;

receiving, by the controller from the wireless communication device, in a start-off state of the vehicle, a message for indicating that preparing for receiving the training images is completed; and

periodically transmitting, by the controller to the wireless communication device in the start-off state of the vehicle, the training images stored in the storage.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2023
From: KIM, JIN SOL; LEE, SE JEONG; HEO, JUNG WOO
To: HYUNDAI MOTOR COMPANY; KIA CORPORATION
Reel/Frame 063262/0543 →
Priority Claims (1)
KR 10-2022-0155702 · Nov 18, 2022 · national
Continuity (1)
Related Publication 20240169703A1 · May 23, 2024
References Cited (14)
US 10713540B2 · Zhang et al. · 2020 [cited by applicant]
US 11386674B2 · Lee et al. · 2022 [cited by applicant]
US 11571817B2 · Kim · 2023 [cited by applicant]
US 20200285866A1 · Lee et al. · 2020 [cited by applicant]
US 20210008726A1 · Kim · 2021 [cited by applicant]
US 20210271259A1 · Karpathy · 2021 [cited by applicant]
US 20220156524A1 · Alon et al. · 2022 [cited by applicant]
KR 20190089794A · 2019 [cited by applicant]
KR 102075270B1 · 2020 [cited by applicant]
KR 102177880B1 · 2020 [cited by applicant]
KR 102313215B1 · 2021 [cited by applicant]
Frank, Steven J., and Andrea M. Frank. “Salient slices: Improved neural network training and performance with image entropy.” Neural Computation 32.6 (2020): 1222-1237. (Year: 2020). [cited by examiner]
Holub, Alex, Pietro Perona, and Michael C. Burl. “Entropy-based active learning for object recognition.” 2008 IEEE computer society conference on computer vision and pattern recognition workshops. IEEE, 2008. (Year: 200… [cited by examiner]
Song, Yan, et al. “Entropy-based training data selection for domain adaptation.” Proceedings of COLING 2012: Posters. 2012. (Year: 2012). [cited by examiner]