IP Library › Granted Patent US 11,715,197
Granted Patent B2
US 11,715,197 · App. 16/753,051 · Granted Aug 1, 2023

Image segmentation method and device

Inventors: Hyo-Seob Song (Seoul, KR); Joon-Ho Lee (Seoul, KR); Ji-Eun Song (Seoul, KR)
Assignee: SAMSUNG SDS CO., LTD.
G06T7/0012G06F18/22G06N20/00G06T7/0002G06T7/11G06V10/50G06V10/758G06V10/764G06V10/774G06V10/82G06V40/193G06T2207/20081
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,715,197
App. No.
16/753,051
Granted
Aug 1, 2023
Kind
B2
Abstract

An image segmentation method according to an embodiment of the present invention is performed in a computing device having one or more processors and memory for storing one or more programs executed by means of the one or more processors, and includes the steps of: (a) receiving the input of an image; (b) generating a first-generation image segment set by dividing the input image in an overlapped manner; and (c) generating a second or higher-generation image segment set from the first-generation image segment set, wherein a subsequent-generation image segment set is generated by dividing in an overlapped manner at least one of a plurality of image segments included in the previous-generation image segment set.

Claims (35)

1. An image segmentation method, which performed in a computing device having one or more processors and a memory for storing one or more programs executed by the one or more processors, the method comprising the steps of:

(a) receiving an input image;

(b) generating a first-generation image segment set by dividing the input image in an overlapped manner;

(c) generating a second or higher-generation image segment set from the first-generation image segment set, wherein a subsequent-generation image segment set is generated by dividing in an overlapped manner at least one image segment that satisfies a preset selection condition among a plurality of image segments comprised in the previous-generation image segment set, wherein the preset selection condition is related to pixel similarity in an image; and

(d) generating a training image set including the input image and at least a part of image segments included in the first-generation image segment set and the subsequent-generation image segment set,

wherein the step (c) comprises:

calculating the pixel similarity in an image for each of the plurality of image segments comprised in the previous-generation image segment set by comparing each pixel in the image with other pixels in the same image based on at least one of brightness, color value, frequency and gradient of pixels; and

generating the subsequent-generation image segment set by dividing in an overlapped manner each of image segments that have the pixel similarity smaller than or equal to a preset reference value among the plurality of image segments comprised in the previous-generation image segment set.

2. The image segmentation method of claim 1 , wherein each of a plurality of image segments included in a j th -generation image segment set comprises a region that overlaps one or more other image segments included in the j th -generation image segment set, where j of the j th -generation image segment set is an integer greater than or equal to 1.

3. The image segmentation method of claim 1 , wherein the step (c) terminates generation of the subsequent-generation image segment set when there is no image segment whose pixel similarity is smaller than or equal to the reference value.

4. The image segmentation method of claim 1 , wherein the step (c) terminates generation of the subsequent-generation image segment set when a preset segmentation termination condition is satisfied.

5. The image segmentation method of claim 4 , wherein the step (c) determines whether the preset segmentation termination condition is satisfied based on a size of each of the image segments comprised in the previous-generation image segment set and a preset reference value.

6. The image segmentation method of claim 4 , wherein the step (c) determines whether the preset segmentation termination condition is satisfied based on a total number of image segments comprised in image segment sets generated so far and a preset reference value.

7. The image segmentation method of claim 1 , wherein the step (d) comprises:

reducing the input image and at least a part of the image segments included in each of the first to n th -generation image segment sets to a preset size, where n of the n th -generation image segment is an integer greater than or equal to 2.

8. The image segmentation method of claim 7 , further comprising:

(e) training a deep learning-based image classifier using the reduced images.

9. An image segmentation device comprising:

one or more processors;

a memory; and

one or more programs stored in the memory, the one or more programs configured to be executed by the one or more processors, the one or more programs comprising commands for performing the steps of:

(a) receiving an input image,

(b) generating a first-generation image segment set by dividing the input image in an overlapped manner,

(c) generating a second or higher-generation image segment set from the first-generation image segment set, wherein a subsequent-generation image segment set is generated by dividing in an overlapped manner at least one image segment that satisfies a preset selection condition among a plurality of image segments comprised in the previous-generation image segment set, wherein the preset selection condition is related to pixel similarity in an image, and

(d) generating a training image set including the input image and at least a part of image segments included in the first-generation image segment set and the subsequent-generation image segment set,

wherein the step (c) comprises:

calculating the pixel similarity in an image for each of the plurality of image segments comprised in the previous-generation image segment set by comparing each pixel in the image with other pixels in the same image based on at least one of brightness, color value, frequency and gradient of pixels; and

generating the subsequent-generation image segment set by dividing in an overlapped manner each of image segments that have the pixel similarity smaller than or equal to a preset reference value among the plurality of image segments comprised in the previous-generation image segment set.

10. The image segmentation device of claim 9 , wherein each of a plurality of image segments included in a j th -generation image segment set includes a region that overlaps one or more other image segments included in the j th -generation image segment set, where j of the j th -generation image segment set is an integer greater than or equal to 1.

11. The image segmentation device of claim 9 , wherein the step (c) terminates generation of the subsequent-generation image segment set when there is no image segment whose pixel similarity is smaller than or equal to the reference value.

12. The image segmentation device of claim 9 , wherein the step (c) terminates generation of the subsequent-generation image segment set when a preset segmentation termination condition is satisfied.

13. The image segmentation device of claim 12 , wherein the step (c) determines whether the preset segmentation termination condition is satisfied based on a size of each of the image segments comprised in the previous-generation image segment set and a preset reference value.

14. The image segmentation device of claim 12 , wherein the step (c) determines whether the preset segmentation termination condition is satisfied based on a total number of image segments comprised in image segment sets generated so far and a preset reference value.

15. The image segmentation device of claim 9 , wherein the step (d) comprises reducing the input image and a least a part of the image segments comprised in each of the first to n th -generation image segment sets to a preset size, where n of the n th -generation image segment is an integer greater than or equal to 2.

16. The image segmentation device of claim 15 , wherein the one or more programs further comprise a command for performing training a deep learning-based image classifier using the reduced images.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 2, 2020
From: SONG, HYO-SEOB; LEE, JOON-HO; SONG, JI-EUN
To: SAMSUNG SDS CO., LTD.
Reel/Frame 052293/0904 →
Priority Claims (1)
KR 10-2018-0062295 · May 31, 2018 · national
Continuity (1)
Related Publication 20200320711A1 · Oct 8, 2020
Cited By (1)
US 12,229,936