Method and device for acquiring image by using light-emitting element array
Disclosed are a method of acquiring an image using a light-emitting element array and an apparatus therefor. The method of acquiring an image using a light-emitting element array includes reconstructing a first image from some images among source images, detecting a partial region containing a detection target object from the first image, acquiring partial-region images corresponding to the partial region from each of the source images, and reconstructing a second image from the partial-region images using the FPMP.
1. A method of acquiring an image using a light-emitting element array, the method comprising:
acquiring N×M source images of a sample using a light source of each of N×M (N and M are integers of 3 or more) light-emitting elements arranged in a matrix structure;
selecting n×m (n is an integer less than N and m is an integer less than M) images among the source images based on a central image using a central light-emitting element, located at a center of the matrix structure, as a light source, performing a Fourier Ptychographic Microscopy Process (FPMP) on the n×m images, and reconstructing a low-resolution, large-area image;
detecting a partial region containing a detection target object from the low-resolution large-area image, and acquiring partial-region images matching the partial region from each of the source images; and
performing FPMP on the partial-region images and reconstructing a high-resolution image on the partial region,
wherein the reconstructing of the high-resolution image on the partial region comprises:
determining overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the N×M source images,
acquiring partial-region images from the remaining images except for the overlapping images among the N×M source images, and
performing FPMP on partial-region images acquired from the remaining images except for the overlapping images,
wherein the determining of the overlapping images comprises:
confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image;
confirming a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1), and
deleting the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more, and
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in a matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
2. The method according to claim 1 , wherein the reconstructing of the low-resolution, large-area image comprises:
determining overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the n×m images; and
performing FPMP on remaining images except for the overlapping images among the n×m images.
3. A method of acquiring an image using a light-emitting element array, the method comprising:
acquiring a plurality of source images by sequentially irradiating a sample with a plurality of light-emitting element light sources arranged in a light-emitting element array;
selecting some images from among the plural source images;
reconstructing a first image from the some images using a Fourier Ptychographic Microscopy Process (FPMP);
detecting a partial region containing a detection target object from the first image;
acquiring partial-region images corresponding to the partial region from each of the source images; and
reconstructing a second image from the partial-region images using the FPMP,
wherein the reconstructing of the first image comprises:
determining overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, from among the some images,
wherein the determining of the overlapping images comprises:
confirming a central image using a central light-emitting element, located at a center of light-emitting elements arrangement, as a light source and confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image,
confirming a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1), and
deleting the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more, and
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in the matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
4. The method according to claim 3 , wherein the reconstructing of the first image comprises:
performing FPMP on remaining images except for the overlapping images among the some images.
5. The method according to claim 3 , wherein the reconstructing of the second image comprises:
determining overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the source images;
acquiring partial-region images from the remaining images except for the overlapping images among the source images; and
performing FPMP on partial-region images acquired from the remaining images except for the overlapping images.
6. A method of acquiring an image using a light-emitting element array, the method comprising:
acquiring a plurality of source images by sequentially irradiating a sample with a plurality of light-emitting element light sources;
determining overlapping images, in which a dark field and a bright field exist in a preset ratio, among the plural source images; and
applying a Fourier Ptychographic Microscopy Process (FPMP) to remaining images except for the overlapping images among the plural source images and generating a reconstructed image,
wherein the determining of the overlapping images comprises:
confirming a central image using a central light-emitting element, located at a center of light-emitting elements arrangement, as a light source and confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image,
confirming a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1), and
deleting the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more, and
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in the matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
7. The method according to claim 6 , wherein the generating of the reconstructed image comprises:
selecting some images from among the remaining images based on a central image using as a central light-emitting element, located at a center of the light-emitting element array, as a light source;
performing FPMP on the some images and reconstructing a low-resolution, large-area image;
detecting a partial region containing a detection target object from the low-resolution, large-area image, and acquiring partial-region images matching the partial region from each of the remaining images; and
performing FPMP on the partial-region images and reconstructing a high-resolution image on the partial region.
8. An apparatus for acquiring an image, comprising:
an image acquirer configured to acquire N×M source images photographed using a light source of each of a plurality of light-emitting elements arranged in a light-emitting element array;
a storage configured to store the source images; and
a controller,
wherein the controller comprises at least one processor,
wherein the processor is configured to select n×m (n is an integer less than N and m is an integer less than M) images from among the source images based on a central image using a central light-emitting element, located at a center of the light-emitting element array, as a light source, to reconstruct a low-resolution, large-area image from the nxm images using a Fourier Ptychographic Microscopy Process (FPMP), to detect a partial region containing a detection target object from the low-resolution, large-area image, to acquire partial-region images matching the partial region from each of the source images; and to reconstruct a high-resolution image on the partial region using the FPMP,
wherein the controller determines overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the N×M source images, acquires partial-region images from the remaining images except for the overlapping images among the N×M source images, and performs FPMP on partial-region images acquired from the remaining images except for the overlapping images,
wherein the controller performs the following processes for determining the overlapping images:
confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image;
confirming a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1); and
deleting the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more, and
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in a matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
9. The apparatus according to claim 8 , wherein the controller determines overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the n×m images; and performs FPMP on remaining images except for the overlapping images among the n×m images.
10. An apparatus for acquiring an image, comprising:
an image acquirer configured to acquire a plurality of source images photographed using a light source of each of a plurality of light-emitting elements arranged in a light-emitting element array;
a storage configured to store the source images; and
a controller,
wherein the controller comprises at least one processor,
wherein the processor is configured to select some images from among the plural source images, located at a center of the light-emitting element array, as a light source, to reconstruct a first image from the some mages using a Fourier Ptychographic Microscopy Process (FPMP), to detect a partial region containing a detection target object from the first image, to acquire partial-region images corresponding to the partial region from each of the source images; and to reconstruct a second image from the partial region images using the FPMP,
wherein the controller determines overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among some images;
wherein the controller is configured to:
confirm a central image using a central light-emitting element, located at a center of light-emitting elements arrangement, as a light source and confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image,
confirm a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1), and
delete the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more, and
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in a matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
11. The apparatus according to claim 10 , wherein the controller performs FPMP on remaining images except for the overlapping images among the some images.
12. The apparatus according to claim 10 , wherein the controller determines overlapping images, in which a dark field (DF) and a bright field (BF) exist in a preset ratio, among the source images; acquires partial-region images from the remaining images except for the overlapping images among the source images; and performs FPMP on partial-region images acquired from the remaining images except for the overlapping images.
13. An apparatus for acquiring an image, comprising:
an image acquirer configured to acquire a plurality of source images photographed using a light source of each of a plurality of light-emitting elements arranged in a light-emitting element array;
a storage configured to store the source images; and
a controller,
wherein the controller comprises at least one processor,
wherein the processor is configured to determine overlapping images, in which a dark field and a bright field exist in a preset ratio, from among the plural source images, to apply a Fourier Ptychographic Microscopy Process (FPMP) to remaining images except for overlapping images among the plural source images, and to generate a reconstructed image,
wherein the controller is configured to:
confirm a central image using a central light-emitting element, located at a center of light-emitting elements arrangement, as a light source and confirming an image group corresponding to an index (2k+1, 2k+1) assigned to an outer row and column image group from the central image based on an index (1,1) assigned to the central image,
confirm a DF and BF ratio of each image belonging to the image group corresponding to the (2k+1, 2k+1), and
delete the image group corresponding to the (2k+1, 2k+1) from the source images when the number of images having DF and BF in the preset ratio among images belonging to the image group is two or more,
wherein the source images are distinguished by indexes matching respective positions of N×M light-emitting elements arranged in a matrix form, an index assigned to the central image is (1,1), and an index assigned to an image group using light-emitting elements, arranged outside by k rows or k columns from the central light-emitting element, as a light source is (2k+1, 2k+1), where k=1,2,3 . . . (M−1)/2, and an image group corresponding to the (2k+1, 2k+1) is composed of {(2k+1)×(2k+1)}−{(2k−1)×(2k−1)} images.
14. The apparatus according to claim 13 , wherein the controller performs processes as follows for generating the reconstructed image:
selecting some images based on a central image using a central light-emitting element, located at a center of the light-emitting element array, as a light source among the remaining images;
performing FPMP on the some images and reconstructing a low-resolution, large-area image;
detecting a partial region containing a detection target object from the low-resolution, large-area image and acquiring partial-region images matching the partial region from each of the remaining images; and
performing FPMP on the partial-region images and reconstructing a high-resolution image for the partial region.