IP Library › Granted Patent US 10,417,766
Granted Patent B2
US 10,417,766 · App. 15/526,607 · Granted Sep 17, 2019

Method and device for generating metadata including frequency characteristic information of image

Inventors: Tae-gyu Lim (Seoul, KR); Il-koo Kim (Suwon-si, KR); Seung-hoon Han (Suwon-si, KR)
Assignee: SAMSUNG ELECTRONICS CO., LTD.
G06T7/11G06K9/6212G06K9/6218G06T7/168G06T7/42H04N7/01H04N7/015H04N7/0127G06T2207/20021G06T2207/20052
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,417,766
App. No.
15/526,607
Granted
Sep 17, 2019
Kind
B2
Abstract

Provided are a method and device for generating metadata including frequency characteristic information of an image. Pixel values of a current block among blocks divided from the image are converted into frequency coefficients in the frequency domain. A band value of a frequency band corresponding to each of regions of the current block is determined using the frequency coefficients included in the regions of the current block, the regions of the current block being divided to correspond to different frequency bands. Metadata including the frequency characteristic information of the current block is generated based on the determined band values.

Claims (39)

1. A method of generating metadata including frequency characteristic information of an image, the method comprising:

converting pixel values of a current block among blocks divided from the image into frequency coefficients in a frequency domain;

determining, for each of regions of the current block, a band value of a frequency band corresponding to a respective region of the regions of the current block by using the frequency coefficients included in the regions of the current block, the regions of the current block being divided to correspond to different frequency bands; and

generating the metadata including the frequency characteristic information of the current block based on the band value of the frequency band, for each of the regions of the current block, corresponding to the respective region of the current block, wherein the metadata is saved with image data of the image.

2. The method of claim 1 , wherein the regions of the current block comprise m regions which are set according to a predetermined frequency band pattern for dividing the frequency coefficients included in the current block into m frequency bands, wherein m is a natural number.

3. The method of claim 2 , wherein the frequency band pattern has a size of N×N when the current block has an N×N pixel array size, wherein N is a natural number.

4. The method of claim 2 , wherein the frequency coefficients comprise discrete cosine transform (DCT) coefficients generated by performing DCT on the pixel values,

wherein the frequency band pattern divides the current block into the m regions corresponding to the m frequency bands in a diagonal direction crossing a direct-current (DC) coefficient of a low-frequency component and an alternating-current (AC) coefficient which is a highest-frequency component among the DCT coefficients.

5. The method of claim 2 , wherein the determining of the band value of the frequency band corresponding to the respective region of the regions of the current block comprises:

grouping the frequency coefficients of the current block into groups corresponding to the m frequency bands by using a predetermined frequency band pattern;

evaluating the frequency coefficients belonging to each of the groups; and

determining the band value of the frequency band, for each of the regions of the current block, based on a result of evaluating the frequency coefficients belonging to each of the groups.

6. The method of claim 5 , wherein different threshold values of the frequency coefficients are allocated to the frequency bands, and

the evaluating of the frequency coefficients belonging to each of the groups comprises evaluating the frequency coefficients by comparing a statistic of the frequency coefficients belonging to each of the groups with a respective threshold value among the different threshold values allocated to a frequency band corresponding to each of the groups.

7. The method of claim 6 , wherein the determining of the band value of the frequency band corresponding to the respective region of the regions of the current block comprises determining a band value of the frequency band corresponding to each of the groups to be ‘1’ when a result of the comparing reveals that the statistic of the frequency coefficients belonging to each of the groups is greater than or equal to the respective threshold value allocated to the frequency band corresponding to each of the groups, and determining the band value of the frequency band corresponding to each of the groups to be ‘0’ when the statistic of the frequency coefficients is less than the threshold value.

8. The method of claim 2 , wherein, when the predetermined frequency band pattern includes m frequency bands, the determining of the band value of the frequency band corresponding to the respective region of the regions of the current block comprises generating an m-digit bit string having bits corresponding to m band values, and

frequency characteristics of the current block are expressed as values calculated from the m-digit bit string.

9. The method of claim 1 , wherein the image is clustered to have frequency characteristics of one of a high-frequency image, a mid-frequency image, and a low-frequency image, based on a statistic of scalar values calculated with respect to each of the blocks.

10. The method of claim 9 , wherein the metadata is generated by an image transmission device which transmits the image and transmitted together with the image from the image transmission device to an image receiving device which reproduces the image, and

the image is clustered by at least one of the image transmission device and the image receiving device.

11. A device for generating metadata including frequency characteristic information of an image, the device comprising;

a frequency converter configured to convert pixel values of a current block among blocks divided from the image into frequency coefficients in a frequency domain;

a frequency characteristics analyzer configured to determine, for each of regions of the current block, a band value of a frequency band corresponding to a respective region of the regions of the current block by using the frequency coefficients included in the regions of the current block, the regions of the current block being divided to correspond to different frequency bands; and

a metadata generator configured to generate the metadata including the frequency characteristic information of the current block based on the band value of the frequency band, for each of the regions of the current block, corresponding to the respective region of the current block, wherein the metadata is saved with image data of the image.

12. The device of claim 11 , wherein the regions of the current block comprise m regions which are set according to a predetermined frequency band pattern for dividing the frequency coefficients included in the current block into m frequency bands, wherein m is a natural number.

13. The device of claim 12 , wherein the frequency band pattern has a size of N×N when the current block has an N×N pixel array size, wherein N is a natural number.

14. The device of claim 12 , wherein the frequency coefficients comprise discrete cosine transform (DCT) coefficients generated by performing DCT on the pixel values,

wherein the frequency band pattern is used to divide the current block into the m regions corresponding to the m frequency bands in a diagonal direction crossing a direct-current (DC) coefficient of a low-frequency component and an alternating-current (AC) coefficient which is a highest-frequency component among the DCT coefficients.

15. The device of claim 12 , wherein the frequency characteristics analyzer is configured to group the frequency coefficients of the current block into groups corresponding to m frequency bands by using a predetermined frequency band pattern, to evaluate the frequency coefficients belonging to each of the groups, and to determine the band value of the frequency band, for each of the regions of the current block, based on a result of evaluating the frequency coefficients belonging to each of the groups.

16. The device of claim 15 , wherein different threshold values of the frequency coefficients are allocated to the frequency bands, and

the frequency characteristics analyzer is configured to evaluate the frequency coefficients by comparing a statistic of the frequency coefficients belonging to each of the groups with a respective threshold value among the different threshold values allocated to a frequency band corresponding to each of the groups.

17. The device of claim 16 , wherein the frequency characteristics analyzer is configured to determine a band value of the frequency band corresponding to each of the groups to be ‘1’ when a result of the comparing reveals that the statistic of the frequency coefficients belonging to each of the groups is greater than or equal to the respective threshold value allocated to the frequency band corresponding to each of the groups, and to determine the band value of the frequency band corresponding to each of the groups to be ‘0’ when the result of the comparing reveals that the statistic of the frequency coefficients is less than the threshold value.

18. The device of claim 12 , wherein, when the predetermined frequency band pattern includes m frequency bands, the frequency characteristics analyzer is configured to generate an m-digit bit string having bits corresponding to m band values, and

frequency characteristics of the current block are expressed as values calculated from the m-digit bit string.

19. The device of claim 11 , wherein the image is clustered to have frequency characteristics of one of a high-frequency image, a mid-frequency image, and a low-frequency image, based on a statistic of scalar values calculated with respect to each of the blocks, and

the device is an image transmission device which transmits the image,

the metadata is transmitted together with the image from the image transmission device to an image receiving device which reproduces the image, and

the image is clustered by at least one of the image transmission device and the image receiving device.

20. A non-transitory computer-readable recording medium having recorded thereon a program for performing in a computer the method of claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 12, 2017
From: LIM, TAE-GYU; KIM, IL-KOO; HAN, SEUNG-HOON
To: SAMSUNG ELECTRONICS CO., LTD.
Reel/Frame 042458/0225 →
Continuity (2)
Provisional Application 62079239 · Nov 13, 2014
Related Publication 20170337691A1 · Nov 23, 2017
Cited By (1)
US 12,309,365