IP Library Granted Patent US 11,659,194
Granted Patent B2
US 11,659,194 · App. 16/034,888 · Granted May 23, 2023

Method of adjusting bitrate of image and image capturing apparatus

Inventors: Young Seo Park (Seongnam-si, KR); Sang Won Lee (Seongnam-si, KR); Yun Seok Kwon (Seongnam-si, KR)
Assignee: Hanwha Techwin Co., Ltd.
H04N19/42H04N19/124H04N19/146H04N19/176H04N19/18H04N19/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,659,194
App. No.
16/034,888
Granted
May 23, 2023
Kind
B2
Abstract

A method of adjusting a bitrate of an image based includes: identifying magnitudes of one or more frequency components in the image; determining a frequency filter based on a difference between a current bitrate and a target bitrate of the image such that the greater is the difference between the current bitrate and the target bitrate, magnitudes of the more high frequency components are reduced by the frequency filter; and applying the determined frequency filter to the magnitudes of the one or more frequency components.

Claims (53)

1. A method of adjusting a bitrate of an image frame, the method comprising:

identifying magnitudes of one or more frequency components in the image by performing a two-dimensional (2D) discrete cosine transformation (DCT) on the image, and arranging the magnitudes of the one or more frequency components on a 2D plane in a first direction and a second direction of the image;

determining a frequency filter based on a difference between a current bitrate and a target bitrate of the image, wherein the frequency filter reduces magnitudes of frequency components other than magnitudes of frequency components existing between an origin point and a predetermined boundary line on the 2D plane;

wherein the predetermined boundary line is a straight line extending in a direction different from the first direction and the second direction, and the first direction and the second direction are perpendicular to each other;

wherein the frequency filter consists of two constant values comprising:

a first filter value corresponding to each of the frequency components existing between the origin point and the predetermined boundary line on the 2D plane; and

a second filter value corresponding to each of the frequency components other than the frequency components existing between the origin point and the predetermined boundary line on the 2D plane;

determining the number of low frequency components in the frequency filter having the first filter value, from the difference between the current bitrate and the target bitrate of the image, while values of the frequency filter remain unchanged, wherein as the difference between the current bitrate and the target bitrate increases, more number of high frequency components are excluded by the frequency filter and as the difference between the current bitrate and the target bitrate decreases, less number of high frequency components are excluded by the frequency filter;

applying the determined frequency filter to the magnitudes of the one or more frequency components in real time;

generating, in advance, the frequency filters corresponding to the difference between the current bitrate and the target bitrate;

storing the frequency filters in advance in a memory;

selecting in real time, the frequency filter stored in the memory, corresponding to real time difference between the current bitrate and the target bitrate, and applying the selected filter to the magnitude of the frequency component;

wherein the image comprises a plurality of image blocks; and

wherein the determining the frequency filter comprises determining a frequency filter corresponding to a difference between an output bitrate and a target bitrate of each image block, with respect to each of the at least one image block.

2. An image capturing apparatus comprising:

at least a controller;

a memory;

the controller being configured to identify magnitudes of one or more frequency components in an image input to the image capturing apparatus;

the controller performing a two-dimensional (2D) discrete cosine transformation (DCT) on the image, and arranging the magnitudes of the one or more frequency components on a 2D plane in a first direction and a second direction of the image;

the controller determining a frequency filter based on a difference between a current bitrate and a target bitrate of the image, wherein the frequency filter is configured to reduce magnitudes of frequency components other than magnitudes of frequency components existing between an origin point and a predetermined boundary line on the 2D plane;

wherein the predetermined boundary line is a straight line extending in a direction different from the first direction and the second direction, and the first direction and the second direction are perpendicular to each other;

wherein the frequency filter consists of two constant values comprising:

a first filter value corresponding to each of the frequency components existing between the origin point and the predetermined boundary line on the 2D plane; and

a second filter value corresponding to each of the frequency components other than the frequency components existing between the origin point and the predetermined boundary line on the 2D plane;

the controller determining the number of low frequency components in the frequency filter having the first filter value, from the difference between the current bitrate and the target bitrate of the image, such that greater the difference between the current bitrate and the target bitrate, magnitudes of more number of high frequency components are reduced by the frequency filter; and

the controller applying the determined frequency filter to the magnitudes of the one or more frequency components in real time.

3. The image capturing apparatus of claim 2 , wherein the controller is configured to multiply each of the magnitudes of the frequency components existing between the origin point and the predetermined boundary line on the 2D plane by the first filter value, and multiply each of the magnitudes of the frequency components other than the frequency components existing between the origin point and the predetermined boundary line on the 2D plane by the second filter value.

4. The image capturing apparatus of claim 2 , wherein the predetermined boundary line is perpendicular to a line bisecting an angle formed by the first direction and the second direction.

5. The image capturing apparatus of claim 2 , wherein the controller is configured to generate an output image based on the magnitudes of the one or more frequency components, to which the frequency filter is applied, and encode the output image.

6. The image capturing apparatus of claim 2 , wherein the controller:

generates, in advance, the frequency filters corresponding to the difference between the current bitrate and the target bitrate;

stores the frequency filters in advance in the memory; and

selects in real time, the frequency filter stored in the memory, corresponding to real time difference between the current bitrate and the target bitrate, and applies the selected filter to the magnitude of the frequency component.

7. A method of adjusting a bitrate of an image, the method comprising:

identifying magnitudes of one or more frequency components in the image by performing a two-dimensional (2D) discrete cosine transformation (DCT) on the image, and arranging the magnitudes of the one or more frequency components on a 2D plane in a first direction and a second direction of the image;

determining a frequency filter based on a difference between a current bitrate and a target bitrate of the image, wherein the frequency filter is configured to reduce magnitudes of frequency components other than magnitudes of frequency components existing between an origin point and a predetermined boundary line on the 2D plane;

wherein the predetermined boundary line is a straight line extending in a direction different from the first direction and the second direction, and the first direction and the second direction are perpendicular to each other:

wherein the frequency filter consists of two constant values comprising:

a first filter value corresponding to each of the frequency components existing between the origin point and the predetermined boundary line on the 2D plane; and

a second filter value corresponding to each of the frequency components other than the frequency components existing between the origin point and the predetermined boundary line on the 2D plane;

determining the number of low frequency components in the frequency filter having the first filter value, from the difference between the current bitrate and the target bitrate of the image, while values of the frequency filter remain unchanged, wherein as the difference between the current bitrate and the target bitrate increases, more number of high frequency components are reduced by the frequency filter and as the difference between the current bitrate and the target bitrate decreases, less number of high frequency components are reduced by the frequency filter; and

applying the determined frequency filter to the magnitudes of the one or more frequency components in real time.

8. The method of claim 7 , wherein the applying the frequency filter to the magnitudes of the one or more frequency components comprises:

multiplying each of the magnitudes of the frequency components existing between the origin point and the predetermined boundary line on the 2D plane by the first filter value; and

multiplying each of the magnitudes of the frequency components other than the frequency components existing between the origin point and the predetermined boundary line on the 2D plane by the second filter value.

9. The method of claim 7 , wherein the predetermined boundary line is perpendicular to a line bisecting an angle formed by the first direction and the second direction.

10. The method of claim 7 , further comprising:

after the applying the frequency filter, generating an output image based on the magnitudes of the one or more frequency components to which the frequency filter is applied; and

encoding the output image.

11. The method of claim 7 , further comprising:

generating, in advance, the frequency filters corresponding to the difference between the current bitrate and the target bitrate;

storing the frequency filters in advance in the memory; and

selecting in real time, the frequency filter stored in the memory, corresponding to real time difference between the current bitrate and the target bitrate, and applying the selected filter to the magnitude of the frequency component.

Assignments (2)
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 13, 2018
From: PARK, YOUNG SEO; LEE, SANG WON; KWON, YUN SEOK
To: HANWHA TECHWIN CO., LTD
Reel/Frame 046545/0294 →
Priority Claims (1)
KR 10-2017-0089158 · Jul 13, 2017 · national
Continuity (1)
Related Publication 20190020885A1 · Jan 17, 2019