IP Library Granted Patent US 10,574,991
Granted Patent B2
US 10,574,991 · App. 16/432,296 · Granted Feb 25, 2020

Apparatus and method for processing image

Inventors: Ji Hyung Ryu (Seongnam-si, KR); II Sik Yang (Seongnam-si, KR)
Assignee: HANWHA TECHWIN CO., LTD.
H04N19/124G06T5/002G06T5/003G06T5/20G06T5/50H04N19/117H04N19/132H04N19/137H04N19/142H04N19/146H04N19/167H04N19/172H04N19/184H04N19/194H04N19/59H04N19/85G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,574,991
App. No.
16/432,296
Granted
Feb 25, 2020
Kind
B2
Abstract

An image processing apparatus includes an image processor and an encoder. The image processor enhances an edge of an input image, removes noise from the input image, synthesizes the edge-enhanced image and the noise-removed image, and removes a high frequency from the synthesized image. The encoder pre-encodes a downsized synthesized image, obtains a pre-bit rate of the pre-encoded image, sets a quantization parameter value based on a reference bit rate and the pre-bit rate, and compresses the high-frequency removed image based on the quantization parameter value.

Claims (32)

1. An image processing apparatus, comprising:

an image processor configured to enhance an edge of an input image, remove noise from the input image, synthesize the edge-enhanced image and the noise-removed image, and remove a high frequency from the synthesized image; and

an encoder configured to pre-encode a downsized synthesized image to obtain a pre-bit rate of the pre-encoded image, set a quantization parameter value based on a reference bit rate and the pre-bit rate, and compress the high-frequency removed image based on the quantization parameter value,

wherein, in response to detecting no event in the input image, the encoder is configured to decrease a frame rate of the high-frequency removed image, insert an P frame to compress the high-frequency removed image, or increase the quantization parameter value of an area in which the event is not detected.

2. The image processing apparatus of claim 1 , wherein the encoder is configured to obtain a current bit rate of a current image, and in response to determining that the current bit rate is less than the reference bit rate, the image processor is configured to decrease or maintain at least one of an edge enhancement level, a noise removal level, and a cutoff frequency level to remove the high frequency, with respect to a next image.

3. The image processing apparatus of claim 1 , wherein the reference bit rate indicates an allowable maximum output bit rate and the pre-bit rate indicates a bit rate overshoot of the pre-encoded image.

4. The image processing apparatus of claim 1 , wherein the encoder is configured to set the quantization parameter value to be greater than an existing quantization parameter value in response to determining that the pre-bit rate is greater than a downsized reference bit rate, the downsized reference bit rate being a reference bit rate reduced by a rate in which the synthesized image is downsized to the downsized synthesized image.

5. The image processing apparatus of claim 1 , wherein the encoder is configured to maintain the quantization parameter value to be an existing quantization parameter value in response to determining that the pre-bit rate is equal to or less than a downsized reference bit rate, the downsized reference bit rate being a reference bit rate reduced by a rate in which the synthesized image is downsized to the downsized synthesized image.

6. The image processing apparatus of claim 1 , wherein the event comprises at least one of a movement of an object, a change of a scene, generation of noise, a movement of a background, panning of a camera module, tilting of the camera module, zooming of the camera module, and detection of a human face in the input image.

7. The image processing apparatus of claim 1 , wherein, in response to detecting an event in the input image, the image processor is configured to increase a cutoff frequency to remove the high frequency from the synthesized image, or the encoder is configured to increase a frame rate of the high-frequency removed image, insert an I frame to compress the high-frequency removed image, or increase the quantization parameter value, or decrease the quantization parameter value of an area in which the event is detected.

8. An image processing apparatus, comprising:

an image processor configured to enhance an edge of an input image, remove noise from the input image, synthesize the edge-enhanced image and the noise-removed image, and remove a high frequency from the synthesized image; and

an encoder configured to compress the high-frequency removed image,

wherein, in response to detecting an event in the input image, the image processor is configured to increase a cutoff frequency to remove the high frequency from the synthesized image,

wherein, in response to detecting no event in the input image, the encoder is configured to decrease a frame rate of the high-frequency removed image, insert an P frame to compress the high-frequency removed image, or increase the quantization parameter value of an area in which the event is not detected.

9. The image processing apparatus of claim 8 , wherein the encoder is configured to obtain a current bit rate of a current image, and in response to determining that the current bit rate is less than the reference bit rate, the image processor is configured to decrease or maintain at least one of an edge enhancement level, a noise removal level, and a cutoff frequency level to remove the high frequency, with respect to a next image.

10. The image processing apparatus of claim 9 , wherein the reference bit rate indicates an allowable maximum output bit rate.

11. The image processing apparatus of claim 8 , wherein the event comprises at least one of a movement of an object, a change of a scene, generation of noise, a movement of a background, panning of a camera module, tilting of the camera module, zooming of the camera module, and detection of a human face in the input image.

12. The image processing apparatus of claim 8 , wherein, in response to detecting an event in the input image, the image processor is configured to increase a cutoff frequency to remove the high frequency from the synthesized image, or the encoder is configured to increase a frame rate of the high-frequency removed image, insert an I frame to compress the high-frequency removed image, or increase the quantization parameter value, or decrease the quantization parameter value of an area in which the event is detected.

13. An image processing method, comprising:

enhancing, by an image processor, an edge of an input image;

removing, by the image processor, noise from the input image;

synthesizing, by the image processor, the edge-enhanced image and the noise-removed image;

removing, by the image processor, a high frequency from the synthesized image;

increasing, by an encoder, a frame rate in response to detecting an event in the input image by the image processor; and

compressing, by the encoder, the high-frequency removed image based on the increased frame rate;

further comprising:

wherein, in response to detecting no event in the input image by the image processor, by the encoder, decreasing a frame rate of the high-frequency removed image, inserting an P frame to compress the high-frequency removed image, or increasing the quantization parameter value of an area in which the event is not detected.

14. The image processing method of claim 13 , further comprising:

obtaining, by the encoder, a current bit rate of the image; and

in response to determining that the current bit rate is less than a reference bit rate, decreasing or maintaining, by the image processor, at least one of an edge enhancement level, a noise removal level, and a cutoff frequency level to remove the high frequency, with respect to a next image.

15. The image processing method of claim 14 , wherein the reference bit rate indicates an allowable maximum output bit rate.

Assignments (3)
NUNC PRO TUNC ASSIGNMENT Recorded Jan 5, 2026
From: VISIONEXT CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 073358/0086 →
CHANGE OF NAME Recorded Aug 10, 2023
From: HANWHA TECHWIN CO., LTD.
To: HANWHA VISION CO., LTD.
Reel/Frame 064549/0075 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 8, 2022
From: HANWHA TECHWIN CO., LTD.
To: HANWHA TECHWIN CO., LTD.; VISIONEXT CO., LTD.,
Reel/Frame 058927/0216 →