IP Library › Granted Patent US 12,664,631
Granted Patent B2
US 12,664,631 · App. 18/441,675 · Granted Jun 23, 2026

Image processing device, image processing method, and recording medium

Inventors: Yuji Umezu (Yokohama, JP); Atsushi Matsuzaka (Yokohama, JP)
Assignee: Socionext Inc.
G06T5/94G06T5/70G06T2207/20192G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,664,631
App. No.
18/441,675
Filed
Feb 14, 2024
Granted
Jun 23, 2026
Kind
B2
Examiner
HAIDER, SYED
Art Unit
2633
USPC
382/274
Abstract

An image processing device includes a memory and a processor configured to calculate a reference black level and a reference illumination light component based on pixel values of peripheral pixels located around a target pixel for image processing using image data acquired by an imaging device, correct a black level of the target pixels based on the reference black level calculated by the processor, and perform a tone correction of the target pixels with the black level corrected based on the reference illumination light component calculated by the processor. Accordingly, even when a large gain is applied to a dark portion of an image in a local tone correction, it is possible to generate an image with high visibility in which an occurrence of raised black levels is suppressed.

Claims (21)

1 . An image processing device, comprising:

a memory; and

a processor coupled to the memory and configured to

calculate, using image data acquired by an imaging device, a reference black level and a reference illumination light component based on pixel values of peripheral pixels located around a target pixel for image processing;

correct a black level of the target pixel based on the reference black level calculated by the processor; and

perform, based on the reference illumination light component calculated by the processor, a tone correction of the target pixel with the black level thereof corrected,

wherein the processor calculates, for each of a plurality of target pixels, the reference black level and the reference illumination light component based on the pixel values of the peripheral pixels located around the target pixel.

2 . The image processing device as claimed in claim 1 , wherein the processor calculates a minimum value of the pixel values of the peripheral pixels as the reference black level.

3 . The image processing device as claimed in claim 1 , wherein the processor calculates an average value of the pixel values of the peripheral pixels as the reference illumination light component.

4 . The image processing device as claimed in claim 1 , wherein the processor performs a first edge-preserving smoothing process when calculating the reference black level, and performs a second edge-preserving smoothing process when calculating the reference illumination light component.

5 . The image processing device as claimed in claim 4 , wherein the processor utilizes a part of a processing result of the first edge-preserving smoothing process in the second edge-preserving smoothing process.

6 . An image processing method executed by a computer, comprising:

a calculation process of calculating, using image data acquired by an imaging device, a reference black level and a reference illumination light component based on pixel values of peripheral pixels located around a target pixel for image processing;

a black level correction process of correcting a black level of the target pixel based on the reference black level calculated by the calculation process; and

a tone correction process of performing, based on the reference illumination light component calculated by the calculation process, a tone correction of the target pixel with the black level thereof corrected,

wherein, for each of a plurality of target pixels, the reference black level and the reference illumination light component are calculated based on the pixel values of the peripheral pixels located around the target pixel.

7 . A non-transitory computer-readable recording medium having a program embodied therein for causing a computer to perform:

a calculation process of calculating, using image data acquired by an imaging device, a reference black level and a reference illumination light component based on pixel values of peripheral pixels located around a target pixel for image processing;

a black level correction process of correcting a black level of the target pixel based on the reference black level calculated by the calculation process; and

a tone correction process of performing, based on the reference illumination light component calculated by the calculation process, a tone correction of the target pixel with the black level thereof corrected,

wherein, for each of a plurality of target pixels, the reference black level and the reference illumination light component are calculated based on the pixel values of the peripheral pixels located around the target pixel.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2024
From: UMEZU, YUJI; MATSUZAKA, ATSUSHI
To: SOCIONEXT INC.
Reel/Frame 066467/0089 →
Continuity (2)
Continuation PCTJP2021031197 · Aug 25, 2021
Related Publication 20240185402A1 · Jun 6, 2024
References Cited (22)
US 10757339B2 · Dabral et al. · 2020 [cited by applicant]
US 10803565B2 · Chen et al. · 2020 [cited by applicant]
US 20080192819A1 · Ward et al. · 2008 [cited by applicant]
US 20120092539A1 · Katagiri · 2012 [cited by examiner]
US 20140146198A1 · Omori · 2014 [cited by examiner]
US 20150116586A1 · Mahowald · 2015 [cited by examiner]
US 20170140922A1 · Iwasaki et al. · 2017 [cited by applicant]
US 20210073958A1 · Masuda · 2021 [cited by applicant]
JP 2012108850A · 2012 [cited by examiner]
JP 2012256168A · 2012 [cited by applicant]
JP 2015212978A · 2015 [cited by applicant]
JP 2016076804A · 2016 [cited by applicant]
JP 2017092350A · 2017 [cited by applicant]
JP 2017092850A · 2017 [cited by examiner]
JP 2020003998A · 2020 [cited by applicant]
JP 2021016103A · 2021 [cited by applicant]
WO 2019193807A1 · 2019 [cited by applicant]
WO 2021010356A1 · 2021 [cited by applicant]
International Search Report dated Nov. 16, 2021 issued in International Patent Application No. PCT/JP2021/031197, with English translation. [cited by applicant]
Written Opinion of the International Searching Authority dated Nov. 16, 2021 issued in International Patent Application No. PCT/JP2021/031197, with English translation. [cited by applicant]
Kaiming He et al., “Guided Image Filtering”, IEEE Transactions on Pattern Analysis and Machine Intelligence (vol. 35, Issue: 6, Jun. 2013) pp. 1-13. [cited by applicant]
1 Office Action issued in the corresponding Japanese Patent Application No. 2023-543558, mailed on Jun. 10, 2025. [cited by applicant]