IP Library Granted Patent US 12,526,537
Granted Patent B2
US 12,526,537 · App. 18/905,238 · Granted Jan 13, 2026

Imaging apparatus, depth map generation method, and program

Inventors: Hirondo Nakatogawa (Tokyo, JP); Yoshiro Aoki (Tokyo, JP); Hitoshi Tanaka (Tokyo, JP)
Assignee: Japan Display Inc.
H04N23/95G06T3/40G06T7/55G06T2207/20104G06T2207/20212G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,526,537
App. No.
18/905,238
Granted
Jan 13, 2026
Kind
B2
Abstract

An arithmetic control unit executes: an imaging process of controlling a coded imaging system to capture an image of a subject by coded imaging and obtain a first captured image; an image generation process of reducing resolution of the first captured image to obtain a second captured image; a partial region setting process of setting a partial region in the first captured image; a process of performing a first decoding process on a partial image corresponding to the partial region in the first captured image to obtain a first depth map; and a process of performing a second decoding process on the second captured image to obtain a second depth map.

Claims (61)

1 . An imaging apparatus comprising:

a coded imaging system; and

an arithmetic control unit,

wherein the arithmetic control unit is configured to execute:

an imaging process of controlling the coded imaging system to capture an image of a subject by coded imaging and obtain a first captured image;

an image generation process of reducing resolution of the first captured image to obtain a second captured image;

a partial region setting process of setting a partial region in the first captured image;

a process of performing a first decoding process on a partial image corresponding to the partial region in the first captured image to obtain a first depth map; and

a process of performing a second decoding process on the second captured image to obtain a second depth map.

2 . The imaging apparatus according to claim 1 ,

wherein the arithmetic control unit is configured to execute a process of superimposing the first depth map on the second depth map to obtain a third depth map.

3 . The imaging apparatus according to claim 1 ,

wherein the first decoding process is a process of applying a first number of types of point spread functions, and

wherein the second decoding process is a process of applying a second number of types of point spread functions, the second number being smaller than the first number.

4 . The imaging apparatus according to claim 1 ,

wherein the imaging process is repeatedly executed a plurality of times,

wherein the first decoding process is performed at a first frequency, and

wherein the second decoding process is performed at a second frequency lower than the first frequency.

5 . The imaging apparatus according to claim 1 ,

wherein the arithmetic control unit executes a process of outputting, to an external device, the first depth map and the second depth map or a third depth map obtained by superimposing the first depth map on the second depth map.

6 . The imaging apparatus according to claim 5 ,

wherein the external device is a device that assists driving of a transportation.

7 . The imaging apparatus according to claim 1 ,

wherein the coded imaging system is installed in a transportation and performs the coded imaging in front of the transportation.

8 . The imaging apparatus according to claim 1 ,

wherein the partial region is set at a center of the first captured image.

9 . The imaging apparatus according to claim 1 ,

wherein the partial region is set at a position designated by a user.

10 . The imaging apparatus according to claim 1 ,

wherein the partial region is set based on an analysis result of the first captured image.

11 . A depth map generation method comprising:

an imaging process of capturing an image of a subject by coded imaging using a coded imaging system to obtain a first captured image;

an image generation process of reducing resolution of the first captured image to obtain a second captured image;

a partial region setting process of setting a partial region in the first captured image;

a process of performing a first decoding process on a partial image corresponding to the partial region in the first captured image to obtain a first depth map; and

a process of performing a second decoding process on the second captured image to obtain a second depth map.

12 . The depth map generation method according to claim 11 ,

wherein an arithmetic control unit is configured to execute a process of superimposing the first depth map on the second depth map to obtain a third depth map.

13 . The depth map generation method according to claim 11 ,

wherein the first decoding process is a process of applying a first number of types of point spread functions, and

wherein the second decoding process is a process of applying a second number of types of point spread functions, the second number being smaller than the first number.

14 . The depth map generation method according to claim 11 ,

wherein the imaging process is repeatedly executed a plurality of times,

wherein the first decoding process is performed at a first frequency, and

wherein the second decoding process is performed at a second frequency lower than the first frequency.

15 . The depth map generation method according to claim 11 ,

wherein an arithmetic control unit executes a process of outputting, to an external device, the first depth map and the second depth map or a third depth map obtained by superimposing the first depth map on the second depth map.

16 . The depth map generation method according to claim 15 ,

wherein the external device is a device that assists driving of a transportation.

17 . The depth map generation method according to claim 11 ,

wherein the coded imaging system is installed in a transportation and performs the coded imaging in front of the transportation.

18 . The depth map generation method according to claim 11 ,

wherein the partial region is set at a center of the first captured image.

19 . The depth map generation method according to claim 11 ,

wherein the partial region is set at a position designated by a user.

20 . A non-transitory tangible computer-readable recording medium storing a program for causing a computer to execute:

an imaging process of capturing an image of a subject by coded imaging using a coded imaging system to obtain a first captured image;

an image generation process of reducing resolution of the first captured image to obtain a second captured image;

a partial region setting process of setting a partial region in the first captured image;

a process of performing a first decoding process on a partial image corresponding to the partial region in the first captured image to obtain a first depth map; and

a process of performing a second decoding process on the second captured image to obtain a second depth map.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2024
From: NAKATOGAWA, HIRONDO; AOKI, YOSHIRO; TANAKA, HITOSHI
To: JAPAN DISPLAY INC.
Reel/Frame 068779/0204 →
Priority Claims (1)
JP 2023-176071 · Oct 11, 2023 · national
Continuity (1)
Related Publication 20250126369A1 · Apr 17, 2025
References Cited (31)
US 8280194B2 · Wong · 2012 [cited by examiner]
US 8773570B2 · Kimura et al. · 2014 [cited by applicant]
US 9270970B2 · Ishii · 2016 [cited by examiner]
US 10122939B2 · Matsuoka · 2018 [cited by examiner]
US 10419741B2 · Calpe Maravilla · 2019 [cited by examiner]
US 10432852B2 · Nakayama · 2019 [cited by examiner]
US 10623661B2 · Oh · 2020 [cited by examiner]
US 10645281B1 · Yu · 2020 [cited by examiner]
US 10897558B1 · Sun · 2021 [cited by examiner]
US 11308592B2 · Hiasa · 2022 [cited by examiner]
US 20110227950A1 · Suzuki · 2011 [cited by examiner]
US 20110267507A1 · Kane · 2011 [cited by examiner]
US 20130063566A1 · Morgan-Mar · 2013 [cited by examiner]
US 20130101177A1 · Yamada · 2013 [cited by examiner]
US 20130113962A1 · Li · 2013 [cited by examiner]
US 20130266210A1 · Morgan-Mar · 2013 [cited by examiner]
US 20140105520A1 · Matsumoto · 2014 [cited by examiner]
US 20140368615A1 · van Baar · 2014 [cited by examiner]
US 20150022518A1 · Takeshita · 2015 [cited by examiner]
US 20150116464A1 · Tanaka · 2015 [cited by examiner]
US 20160150219A1 · Gordon · 2016 [cited by examiner]
US 20160269709A1 · Lin · 2016 [cited by examiner]
US 20160381342A1 · Matsuoka · 2016 [cited by examiner]
US 20180249143A1 · Calpe Maravilla · 2018 [cited by examiner]
US 20190198540A1 · Shibata · 2019 [cited by examiner]
US 20230206476A1 · Lyu · 2023 [cited by examiner]
US 20240354977A1 · Nakatogawa · 2024 [cited by examiner]
US 20240386592A1 · Tanaka · 2024 [cited by examiner]
US 20250239843A1 · Primm · 2025 [cited by examiner]
WO 2011158508A1 · 2011 [cited by applicant]
“Coded Aperture Pairs for Depth from Defocus and Deblurring” C. Zhou, S. Lin and S.K. Nayar, International Journal of Computer Vision, vol. 93, No. 1, pp. 53, May 2011. [cited by applicant]