IP Library Granted Patent US 12,256,160
Granted Patent B2
US 12,256,160 · App. 18/001,265 · Granted Mar 18, 2025

Imaging device, imaging method, and method for producing the imaging device

Inventors: Hiroyuki Kusaka (Tokyo, JP); Masahiro Kashiwagi (Tokyo, JP); Yuichiro Kunai (Tokyo, JP)
Assignee: Fujikura Ltd.
H04N23/95H04N23/815H04N25/41
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,256,160
App. No.
18/001,265
Granted
Mar 18, 2025
Kind
B2
Abstract

An imaging device includes: an optical computing section that receives a first optical signal and generates a second optical signal including a feature amount extracted from the first optical signal; an image sensor that converts the second optical signal into a first electric signal including a piece of image information; and a computer that receives the first electric signal and generates second electric signals using machine learning models, each of the second electric signals corresponding to a respective one of the machine learning models, wherein: each of the second electric signals, generated from the first electric signal including the same piece of image information, includes different image information.

Claims (26)

1. An imaging device comprising:

an optical computing section that receives a first optical signal and generates a second optical signal including a feature amount extracted from the first optical signal;

an image sensor that converts the second optical signal into a first electric signal including a piece of image information; and

a computer that receives the first electric signal and generates second electric signals using machine learning models, each of the second electric signals corresponding to a respective one of the machine learning models, wherein

each of the second electric signals, generated from the first electric signal including the same piece of image information, includes different image information, and

the optical computing section includes an optical modulation element constituted by microcells, wherein the microcells, each having an independently set phase modulation amount, are disposed in a single layer.

2. The imaging device according to claim 1 , wherein the optical computing section and the machine learning models are designed by machine leaning such that each of the second electric signals is indicative of a different image.

3. The imaging device according to claim 1 , wherein each of the second electric signals includes image information differing in angle of view.

4. The imaging device according to claim 1 , wherein each of the second electric signals includes image information differing in resolution.

5. The imaging device according to claim 1 , wherein each of the second electric signals includes image information differing in focal depth.

6. The imaging device according to claim 1 , wherein the image sensor is disposed in the imaging device such that an image of a subject is not formed on a light receiving surface of the image sensor.

7. The imaging device according to claim 1 , wherein

the optical modulation element is a transmissive optical modulation element, and

a specific optical path on which the first optical signal travels passes the transmissive optical modulation element.

8. The imaging device according to claim 1 , wherein

the optical modulation element is a reflective optical modulation element, and

a specific optical path on which the first optical signal travels is a zigzag optical path passing the reflective optical modulation element.

9. A method for producing the imaging device according to claim 1 comprising:

designing the optical computing section and the machine learning models such that each of the second electric signals includes the different image information.

10. An imaging method comprising:

receiving a first optical signal and generating a second optical signal including a feature amount extracted from the first optical signal;

converting the second optical signal into a first electric signal;

receiving the first electric signal and generating second electric signals using machine learning models, each of the second electric signals corresponding to a respective one of the machine learning models; and

optical computing using an optical modulation element constituted by microcells, wherein

the microcells, each having an independently set phase modulation amount, are disposed in a single layer, and

each of the second electric signals, generated from the first electric signal, includes different image information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 7, 2023
From: KUSAKA, HIROYUKI; KASHIWAGI, MASAHIRO; KUNAI, YUICHIRO
To: FUJIKURA LTD.
Reel/Frame 062912/0198 →
Continuity (1)
Related Publication 20240236513A1 · Jul 11, 2024
References Cited (18)
US 4314151A · Suzuki · 1982 [cited by examiner]
US 11605171B1 · Hillman · 2023 [cited by examiner]
US 20020140841A1 · Sasaki · 2002 [cited by examiner]
US 20140253781A1 · Gill et al. · 2014 [cited by applicant]
US 20190146305A1 · Xin · 2019 [cited by examiner]
US 20190222813A1 · Kane · 2019 [cited by examiner]
US 20210294085A1 · Dowaki · 2021 [cited by examiner]
US 20220253978A1 · Park · 2022 [cited by examiner]
JP 2019176214A · 2019 [cited by applicant]
JP 2020086357A · 2020 [cited by applicant]
WO 2004077819A1 · 2004 [cited by applicant]
WO 2019078340A1 · 2019 [cited by applicant]
International Search Report issued in corresponding International Application No. PCT/JP2022/001527 issued Apr. 12, 2022 (2 pages). [cited by applicant]
Written Opinion issued in corresponding International Application No. PCT/JP2022/001527 issued Apr. 12, 2022 (4 bages). [cited by applicant]
English translation of Written Opinion issued in corresponding International Application No. PCT/JP2022/001527 issued Apr. 12, 2022 (4 pages). [cited by applicant]
Geochang Wu et al., “Light Field Image Processing: An Overview” IEEE Journal of Selected Topics in Signal Processing, vol. 11, No. 7, Oct. 31, 2017, pp. 926-954 (29 pages). [cited by applicant]
Vincent Sitzmann et al., “End-to-end Optimization of Optics and Image Processing for Achromatic Extended Depth of Field and Super-resolution Imaging” ACM Transactions On Graphics, vol. 37, No. 4, Jul. 30, 2018, pges 1-1… [cited by applicant]
Jorge Bacca et al., “Deep Coded Aperture Design: An End-to-End Approach for Computational Imaging Tasks” IEEE Transactions On Computational Imaging, vol. 7, Oct. 26, 2021, pp. 1148-1160 (13 pages). [cited by applicant]