IP Library Granted Patent US 12,267,608
Granted Patent B2
US 12,267,608 · App. 18/033,493 · Granted Apr 1, 2025

Solid-state imaging device and electronic device

Inventor: Takahiro Miyazaki (Kanagawa, JP)
Assignee: Sony Semiconductor Solutions Corporation
H04N25/77
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,267,608
App. No.
18/033,493
Granted
Apr 1, 2025
Kind
B2
Abstract

A decrease in event detection efficiency is suppressed. A solid-state imaging device according to an embodiment includes a pixel array unit ( 101 ) in which a plurality of pixels each detecting a change in luminance of incident light is disposed in a two-dimensional lattice pattern, a signal processing unit ( 103 ) that generates first event data including position information about one or more pixels that detect a change in luminance, an adjustment unit ( 320 ) that adjusts an amount of data of the first event data to generate second event data, and an output unit ( 109 ) that outputs the second event data to an outside, wherein the adjustment unit includes a plurality of paths that adjusts the amount of data of the first event data by respective different methods to generate the second event data, and wherein the output unit outputs at least one of the second event data output from the plurality of respective paths to the outside.

Claims (24)

1. A solid-state imaging device including:

a pixel array unit in which a plurality of pixels each detecting a change in luminance of incident light is disposed in a two-dimensional lattice pattern;

a signal processing unit that generates first event data including position information about one or more pixels that detect a change in luminance;

an adjustment unit that adjusts an amount of data of the first event data to generate second event data; and

an output unit that outputs the second event data, wherein

the adjustment unit includes a plurality of paths that respectively adjust the amount of data of the first event data by respective different methods to generate instances of adjusted second event data, and wherein the output unit outputs at least one of the instances of adjusted second event data output from the plurality of paths.

2. The solid-state imaging device according to claim 1 , wherein the plurality of paths includes one or more first paths that generate one or more of the instances of adjusted second event data by respectively coding the first event data.

3. The solid-state imaging device according to claim 2 , wherein the one or more first paths include a path that codes the first event data by using at least one of Hcomp coding, Run Length coding, Huffman coding, Light Huffman coding, Event Distance coding, and Entropy coding.

4. The solid-state imaging device according to claim 1 , wherein the plurality of paths includes one or more second paths that generate one or more of the instances of second event data by respectively performing a signal process on the first event data.

5. The solid-state imaging device according to claim 4 , wherein the one or more second paths include a path that performs a signal process on the first event data using at least one of optical flow calculation, feature point extraction, and region of interest (ROI) extraction.

6. The solid-state imaging device according to claim 1 , wherein the plurality of paths includes a third path that outputs the first event data unadjusted.

7. The solid-state imaging device according to claim 1 , wherein the adjustment unit inputs the first event data generated by the signal processing unit to the plurality of paths and inputs the instances of adjusted second event data to the output unit.

8. The solid-state imaging device according to claim 7 , wherein the output unit outputs a given instance of adjusted second event data with an amount of data not exceeding a transmission band among the instances of adjusted second event data.

9. The solid-state imaging device according to claim 7 , wherein the output unit outputs a given instance of adjusted second event data with a smallest amount of data among the instances of adjusted second event data.

10. The solid-state imaging device according to claim 1 , further including:

a determination unit that determines a scene based on the first event data, wherein

the determination unit inputs the first event data to at least one path of the plurality of paths based on the scene determined based on the first event data.

11. The solid-state imaging device according to claim 1 , wherein the output unit outputs the second event data in frame.

12. The solid-state imaging device according to claim 11 , wherein the output unit outputs frame data in which a data length of each line is adjusted by the adjustment unit.

13. The solid-state imaging device according to claim 11 , wherein the output unit outputs frame data not including line data of a line in which a pixel in which a change in luminance of incident light is detected does not exist.

14. The solid-state imaging device according to claim 11 , wherein the output unit outputs a horizontal synchronization signal as soon as an output of line data of each line is completed.

15. An electronic device including:

a solid-state imaging device according to claim 1 ; and

an information processing device that processes second event data output from the solid-state imaging device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2023
From: MIYAZAKI, TAKAHIRO
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 063909/0617 →
Priority Claims (1)
JP 2020-182095 · Oct 30, 2020 · national
Continuity (1)
Related Publication 20230403482A1 · Dec 14, 2023
References Cited (20)
US 20120257789A1 · Lee · 2012 [cited by examiner]
US 20180262665A1 · Jung · 2018 [cited by applicant]
US 20190007678A1 · Perez-Ramirez · 2019 [cited by applicant]
US 20190204121A1 · Yen · 2019 [cited by applicant]
US 20190279100A1 · Cline · 2019 [cited by examiner]
US 20190364230A1 · Yeo · 2019 [cited by applicant]
US 20200092508A1 · Park · 2020 [cited by applicant]
US 20200366824A1 · Hofer · 2020 [cited by examiner]
US 20210152757A1 · Wakabayashi · 2021 [cited by applicant]
US 20230234503A1 · Ryoji · 2023 [cited by applicant]
EP 3506622A1 · 2019 [cited by applicant]
JP 2003116006A · 2003 [cited by applicant]
JP 2004248320A · 2004 [cited by applicant]
JP 2017535999A · 2017 [cited by applicant]
JP 2020127186A · 2020 [cited by applicant]
WO WO2020027233A1 · 2020 [cited by applicant]
WO WO2020116185A1 · 2020 [cited by applicant]
International Search Report (PCT/ISA/210), International Application No. PCT/JP2021/038359, dated Dec. 21, 2021. [cited by applicant]
Chen et al, “A low-complexity image compression algorithm for Address-Event Representation (AER) PWM image sensors”, Circuits and Systems (ISCAS), 2011 IEEE International Symposium on, IEEE, May 15, 2011, pp. 2825-2828. [cited by applicant]
Khan et al, “Time-Aggregation-Based Lossless Video Encoding for Neuromorphic Vision Sensor Data”, IEEE Internet of Things Journal, IEEE, USA, vol. 8, No. 1, Jul. 8, 2020, pp. 596-609. [cited by applicant]