IP Library › Granted Patent US 12,096,137
Granted Patent B2
US 12,096,137 · App. 17/769,157 · Granted Sep 17, 2024

Signal processing device, signal processing method, and detection sensor

Inventor: Shun Kaizu (Kanagawa, JP)
Assignee: SONY GROUP CORPORATION
H04N25/47H04N23/74H04N23/745
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,096,137
App. No.
17/769,157
Granted
Sep 17, 2024
Kind
B2
Abstract

There is provided a signal processing device, a signal processing method, and a detection sensor that makes it possible to detect flicker information from an output indicating a luminance change. The signal processing device includes: a change detection unit that detects a first luminance change in a positive direction and a second luminance change in a negative direction among luminance changes detected by a light receiving unit; a coefficient generation unit that generates a coefficient depending on a time at which the luminance change is detected; and an integration unit that integrates a result of multiplication of the first luminance change and the coefficient and integrates a result of multiplication of the second luminance change and the coefficient. The present technology can be applied to, for example, an event detection sensor and the like.

Claims (54)

1. A signal processing device comprising:

a change detection unit that detects a first luminance change in a positive direction and a second luminance change in a negative direction among luminance changes detected by a light receiving unit;

a coefficient generation unit that generates a coefficient depending on a time at which the luminance change is detected; and

an integration unit that integrates a result of multiplication of the first luminance change and the coefficient and integrates a result of multiplication of the second luminance change and the coefficient,

wherein the change detection unit, the coefficient generation unit, and the integration unit are each implemented via at least one processor.

2. The signal processing device according to claim 1 , wherein

the change detection unit outputs the first luminance change with a first value and outputs the second luminance change with a second value.

3. The signal processing device according to claim 1 , wherein

the change detection unit includes:

a first change detection unit that detects the first luminance change; and

a second change detection unit that detects the second luminance change, and

the first change detection unit and the second change detection unit are each implemented via at least one processor.

4. The signal processing device according to claim 3 , wherein

the first change detection unit and the second change detection unit represent the first luminance change or the second luminance change as an ON-OFF signal.

5. The signal processing device according to claim 1 , wherein

the coefficient generation unit generates, as the coefficients, values of a sine function and a cosine function depending on the time.

6. The signal processing device according to claim 5 , wherein

the coefficient generation unit generates, as the coefficients, values of the sine function and the cosine function depending on a cycle desired to be detected.

7. The signal processing device according to claim 5 , wherein

the coefficient generation unit generates, as the coefficients, values of a sine approximation function and a cosine approximation function approximating the sine function and the cosine function.

8. The signal processing device according to claim 7 , wherein

the sine approximation function and the cosine approximation function are functions obtained by approximating the sine function and the cosine function to signals having two values of 1 and −1.

9. The signal processing device according to claim 8 , wherein

the coefficient generation unit outputs 1 or −1 on a basis of a table in which 1 or −1 is associated with the time.

10. The signal processing device according to claim 1 , further comprising

a flicker amount estimation unit that estimates a flicker amount in which the luminance change occurs at a specific frequency on a basis of an integration result by the integration unit,

wherein the flicker amount estimation unit is implemented via at least one processor.

11. The signal processing device according to claim 10 , further comprising

a plurality of flicker detection units including:

the change detection unit;

the coefficient generation unit;

the integration unit; and

the flicker amount estimation unit,

wherein the plurality of flicker detection units respectively has different frequencies at which the flicker amount is estimated, and

wherein the plurality of flicker detection units respectively is implemented via at least one processor.

12. The signal processing device according to claim 10 , further comprising

a control unit that controls a sensitivity parameter of the light receiving unit on a basis of an estimation result by the flicker amount estimation unit,

wherein the control unit is implemented via at least one processor.

13. The signal processing device according to claim 1 , wherein

the light receiving unit is divided into a plurality of blocks,

a plurality of the integration units is included corresponding to the plurality of blocks, and

the plurality of the integration units integrates the result of multiplication in units of blocks in which the luminance change occurs,

wherein the plurality of integration units respectively is implemented via at least one processor.

14. A signal processing method comprising

detecting a first luminance change in a positive direction and a second luminance change in a negative direction among luminance changes detected by a light receiving unit,

generating a coefficient depending on a time at which the luminance change is detected, and

integrating a result of multiplication of the first luminance change and the coefficient and integrating a result of multiplication of the second luminance change and the coefficient,

by a signal processing device.

15. A detection sensor comprising:

a light receiving unit in which pixels that perform photoelectric conversion of incident light to generate electric signals are arranged in a lattice;

a change detection unit that detects a first luminance change in a positive direction and a second luminance change in a negative direction among luminance changes detected by the light receiving unit;

a coefficient generation unit that generates a coefficient depending on a time at which the luminance change is detected; and

an integration unit that integrates a result of multiplication of the first luminance change and the coefficient and integrates a result of multiplication of the second luminance change and the coefficient,

wherein the light receiving unit, the change detection unit, the coefficient generation unit, and the integration unit are each implemented via at least one processor.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 14, 2022
From: KAIZU, SHUN
To: SONY GROUP CORPORATION
Reel/Frame 059602/0207 →
Priority Claims (1)
JP 2019-218055 · Dec 2, 2019 · national
Continuity (1)
Related Publication 20240114255A1 · Apr 4, 2024
Cited By (1)
US 12,477,240