IP Library › Granted Patent US 12,137,287
Granted Patent B2
US 12,137,287 · App. 17/922,786 · Granted Nov 5, 2024

Autofocus imaging circuitry, autofocus imaging apparatus, and autofocus imaging method for an event camera

Inventors: Kirk Scheper (Stuttgart, DE); Peter Dürr (Stuttgart, DE); Oliver Erdler (Stuttgart, DE)
Assignee: Sony Group Corporation
H04N23/673G02B7/38H04N23/61H04N25/47
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,137,287
App. No.
17/922,786
Granted
Nov 5, 2024
Kind
B2
Abstract

The present disclosure generally pertains to autofocus imaging circuitry, configured to: obtain, for a first adjusted focus, a first plurality of brightness change events from a brightness change event detection element; obtain, for a second adjusted focus, a second plurality of brightness change events from the brightness change event detection element; and determine a focus based on the first and the second plurality of brightness change events for autofocusing a scene.

Claims (38)

1. Autofocus imaging circuitry, configured to:

obtain, for a first adjusted focus, a first plurality of brightness change events from a brightness change event detection element;

obtain, for a second adjusted focus, a second plurality of brightness change events from the brightness change event detection element; and

determine a focus for autofocusing a scene using a spiking neural network processing the first and the second plurality of brightness change events, wherein the brightness change event detection element is in a hybrid sensor and has a predetermined pattern of the brightness change event detection elements and a plurality of color imaging elements.

2. The autofocus imaging circuitry of claim 1 , wherein the first and the second plurality of brightness change events is indicative of an event density.

3. The autofocus imaging circuitry of claim 2 , further configured to:

determine the event density.

4. The autofocus imaging circuitry of claim 3 , further configured to:

determine a contrast based on the determined event density.

5. The autofocus imaging circuitry of claim 1 , further configured to:

track an object based on the determined focus.

6. The autofocus imaging circuitry of claim 1 , further configured to:

obtain at least one of the first and the second plurality of brightness change events based on a detection of a reflection of a structured emission pattern.

7. The autofocus imaging circuitry of claim 1 , wherein the determination of the focus is based on a feedback loop based on the first and second plurality of brightness change events.

8. An autofocus imaging apparatus, comprising:

an imaging device including a plurality of brightness change event detection elements and a plurality of imaging elements, wherein the imaging device has a hybrid sensor with a predetermined pattern of the brightness change event detection elements and the plurality of imaging element; and

autofocus imaging circuitry, configured to, for each brightness change event detection element:

obtain, for a first adjusted focus, a first plurality of brightness change events from the brightness change event detection element;

obtain, for a second adjusted focus, a second plurality of brightness change events from the brightness change event detection element; and

determine a focus based on the first and the second plurality of brightness change events for autofocusing a scene.

9. The autofocus imaging apparatus of claim 8 , the autofocus imaging circuitry being further configured to, for each brightness change event detection element:

determine a brightness change event density for determining a spatial brightness change event density for the plurality of brightness change event elements.

10. An autofocus imaging method, comprising:

obtaining, for a first adjusted focus, a first plurality of brightness change events from a brightness change event detection element;

obtaining, for a second adjusted focus, a second plurality of brightness change events from the brightness change event detection element; and

determining a focus for autofocusing a scene by spiking neural network processing the first and the second plurality of brightness change events, wherein the brightness change event detection element is in a hybrid sensor and has a predetermined pattern of the brightness change event detection elements and a plurality of color imaging elements.

11. The autofocus imaging method of claim 10 , further comprising:

determining an event density based on the first and the second plurality of brightness change events.

12. The autofocus imaging method of claim 11 , further comprising:

determining a contrast based on the determined event density.

13. The autofocus imaging method of claim 10 , further comprising:

tracking an object based on the determined focus.

14. The autofocus imaging method of claim 10 , further comprising:

obtaining at least one of the first and the second plurality of brightness change events based on a detection of a reflection of a structured emission pattern.

15. The autofocus imaging method of claim 10 , wherein determining the focus is based on a feedback loop based on the first and second plurality of brightness change events.

16. The autofocus imaging method of claim 10 , wherein every second line of the hybrid sensor only has color imaging elements and remaining lines have one brightness change event detection element in the middle of the line alternates with a line with two brightness change event detection elements.

17. The autofocus imaging circuitry of claim 1 , wherein every second line of the hybrid sensor only has color imaging elements and remaining lines have one brightness change event detection element in the middle of the line alternates with a line with two brightness change event detection elements.

18. The autofocus imaging apparatus of claim 8 , wherein every second line of the hybrid sensor only has color imaging elements and remaining lines have one brightness change event detection element in the middle of the line alternates with a line with two brightness change event detection elements.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 2, 2022
From: SCHEPER, KIRK; DÜRR, PETER; ERDLER, OLIVER
To: SONY GROUP CORPORATION
Reel/Frame 061629/0425 →
Priority Claims (1)
EP 20174764 · May 14, 2020 · regional
Continuity (1)
Related Publication 20230171492A1 · Jun 1, 2023