IP Library Granted Patent US 12,149,840
Granted Patent B2
US 12,149,840 · App. 17/636,418 · Granted Nov 19, 2024

Ranging system and electronic apparatus

Inventors: Kei Nakagawa (Tokyo, JP); Shota Watanabe (Kanagawa, JP)
Assignees: Sony Group Corporation; Sony Semiconductor Solutions Corporation
H04N25/50G01B11/22G01S7/4814G01S7/4816G01S17/89G06V40/161H04N23/84H04N25/705H04N25/709H04N25/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,149,840
App. No.
17/636,418
Granted
Nov 19, 2024
Kind
B2
Abstract

A system includes a processor, a light source controlled by the processor and configured to emit a light, and an event based vision sensor controlled by the processor. The sensor includes a plurality of pixels. At least one of the plurality of pixels includes a photosensor configured to detect incident light and first circuitry configured to output a first signal based on an output from the photosensor. The first signal indicates a change of amount of incident light. The sensor includes a comparator configured to output a comparison result based on the first signal and at least one of a first reference voltage and a second reference voltage. The processor is configured to apply one of the first reference voltage and the second reference voltage to the comparator selectively based on an operation of the light source.

Claims (48)

1. A system, comprising:

a processor;

a light source controlled by the processor and configured to emit a light; and

an event based vision sensor controlled by the processor, wherein the event based vision sensor includes:

a plurality of pixels, wherein at least one of the plurality of pixels includes:

a photosensor configured to detect incident light;

first circuitry configured to output a first signal based on an output from the photosensor, wherein the first signal indicates a change of amount of incident light; and

a comparator configured to output a comparison result based on the first signal and at least one of a first reference voltage and a second reference voltage,

wherein the processor is configured to apply one of the first reference voltage and the second reference voltage to the comparator selectively based on an operation of the light source,

wherein when the first reference voltage is applied to the comparator, the light source emits light and the event based vision sensor stores on event data in memory, and

wherein when the second reference voltage is applied to the comparator, the light source ceases to emit light and the event based vision sensor stores off event data in the memory.

2. The system of claim 1 , wherein the stored on event data and off event data are sequentially transferred to a readout circuit.

3. The system of claim 1 , wherein the stored on event data and off event data are used to perform face detection processing.

4. The system of claim 1 , wherein the light source is a vertical-cavity surface-emitting laser.

5. A system, comprising:

an image sensor configured to output an image signal;

a light source configured to emit a light;

an event based vision sensor configured to output an event signal, the event based vision sensor including:

a plurality of pixels, wherein at least one of the plurality of pixels includes:

a photosensor configured to detect incident light; and

first circuitry that outputs a first signal based on an output from the photosensor, wherein the first signal indicates a change of amount of incident light; and

a comparator configured to output a comparison result based on the first signal and at least one of a first reference voltage and a second reference voltage;

a system controller configured to control the event based vision sensor and the light source synchronously; and

a processor configured to process the image signal and the event signal,

wherein the system controller applies the first reference voltage and the second reference voltage to the comparator selectively based on an operation of the light source,

wherein when the first reference voltage is applied to the comparator, the light source emits light and the event based vision sensor stores on event data in memory, and

wherein when the second reference voltage is applied to the comparator, the light source ceases to emit light and the event based vision sensor stores off event data in the memory.

6. The system of claim 5 , wherein the image sensor comprises an RGB camera.

7. The system of claim 5 , wherein the stored on event data and off event data are sequentially transferred to a readout circuit.

8. The system of claim 5 , wherein the stored on event data and off event data are used to perform face detection processing.

9. The system of claim 5 , wherein the on event data and the off event data are used to generate a depth map.

10. The system of claim 9 , wherein the depth map is used to recognize a face.

11. The system of claim 10 , wherein prior to applying the first reference voltage the face is detected with the image sensor.

12. The system of claim 9 , wherein the processor is configured to recognize a face using the depth map and the image signal.

13. The system of claim 5 , wherein the light source is a vertical-cavity surface-emitting laser.

14. The system of claim 5 , wherein the image sensor is controlled by a camera control section.

15. A method of driving a ranging system, the method comprising:

selectively applying, with a processor, one of a first reference voltage and a second reference voltage to a comparator based on an operation of a light source; and

comparing, with the comparator the one of the first reference voltage and the second reference voltage with a first signal output by circuitry of a pixel, wherein:

the light source is controlled by the processor and configured to emit a light,

the pixel is one of a plurality of pixels included within an event based vision sensor,

the pixel includes a photosensor configured to detect incident light and first circuitry that outputs the first signal based on an output from the photosensor, and

the first signal indicates a change of amount of incident light,

when the first reference voltage is applied to the comparator, the light source emits light and the event based vision sensor stores on event data in memory, and

when the second reference voltage is applied to the comparator, the light source ceases to emit light and the event based vision sensor stores off event data in the memory.

16. The method of claim 15 , wherein the stored on event data and off event data are sequentially transferred to a readout circuit.

17. The method of claim 15 , wherein the stored on event data and off event data are used to perform face detection processing.

18. The method of claim 15 , wherein the light source is a vertical-cavity surface-emitting laser.

Assignments (2)
CHANGE OF NAME Recorded Mar 10, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 059986/0015 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 10, 2022
From: NAKAGAWA, KEI; WATANABE, SHOTA
To: SONY CORPORATION; SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 059227/0982 →
Priority Claims (1)
JP 2019-154499 · Aug 27, 2019 · national
Continuity (1)
Related Publication 20220400218A1 · Dec 15, 2022
Cited By (1)
US 12,607,503