IP Library Granted Patent US 11,343,441
Granted Patent B2
US 11,343,441 · App. 16/639,341 · Granted May 24, 2022

Imaging device and apparatus

Inventor: Kazuyuki Okuike (Kanagawa, JP)
Assignee: Sony Semiconductor Solutions Corporation
H04N5/2357B60R11/04G06T7/20G06V10/56G06V20/582G08G1/09623H04N5/2258H04N5/2353H04N5/247B60R2300/105G06T2207/30252
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,343,441
App. No.
16/639,341
Granted
May 24, 2022
Kind
B2
Abstract

Provided is an imaging device and an apparatus that can obtain an appropriate captured image that allows recognition of an object even when a flicker phenomenon is occurring. Provided is an imaging device including a detection unit that detects a blinking object or an object lit by a blinking illuminator, a tracking unit that performs tracking on the detected object, an estimation unit that estimates period information of the blinking, on the basis of a plurality of imaging frames of the tracked object, and a signal generation unit that generates a timing signal for capturing the object, on the basis of the estimation result.

Claims (40)

1. An imaging device comprising:

a first imaging unit that captures images at a first frame rate;

a detection unit that detects a blinking object or an object lit by a blinking illuminator;

a tracking unit that performs tracking on the detected object;

an estimation unit that estimates period information of the blinking, on a basis of a plurality of imaging frames of the tracked object;

a signal generation unit that generates a timing signal for capturing the object, on a basis of an estimation result; and

a transmitting unit that transmits the timing signal to a second imaging device comprising a second imaging unit, wherein the second imaging unit captures images at a second frame rate, different from the first frame rate, based on the timing signal.

2. The imaging device according to claim 1 , wherein the second frame rate is lower than the first frame rate.

3. The imaging device according to claim 2 , wherein the detection unit detects the object, on a basis of a plurality of imaging frames of the object acquired at the first frame rate.

4. The imaging device according to claim 3 , wherein the detection unit detects the object, on a basis of color information of pixels of the imaging frames.

5. The imaging device according to claim 3 , wherein the detection unit detects the object, on a basis of a characteristic point of the imaging frames.

6. The imaging device according to claim 1 , further comprising a positioning unit that determines a position of the imaging device, wherein

the detection unit detects the object, on a basis of position information of the imaging device.

7. The imaging device according to claim 2 , wherein the tracking unit performs tracking on the object, on a basis of a comparison of two successive imaging frames of a plurality of imaging frames of the object acquired at the first frame rate.

8. The imaging device according to claim 2 , wherein the estimation unit estimates at least one of a frequency, a lighting time, or a lighting interval of the blinking, on a basis of changes in brightness of the object in a plurality of imaging frames of the object acquired at the first frame rate.

9. The imaging device according to claim 2 , wherein the signal generation unit generates a signal to control timing of exposure start at the second imaging unit or a signal to control timing of exposure end.

10. The imaging device according to claim 1 , wherein

the detection unit detects a plurality of the objects,

the tracking unit performs tracking on the objects,

the estimation unit estimates period information of the blinking associated with the objects, and

the signal generation unit generates timing signals for capturing the objects, on a basis of estimation results.

11. An apparatus that is spatially movable or can analyze a blinking object or an object lit by a blinking illuminator, while moving through space, and is equipped with an imaging device comprising:

a first imaging unit that captures images at a first frame rate;

a detection unit that, while moving through space, detects the object;

a tracking unit that, while moving through space, performs tracking on the detected object;

an estimation unit that estimates period information of the blinking, on a basis of a plurality of imaging frames of the tracked object;

a signal generation unit that generates a timing signal for capturing the object, on a basis of an estimation result; and

a transmitting unit that transmits the timing signal to a second imaging device comprising a second imaging unit, wherein the second imaging unit captures images at a second frame rate, different from the first frame rate, based on the timing signal.

12. The imaging device according to claim 11 , wherein the second frame rate is lower than the first frame rate.

13. The imaging device according to claim 12 , wherein the detection unit detects the object, on a basis of a plurality of imaging frames of the object acquired at the first frame rate.

14. The imaging device according to claim 13 , wherein the detection unit detects the object, on a basis of color information of pixels of the imaging frames.

15. An imaging device comprising:

a first imager that captures images at a first frame rate;

detection circuitry that detects a blinking object;

tracking circuitry that performs tracking on the detected object;

estimation circuitry that estimates period information of the blinking, on a basis of a plurality of imaging frames of the tracked object;

signal generation circuitry that generates a timing signal for capturing the object, on a basis of an estimation result; and

a transmitter that transmits the timing signal to a second imaging device comprising a second imager, wherein the second imager captures images at a second frame rate, different from the first frame rate, based on the timing signal.

16. The imaging device according to claim 15 , wherein the second frame rate is lower than the first frame rate.

17. The imaging device according to claim 15 , wherein the detection circuitry detects the object, on a basis of a plurality of imaging frames of the object acquired at the first frame rate.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 25, 2020
From: OKUIKE, KAZUYUKI
To: SONY SEMICONDUCTOR SOLUTIONS CORPORATION
Reel/Frame 052226/0183 →
Priority Claims (1)
JP JP2017-158538 · Aug 21, 2017 · national
Continuity (1)
Related Publication 20210029290A1 · Jan 28, 2021
Cited By (2)
US 12,470,816 US 12,535,330