IP Library Granted Patent US 9,978,148
Granted Patent B2
US 9,978,148 · App. 14/410,168 · Granted May 22, 2018

Motion sensor apparatus having a plurality of light sources

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,978,148
App. No.
14/410,168
Granted
May 22, 2018
Kind
B2
Abstract

A motion sensor device according to an embodiment of the present disclosure includes an image sensor and LED light sources. Using three images captured by the image sensor when only the LED light source is turned ON, when only the LED light source is turned ON, and when only the LED light source is turned ON, respectively, the motion sensor device estimates the distance to an object based on the luminance ratio of the object.

Claims (40)

1. A motion sensor device comprising:

an image sensor;

first, second and third light sources; and

a processor configured to control the image sensor and the first to third light sources,

wherein the processor is configured to:

make the image sensor capture a first frame with light emitted from the first light source at a first time;

make the image sensor capture a second frame with light emitted from the second light source at a second time;

make the image sensor capture a third frame with light emitted from the third light source at a third time;

generate a first piece of estimated distance information based on a ratio of a luminance of an object obtained from a first image produced by capturing the first frame to a luminance of the object obtained from a second image produced by capturing the second frame;

generate a second piece of estimated distance information based on a ratio of the luminance of the object obtained from the first image to a luminance of the object obtained from a third image produced by capturing the third frame; and

obtain information about a distance to the object by either choosing one from, or synthesizing together, the first and second pieces of estimated distance information, wherein the information about the distance to the object is obtained:

based on only the second piece of estimated distance information when the ratio of the luminance of the object obtained from the first image to the luminance of the object obtained from the second image falls within a preset range, and

based on only the first piece of estimated distance information when the ratio of the luminance of the object obtained from the second image to the luminance of the object obtained from the third image falls within a preset range.

2. The motion sensor device of claim 1 , wherein the first light source is arranged at a first distance from the image sensor in a first direction,

the second light source is arranged at a second distance from the image sensor in a second direction,

the third light source is arranged at a third distance from the image sensor in a third direction,

the second and third directions are opposite from the first direction, and

the second distance is shorter than any of the first and third distances.

3. The motion sensor device of claim 1 , wherein the processor is configured to obtain information about the distance to the object based on the first piece of estimated distance information only when the luminance of the object obtained from the second image is greater than the luminance of the object obtained from the first image, and

obtain information about the distance to the object based on the second piece of estimated distance information only when the luminance of the object obtained from the second image is greater than the luminance of the object obtained from the third image.

4. The motion sensor device of claim 1 , wherein the image sensor is configured to be able to detect light with a first wavelength which is a near-infrared ray, and

the first to third light sources are configured to emit light with the first wavelength.

5. An electronic device comprising:

the motion sensor device of claim 1 ; and

a display which changes what to present thereon in response to an object's motion detected by the motion sensor device.

6. The motion sensor device of claim 1 further comprising an integrated circuit comprising:

a timing controller which is connected to the image sensor and the light sources to control timings of exposure and light emission;

an extreme value searching section which processes image capturing data to search an area with a relatively high luminance;

a coordinate memory which stores coordinates and luminance of the area that has been searched by the extreme value searching section; and

a distance calculating section which calculates estimated distance information based on a luminance ratio by choosing frames that have been shot in the same area under different conditions from data in the coordinate memory.

7. The motion sensor device of claim 1 , wherein the processor is further configured to:

search for an extreme value by extracting selectively a range with a relatively high light intensity from data of captured frames and by calculating its coordinates and light intensity;

calculate a ratio of luminances that have been extracted in the extreme value searching step and that have been selected from among luminances of frames shot under different conditions; and

convert the luminance ratio calculated in the luminance ratio calculating step and the coordinates searched for in the extreme value searching step into a distance.

8. The motion sensor device of claim 1 comprising:

a non-transitory computer readable medium having encoded thereon a computer program configured to:

cause the motion sensor device of claim 1 to perform the steps of:

searching for an extreme value by extracting selectively a range with a relatively high light intensity from data of captured frames and by calculating its coordinates and light intensity;

calculating a ratio of luminances that have been extracted in the extreme value searching step and that have been selected from among luminances of frames shot under different conditions; and

converting the luminance ratio calculated in the luminance ratio calculating step and the coordinates searched for in the extreme value searching step into a distance.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2018
From: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
To: SOVEREIGN PEAK VENTURES, LLC
Reel/Frame 047914/0784 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 16, 2015
From: FUCHIKAMI, RYUJI; TEZUKA, TADANORI
To: PANASONIC INTELLECTUAL PROPERTY CORPORATION OF AMERICA
Reel/Frame 034968/0920 →