IP Library Granted Patent US 11,561,290
Granted Patent B2
US 11,561,290 · App. 16/579,170 · Granted Jan 24, 2023

Distance image generating device and distance image generating method

Inventors: Taichi Nagata (Osaka, JP); Keiichi Mori (Osaka, JP)
Assignee: NUVOTON TECHNOLOGY CORPORATION JAPAN
G01S7/484G01S7/4808G01S7/4863G01S17/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,561,290
App. No.
16/579,170
Granted
Jan 24, 2023
Kind
B2
Abstract

A distance image generating device includes a light emitter that emits light pulses; a light receiver that includes light receiving elements and receives reflected light; a distance calculator that generates a distance image based on an amount of the reflected light; and a light amount adjuster that determines an emission count in accordance with which the light emitter is to emit the light pulses and an exposure count in accordance with which the light receiver is to receive the reflected light based on the distance image and causes the light emitter to emit the light pulses in accordance with the determined emission count and the light receiver to receive the reflected light in accordance with the determined exposure count. The distance calculator calculates the distance based on an amount of the reflected light received at the exposure count by the light receiver.

Claims (54)

1. A distance image generating device, comprising:

a light emitter that emits light pulses to an object;

a light receiver that includes a plurality of light receiving elements, the light receiver receiving reflected light corresponding to the light pulses in an exposure period associated with an emission period of the light pulses;

a distance calculator that generates a distance image by calculating a distance to the object from each of the plurality of light receiving elements, based on an amount of the reflected light received by the light receiver; and

a light amount adjuster that

determines an emission count in accordance with which the light emitter is to emit the light pulses and an exposure count in accordance with which the light receiver is to receive the reflected light, based on the distance image generated by the distance calculator, and

causes the light emitter to emit the light pulses in accordance with the emission count determined by the light amount adjuster and the light receiver to receive the reflected light in accordance with the exposure count determined by the light amount adjuster, wherein:

the distance calculator calculates the distance, based on an amount of the reflected light received in accordance with the exposure count by the light receiver, and

the light amount adjuster calculates a representative distance to the object with use of the distance image and determines, as the emission count and the exposure count, one set count selected from a plurality of set counts corresponding to a plurality of preset distance ranges, based on the representative distance calculated by the light amount adjuster.

2. The distance image generating device according to claim 1 , wherein

the light amount adjuster further determines one of an upper limit count and a lower limit count that are preset as the emission count and the exposure count when the representative distance satisfies a predetermined condition.

3. The distance image generating device according to claim 2 , wherein

the light amount adjuster determines the lower limit count as the emission count and the exposure count when, as a case in which the predetermined condition is satisfied, the representative distance is less than a shortest distance range among the plurality of distance ranges and the amount of the reflected light exceeds a first threshold.

4. The distance image generating device according to claim 2 , wherein

the light amount adjuster determines the upper limit count as the emission count and the exposure count when, as a case in which the predetermined condition is satisfied, the representative distance is greater than a longest distance range among the plurality of distance ranges and the amount of the reflected light is less than a second threshold.

5. The distance image generating device according to claim 1 , wherein

in an initial state in which no distance image has been generated, the light amount adjuster determines, as the emission count and the exposure count, the one set count corresponding to a shortest distance range among the plurality of distance ranges.

6. The distance image generating device according to claim 1 , wherein

in an initial state in which no distance image has been generated, the light amount adjuster determines, as the emission count and the exposure count, the set count corresponding to a longest distance range among the plurality of distance ranges.

7. The distance image generating device according to claim 1 , wherein

a minimum value among the plurality of set counts is set to a value suitable for measuring a shortest of a distance range to be measured.

8. The distance image generating device according to claim 1 , wherein

a maximum value among the plurality of set counts is set to a value suitable for measuring a longest of a distance range to be measured.

9. The distance image generating device according to claim 1 , wherein

the light amount adjuster causes the light emitter to emit the light pulses in accordance with the emission count determined by the light amount adjuster in a preset duration and the light receiver to receive the reflected light in accordance with the exposure count determined by the light amount adjuster.

10. The distance image generating device according to claim 1 , wherein

the light amount adjuster causes the light emitter to iteratively emit the light pulses in accordance with the emission count at a preset constant time interval and the light receiver to iteratively receive the reflected light in accordance with the exposure count at the preset constant time interval.

11. The distance image generating device according to claim 1 , wherein

the distance calculator iteratively generates the distance image at a frame cycle, and

the light amount adjuster, iteratively for each frame, determines the emission count and the exposure count in a second frame following a first frame, based on the distance image of the first frame and controls the light emitter and the light receiver.

12. The distance image generating device according to claim 1 , wherein

the light emitter emits light pulses having a fixed emission period, and

the distance calculator calculates the distance to the object with use of the emission period and an amount of a plurality of the reflected light in an exposure period associated with the emission period for a plurality of the light pulses.

13. A distance image generating method of generating a distance image with a distance image generating device, the distance image generating device including a light emitter that emits light pulses to an object and a light receiver that includes a plurality of light receiving elements and receives reflected light corresponding to the light pulses in an exposure period associated with an emission period of the light pulses, the distance image generating method comprising:

generating a distance image by calculating a distance to the object from each of the plurality of light receiving elements, based on an amount of the reflected light received by the light receiver; and

adjusting the amount of the reflected light including:

determining an emission count in accordance with which the light emitter is to emit the light pulses and an exposure count in accordance with which the light receiver is to receive the reflected light, based on the distance image generated in the generating, and

causing the light emitter to emit the light pulses in accordance with the emission count determined in the adjusting and the light receiver to receive the reflected light in accordance with the exposure count determined in the adjusting, wherein:

in the generating, the distance is calculated based on an amount of the reflected light received in accordance with the exposure count by the light receiver, and

in the adjusting the amount of the reflected light, calculating a representative distance to the object is calculated with use of the distance image, and one set count selected from a plurality of set counts corresponding to a plurality of preset distance ranges is determined as the emission count and the exposure count, based on the representative distance.

14. The distance image generating method according to claim 13 , wherein

in the adjusting the amount of the reflected light, one of an upper limit count and a lower limit count that are preset is determined as the emission count and the exposure count when the representative distance satisfies a predetermined condition.

15. The distance image generating method according to claim 14 , wherein

in the adjusting the amount of the reflected light, the lower limit count is determined as the emission count and the exposure count when, as a case in which the predetermined condition is satisfied, the representative distance is less than a shortest distance range among the plurality of distance ranges and the amount of the reflected light exceeds a first threshold.

16. The distance image generating method according to claim 14 , wherein

in the adjusting the amount of the reflected light, the upper limit count is determined as the emission count and the exposure count when, as a case in which the predetermined condition is satisfied, the representative distance is greater than a longest distance range among the plurality of distance ranges and the amount of the reflected light is less than a second threshold.

17. The distance image generating method according to claim 13 , wherein

in an initial state in which no distance image has been generated, the adjusting the amount of the reflected light includes determining, as the emission count and the exposure count, the one set count corresponding to a shortest distance range among the plurality of distance ranges.

18. The distance image generating method according to claim 13 , wherein

in an initial state in which no distance image has been generated, the adjusting the amount of the reflected light includes determining, as the emission count and the exposure count, the set count corresponding to a longest distance range among the plurality of distance ranges.

19. The distance image generating method according to claim 13 , wherein

a minimum value among the plurality of set counts is set to a value suitable for measuring a shortest of a distance range to be measured.

20. The distance image generating method according to claim 13 , wherein

a maximum value among the plurality of set counts is set to a value suitable for measuring a longest of a distance range to be measured.

Assignments (3)
CHANGE OF NAME Recorded May 14, 2021
From: PANASONIC SEMICONDUCTOR SOLUTIONS CO., LTD.
To: NUVOTON TECHNOLOGY CORPORATION JAPAN
Reel/Frame 056245/0395 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 27, 2020
From: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
To: PANASONIC SEMICONDUCTOR SOLUTIONS CO., LTD.
Reel/Frame 052755/0870 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 7, 2020
From: NAGATA, TAICHI; MORI, KEIICHI
To: PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO., LTD.
Reel/Frame 051747/0089 →