Distance image acquisition apparatus and distance image acquisition method
Disclosed are a distance image acquisition apparatus and a distance image acquisition method capable of acquiring a distance image with satisfactory accuracy based on a first pattern projected from a host apparatus even in a case where patterns of structured light having the same shape are projected simultaneously from the host apparatus and another apparatus. A distance image acquisition apparatus ( 10 ) includes a projection unit ( 12 ) which projects a pattern of structured light, a light modulation unit ( 22 ) which modulates a switching timing of projection and non-projection of the pattern with a code, an imaging unit ( 14 ) which is provided in parallel with and apart from the projection unit ( 12 ) by a baseline length, performs imaging in synchronization with a projection period and a non-projection period of the pattern, and generates a first captured image captured in the projection period of the pattern and a second captured image captured in the non-projection period of the pattern, a differential image generation unit ( 20 D) which generates a differential image of the first captured image and the second captured image, a pattern extraction unit ( 20 A) which extracts the pattern from the differential image, and a distance image acquisition unit ( 20 B) which acquires a distance image indicating a distance of a subject within a distance measurement region based on the pattern extracted by the pattern extraction unit ( 20 A).
1. A distance image acquisition apparatus comprising:
a projector which projects a first pattern of structured light distributed in a two-dimensional manner with respect to a subject within a distance measurement region;
a light modulator which modulates a switching timing of projection and non-projection of the first pattern projected from the projector with a code;
an image sensor which is provided in parallel with and apart from the projector by a baseline length, performs imaging in synchronization with a projection period and a non-projection period of the first pattern, and generates a plurality of captured images including the first pattern reflected from the subject, the plurality of captured images including a first captured image captured in the projection period of the first pattern and a second captured image captured in the non-projection period of the first pattern;
a processor configured to:
generate a differential image of the first captured image captured in the projection period and the second captured image captured in the non-projection period;
extract the first pattern from the differential image;
acquire a distance image indicating a distance of the subject within the distance measurement region based on the first pattern;
determine whether or not a second pattern is projected from another distance image acquisition apparatus; and
a beacon information reception unit which receives beacon information transmitted from the another distance image acquisition apparatus, the beacon information indicating that the second pattern is projected from the another distance image acquisition apparatus,
wherein, in a case where the processor determines that the second pattern is projected from the another distance image acquisition apparatus, the light modulator performs modulation on the first pattern projected from the projector,
wherein, in a case where the beacon information reception unit receives the beacon information, the processor determines that the second pattern is projected from the another distance image acquisition apparatus.
2. The distance image acquisition apparatus according to claim 1 ,
wherein the light modulator modulates the switching timing of projection and non-projection of the first pattern with a random code.
3. The distance image acquisition apparatus according to claim 1 ,
wherein the image sensor performs exposure in an exposure period corresponding to a frame rate of the distance image, and
the light modulator modulates the switching timing of projection and non-projection of the first pattern in synchronization with start and end timings of the exposure period of the image sensor.
4. A distance image acquisition apparatus comprising:
a projector which projects a first pattern of structured light distributed in a two-dimensional manner with respect to a subject within a distance measurement region;
a light modulator which modulates a switching timing of projection and non-projection of the first pattern projected from the projector with a code;
an image sensor which is provided in parallel with and apart from the projector by a baseline length, performs imaging in synchronization with a projection period and a non-projection period of the first pattern, and generates a plurality of captured images including the first pattern reflected from the subject, the plurality of captured images including a first captured image captured in the projection period of the first pattern and a second captured image captured in the non-projection period of the first pattern;
a processor configured to:
generate a differential image of the first captured image captured in the projection period and the second captured image captured in the non-projection period;
extract the first pattern from the differential image;
acquire a distance image indicating a distance of the subject within the distance measurement region based on the first pattern and
determine whether or not a second pattern is projected from another distance image acquisition apparatus,
wherein, in a case where the processor determines that the second pattern is projected from the another distance image acquisition apparatus, the light modulator performs modulation on the first pattern projected from the projector,
wherein the first pattern and the second pattern are dot patterns,
wherein, when the number of dots of a dot pattern detected from a captured image captured by the image sensor exceeds the number of dots of the first pattern projected from the projector, the processor determines that the second pattern is projected from the another distance image acquisition apparatus.
5. A distance image acquisition method comprising:
a step of modulating a switching timing of projection and non-projection of a first pattern of structured light distributed in a two-dimensional manner with respect to a subject within a distance measurement region with a code and making a projector project the first pattern,
a step of performing imaging in synchronization with a projection period and a non-projection period of the first pattern with an image sensor provided in parallel with and apart from the projector by a baseline length and generating a plurality of captured images including the first pattern reflected from the subject, the plurality of captured images including a first captured image captured in the projection period of the first pattern and a second captured image captured in the non-projection period of the first pattern;
a step of generating a differential image of the first captured image captured in the projection period and the second captured image captured in the non-projection period;
a step of extracting the first pattern from the differential image;
a step of acquiring a distance image indicating a distance of the subject within the distance measurement region based on the extracted first pattern;
a step of determining whether or not a second pattern is projected from another distance image acquisition apparatus;
a step of receiving beacon information transmitted from the another distance image acquisition apparatus, the beacon information indicating that the second pattern is projected from the another distance image acquisition apparatus;
in a case where it is determined that the second pattern is projected from the another distance image acquisition apparatus, a step of performing modulation on the first pattern projected from the projector; and
in a case where the beacon information is received, a step of determining that the second pattern is projected from the another distance image acquisition apparatus.
6. A distance image acquisition method comprising:
a step of modulating a switching timing of projection and non-projection of a first pattern of structured light distributed in a two-dimensional manner with respect to a subject within a distance measurement region with a code and making a projector project the first pattern,
a step of performing imaging in synchronization with a projection period and a non-projection period of the first pattern with an image sensor provided in parallel with and apart from the projector by a baseline length and generating a plurality of captured images including the first pattern reflected from the subject, the plurality of captured images including a first captured image captured in the projection period of the first pattern and a second captured image captured in the non-projection period of the first pattern;
a step of generating a differential image of the first captured image captured in the projection period and the second captured image captured in the non-projection period;
a step of extracting the first pattern from the differential image;
a step of acquiring a distance image indicating a distance of the subject within the distance measurement region based on the extracted first pattern;
a step of determining whether or not a second pattern is projected from another distance image acquisition apparatus;
in a case where it is determined that the second pattern is projected from the another distance image acquisition apparatus, a step of performing modulation on the first pattern projected from the projector, wherein the first pattern and the second pattern are dot patterns; and
when the number of dots of a dot pattern detected from a captured image captured by the image sensor exceeds the number of dots of the first pattern projected from the projector, a step of determining that the second pattern is projected from the another distance image acquisition apparatus.