Voice pickup method for intelligent rearview mirror, electronic device and storage medium
View Patent ↗It is disclosed a voice pickup method and apparatus for an intelligent rearview mirror, an electronic device and a computer readable storage medium which relates to the technical field of vehicle-mounted equipment, and may be used in the field of automatic driving technologies. A voice pickup implementation of the intelligent rearview mirror according to some embodiments includes: acquiring an image of the interior of the vehicle; determining the position of a person in the vehicle with the image of the interior of the vehicle; and adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle.
1. A voice pickup method implemented by an intelligent rearview mirror, comprising:
acquiring an image of an interior of a vehicle;
determining a position of a person in the vehicle with the image of the interior of the vehicle;
adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle;
acquiring a time interval corresponding to an operation state of the vehicle; and
when a time between a current time and a time when the image of the interior of the vehicle is acquired last time reaches the time interval, turning to the acquiring the image of the interior of the vehicle, so as to repeat the actions of image acquirement, position determination and beamforming direction adjustment,
wherein the operation state of the vehicle comprises a vehicle travelling state and a vehicle stationary state, and the time interval corresponding to the vehicle travelling state is longer than the time interval corresponding to the vehicle stationary state.
2. The method according to claim 1 , wherein the determining the position of the person in the vehicle with the image of the interior of the vehicle comprises:
detecting whether a person exists at a preset position in the vehicle with the image of the interior of the vehicle; and
acquiring the position of the person in the vehicle according to the result of person detection for the preset position.
3. The method according to claim 1 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
determining a microphone in the microphone array corresponding to the position of the person in the vehicle; and
adjusting the beamforming direction of the microphone array using the microphone determined, and turning off remaining microphones in the microphone array.
4. The method according to claim 1 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
receiving a voice signal of the person in the vehicle, and acquiring sound-source positioning information corresponding to the voice signal; and
filtering out wrong sound-source positioning information in the sound-source positioning information according to the position of the person in the vehicle, and adjusting the beamforming direction of the microphone array according to the filtered sound-source positioning information.
5. An electronic device used for an intelligent rearview mirror, comprising:
at least one processor; and
a memory connected with the at least one processor communicatively;
wherein the memory stores instructions executable by the at least one processor to cause the at least one processor to perform a voice pickup method which comprises:
acquiring an image of an interior of a vehicle;
determining a position of a person in the vehicle with the image of the interior of the vehicle;
adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle;
acquiring a time interval corresponding to an operation state of the vehicle; and
when a time between a current time and a time when the image of the interior of the vehicle is acquired last time reaches the time interval, turning to the acquiring the image of the interior of the vehicle, so as to repeat the actions of image acquirement, position determination and beamforming direction adjustment,
wherein the operation state of the vehicle comprises a vehicle travelling state and a vehicle stationary state, and the time interval corresponding to the vehicle travelling state is longer than the time interval corresponding to the vehicle stationary state.
6. The electronic device according to claim 5 , wherein the determining the position of the person in the vehicle with the image of the interior of the vehicle comprises:
detecting whether a person exists at a preset position in the vehicle with the image of the interior of the vehicle; and
acquiring the position of the person in the vehicle according to the result of person detection for the preset position.
7. The electronic device according to claim 5 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
determining a microphone in the microphone array corresponding to the position of the person in the vehicle; and
adjusting the beamforming direction of the microphone array using the microphone determined, and turning off remaining microphones in the microphone array.
8. The electronic device according to claim 5 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
receiving a voice signal of the person in the vehicle, and acquiring sound-source positioning information corresponding to the voice signal; and
filtering out wrong sound-source positioning information in the sound-source positioning information according to the position of the person in the vehicle, and adjusting the beamforming direction of the microphone array according to the filtered sound-source positioning information.
9. A non-transitory computer readable storage medium comprising computer instructions, which, when executed by a computer, cause the computer to carry out a voice pickup method which comprises:
acquiring an image of an interior of a vehicle;
determining a position of a person in the vehicle with the image of the interior of the vehicle;
adjusting a beamforming direction of a microphone array according to the position of the person in the vehicle;
acquiring a time interval corresponding to an operation state of the vehicle; and
when a time between a current time and a time when the image of the interior of the vehicle is acquired last time reaches the time interval, turning to the acquiring the image of the interior of the vehicle, so as to repeat the actions of image acquirement, position determination and beamforming direction adjustment,
wherein the operation state of the vehicle comprises a vehicle travelling state and a vehicle stationary state, and the time interval corresponding to the vehicle travelling state is longer than the time interval corresponding to the vehicle stationary state.
10. The non-transitory computer readable storage medium according to claim 9 , wherein the determining the position of the person in the vehicle with the image of the interior of the vehicle comprises:
detecting whether a person exists at a preset position in the vehicle with the image of the interior of the vehicle; and
acquiring the position of the person in the vehicle according to the result of person detection for the preset position.
11. The non-transitory computer readable storage medium according to claim 9 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
determining a microphone in the microphone array corresponding to the position of the person in the vehicle; and
adjusting the beamforming direction of the microphone array using the microphone determined, and turning off remaining microphones in the microphone array.
12. The non-transitory computer readable storage medium according to claim 9 , wherein the adjusting the beamforming direction of the microphone array according to the position of the person in the vehicle comprises:
receiving a voice signal of the person in the vehicle, and acquiring sound-source positioning information corresponding to the voice signal; and
filtering out wrong sound-source positioning information in the sound-source positioning information according to the position of the person in the vehicle, and adjusting the beamforming direction of the microphone array according to the filtered sound-source positioning information.