Granted Patent B2

US 12,612,048 · App. 17/976,424 · Granted Apr 28, 2026

Inventors: Qinsong Zhao (Dongguan, CN); Mingrui Yin (Shenzhen, CN)

Assignee: Shenzhen Yinwang Intelligent Technologies Co., Ltd.

B60W40/08B60W50/10G06V20/593G06V40/161B60W2040/0881B60W2540/047B60W2540/21

Abstract

Claims (51)

1 . An in-vehicle user positioning method, comprising:

obtaining, by an in-vehicle apparatus, a sound signal collected by an in-vehicle microphone;

in response to that a first voice command is recognized from the sound signal, determining, by the in-vehicle apparatus, a first user who sends the first voice command;

obtaining, by the in-vehicle apparatus, a mapping relationship between an in-vehicle user and an in-vehicle location;

determining, by the in-vehicle apparatus, an in-vehicle location of the first user based on the mapping relationship between the in-vehicle user and the in-vehicle location;

obtaining at least one in-vehicle sound source location by performing sound source positioning based on the sound signal;

correcting the in-vehicle location of the first user based on the in-vehicle location of the first user and the at least one in-vehicle sound source location, wherein the correcting comprises determining, as a corrected in-vehicle location of the first user, an in-vehicle sound source location that is in the at least one in-vehicle sound source location and that is closest to the in-vehicle location of the first user; and

controlling, by the in-vehicle apparatus, a rotation angle of a projector component based on the corrected in-vehicle location of the first user.

2 . The method according to claim 1 , wherein the determining a first user who sends the first voice command comprises:

recognizing the first user who sends the first voice command by performing voiceprint feature matching on the first voice command.

3 . The method according to claim 1 , wherein the mapping relationship between the in-vehicle user and the in-vehicle location is determined based on a face image collected by a vehicle-mounted camera.

4 . The method according to claim 3 , wherein that the mapping relationship between the in-vehicle user and the in-vehicle location is determined based on the face image collected by the vehicle-mounted camera comprises:

obtaining user information;

determining, based on a mapping relationship between the user information and the face image, a user corresponding to the face image; and

determining an in-vehicle location of the user based on at least one of a location or an angle of the vehicle-mounted camera.

5 . The method according to claim 1 , wherein the first voice command comprises turning on an air conditioner of a vehicle, and the method comprises: turning on the air conditioner corresponding to the corrected in-vehicle location of the first user.

6 . An in-vehicle interaction method, comprising:

obtaining, by an in-vehicle apparatus, a sound signal collected by an in-vehicle microphone;

in response to that a first voice command is recognized from the sound signal, determining, by the in-vehicle apparatus, a first user who sends the first voice command;

obtaining, by the in-vehicle apparatus, a mapping relationship between an in-vehicle user and an in-vehicle location;

determining, by the in-vehicle apparatus, an in-vehicle location of the first user based on the mapping relationship between the in-vehicle user and the in-vehicle location;

obtaining at least one in-vehicle sound source location by performing sound source positioning based on the sound signal;

correcting the in-vehicle location of the first user based on the in-vehicle location of the first user and the at least one in-vehicle sound source location, wherein the correcting comprises determining, as a corrected in-vehicle location of the first user, an in-vehicle sound source location that is in the at least one in-vehicle sound source location and that is closest to the in-vehicle location of the first user; and

executing, by the in-vehicle apparatus, the first voice command based on the corrected in-vehicle location of the first user, wherein executing the first voice command based on the corrected in-vehicle location of the first user comprises:

controlling, by the in-vehicle apparatus, a rotation angle of a projector component based on the corrected in-vehicle location of the first user.

7 . The method according to claim 6 , wherein the executing the first voice command based on the in-vehicle location of the first user comprises:

controlling a location of a projection interface based on controlling the rotation angle of the projector component.

8 . The method according to claim 6 , wherein the first voice command comprises turning on an air conditioner of a vehicle, and the method comprises: turning on the air conditioner corresponding to the corrected in-vehicle location of the first user.

9 . A vehicle-mounted apparatus, comprising:

a data storage configured to store a mapping relationship between an in-vehicle user and an in-vehicle location; and

at least one processor coupled with one or more memories that store programming instructions for execution by the at least one processor to:

obtain a sound signal collected by an in-vehicle microphone;

in response to that a first voice command is recognized from the sound signal, determine a first user who sends the first voice command;

obtain the mapping relationship between an in-vehicle user and an in-vehicle location;

determine an in-vehicle location of the first user based on the mapping relationship between the in-vehicle user and the in-vehicle location;

obtain at least one in-vehicle sound source location by performing sound source positioning based on the sound signal;

correct the in-vehicle location of the first user based on the in-vehicle location of the first user and the at least one in-vehicle sound source location, wherein the correcting comprises determining, as a corrected in-vehicle location of the first user, an in-vehicle sound source location that is in the at least one in-vehicle sound source location and that is closest to the in-vehicle location of the first user; and

control a rotation angle of a projector component based on the corrected in-vehicle location of the first user.

10 . The apparatus according to claim 9 , wherein the at least one processor coupled with the one or more memories that store the programming instructions for execution by the at least one processor to:

perform voiceprint feature matching on the first voice command, to recognize the first user who sends the first voice command.

11 . The apparatus according to claim 9 , wherein the mapping relationship between the in-vehicle user and the in-vehicle location is determined based on a face image collected by a vehicle-mounted camera.

12 . The apparatus according to claim 11 , wherein that the mapping relationship between the in-vehicle user and the in-vehicle location is determined based on a location of the vehicle-mounted camera and the face image collected by the vehicle-mounted camera comprises:

obtaining user information;

determining, based on a mapping relationship between the user information and the face image, a user corresponding to the face image; and

determining an in-vehicle location of the user based on at least one of the location or an angle of the vehicle-mounted camera.

13 . The apparatus according to claim 9 , wherein the at least one processor coupled with the one or more memories that store the programming instructions for execution by the at least one processor to:

execute the first voice command based on the in-vehicle location of the first user.

14 . The apparatus according to claim 13 , wherein the at least one processor coupled with the one or more memories that store the programming instructions for execution by the at least one processor to:

control a location of a projection interface based on controlling the rotation angle of the projector component.

15 . The apparatus according to claim 13 , wherein the first voice command comprises turning on an air conditioner of a vehicle, and the at least one processor coupled with the one or more memories that store the programming instructions for execution by the at least one processor to:

turn on the air conditioner corresponding to the corrected in-vehicle location of the first user.

Assignments (3)

Continuity (2)

References Cited (51)