IP Library Granted Patent US 10,672,386
Granted Patent B2
US 10,672,386 · App. 16/364,177 · Granted Jun 2, 2020

Voice control system with dialect recognition

Inventor: Yong-Syuan Chen (New Taipei, TW)
Assignee: Thunder Power New Energy Vehicle Development Company Limited
G10L15/07B60R16/0373G01C21/3608G06F3/04842G10L15/22G10L17/22G10L15/005G10L15/065G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,672,386
App. No.
16/364,177
Granted
Jun 2, 2020
Kind
B2
Abstract

Voice command recognition with dialect translation is disclosed. User voice input can be translated to a standard voice pattern using a dialect translation unit. A control command can then be generated based on the translated user voice input. In certain embodiments, the voice command recognition system with dialect translation can be implemented in a driving apparatus. In those embodiments, various control commands to control the driving apparatus can be generated by a user with a dialect input. The generated voice control commands for the driving apparatus can include starting the driving apparatus, turning on/off A/C unit, controlling the A/C unit, turning on/off entertainment system, controlling the entertainment system, turning on/off certain safety features, turning on/off certain driving features, adjusting seat, adjusting steering wheel, taking a picture of surroundings and/or any other control commands that can control various functions of the driving apparatus.

Claims (61)

1. A computer-implemented method for facilitating control of one or more systems of a vehicle the method comprising:

receiving, by a processor, a user voice input;

translating, by the processor, the user voice input to a standard voice pattern, wherein the translating comprises:

retrieving one or more reference patterns representing predetermined voice inputs;

obtaining one or more characteristic vectors for the one or more reference patterns;

obtaining a characteristic vector for the user voice input;

determining a similarity between the one or more characteristic vectors for the one or more reference patterns and the characteristic vector for the user voice input;

based on a determined similarity between the one or more characteristic vectors for the one or more reference patterns and the characteristic vector for the user voice input, determining a reference pattern of the one or more reference patterns having a highest similarity to the user voice input;

based on a determination of the reference pattern having the highest similarity to the user voice input, designating the reference pattern having the highest similarity as the standard voice pattern;

based on the standard voice pattern, determining, by the processor, a control command corresponding to the user voice input for maneuvering the one or more systems of the vehicle; and

causing, by the processor, execution of the control command to control the one or more systems of the vehicle.

2. The computer-implemented method of claim 1 , wherein the user voice input includes information indicating a maneuver of the one or more systems of the vehicle.

3. The computer-implemented method of claim 1 , wherein the user voice input includes information indicating a control of a component within the one or more systems of the vehicle.

4. The computer-implemented method of claim 1 , further comprising:

storing one or more characteristic vectors of a language dialect; and

wherein translating the user voice input to the standard voice pattern further comprises obtaining a dialect characteristic vector of the user voice input and comparing the dialect characteristic vector of the user voice input with the one or more characteristic vectors of the language dialect.

5. The computer-implemented method of claim 1 , further comprising automatically determining a user identification based on the user voice input received.

6. The computer-implemented method of claim 1 , further comprising:

converting the user voice input to a sequence of digital values representing the characteristic vector of the user voice input; and

determining the user voice input is associated with a language dialect based on the characteristic vector of the user voice input.

7. The computer-implemented method of claim 1 , further comprising presenting a user interface enabling a user to select a locale to be associated with the user.

8. The computer-implemented method of claim 1 , wherein the user voice input is a first voice input, the standard voice pattern is a first standard voice pattern, and the control command is a first control command, and wherein the method further comprises:

receiving, by the processor, a second voice input;

translating, by the processor, the second voice input to a second standard voice pattern;

based on the second standard voice pattern, determining, by the processor, a second control command corresponding to the second voice input for maneuvering the one or more systems of the vehicle; and

causing, by the processor, execution of the second control command to control the one or more systems of the vehicle.

9. The computer-implemented method of claim 1 , further comprising presenting a user interface enabling a user to select a language to be associated with the user.

10. The computer-implemented method of claim 1 , wherein the one or more reference patterns are associated with a language corresponding to a selected language translation unit.

11. A system for facilitating control of one or more systems of a vehicle, the system comprising:

at least one processor; and

a non-transitory computer readable medium communicatively coupled to the at least one processor, the non-transitory computer readable medium having stored thereon computer software comprising a set of instructions that, when executed by the at least one processor, causes the at least one processor to:

receive a user voice input;

translate the user voice input to a standard voice pattern, wherein the translating comprises:

retrieve one or more reference patterns representing predetermined voice inputs;

obtain one or more characteristic vectors for the one or more reference patterns;

obtain a characteristic vector for the user voice input;

determine a similarity between the one or more characteristic vectors for the one or more reference patterns and the characteristic vector for the user voice input;

based on a determined similarity between the one or more characteristic vectors for the one or more reference patterns and the characteristic vector for the user voice input, determine a reference pattern of the one or more reference patterns having a highest similarity to the user voice input;

based on a determination of the reference pattern having the highest similarity to the user voice input, designate the reference pattern having the highest similarity as the standard voice pattern;

based on the standard voice pattern, determine a control command corresponding to the user voice input for maneuvering the one or more systems of the vehicle; and

cause execution of the control command to control the one or more systems of the vehicle.

12. The system of claim 11 , wherein the user voice input includes information indicating a maneuver of the one or more systems of the vehicle.

13. The system of claim 11 , wherein the user voice input includes information indicating a control of a component within the one or more systems of the vehicle.

14. The system of claim 11 , wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

store one or more characteristic vectors of a language dialect; and

wherein translating the user voice input to the standard voice pattern further comprises obtaining a dialect characteristic vector of the user voice input and comparing the dialect characteristic vector of the user voice input with the one or more characteristic vectors of the language dialect.

15. The system of claim 11 , wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

automatically determine a user identification based on the user voice input received.

16. The system of claim 11 , wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

convert the user voice input to a sequence of digital values representing the characteristic vector of the user voice input; and

determine the user voice input is associated with a language dialect is-based on the characteristic vector of the user voice input.

17. The system of claim 11 , wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

present a user interface enabling a user to select a language to be associated with the user.

18. The system of claim 11 , wherein the user voice input is a first user voice input, the standard voice pattern is a first standard voice pattern, and the control command is a first control command, and wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

receive a second user voice input;

translate the second voice input to a second standard voice pattern;

based on the second standard voice pattern, determine a second control command corresponding to the second user voice input for controlling the one or more systems of the vehicle; and

cause execution of the second control command to control the one or more systems of the vehicle.

19. The system of claim 11 , wherein the set of instructions, when executed by the at least one processor, further causes the at least one processor to:

present a user interface enabling a user to select a locale to be associated with the user.

20. The system of claim 11 , wherein the one or more reference patterns are associated with a language corresponding to a selected language translation unit.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 26, 2019
From: CHEN, YONG-SYUAN
To: THUNDER POWER NEW ENERGY VEHICLE DEVELOPMENT COMPANY LIMITED
Reel/Frame 048694/0580 →
Continuity (6)
Continuation 15895792 · Feb 13, 2018
Continuation 15597168 · May 17, 2017
Continuation 15217092 · Jul 22, 2016
Continuation 14996180 · Jan 14, 2016
Provisional Application 62272710 · Dec 30, 2015
Related Publication 20190355349A1 · Nov 21, 2019