IP Library Granted Patent US 11,275,449
Granted Patent B2
US 11,275,449 · App. 17/120,641 · Granted Mar 15, 2022

Method and apparatus for controlling onboard system

Inventors: Xinyu Zhao (Dongguan, CN); Chengping Liu (Dongguan, CN); Heshuai Si (Dongguan, CN); Yongfang Su (Shenzhen, CN); Zeshi Zhang (Shenzhen, CN)
Assignee: HUAWEI TECHNOLOIES CO., LTD.
G06F3/017G01S7/539B60K37/06B60K2370/146B60K2370/1529B60K2370/48B60K2370/52B62D1/06
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,275,449
App. No.
17/120,641
Granted
Mar 15, 2022
Kind
B2
Abstract

A method and an apparatus for controlling an onboard system includes determining, using a sensor mounted in a steering wheel, a track of a current gesture of a driver in a process of holding, by the driver, the steering wheel; determining a type of the current gesture from preset gesture types based on the track of the current gesture; and controlling the onboard system to perform an operation corresponding to the type of the current gesture.

Claims (73)

1. A method for controlling an onboard system in a vehicle, comprising:

obtaining ultrasonic signals reflected from a portion of an object of a driver contacting a steering wheel of the vehicle using a plurality of ultrasonic sensors, wherein the ultrasonic signals are obtained during a period of time, wherein the plurality of ultrasonic sensors is mounted in the steering wheel, and wherein the object is a hand or a finger of the driver;

determining coordinates of a position of the object within the period of time using the ultrasonic signals;

determining, by performing function fitting on the coordinates, a track of the object as a current gesture of the driver;

determining, according to the track, a gesture type of the current gesture from preset gesture types; and

controlling the onboard system to perform an operation,

wherein the operation corresponds to the gesture type.

2. The method of claim 1 , further comprising:

determining contour information of the object at a first time period of the period of time using the ultrasonic signals at the first time period; and

determining whether the contour information is valid by comparing the contour information with pre-stored contour information.

3. The method of claim 1 , further comprising obtaining a fitted function curve as the current gesture of the driver by performing the function fitting.

4. The method of claim 3 , wherein determining, according to the track, the gesture type of the current gesture from the preset gesture types comprises:

comparing the fitted function curve with function curves in a database;

selecting a target function curve from the function curves, wherein the target function curve has a highest matching degree with the fitted function curve; and

determining a second gesture type corresponding to the target function curve from the preset gesture types as the gesture type of the current gesture.

5. The method of claim 1 , further comprising determining directions of sound holes in a circumference of the steering wheel based on an active area of the object of the driver and coverage of the ultrasonic signals, wherein the sound holes correspond with the ultrasonic sensors.

6. The method of claim 1 , wherein the preset gesture types comprise at least one of the following gesture types:

sliding two fingers either inward or outward;

sliding two fingers either clockwise or anticlockwise;

sliding one finger either upward, downward, leftward or rightward;

double-clicking the steering wheel with one finger;

waving one hand;

touching and sliding one finger along an inner side of a circumference of the steering wheel; or

double-clicking the steering wheel with two fingers.

7. The method of claim 1 , further comprising:

detecting whether the steering wheel is in a rotation state; and

obtaining the ultrasonic signals reflected from the portion of the object of the driver when the steering wheel is in a non-rotation state.

8. The method of claim 7 , further comprising further detecting whether the steering wheel is in the rotation state using a status of a gyroscope in the steering wheel.

9. An apparatus for controlling an onboard system in a vehicle, comprising:

a memory comprising instructions; and

a processor coupled to the memory and configured to execute the instructions, wherein the instructions cause the processor to:

obtain ultrasonic signals reflected from a portion of an object of a driver contacting a steering wheel of the vehicle using a plurality of ultrasonic sensors, wherein the ultrasonic signals are obtained during a period of time, wherein the plurality of ultrasonic sensors is mounted in the steering wheel, and wherein the object is a hand or a finger of the driver;

determine coordinates of a position of the object within the period of time using the ultrasonic signals;

determine, by performing function fitting on the coordinates, a track of the object as a current gesture of the driver;

determine, according to the track, a gesture type of the current gesture from preset gesture types; and

control the onboard system to perform an operation,

wherein the operation corresponds to the gesture type.

10. The apparatus of claim 9 , wherein the instructions further cause the processor to:

determine contour information of the object at a first time period of the period of time using the ultrasonic signals at the first time period; and

determine the contour information is valid by comparing the contour information with pre-stored contour information.

11. The apparatus of claim 9 , wherein the instructions further cause the processor to obtain a fitted function curve as the current gesture of the driver by performing the function fitting.

12. The apparatus of claim 11 , wherein the instructions further cause the processor to:

compare the fitted function curve with function curves in a database;

select a target function curve from the function curves, wherein the target function curve has a highest matching degree with the fitted function curve; and

determine a second gesture type corresponding to the target function curve from the preset gesture types as the gesture type of the current gesture.

13. The apparatus of claim 9 , wherein the instructions further cause the processor to determine directions of sound holes in a circumference of the steering wheel based on an active area of the hand of the driver and coverage of the ultrasonic signals, and wherein the sound holes correspond with the ultrasonic sensors.

14. The apparatus of claim 9 , wherein the preset gesture types comprise at least one of the following gesture types:

sliding two fingers either inward or outward;

sliding two fingers either clockwise or anticlockwise;

sliding one finger either upward, downward, leftward or rightward;

double-clicking the steering wheel with one finger;

waving one hand;

touching and sliding one finger along an inner side of a circumference of the steering wheel; or

double-clicking the steering wheel with two fingers.

15. The apparatus of claim 9 , wherein the instructions further cause the processor to:

detect whether the steering wheel is in a rotation state; and

obtain the ultrasonic signals reflected from the portion of the object of the driver when the steering wheel is in a non-rotation state.

16. The apparatus of claim 15 , wherein the instructions further cause the processor to be configured to further detect whether the steering wheel is in the rotation state using a status of a gyroscope in the steering wheel.

17. A computer program product comprising computer-executable instructions stored on a non-transitory computer-readable medium that, when executed by a processor, cause an apparatus to:

obtain ultrasonic signals reflected from a portion of an object of a driver contacting a steering wheel of a vehicle using a plurality of ultrasonic sensors, wherein the ultrasonic signals are obtained during a period of time, wherein the plurality of ultrasonic sensors is mounted in the steering wheel, and wherein the object is a hand or a finger of the driver;

determine coordinates of a position of the object within the period of time using the ultrasonic signals;

determine, by performing function fitting on the coordinates, a track of the object as a current gesture of the driver;

determine, according to the track, a gesture type of the current gesture from preset gesture types; and

control an onboard system in the vehicle to perform an operation,

wherein the operation corresponds to the gesture type.

18. The computer program product of claim 17 , wherein the computer-executable instructions further cause the apparatus to:

determine contour information of the object at a first time period of the period of time using the ultrasonic signals at the first time period; and

determine the contour information is valid by comparing the contour information with pre-stored contour information.

19. The computer program product of claim 17 , wherein the computer-executable instructions further cause the apparatus to obtain a fitted function curve as the current gesture of the driver by performing the function fitting.

20. The computer program product of claim 19 , wherein the computer-executable instructions further cause the apparatus to:

compare the fitted function curve with function curves in a database;

select a target function curve from the function curves, wherein the target function curve has a highest matching degree with the fitted function curve; and

determine a second gesture type corresponding to the target function curve from the preset gesture types as the gesture type of the current gesture.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2024
From: HUAWEI TECHNOLOGIES CO., LTD.
To: SHENZHEN YINWANG INTELLIGENT TECHNOLOGIES CO., LTD.
Reel/Frame 069335/0829 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 14, 2020
From: ZHAO, XINYU; LIU, CHENGPING; SI, HESHUAI; SU, YONGFANG; ZHANG, ZESHI
To: HUAWEI TECHNOLOGIES CO., LTD.
Reel/Frame 054635/0014 →