IP Library Granted Patent US 10,449,972
Granted Patent B2
US 10,449,972 · App. 15/664,192 · Granted Oct 22, 2019

Gesture based input system in a vehicle with haptic feedback

Inventor: Dat Truong (San Jose, CA)
Assignee: IMMERSION CORPORATION
B60W50/16B60W50/10G06F1/163G06F3/005G06F3/016G06F3/017G06F3/04817G06F3/167G10L25/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,449,972
App. No.
15/664,192
Granted
Oct 22, 2019
Kind
B2
Abstract

A vehicle haptic feedback system includes a haptic actuator, a detection device, and a controller. The haptic actuator is configured to provide haptic feedback to a vehicle driver. The detection device is disposed in an interior of the vehicle and is configured to capture movements of the vehicle driver and output data representing the movements. The controller is coupled to the detection device and is configured to receive a signal from the detection device indicative of the movements. The controller is also coupled to a haptic effect feedback system. Based on the signal, the controller is configured to send a signal to select a haptic effect from an effect table and is configured to send a signal to the haptic actuator to provide the selected haptic effect. The haptic actuator is coupled to a driver's seat, a steering wheel, a driver's seat belt, and/or an object wearable by the driver.

Claims (38)

1. A vehicle haptic feedback system comprising:

a haptic actuator configured to provide haptic feedback to a haptic feedback recipient, the haptic feedback recipient being one of a first or a second vehicle occupant;

a detection device disposed in an interior of the vehicle, wherein the detection device is configured to capture movements of a gesture provider and output a gesture signal representing the movements made by the gesture provider, the gesture provider being one of the first or the second vehicle occupant; and

a controller configured to

receive the gesture signal from the detection device indicative of the movements, wherein the controller is further configured to provide a haptic signal to the haptic actuator,

select a haptic effect based on the gesture signal indicative of the movements, and send the haptic signal to the haptic actuator to provide the selected haptic effect,

wherein the haptic actuator is coupled to at least one of the haptic feedback recipient's seat, a steering wheel, the haptic feedback recipient's seat belt, and/or an object that is wearable by the haptic feedback recipient.

2. The system of claim 1 , wherein the movements of the gesture provider are hand and/or finger movements.

3. The system of claim 2 , wherein the hand and/or finger movements are non-contact with respect to vehicle input devices.

4. The system of claim 1 , wherein the haptic actuator is selected from the group consisting of electromagnetic motor actuators, eccentric rotating mass, linear resonant actuators, shape memory alloy actuators, electro-active polymer actuators, vibrotactile actuators, inertial actuators, piezoelectric actuators, and moving magnet actuators.

5. The system of claim 1 , wherein the detection device is at least one camera.

6. The system of claim 1 , wherein the controller is further configured to cause a vehicle component to perform at least one action in response to the gesture signal from the detection device.

7. The system of claim 6 , further comprising at least one microphone configured to receive an audio command from the gesture provider, wherein the controller is further configured to receive an audio signal corresponding to the audio command and cause the vehicle component to perform the at least one action in response to the gesture signal from the detection device and the audio signal.

8. The system of claim 6 , wherein the controller is configured to select the haptic effect according to the at least one action caused to be performed by the vehicle component.

9. The system of claim 1 , wherein the controller is configured to select the haptic effect as confirmation that the movements of the gesture provider were captured.

10. The system of claim 1 , further comprising at least one microphone configured to receive an audio command from the gesture provider, wherein the controller is further configured to receive an audio signal corresponding to the audio command and select the haptic effect according to the gesture signal and the audio signal.

11. A method of providing haptic feedback to a haptic feedback recipient including one of a first or a second vehicle occupant, the method comprising:

capturing movements of a gesture provider via a detection device disposed in an interior of the vehicle, wherein the gesture provider is one of the first or the second vehicle occupant;

outputting, by the detection device, a gesture signal representing the movements made by the gesture provider;

receiving, via a controller, the gesture signal from the detection device indicative of the movements;

selecting, via the controller, a haptic effect based on the gesture signal indicative of the movements;

sending, via the controller, a haptic signal to a haptic actuator to provide the selected haptic effect, and

providing the selected haptic effect to the haptic feedback recipient via the haptic actuator, the haptic actuator being coupled to at least one of the haptic feedback recipient's seat, a steering wheel, the haptic feedback recipient's seat belt, and/or an object that is wearable by the haptic feedback recipient.

12. The method of claim 11 , wherein the movements of the gesture provider are hand and/or finger movements.

13. The method of claim 12 , wherein the hand and/or finger movements are non-contact with respect to vehicle input devices.

14. The method of claim 11 , wherein the haptic actuator is selected from the group consisting of electromagnetic motor actuators, eccentric rotating mass, linear resonant actuators, shape memory alloy actuators, electro-active polymer actuators, vibrotactile actuators, inertial actuators, piezoelectric actuators, and moving magnet actuators.

15. The method of claim 11 , wherein the detection device is at least one camera.

16. The method of claim 11 , further comprising causing, by the controller, a vehicle component to perform at least one action in response to the gesture signal from the detection device.

17. The method of claim 16 , further comprising:

receiving, via at least one microphone, an audio command from the gesture provider;

receiving, via the controller, an audio signal corresponding to the audio command; and

causing the vehicle component to perform the at least one action in response to the gesture signal from the detection device and the audio signal.

18. The method of claim 16 , further comprising selecting the haptic effect according to the at least one action caused to be performed by the vehicle component.

19. The method of claim 11 , further comprising selecting the haptic effect as confirmation that the movements of the gesture provider were captured.

20. The method of claim 11 , further comprising:

receiving, via at least one microphone, an audio command from the gesture provider;

receiving, via the controller, an audio signal corresponding to the audio command; and

selecting, by the controller, the haptic effect according to the gesture signal and the audio signal.

Continuity (3)
Continuation 15011921 · Feb 1, 2016
Continuation 14137540 · Dec 20, 2013
Related Publication 20180015933A1 · Jan 18, 2018
Cited By (1)
US 12,485,756