IP Library Granted Patent US 10,281,989
Granted Patent B2
US 10,281,989 · App. 15/357,077 · Granted May 7, 2019

Vehicle operating system using motion capture

Inventors: Jen-Chieh Hsiao (Taipei, TW); Yong-Syuan Chen (New Taipei, TW)
Assignee: THUNDER POWER NEW ENERGY VEHICLE DEVELOPMENT COMPANY LIMITED
G06F3/017B60K35/00B60K37/06B60R1/00G06F3/0304G06F3/04883G06K9/00355G06K9/00845H04N5/23296H04N5/247B60K2350/106B60K2350/1028B60K2350/1052B60K2350/2013B60R2300/105B60R2300/207B60R2300/303B60R2300/8006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,281,989
App. No.
15/357,077
Granted
May 7, 2019
Kind
B2
Abstract

Vehicle operating systems for operating a vehicle having a driving seat for a vehicle driver and at least one passenger seat for passengers are described. The vehicle operating system may include one or more camera devices for shooting images of hand actions of the driver or images of hand actions of a passenger, and a storage device for storing operating signals corresponding to hand actions. A processing device may be configured to select the driver or the passengers as a gesture command operator, and to control the camera device to shoot hand action images of the selected gesture command operator. The command system may also be configured to convert the shot hand action images into corresponding operating signals according to hand action indicia stored in the storage device. The operating signals may be sent to execution devices, that execute the corresponding operations.

Claims (42)

1. A vehicle operating system for operating a vehicle having multiple users inside the vehicle, the vehicle operating system comprising:

multiple camera devices for capturing at least one image for each of the multiple users including a first user and a second user, wherein the multiple camera devices include a first camera device corresponding to the first user and a second camera device corresponding to the second user;

a storage device for storing operating signals corresponding to gesture actions;

a processing device configured to

control the first and second camera devices to capture gesture action images for the multiple users simultaneously or substantially simultaneously, wherein the captured gesture action images include a first action image for the first user captured by the first camera device and a second action image for the second user captured by the second camera device, the first action image and the second action image being captured by the first and second camera devices simultaneously or substantially simultaneously,

convert the captured gesture action images into corresponding operating signals according to the operating signals corresponding to the gesture actions stored in the storage device,

determine the first user has performed a first gesture action based on the first action image and the second action image,

determine the first gesture action to be an active gesture action;

select a first operating signal from the first user based on the first gesture action by virtue of the first gesture action having been determined to be the active gesture action, and

send out the first operating signal; and

execution devices configured to receive the operating signals sent by the processing device, and to execute a first operation corresponding to the first operating signal.

2. The vehicle operating system of claim 1 , wherein the processing device switches the gesture command operator from the driver to a passenger or from a passenger to the driver according to a switch instruction.

3. The vehicle operating system of claim 2 , wherein the switch instruction is a hand action of the gesture command operator.

4. The vehicle operating system of claim 1 , wherein the camera device captures an image from a body locating point of the gesture command operator to his hand, the processing device checks whether the gesture image and the body locating point image are image-continuous, and if so, the gesture actions are converted into the operating signals.

5. The vehicle operating system of claim 4 , wherein the body locating point comprises an arm, head or breast of the gesture command operator.

6. The vehicle operating system of claim 1 , wherein the camera device comprises a camera and a driving device for the camera, and the driving device configured for driving the camera to move or rotate.

7. The vehicle operating system of claim 6 , wherein the driving device comprises a motor and a gear set.

8. The vehicle operating system of claim 1 , wherein the camera device is arranged in front of the driving seat.

9. The vehicle operating system of claim 1 , including a plurality of camera devices, at least one of the plurality of camera devices being arranged in front of the driving seat, and at least one camera device being arranged at a different location providing a view of the back seat.

10. The vehicle operating system of claim 1 , wherein the execution devices comprise at least one of a multimedia system, a door switch, a refill opening switch, Bluetooth equipment, a light switch and an air-conditioning system.

11. The vehicle operating system of claim 1 , wherein,

the execution devices comprise a center console provided with at least one touch screen, the touch screen at least extends from the front part between the driving seat and the front passenger seat to the front part of the front passenger seat,

a touch screen operating interface is displayed on the touch screen, and

the center console can control the touch screen operating interface to move on the touch screen according to an operating signal.

12. The vehicle operating system of claim 1 , wherein,

each operating signal corresponds to a two-step hand action,

a first step of the hand action is used for selecting an execution device, and

a second step of the hand action is used for instructing the selected execution device to carry out an specific operation.

13. An electric vehicle, comprising:

a driving seat for a vehicle driver;

at least one passenger seat for passengers; and

a vehicle operating system including:

multiple camera devices for capturing at least one of images of gestures of the driver or images of gestures of a passenger, wherein the multiple camera devices include a first camera device corresponding to the first user and a second camera device corresponding to the second user;

a storage device for storing operating signals corresponding to gesture actions;

a processing device configured to

control first and second camera devices to capture gesture action images for the multiple users simultaneously or substantially simultaneously, wherein the captured gesture action images include a first action image for the first user captured by the first camera device and a second action image for the second user captured by the second camera device, the first action image and the second action image being captured by the first and second camera devices simultaneously or substantially simultaneously,

convert the captured gesture action images into corresponding operating signals according to the operating signals corresponding to the gesture actions stored in the storage device,

determine the first user has performed a first gesture action based on the first action image and the second action image,

determine the first gesture action to be an active gesture action:

select a first operating signal from the first user based on the first gesture action by virtue of the first gesture action having been determined to be the active gesture action, and

send out the first operating signal; and

an execution device configured to receive the operating signals sent by the processing device, and to execute a first operation corresponding to the first operating signal.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2017
From: THUNDER POWER HONG KONG LIMITED
To: THUNDER POWER NEW ENERGY VEHICLE DEVELOPMENT COMPANY LIMITED
Reel/Frame 042084/0334 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 21, 2016
From: HSIAO, JEN-CHIEH; CHEN, YONG-SYUAN
To: THUNDER POWER HONG KONG LTD.
Reel/Frame 040391/0299 →
Continuity (4)
Continuation 14883621 · Oct 15, 2013
Provisional Application 62133991 · Mar 16, 2015
Provisional Application 62150848 · Apr 22, 2015
Related Publication 20170235371A1 · Aug 17, 2017