IP Library Granted Patent US 10,203,765
Granted Patent B2
US 10,203,765 · App. 15/075,714 · Granted Feb 12, 2019

Interactive input system and method

Inventors: Anli He (San Jose, CA); Yue Fei (San Jose, CA)
Assignee: uSens, Inc.
G06F3/017G06F3/013G06F3/0425G06K9/00201G06K9/00335G06K9/209G06K9/52G06K9/6214G06K9/6232
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,203,765
App. No.
15/075,714
Granted
Feb 12, 2019
Kind
B2
Abstract

A method for human-machine interaction includes monitoring a movement of an object by a sensor that detects positions of the object over time, generating a time-dependent velocity of the object based on the movement of the object, detecting a tapping event of the object tapping on a surface by detecting a sudden change of the time-dependent velocity, and determining a position of the object at a time when the tapping event occurs as a tapping position of the object.

Claims (70)

1. A method for human-machine interaction, comprising:

monitoring a movement of an object by a sensor that detects positions of the object over time;

generating a time-dependent velocity of the object based on the movement of the object;

detecting a tapping event of the object tapping on a surface by detecting a sudden change of the time-dependent velocity; and

determining a position of the object at a time when the tapping event occurs as a tapping position of the object;

wherein detecting the tapping event comprises:

determining whether the time-dependent velocity in a certain direction drops from a first speed value to a second speed value within a first time threshold, the first speed value being larger than the second speed value, and the second speed value being close to zero, and

determining whether the time-dependent velocity in the certain direction keeps at about the second speed value for longer than a second time threshold; and

determining the tapping event has occurred if the time-dependent velocity in the certain direction drops from the first speed value to the second speed value within the first period of time and the time-dependent velocity in the certain direction keeps at about the second speed value for longer than the second time threshold.

2. The method of claim 1 , wherein monitoring the movement of the object includes:

recording a time-dependent position value of the object based on the detected positions over time; and

converting the time-dependent position value to the time-dependent velocity by differentiation.

3. The method of claim 2 , wherein:

detecting the positions of the object includes recording the positions of the object in a first three-dimensional (3D) coordinate system, and

determining whether the time-dependent velocity in the certain direction drops from the first speed value to the second speed value within the first time threshold includes:

mapping the positions of the object from the first 3D coordinate system to a second 3D coordinate system using a dimension reduction method, a minimum axis of the second 3D coordinate system being along the certain direction; and

determining whether the time-dependent velocity in the certain direction drops from the first speed value to the second speed value based on the positions of the object in the second 3D coordinate system.

4. The method of claim 3 , wherein:

mapping the positions of the object from the first 3D coordinate system to the second 3D coordinate system includes mapping the positions using a principal component analysis method, and

the minimum axis has a smallest eigenvalue among axes of the second 3D coordinate system, an eigenvalue of an axis of the second 3D coordinate system relating to an amount of variation of the positions along the axis in the second 3D coordinate system.

5. The method of claim 1 , further comprising:

determining whether the tapping position is on an existing touch interactive surface of a human-machine interaction system;

if the tapping position is on the existing touch interactive surface, using the tapping position to increase a resolution of the existing touch interactive surface;

if the tapping position is slightly off the existing touch interactive surface, updating the existing touch interactive surface using the tapping position or deleting the existing touch interactive surface; and

if the tapping position is not associated with the existing touch interactive surface, initiating a process for creating a new touch interactive surface.

6. The method of claim 1 , further comprising:

determining a plurality of tapping positions of the object; and

creating a touch interactive surface based on the tapping positions.

7. The method of claim 6 , wherein creating the touch interactive surface based on the tapping positions includes:

plugging coordinate values of each of the tapping positions into a polynomial surface fitting equation containing a plurality of parameters; and

determining best values for the parameters of the polynomial surface fitting equation using a regression method.

8. The method of claim 6 , wherein creating the touch interactive surface based on the tapping positions includes creating the touch interactive surface using a point cloud method.

9. The method of claim 6 , further comprising:

after the touch interactive surface is determined, continuing to detect positions of the object by the sensor; and

determining a distance from the object to the touch interactive surface based on a position of the object and the touch interactive surface.

10. The method of claim 1 , further comprising:

determining a plurality of tapping positions of the object;

calculating a covariance matrix using the tapping positions;

after the covariance matrix is calculated, continuing to monitor the position of the object; and

determining a distance from the object to a touch interactive surface of a human-machine interaction system represented by the tapping positions using a Gaussian regression method.

11. An apparatus for human-machine interaction, comprising:

a sensing device configured to monitor a movement of an object by detecting positions of the object over time; and

a processor configured to:

generate a time-dependent velocity of the object based on the movement of the object;

detect a tapping event of the object tapping on a surface by detecting a sudden change of the time-dependent velocity; and

determine a position of the object at a time when the tapping event occurs as a tapping position of the object;

wherein the processor is further configured to:

determine whether the time-dependent velocity in a certain direction drops from a first speed value to a second speed value within a first time threshold, the first speed value being larger than the second speed value, and the second speed value being close to zero, and

determine whether the time-dependent velocity in the certain direction keeps at about the second speed value for longer than a second time threshold; and

determine the tapping event has occurred if the time-dependent velocity in the certain direction drops from the first speed value to the second speed value within the first period of time and the time-dependent velocity in the certain direction keeps at about the second speed value for longer than the second time threshold.

12. The apparatus of claim 11 , wherein the processor is further configured to:

record a time-dependent position value of the object based on the detected positions over time; and

convert the time-dependent position value to the time-dependent velocity by differentiation.

13. The apparatus of claim 12 , wherein the processor is further configured to:

record the positions of the object in a first three-dimensional (3D) coordinate system;

map the positions of the object from the first 3D coordinate system to a second 3D coordinate system using a dimension reduction method, a minimum axis of the second 3D coordinate system being along the certain direction; and

determine whether the time-dependent velocity in the certain direction drops from the first speed value to the second speed value based on the positions of the object in the second 3D coordinate system.

14. The apparatus of claim 11 , wherein the processor is further configured to:

determine whether the tapping position is on an existing touch interactive surface of a human-machine interaction system;

if the tapping position is on the existing touch interactive surface, use the tapping position to increase a resolution of the existing touch interactive surface;

if the tapping position is slightly off the existing touch interactive surface, update the existing touch interactive surface using the tapping position or delete the existing touch interactive surface; and

if the tapping position is not associated with the existing touch interactive surface, initiate a process for creating a new touch interactive surface.

15. The apparatus of claim 11 , wherein the processor is further configured to:

determine a plurality of tapping positions of the object; and

create a touch interactive surface based on the tapping positions.

16. The apparatus of claim 11 , wherein the processor is further configured to:

determine a plurality of tapping positions of the object;

calculate a covariance matrix using the tapping positions;

after the covariance matrix is calculated, continue to monitor the position of the object; and

determine a distance from the object to a touch interactive surface of a human-machine interaction system represented by the tapping positions using a Gaussian regression method.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 4, 2023
From: USENS, INC.
To: SHANGHAI YVR TECHNOLOGY CO., LTD.
Reel/Frame 064510/0610 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2016
From: HE, ANLI; FEI, YUE
To: USENS, INC.
Reel/Frame 038049/0813 →
Continuity (4)
Continuation 14034286 · Sep 23, 2013
Provisional Application 61841864 · Jul 1, 2013
Provisional Application 61811680 · Apr 12, 2013
Related Publication 20160202844A1 · Jul 14, 2016