IP Library › Granted Patent US 9,098,142

Granted Patent B2

US 9,098,142 · App. 14/089,240 · Granted Aug 4, 2015

Sensor arrangement for use with a touch sensor that identifies hand parts

Inventors: Wayne Westerman (Burlingame, CA); John G. Elias (Townsend, DE)

Assignee: Apple Inc.

G06F3/0416 G06F3/0235 G06F3/041 G06F3/044 G06F3/0412 G06F3/0485 G06F3/0488 G06F3/04815 G06F3/04845 G06F3/04883 G06F3/04886 G06K9/00375 G06K9/6272 G06K9/6878 H03K17/9622 G06F2203/04101 G06F2203/04104 G06F2203/04106 G06F2203/04808 H03K2217/960725

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 9,098,142
App. No.: 14/089,240
Granted: Aug 4, 2015
Kind: B2

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

Apparatus and methods are disclosed for simultaneously tracking multiple finger and palm contacts as hands approach, touch, and slide across a proximity-sensing, multi-touch surface. Identification and classification of intuitive hand configurations and motions enables unprecedented integration of typing, resting, pointing, scrolling, 3D manipulation, and handwriting into a versatile, ergonomic computer input device.

Claims (50)

1. A method of input of a computing system including a touch sensing surface, the method comprising:

obtaining touch sensing information of a scan of the touch sensing surface;

determining, based on the touch sensing information of the scan, contact information of a set of one or more contacts, each contact corresponding to a touch object on or near the surface and the contact information including an angle of one of a major axis and a minor axis of an ellipse of a first contact of the set; and

determining, based on the angle, a first orientation of the first contact.

2. The method of claim 1 , further comprising:

obtaining touch sensing information of another scan of the touch sensing surface;

determining, based on the touch sensing information of the other scan, a second orientation of the first contact; and

determining a rotation of the first contact based on the first orientation and the second orientation.

3. The method of claim 1 , further comprising:

identifying the first contact; and

generating input based on an identity of the first contact.

4. The method of claim 3 , wherein identifying the first contact includes determining an anatomical identity of the first contact, and generating the input based on the identity includes generating the input based on the anatomical identity of the first contact.

5. The method of claim 4 , wherein determining the anatomical identity of the first contact includes identifying the first contact as a thumb contact, and generating the input based on the anatomical identity includes generating the input based on the identification of the first contact as a thumb contact.

6. The method of claim 1 , further comprising:

grouping the first contact together with one or more other contacts as a first group based on the first orientation; and

generating input based on the first group.

7. The method of claim 6 , wherein grouping the first contact and one or more other contacts as a first group includes weighting a first information based on the first orientation to obtain a weighted first information, wherein the first group is based on the weighted first information.

8. The method of claim 7 , wherein the first information includes a distance between the first contact and an attractor point of a template, weighting the first information includes weighting the distance to obtain a weighted distance, and grouping the first contact and one or more other contacts includes determining a cost of the first group based on the weighted distance, and wherein the first group is based on the cost.

9. The method of claim 1 , further comprising:

determining, based on the first orientation, an anatomical identity of the first contact; and

generating input based on the anatomical identity.

10. The method of claim 9 , further comprising:

determining a second orientation of a second contact of the set, wherein the anatomical identity of the first contact is further determined based on the second orientation.

11. The method of claim 10 , further comprising:

evaluating a fuzzy logic expression based on the first and second orientations, wherein the anatomical identity of the first contact is further determined based on the evaluation of the fuzzy logic expression.

12. The method of claim 1 , wherein the contact information includes a size of the first contact, and determining the first orientation includes determining the first orientation based on the size of the first contact.

13. The method of claim 12 , further comprising:

determining whether the size of the first contact is less than a predetermined threshold size, wherein determining the first orientation includes setting the first orientation to a default orientation if the size of the first contact is less than the predetermined threshold size.

14. The method of claim 1 , wherein the set includes a plurality of contacts.

15. The method of claim 1 , wherein the contact information includes a shape of the first contact, and determining the first orientation includes determining the first orientation based on the shape of the first contact.

16. The method of claim 15 , wherein determining the first orientation based on the shape includes fitting an ellipse to the shape.

17. A computing system comprising:

a touch sensing surface;

one or more touch processing modules that obtain touch sensing information of a scan of the touch sensing surface, determine, based on the touch sensing information of the scan, contact information of a set of one or more contacts, each contact corresponding to a touch object on or near the surface and the contact information including an angle of one of a major axis and a minor axis of an ellipse of a first context of the set, and determine, based on the angle, a first orientation of the first contact.

18. The system of claim 17 , wherein the one or more touch processing modules further obtain touch sensing information of another scan of the touch sensing surface, determine, based on the touch sensing information of the other scan, a second orientation of the first contact, and determine a rotation of the first contact based on the first orientation and the second orientation.

19. The system of claim 18 , wherein the one or more touch processing modules further identify the first contact, and generate input based on an identity of the first contact.

20. The system of claim 19 , wherein identifying the first contact includes determining an anatomical identity of the first contact, and generating the input based on the identity includes generating the input based on the anatomical identity of the first contact.

21. The system of claim 20 , wherein determining the anatomical identity of the first contact includes identifying the first contact as a thumb contact, and generating the input based on the anatomical identity includes generating the input based on the identification of the first contact as a thumb contact.

22. The system of claim 17 , wherein the one or more touch processing modules further group the first contact together with one or more other contacts as a first group based on the first orientation, and generate input based on the first group.

23. The system of claim 22 , wherein grouping the first contact and one or more other contacts as a first group includes weighting a first information based on the first orientation to obtain a weighted first information, wherein the first group is based on the weighted first information.

24. The system of claim 23 , wherein the first information includes a distance between the first contact and an attractor point of a template, weighting the first information includes weighting the distance to obtain a weighted distance, and grouping the first contact and one or more other contacts includes determining a cost of the first group based on the weighted distance, and wherein the first group is based on the cost.

25. The system of claim 17 , wherein the one or more touch processing modules further determine, based on the first orientation, an anatomical identity of the first contact, and generate input based on the anatomical identity.

26. The system of claim 25 , wherein the one or more touch processing modules further determine a second orientation of a second contact of the set, wherein the anatomical identity of the first contact is further determined based on the second orientation.

27. The system of claim 26 , wherein the one or more touch processing modules further evaluate a fuzzy logic expression based on the first and second orientations, wherein the anatomical identity of the first contact is further determined based on the evaluation of the fuzzy logic expression.

28. The system of claim 17 , wherein the contact information includes a size of the first contact, and determining the first orientation includes determining the first orientation based on the size of the first contact.

29. The system of claim 28 , wherein the one or more touch processing modules further determine whether the size of the first contact is less than a predetermined threshold size, wherein determining the first orientation includes setting the first orientation to a default orientation if the size of the first contact is less than the predetermined threshold size.

30. The system of claim 17 , wherein the set includes a plurality of contacts.

31. A computing system comprising:

a touch sensing surface;

one or more touch processing modules that obtain touch sensing information of a scan of the touch sensing surface, determine, based on the touch sensing information of the scan, contact information of a set of one or more contacts, each contact corresponding to a touch object on the surface and the contact information including an angle of one of a major axis and a minor axis of an ellipse of a first context of the set, and determine, based on the angle, a first orientation of the first contact.

Continuity (6)

Continuation 11830757 · Jul 30, 2007

Continuation 11015434 · Dec 17, 2004

Continuation 09919266 · Jul 31, 2001

Division 09236513 · Jan 25, 1999

Provisional Application 60072509 · Jan 26, 1998

Related Publication 20140160068A1 · Jun 12, 2014