IP Library Granted Patent US 7,643,006
Granted Patent B2
US 7,643,006 · App. 12/189,579 · Granted Jan 5, 2010

Gesture recognition method and touch system incorporating the same

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 7,643,006
App. No.
12/189,579
Granted
Jan 5, 2010
Kind
B2
Abstract

A gesture recognition method includes detecting multiple pointers in close proximity to a touch surface to determine if the multiple pointers are being used to perform a known gesture. When the multiple pointers are being used to perform a known gesture, executing a command associated with the gesture. A touch system incorporating the gesture recognition method is also provided.

Claims (69)

1. An event generation method comprising the steps of:

capturing images of a touch surface from different vantages using imaging devices that are proximate to the touch surface and aimed to look generally across said touch surface;

processing the captured images to detect successive pointer contacts on said touch surface and to recognize a gesture based on the relative positions of the successive pointer contacts and the subsequent relative movement of the pointers along the touch surface; and

generating an event when a gesture is recognized.

2. The method of claim 1 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

3. The method of claim 1 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

4. The method of claim 1 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

5. The method of claim 1 wherein said event represents a graphical object manipulation command.

6. The method of claim 5 wherein said graphical object manipulation command is one of a graphical object resize command, a graphical object rotate and a graphical object translate command.

7. The method of claim 6 further comprising executing said graphical object manipulation command.

8. The method of claim 7 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

9. The method of claim 8 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

10. The method of claim 8 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

11. An event generation method comprising the steps of:

detecting successive pointers brought into contact with and oriented generally normal to a touch surface and examining the relative positions of the pointer contacts and the subsequent relative movement of said pointers along said touch surface by processing images of the touch surface captured using imaging devices that are proximate to the touch surface and aimed to look generally across the touch surface to determine if a gesture has been input; and

generating an event when an input gesture is determined.

12. The method of claim 11 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving towards one another.

13. The method of claim 11 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving away from one another.

14. The method of claim 11 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if one pointer is moving in a generally arcuate path about another pointer.

15. The method of claim 11 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving in a generally similar direction.

16. The method of claim 11 wherein said event represents a graphical object manipulation command.

17. The method of claim 16 wherein said graphical object manipulation command is one of a graphical object resize command, a graphical object rotate and a graphical object translate command.

18. The method of claim 17 further comprising executing said graphical object manipulation command.

19. The method of claim 18 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving towards one another.

20. The method of claim 18 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving away from one another.

21. The method of claim 18 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if one pointer is moving in a generally arcuate path about another pointer.

22. The method of claim 18 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving in a generally similar direction.

23. An event generation method comprising the steps of:

capturing images of a touch surface from different vantages using imaging devices that are proximate to the touch surface and aimed to look generally across said touch surface;

processing the captured images to detect successive pointers brought into contact with said touch surface and to recognize a gesture based on the pointer contact positions and the subsequent relative movement of the pointers along said touch surface; and

generating an event when a gesture is recognized.

24. The method of claim 23 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

25. The method of claim 23 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

26. The method of claim 23 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

27. The method of claim 23 wherein said event represents a graphical object manipulation command.

28. The method of claim 27 wherein said graphical object manipulation command is one of a graphical object resize command, a graphical object rotate and a graphical object translate command.

29. The method of claim 28 further comprising executing said graphical object manipulation command.

30. The method of claim 29 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

31. The method of claim 29 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

32. The method of claim 31 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

33. An event generation method comprising the steps of:

detecting multiple pointers brought successively into contact with and oriented substantially normal to a touch surface and examining the relative positions of the pointer contacts and the subsequent relative movement of said pointers along said touch surface by processing images of the touch surface captured using imaging devices that are proximate to the touch surface and aimed to look generally across the touch surface to determine if a gesture has been input; and

generating an event when an input gesture is determined.

34. The method of claim 33 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving towards one another.

35. The method of claim 33 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving away from one another.

36. The method of claim 33 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if one pointer is moving in a generally arcuate path about another pointer.

37. The method of claim 33 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving in a generally similar direction.

38. The method of claim 33 wherein said event represents a graphical object manipulation command.

39. The method of claim 38 wherein said graphical object manipulation command is one of a graphical object resize command, a graphical object rotate and a graphical object translate command.

40. The method of claim 39 further comprising executing said graphical object manipulation command.

41. The method of claim 40 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving towards one another.

42. The method of claim 40 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving away from one another.

43. The method of claim 40 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if one pointer is moving in a generally arcuate path about another pointer.

44. The method of claim 40 wherein during said examining, the subsequent relative movement of said pointers is examined to determine if said pointers are moving in a generally similar direction.

45. An event generation method comprising the steps of:

capturing images from different vantages using imaging devices that are proximate to and aimed to look generally across a pointer input region;

processing the captured images to detect positions of multiple pointers brought successively into said pointer input regions and to recognize a gesture based on the detected pointer positions and the subsequent relative movement of the pointers within said pointer input region; and

generating an event when a gesture is recognized.

46. The method of claim 45 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

47. The method of claim 45 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

48. The method of claim 45 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

49. The method of claim 45 wherein during said processing, the images are processed to detect movement of multiple pointers in a generally similar direction.

50. The method of claim 45 wherein said event represents a graphical object manipulation command.

51. The method of claim 50 wherein said graphical object manipulation command is one of a graphical object resize command, a graphical object rotate and a graphical object translate command.

52. The method of claim 51 further comprising executing said graphical object manipulation command.

53. The method of claim 52 wherein during said processing, the images are processed to detect movement of multiple pointers towards one another.

54. The method of claim 52 wherein during said processing, the images are processed to detect movement of multiple pointers away from one another.

55. The method of claim 52 wherein during said processing, the images are processed to detect movement of one pointer in a generally arcuate path about another pointer.

56. The method of claim 52 wherein during said processing, the images are processed to detect movement of multiple pointers in a generally similar direction.

Assignments (9)
RELEASE OF SECURITY INTEREST Recorded Dec 2, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040798/0077 →
RELEASE OF SECURITY INTEREST Recorded Dec 2, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040819/0306 →
RELEASE OF ABL SECURITY INTEREST Recorded Nov 29, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040711/0956 →
RELEASE OF TERM LOAN SECURITY INTEREST Recorded Nov 29, 2016
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 040713/0123 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 17, 2014
From: SMART TECHNOLOGIES ULC
To: PIXART IMAGING INC.
Reel/Frame 032693/0266 →
RELEASE OF SECURITY INTEREST RECORDED AT 030935/0848 Recorded Feb 18, 2014
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 032269/0610 →
RELEASE OF SECURITY INTEREST RECORDED AT 030935/0879 Recorded Feb 18, 2014
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
Reel/Frame 032269/0622 →
SECURITY AGREEMENT Recorded Aug 1, 2013
From: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING, INC.
Reel/Frame 030935/0879 →
SECURITY AGREEMENT Recorded Aug 1, 2013
From: SMART TECHNOLOGIES ULC; SMART TECHNOLOGIES INC.
To: MORGAN STANLEY SENIOR FUNDING INC.
Reel/Frame 030935/0848 →