IP Library Granted Patent US 8,872,762
Granted Patent B2
US 8,872,762 · App. 13/314,207 · Granted Oct 28, 2014

Three dimensional user interface cursor control

Inventors: Micha Galor (Tel Aviv, IL); Idan Gelbourt (Jerusalem, IL); Ofir Or (Ramat Gan, IL); Jonathan Pokrass (Bat-Yam, IL); Amir Hoffnung (Tel Aviv, IL)
Assignee: Primesense Ltd.
G06F3/017G06F3/011
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,872,762
App. No.
13/314,207
Granted
Oct 28, 2014
Kind
B2
Abstract

A method, including receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a first set of multiple 3D coordinates representing a gesture performed by a user positioned within a field of view of a sensing device coupled to the computer, the first set of 3D coordinates comprising multiple points in a fixed 3D coordinate system local to the sensing device. The first set of multiple 3D coordinates are transformed to a second set of corresponding multiple 3D coordinates in a subjective 3D coordinate system local to the user.

Claims (32)

1. A method, comprising:

receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a set of 3D coordinates representing a gesture performed by a limb of a user, wherein the limb is positioned within a field of view of a sensing device coupled to the computer and includes a joint, the set of 3D coordinates comprising first multiple points measured in a fixed 3D coordinate system local to the sensing device, the fixed 3D coordinate system having a first depth axis;

upon the set of the 3D coordinates indicating that a motion of the joint has exceeded a specified threshold, transforming the first multiple points that indicate the limb to be moving along the first depth axis to corresponding second multiple points along a different, second depth axis local to the user; and

applying the second multiple points in executing the non-tactile 3D user interface.

2. The method according to claim 1 , wherein the limb comprises a hand and the joint comprises an elbow associated with the hand.

3. An apparatus, comprising:

a display; and

a computer executing a non-tactile three dimensional (3D) user interface, and configured to receive a set of 3D coordinates representing a gesture performed by a limb of a user, wherein the limb is positioned within a field of view of a sensing device coupled to the computer and includes a joint, the set of 3D coordinates comprising first multiple points measured in a fixed 3D coordinate system local to the sensing device, the fixed 3D coordinate system having a first depth axis, and upon the set of the 3D coordinates indicating that a motion of the joint has exceeded a specified threshold, to transform the first multiple points that indicate the limb to be moving along the first depth axis to corresponding second multiple points along a different, second depth axis local to the user, and to apply the second multiple points in executing the non-tactile 3D user interface.

4. The apparatus according to claim 3 , wherein the limb comprises a hand and the joint comprises an elbow associated with the hand.

5. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a non-tactile three dimensional user interface, cause the computer to receive a set of 3D coordinates representing a gesture performed by a limb of a user, wherein the limb is positioned within a field of view of a sensing device coupled to the computer and includes a joint, the set of 3D coordinates comprising first multiple points measured in a fixed 3D coordinate system local to the sensing device, the fixed 3D coordinate system having a first depth axis, and upon the set of the 3D coordinates indicating that a motion of the joint has exceeded a specified threshold, to transform the first multiple points that indicate the limb to be moving along the first depth axis to corresponding second multiple points along a different, second depth axis local to the user, and to apply the second multiple points in executing the non-tactile 3D user interface.

6. A method, comprising:

presenting, by a computer executing a non-tactile three dimensional (3D) user interface, a cursor, having a given cursor size, in proximity to one or more items on a display;

receiving in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a body part of a user positioned within a field of view of the sensing device;

calculating a ratio between the cursor size and a body part size of the body part that performed the gesture; and

moving the cursor responsively to the received set of the coordinates in proportion to the calculated ratio.

7. The method according to claim 6 , wherein the body part comprises a hand.

8. An apparatus, comprising:

a display; and

a computer executing a non-tactile three dimensional (3D) user interface, and configured to present a cursor, having a given cursor size, in proximity to one or more items on the display, to receive in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a body part of a user positioned within a field of view of the sensing device, to calculate a ratio between the cursor size and a body part size of the body part that performed the gesture, and to move the cursor responsively to the received set of the coordinates in proportion to the calculated ratio.

9. The apparatus according to claim 8 , wherein the body part comprises a hand.

10. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a non-tactile three dimensional user interface, cause the computer to present a cursor, having a given cursor size, in proximity to one or more items on the display, to receive in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a body part of a user positioned within a field of view of the sensing device, to calculate a ratio between the cursor size and a body part size of the body part that performed the gesture, and to move the cursor responsively to the received set of the coordinates in proportion to the calculated ratio.

11. A method, comprising:

presenting, by a computer executing a non-tactile three dimensional (3D) user interface, an interactive cursor shaped as a hand in proximity to one or more items on a display;

receiving in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a user positioned within a field of view of the sensing device;

positioning the interactive cursor on the display responsively to the received set of the coordinates; and

conveying feedback to the user, responsively to the received set of the coordinates, indicating a proximity of the cursor to the one or more items, wherein a disposition of one or more fingers of the hand changes responsively to a distance of the cursor from the one of the items.

12. The method according to claim 11 , wherein the feedback further comprises a sound.

13. An apparatus, comprising:

a display; and

a computer executing a non-tactile three dimensional (3D) user interface, and configured to present an interactive cursor shaped as a hand in proximity to one or more items on the display, to receive in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a user positioned within a field of view of the sensing device, to position the interactive cursor on the display responsively to the received set of the coordinates, and to convey feedback to the user, responsively to the received set of the coordinates, indicating a proximity of the cursor to one of the items, wherein a disposition of one or more fingers of the hand changes responsively to a distance of the cursor from the one of the items.

14. The apparatus according to claim 13 , wherein the feedback further comprises a sound.

15. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a non-tactile three dimensional user interface, cause the computer to present an interactive cursor shaped as a hand in proximity to one or more items on a display, to receive in the computer, from a sensing device, a set of 3D coordinates representing a gesture performed by a user positioned within a field of view of the sensing device, to position the interactive cursor on the display responsively to the received set of the coordinates, and to convey feedback to the user, responsively to the received set of the coordinates, indicating a proximity of the cursor to one of the items, wherein a disposition of one or more fingers of the hand changes responsively to a distance of the cursor from the one of the items.

Assignments (3)
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION # 13840451 AND REPLACE IT WITH CORRECT APPLICATION # 13810451 PREVIOUSLY RECORDED ON REEL 034293 FRAME 0092. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded May 11, 2015
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 035624/0091 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 19, 2014
From: PRIMESENSE LTD.
To: APPLE INC.
Reel/Frame 034293/0092 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 28, 2012
From: GALOR, MICHA; GELBOURT, IDAN; OR, OFIR; POKRASS, JONATHAN; HOFFNUNG, AMIR
To: PRIMESENSE LTD.
Reel/Frame 028276/0781 →
Continuity (4)
Provisional Application 61420809 · Dec 8, 2010
Provisional Application 61448670 · Mar 3, 2011
Provisional Application 61538970 · Sep 26, 2011
Related Publication 20120223882A1 · Sep 6, 2012