IP Library Granted Patent US 10,782,792
Granted Patent B2
US 10,782,792 · App. 15/941,034 · Granted Sep 22, 2020

3D pointing devices with orientation compensation and improved usability

Inventor: Matthew G. Liberty (Olney, MD)
Assignee: IDHL Holdings, Inc.
G06F3/017G06F3/033G06F3/0346G06F3/0383H04N21/42222H04N5/4403H04N2005/4432
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,782,792
App. No.
15/941,034
Granted
Sep 22, 2020
Kind
B2
Abstract

Systems and methods according to the present invention describe 3D pointing devices which enhance usability by transforming sensed motion data from a first frame of reference (e.g., the body of the 3D pointing device) into a second frame of reference (e.g., a user's frame of reference). One exemplary embodiment of the present invention removes effects associated with a tilt orientation in which the 3D pointing device is held by a user.

Claims (44)

1. A handheld device comprising:

a three-axis accelerometer configured to determine an acceleration of the handheld device and output an acceleration output associated therewith, wherein the determined acceleration comprises an acceleration of the handheld device due to gravity;

a plurality of rotational sensors configured to determine rotation of the handheld device about a respective plurality of axes and output a respective plurality of rotational outputs associated therewith, wherein the plurality of rotational outputs comprises angular velocities of the handheld device in a first frame of reference; and

a processing unit configured to:

determine an angular position of the handheld device between the first frame of reference and a second frame of reference using a combination of the angular velocities of the handheld device in the first frame of reference and the acceleration output corresponding to the acceleration of the handheld device due to gravity in the first frame of reference, wherein:

the determined angular position has an axis of rotation in a plane perpendicular to gravity and comprises first, second and third values for first, second and third axes of rotation, respectively;

the first value is an estimate of roll of the handheld device;

the third axis of rotation corresponds to the handheld device's heading; and

the third value corresponds to an estimate of a current heading relative to any of an arbitrary reference point and an arbitrary and drifting reference point; and

report the angular position for a current sample.

2. The device of claim 1 , wherein the angular position is represented as a quaternion.

3. The device of claim 2 , wherein the quaternion is a unit quaternion.

4. The device of claim 1 , wherein the angular velocities of the handheld device are in body angles in the first frame of reference.

5. The device of claim 1 , wherein the second frame of reference is any of a user frame of reference and an inertial frame of reference.

6. The device of claim 1 , wherein the second frame of reference is any of a stationary frame of reference, a non-stationary frame of reference, an intermediary frame of reference and a frame of reference associated with a wrist of a user.

7. The device of claim 1 , wherein the processing unit is configured to generate a user interface command using the reported angular position.

8. The device of claim 1 , wherein at least one of the plurality of rotational sensors comprises a resonating mass attached to a frame, wherein the resonating mass resonates along a corresponding axis, and wherein displacement of the resonating mass along the corresponding axis is measured using the Coriolis acceleration effect to generate the corresponding rotational output.

9. The device of claim 1 , wherein either the first rotational output reflects no rotation of the handheld device about the first axis or the second rotational output reflects no rotation of the handheld device about the second axis.

10. A method implemented in a handheld device comprising a processing unit, a three-axis accelerometer and a plurality of rotational sensors, the method comprising:

obtaining, at the processing unit, a plurality of rotational outputs from the plurality of rotational sensors and an acceleration output from the three-axis accelerometer, wherein the plurality of rotational outputs is associated with rotation of the handheld device about a respective plurality of axes as determined by the plurality of rotational sensors, wherein the plurality of rotational outputs comprises angular velocities of the handheld device in a first frame of reference, wherein the acceleration output is associated with an acceleration of the handheld device as determined by the three-axis accelerometer, and wherein the acceleration comprises an acceleration of the handheld device due to gravity;

determining, at the processing unit, an angular position of the handheld device between the first frame of reference and a second frame of reference using a combination of the angular velocities of the handheld device in the first frame of reference and the acceleration output corresponding to the acceleration of the handheld device due to gravity in the first frame of reference, wherein:

the determined angular position has an axis of rotation in a plane perpendicular to gravity and comprises first, second and third values for first, second and third axes of rotation, respectively;

the first value is an estimate of roll of the handheld device;

the third axis of rotation corresponds to the handheld device's heading; and

the third value corresponds to an estimate of a current heading relative to any of an arbitrary reference point and an arbitrary and drifting reference point; and

reporting the angular position for a current sample.

11. The method of claim 10 , wherein the angular position is represented as a quaternion.

12. The method of claim 10 , wherein the quaternion is a unit quaternion.

13. The method of claim 12 , wherein the angular velocities of the handheld device are in body angles in the first frame of reference.

14. The method of claim 10 , wherein the second frame of reference is any of a user frame of reference and an inertial frame of reference.

15. The method of claim 10 , wherein the second frame of reference is any of a stationary frame of reference, a non-stationary frame of reference, an intermediary frame of reference and a frame of reference associated with a wrist of a user.

16. The method of claim 10 , further comprising the processing unit generating a user interface command using the reported angular position.

17. The method of claim 10 , wherein at least one of the plurality of rotational sensors comprises a resonating mass attached to a frame, wherein the resonating mass resonates along a corresponding axis, and wherein displacement of the resonating mass along the corresponding axis is measured using the Coriolis acceleration effect to generate the corresponding rotational output.

18. The method of claim 10 , wherein either the first rotational output reflects no rotation of the handheld device about the first axis or the second rotational output reflects no rotation of the handheld device about the second axis.

19. A method implemented in a handheld device, the method comprising:

generating, by a plurality of rotational sensors, a rotational output associated with rotation of the handheld device about a plurality of axes, wherein the rotational output comprises angular velocities of the handheld device in a first frame of reference;

generating, by a three-axis accelerometer, an acceleration output associated with an acceleration of the handheld device, wherein the acceleration comprises an acceleration of the handheld device due to gravity;

determining, at the processing unit, an angular position of the handheld device between the first frame of reference and a second frame of reference using a combination of the angular velocities of the handheld device in the first frame of reference and the acceleration output corresponding to the acceleration of the handheld device due to gravity in the first frame of reference, wherein:

the determined angular position has an axis of rotation in a plane perpendicular to gravity and comprises first, second and third values for first, second and third axes of rotation, respectively;

the first value is an estimate of roll of the handheld device;

the third axis of rotation corresponds to the handheld device's heading; and

the third value corresponds to an estimate of a current heading relative to any of an arbitrary reference point and an arbitrary and drifting reference point; and

reporting the angular position for a current sample.

20. The method of claim 19 , wherein the angular position is represented as a quaternion.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2023
From: IDHL HOLDINGS, INC.
To: DRNC HOLDINGS, INC.
Reel/Frame 063327/0188 →
Continuity (12)
Continuation 15015745 · Feb 4, 2016
Continuation 14563314 · Dec 8, 2014
Continuation 14090050 · Nov 26, 2013
Continuation 13304854 · Nov 28, 2011
Continuation 12188595 · Aug 8, 2008
Continuation 11820517 · Jun 20, 2007
Continuation 11640677 · Dec 18, 2006
Continuation 11119719 · May 2, 2005
Provisional Application 60641410 · Jan 5, 2005
Provisional Application 60612571 · Sep 23, 2004
Provisional Application 60566444 · Apr 30, 2004
Related Publication 20180224946A1 · Aug 9, 2018