IP Library Granted Patent US 8,639,471
Granted Patent B2
US 8,639,471 · App. 12/358,006 · Granted Jan 28, 2014

Wireless position sensing in three dimensions using ultrasound

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,639,471
App. No.
12/358,006
Granted
Jan 28, 2014
Kind
B2
Abstract

According to various embodiments, the invention provides a method for establishing communication between a computer program in a computing system and a controller held in a hand of a user, comprising: capturing image data in a capture area in front of a display, the capturing configured to identify a two-dimensional location of the controller in the capture area; and capturing one-way sound communication between a location proximate to the display and a location at the controller, the sound communication being used to compute a third-dimensional location of the controller in the capture area.

Claims (53)

1. A method for determining a position of a mobile controller relative to a fixed unit, wherein the mobile controller comprises an infrared (IR) light source and an ultrasonic transducer, and wherein the fixed unit comprises a camera and a first ultrasonic transducer, the method comprising the steps of:

using the camera to determine an angular location of the IR light source relative to the fixed unit;

determining a distance between the mobile controller and the fixed unit by measuring a time of flight of an ultrasonic transmission between the mobile controller and the fixed unit;

determining a three dimensional position of the mobile controller, relative to the fixed unit, by combining the angular location with the distance;

using the camera to track a path of the IR light source detected over time; and

using the tracked path to distinguish the IR light source from a background light source, when the IR light source and the background light source are detected close to each other, by comparing the tracked path with a extrapolated path of the IR light source.

2. A method according to claim 1 , further comprising:

altering an illumination of the IR light source on receipt of a signal by the mobile controller from the fixed unit; and

distinguishing the IR light source from other IR light sources by detecting the altered illumination of the IR light source using the camera.

3. A method according to claim 1 , wherein the fixed unit further comprises a second ultrasonic transducer. the method further comprising:

determining an approximate location for the mobile component by comparing the time of flight of ultrasound between the mobile controller and the first ultrasonic transducer and between the mobile controller the second ultrasonic transducer; and

determining which IR light source belongs to the mobile controller by comparing the approximate location to an image detected by the camera.

4. A method according to claim 1 , further comprising:

averaging the time of flight of ultrasound between the mobile controller and fixed unit over two or more readings of the time of flight of ultrasound, for reducing an effect of errors on the determined distance.

5. A method according to claim 4 , wherein the mobile controller further comprises an accelerometer, the method comprising:

determining a speed of the mobile controller using the accelerometer; and

reducing a number of readings used for averaging the time of flight of ultrasound when the controller is moving quickly.

6. A method according to claim 1 , further comprising:

correcting an image detected by the camera to remove distortion caused by the camera.

7. A method according to claim 1 , wherein the fixed unit further comprises means for sensing the angle of tilt of the camera, the method comprising:

detecting the angle of tilt of the camera from an upright position; and

correcting information determined from an image captured by the camera while at the angle of tilt.

8. A method according to claim 1 , further comprising filtering a measured distance reading by:

comparing a measured distance reading to be tested to a last valid measured distance reading to determine an average speed: and

rejecting the measured distance reacting to be tested if the average speed is above a maximum allowable speed.

9. A method according to claim 1 . further comprising filtering measured distance reading by:

calculating a tangential speed of the mobile controller by measuring a movement of the mobile controller with the camera and taking as a range of the mobile controller a last valid distance reading:

comparing a measured distance reading to be tested to the last valid measured distance reading to determine an average radial speed;

calculating an average speed by combining the tangential speed and the average radial speed; and

rejecting the measured distance reading to be tested if the average speed is above a maximum allowable speed.

10. A method according to claim 1 , further comprising filtering a measured distance reading by:

comparing a measured distance reading to be tested to a last valid measured distance reading to determine a first average speed;

comparing the last valid measured distance reading to a penultimate valid measured distance reading to determine a second average speed;

comparing the first average speed to the second average speed to determine an average acceleration; and

rejecting the measured distance reading to be tested if the average acceleration is above a maximum allowable acceleration.

11. A position sensing apparatus comprising:

an ultrasonic transmitter;

an ultrasonic receiver;

an infrared transmitter;

a two-dimensional (2D) infrared receiver;

an image processing means for processing an image received by the 2D infrared receiver;

a timer;

a control means for coordinating functions of the 2D infrared receiver, the ultrasonic transmitter, and the timer; and

a trigger means for activating the timer,

wherein the apparatus comprises a mobile and a fixed component separate from one another,

wherein ultrasonic and infrared components are located adjacent to one another in a heterogeneous pair on each of the mobile and the fixed components,

wherein the apparatus is configured to transmit an ultrasonic pulse between the ultrasonic transmitter and ultrasonic receiver, and is configured to measure a time of flight of the ultrasonic pulse between the ultrasonic transmitter and receiver by:

starting the timer substantially simultaneously to transmission of the ultrasonic pulse,

stopping the timer when the ultrasonic pulse has been received by the ultrasonic receiver,

wherein in use the apparatus is further configured to determine a two-dimensional (2D) angular position of the infrared transmitter in relation to the 2D infrared receiver by processing the image received by the 2D infrared receiver, whereby an ultrasonic distance measurement from the time of flight of the ultrasonic pulse and an infrared angular measurement provide a three-dimensional (3D) position fix of the mobile component relative to the fixed component; and

wherein in use the apparatus is further configured to use the 2D infrared receiver to track, over time, a course of an infrared light source transmitted by the infrared transmitter to distinguish the infrared light source from a background light source, when the infrared light source and the background light source are detected close to each other, by comparing the tracked course with a extrapolated course of the IR light source.

12. The position sensing apparatus according to claim 11 , further comprising a second infrared transmitter in a known spatial relationship to the infrared transmitter, wherein the image processing means is configured to distinguish the infrared transmitter and the second infrared transmitter from a background by searching for the known relationship between the infrared transmitter and the second infrared transmitter.

13. The position sensing apparatus according to claim 11 , wherein the infrared transmitter is of a known size, wherein the image processing means is configured to calculate an approximate range for the infrared transmitter by measuring a detected size of the infrared transmitter, and wherein the apparatus is configured to compare the approximate range with the ultrasonic distance measurement to validate a received infrared source received by the 2D infrared receiver as being the infrared transmitter.

Assignments (16)
RELEASE OF SECURITY INTEREST Recorded May 1, 2026
From: BANK OF AMERICA, N.A.
To: TURTLE BEACH CORPORATION; VOYETRA TURTLE BEACH, INC.; PERFORMANCE DESIGNED PRODUCTS LLC
Reel/Frame 075315/0067 →
RELEASE OF SECURITY INTEREST Recorded Aug 14, 2025
From: BANK OF AMERICA, N.A.
To: TURTLE BEACH CORPORATION; VOYETRA TURTLE BEACH, INC.; PERFORMANCE DESIGNED PRODUCTS LLC
Reel/Frame 072470/0260 →
ASSIGNMENT OF SECURITY AGREEMENT Recorded Aug 4, 2025
From: TURTLE BEACH CORPORATION; VOYETRA TURTLE BEACH, INC.; PERFORMANCE DESIGNED PRODUCTS LLC
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 072338/0059 →
RELEASE OF SECURITY INTEREST Recorded Aug 1, 2025
From: BLUE TORCH FINANCE LLC, AS THE COLLATERAL AGENT
To: TURTLE BEACH CORPORATION; VOYETRA TURTLE BEACH, INC.; PERFORMANCE DESIGNED PRODUCTS LLC
Reel/Frame 072337/0391 →
RELEASE OF SECURITY INTEREST Recorded Mar 15, 2024
From: FIFTH THIRD BANK, NATIONAL ASSOCIATION
To: PERFORMANCE DESIGNED PRODUCTS LLC
Reel/Frame 066895/0786 →
SECURITY INTEREST Recorded Mar 14, 2024
From: VOYETRA TURTLE BEACH, INC.; TURTLE BEACH CORPORATION; PERFORMANCE DESIGNED PRODUCTS LLC
To: BLUE TORCH FINANCE LLC, AS THE COLLATERAL AGENT
Reel/Frame 066797/0517 →
SECURITY INTEREST Recorded Mar 14, 2024
From: PERFORMANCE DESIGNED PRODUCTS LLC
To: BANK OF AMERICA, N.A., AS AGENT
Reel/Frame 066796/0562 →
PATENT SECURITY AGREEMENT Recorded Sep 1, 2020
From: PERFORMANCE DESIGNED PRODUCTS LLC
To: FIFTH THIRD BANK, NATIONAL ASSOCIATION
Reel/Frame 053657/0655 →
RELEASE OF SECURITY INTEREST Recorded Jun 29, 2020
From: ARK ANGELS VIII LLC
To: PERFORMANCE DESIGNED PRODUCTS, LLC
Reel/Frame 053082/0001 →
SECURITY INTEREST Recorded Jan 28, 2020
From: EAST WEST BANK
To: ARK ANGELS VIII LLC
Reel/Frame 051723/0138 →
SECURITY INTEREST Recorded Jan 27, 2017
From: PERFORMANCE DESIGNED PRODUCTS LLC
To: EAST WEST BANK
Reel/Frame 041517/0476 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Jan 18, 2017
From: WELLS FARGO CAPITAL FINANCE, LLC
To: PERFORMANCE DESIGNED PRODUCTS LLC
Reel/Frame 041389/0662 →
RELEASE OF SECURITY INTEREST IN PATENTS Recorded Dec 22, 2015
From: PATRIARCH PARTNERS AGENCY SERVICES, LLC
To: PERFORMANCE DESIGNED PRODUCTS LIMITED
Reel/Frame 037362/0052 →
SECURITY AGREEMENT Recorded May 23, 2013
From: PERFORMANCE DESIGNED PRODUCTS LLC
To: WELLS FARGO CAPITAL FINANCE, LLC
Reel/Frame 030499/0091 →
SECURITY AGREEMENT Recorded Mar 29, 2011
From: PERFORMANCE DESIGNED PRODUCTS LIMITED
To: PATRIARCH PARTNERS AGENCY SERVICES, LLC
Reel/Frame 026038/0013 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 7, 2009
From: BAXTER, RICHARD; LEVACHE, STEPHEN
To: PERFORMANCE DESIGNED PRODUCTS LIMITED
Reel/Frame 022517/0414 →