IP Library Granted Patent US 10,001,833
Granted Patent B2
US 10,001,833 · App. 15/291,336 · Granted Jun 19, 2018

User input system for immersive interaction

Inventor: Edward L. Hill (Exeter, NH)
Assignee: POSITION IMAGING, INC.
G06F3/011A63F13/213A63F13/23G06F1/1694G06F1/1698G06F3/01G06F3/014G06F3/017G06F3/0346A63F2300/1025A63F2300/1087A63F2300/1093
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,001,833
App. No.
15/291,336
Granted
Jun 19, 2018
Kind
B2
Abstract

A system and method for providing immersive interaction between users and interactive software programs comprise receiving radio frequency (RF) signals, transmitted by an RF-transmitting device, at three or more spatially separated antennas. Time of arrival information is acquired from the RF signals. A position of the RF-transmitting device is computed from the time of arrival information acquired from the RF signals. The position of the RF-transmitting device is registered within a virtual environment produced by an interactive software program (which can execute on a mobile device). The virtual environment, as affected by the registered position of the RF-transmitting device, is transmitted to a display apparatus for display.

Claims (28)

1. A user input system comprising:

an input interface connected to three or more spatially separated antennas to acquire therefrom radio signals transmitted by an RF-transmitting device operated by a user;

a first interface in wireless communication with a mobile device executing at least a portion of an interactive software program on the mobile device that, when executed, displays a virtual environment on a display screen;

a second interface in communication with the display screen; and

a processor programmed to calculate a position of the RF-transmitting device from timing information determined from the radio signals received through the input interface and to register the position of the RF-transmitting device within the interactive software program as user input by which the user interacts with and navigates the virtual environment displayed by the interactive software program on the display screen,

wherein the first interface is configured to receive the virtual environment, as affected by the registered position of the RF-transmitting device, from the mobile device, and wherein the second interface is configured to transmit the virtual environment, as affected by the registered position of the RF-transmitting device, to a device having the display screen after the virtual environment, as affected by the registered position of the RF-transmitting device, has been received from the mobile device by the first interface.

2. The user input system of claim 1 , wherein the processor is further programmed to run at least a portion of the interactive software program.

3. The user input system of claim 1 , wherein the mobile device comprises the RF-transmitting device whose position is calculated and registered.

4. The user input system of claim 1 , wherein the processor is further programmed to determine an orientation of the mobile device from inertial data included in the radio signals transmitted by the RF-transmitting device.

5. The user input system of claim 1 , wherein the input interface is in wireless communication with the three or more spatially separated antennas.

6. The user input system of claim 1 , wherein the second interface comprises a USB connection to the device having the display screen through which the user input system receives power.

7. The user input system of claim 1 , wherein the second interface comprises a High Definition Multimedia Interface (HDMI) connection to the device having the display screen through which the user input system sends the virtual environment as affected by the registered position of the RF-transmitting device.

8. A method for providing immersive interaction between users and interactive software programs, the method comprising:

acquiring timing information associated with radio signals transmitted by an RF-transmitting device operated by a user and received by at least three spatially separated antennas;

computing a position of the RF-transmitting device from the timing information associated with the radio signals received by the at least three antennas;

executing at least a portion of an interactive software program on a mobile device to provide a virtual environment;

registering the computed position of the RF-transmitting device within the virtual environment of the interactive software program as user input by which the user interacts with and navigates the virtual environment produced by the interactive software program;

receiving a signal representing the virtual environment, as affected by the registered position of the RF-transmitting device, over a wireless communication link from the mobile device executing the interactive software program; and

transmitting the virtual environment, as affected by the registered position of the RF-transmitting device, to a device having a display screen for display of the virtual environment and the RF transmitting device within the virtual environment after receiving the virtual environment, as affected by the registered position of the RF-transmitting device, from the mobile device.

9. The method of claim 8 , wherein transmitting the virtual environment, as affected by the registered position of the RF-transmitting device, to the device with the display screen occurs over an HDMI connection.

10. The method of claim 8 , further comprising determining an orientation of the mobile device that comprises the RF-transmitting device from inertial data included in the radio signals transmitted by the RF-transmitting device.

11. A display device comprising:

a unit with a display screen;

three or more spatially separated antennas coupled fixedly at different locations to the unit, the three or more antennas receiving radio signals sent from an RF-transmitting device operated by a user to interact with an interactive software program executing at least in part on a mobile device that produces a virtual environment; and

a user input system in communication with the antennas to acquire therefrom timing information associated with the radio signals sent from the RF-transmitting device and received by each of the antennas, the user input system including a processor programmed to calculate a position of the RF-transmitting device from the timing information associated with the radio signals received by each of the antennas and to register the position of the RF-transmitting device within the interactive software program as user input by which the user interacts with and navigates within the virtual environment to be displayed on the display screen, the user input system further including a first interface in wireless communication with the interactive software program executing at least in part on the mobile device and configured to receive the virtual environment, as affected by the registered position of the RF-transmitting device, from the mobile device, and a second interface in communication with the display screen and configured to transmit the virtual environment, as affected by the registered position of the RF-transmitting device, to the display screen after the virtual environment, as affected by the registered position of the RF-transmitting device, has been received from the mobile device via the first interface.

12. The display device of claim 11 , wherein the processor of the user input system is further programmed to run at least in part the interactive software program.

13. The display device of claim 11 , wherein the user input system is in wireless communication with the three or more spatially separated antennas.

14. The display device of claim 11 , wherein the first interface of the user input system is in wireless communication with the mobile device that comprises the RF-transmitting device whose position is calculated and registered within the interactive software program that produces the virtual environment to be displayed on the display screen.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 26, 2025
From: POSITION IMAGING, INC.
To: POSITION IMAGING IP LLC
Reel/Frame 070342/0196 →
SECURITY INTEREST Recorded Aug 23, 2023
From: POSITION IMAGING IP LLC
To: ANKURA TRUST COMPANY, LLC
Reel/Frame 064688/0851 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 2, 2018
From: HILL, EDWARD L.
To: POSITION IMAGING, INC.
Reel/Frame 045093/0310 →
Continuity (3)
Continuation 13967058 · Aug 14, 2013
Provisional Application 61682787 · Aug 14, 2012
Related Publication 20170031432A1 · Feb 2, 2017
Cited By (4)
US 12,190,542 US 12,393,906 US 12,541,944 US 12,717,343