IP Library › Granted Patent US 12,085,670
Granted Patent B2
US 12,085,670 · App. 18/312,509 · Granted Sep 10, 2024

Advanced gaming and virtual reality control using radar

Inventors: Patrick M. Amihood (Palo Alto, CA); Ivan Poupyrev (Sunnyvale, CA)
Assignee: Google LLC
G01S7/415A63F13/21A63F13/24G01S7/4004G01S7/41G01S7/412G01S13/56G01S13/66G01S13/86G01S13/867G01S13/88G01S13/888G01S13/90G01S13/904G06F3/011G06F3/017G06F3/04815G06F16/245G06F18/217G06F18/25G06F18/253G06F18/28G06F18/41G06F21/32G06F21/6245G06N20/00G06V10/806G06V20/64G06V40/28H04Q9/00H04W4/80H04W16/28A63F2300/8082G01S13/865G01S13/931G01S2013/9322G01S19/42G06F1/163G06F3/0346G06F3/0484G06F3/165G06F2203/0384G06F2221/2105G06T7/75G08C17/02G08C2201/93H04Q2209/883
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,085,670
App. No.
18/312,509
Granted
Sep 10, 2024
Kind
B2
Abstract

Techniques are described herein that enable advanced gaming and virtual reality control using radar. These techniques enable small motions and displacements to be tracked, even in the millimeter or submillimeter scale, for user control actions even when those actions are optically occluded or obscured.

Claims (53)

1. A method for controlling a gaming or virtual-reality application, the method comprising:

receiving a radar signal representing reflections of a radar field off two or more points over time, at least one of the two or more points being on a portion of an object, the object in contact with a body of a user;

determining, based on the radar signal, relative Doppler-frequencies between the two or more points over time;

determining, based on the relative Doppler-frequencies, a user-control action for the gaming or virtual-reality application; and

directing, based on the user-control action, the gaming or virtual-reality application to perform an action.

2. The method of claim 1 , further comprising:

determining, based on the radar signal, locations of the two or more points over time; and

directing, based on the determined locations, the gaming or virtual-reality application to alter a display associated with the gaming or virtual-reality application.

3. The method of claim 1 , wherein determining relative Doppler-frequencies between the two or more points over time comprises determining a micro-Doppler centroid for each respective point of the two or more points.

4. The method of claim 1 , further comprising determining, based on the relative Doppler-frequencies, relative velocities of the two or more points over time, and wherein determining the user-control action is further based on the relative velocities.

5. The method of claim 4 , further comprising integrating the relative velocities to determine relative displacements between the two or more points over time, and wherein determining the user-control action is further based on the relative displacements.

6. The method of claim 5 , wherein the relative displacements between the two or more points over time comprises millimeter-scale displacements.

7. The method of claim 1 , further comprising spatially resolving at least a first point and a second point of the two or more points over time by determining:

radial distances for the first point and the second point based on respective time delays determined from the radar signal;

radial velocities for the first point and the second point based on respective Doppler-frequencies determined from the radar signal; and

reflected energies for the first point and the second point determined from the radar signal.

8. The method of claim 1 , wherein the object in contact with the body of the user comprises at least one of:

a mock controller;

a mock tool;

a mock weapon;

a wearable accessory;

clothing; or

an electronic device.

9. The method of claim 1 , wherein the object does not have control or communication capabilities.

10. The method of claim 1 , wherein the user control-action for the gaming or virtual-reality application is determined based on a movement that is recognized by the gaming or virtual-reality application, the recognized movement comprising a machine-learned movement or a previously-catalogued movement.

11. An apparatus comprising:

at least one processor;

a radar system configured to receive a radar signal representing reflections of a radar field off two or more points over time, at least one of the two or more points being on a portion of an object, the object in contact with a body of a user; and

a computer-readable storage medium having instructions stored thereon that, responsive to execution by the at least one processor, cause the at least one processor to:

determine, based on the radar signal, relative Doppler-frequencies between the two or more points over time;

determine, based on the relative Doppler-frequencies, a user-control action for a gaming or virtual-reality application; and

direct, based on the user-control action, the gaming or virtual-reality application to perform an action.

12. The apparatus of claim 11 , wherein the computer-readable storage medium further comprises instructions that, responsive to execution by the at least one processor, further cause the at least one processor to:

determine, based on the radar signal, locations of the two or more points over time; and

direct, based on the determined locations, the gaming or virtual-reality application to alter a display associated with the gaming or virtual-reality application.

13. The apparatus of claim 11 , wherein the radar system comprises one or more radar-emitting elements and one or more antennas configured to receive the radar signal, and wherein the radar system is further configured to provide the radar field prior to receipt of the radar signal.

14. The apparatus of claim 13 , wherein the apparatus and the display associated with the gaming or virtual-reality application are integrated into a single wearable package, and wherein another point of the two or more points is on a portion of a body of the user.

15. The apparatus of claim 11 , wherein at least one of the user-control action or the locations is passed to the gaming or virtual-reality application via at least one application programming interface (API).

16. The apparatus of claim 11 , wherein the apparatus is configured as smart glasses, a smart watch, a virtual or augmented-reality system, a gaming system, a mobile phone, a tablet, a laptop, or a desktop computer.

17. The apparatus of claim 11 , wherein:

the object is a mock controller, the mock controller being held by a hand of the user in a dark room;

a first point of the two or more points is a button of the mock controller; and

a second point of the two or more points is a housing of the mock controller.

18. The apparatus of claim 17 , wherein:

the user-control action is determined based on the relative Doppler-frequencies between the button of the mock controller and the housing of the mock controller; and

the action performed, based on the user-control action, in the gaming or virtual-reality application comprises selecting an item.

19. The apparatus of claim 11 , wherein:

the object is a mock weapon, the mock weapon being held by a hand of the user;

a first point of the two or more points is a tip of the mock weapon; and

a second point of the two or more points is a handle of the mock weapon.

20. The apparatus of claim 19 , wherein:

the user-control action is determined based on the relative Doppler-frequencies between the tip of the mock weapon and the handle of the mock weapon; and

the action performed, based on the user-control action, in the gaming or virtual-reality application comprises picking up the mock weapon, moving the mock weapon, swinging the mock weapon, aiming the mock weapon, or actuating the mock weapon.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2023
From: AMIHOOD, PATRICK M.; POUPYREV, IVAN
To: GOOGLE INC.
Reel/Frame 063932/0179 →
CHANGE OF NAME Recorded Jun 13, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 063985/0001 →
Continuity (5)
Continuation 17119312 · Dec 11, 2020
Continuation 16380245 · Apr 10, 2019
Continuation 15286495 · Oct 5, 2016
Provisional Application 62237975 · Oct 6, 2015
Related Publication 20230273298A1 · Aug 31, 2023
Cited By (1)
US 12,340,028