IP Library Granted Patent US 10,845,895
Granted Patent B1
US 10,845,895 · App. 16/509,109 · Granted Nov 24, 2020

Handheld controllers for artificial reality and related methods

Inventors: Lorenz Henric Jentz (Seattle, WA); Chun Li Chen (Seattle, WA); Khaled Boulos (Seattle, WA)
Assignee: Facebook Technologies, LLC
G06F3/0346G06F3/0304G06F3/03544G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,845,895
App. No.
16/509,109
Granted
Nov 24, 2020
Kind
B1
Abstract

The disclosed handheld controllers may include a multi-degree of freedom sensor module, a mouse module, and a switch. The mouse module may include a mouse sensor and a proximity sensor. The switch may be configured to activate the mouse sensor and deactivate the multi-degree of freedom sensor module when the proximity sensor indicates that the mouse sensor is proximate to a physical surface and to deactivate the mouse sensor and activate the multi-degree of freedom sensor when the proximity sensor indicates that the mouse sensor is not proximate to the physical surface. Various other related methods, systems, and devices are also disclosed.

Claims (43)

1. A handheld controller, comprising:

a handle shaped and sized for gripping the handheld controller;

a multi-degree of freedom sensor module configured for sensing a position and orientation of the handheld controller;

a mouse module, comprising:

a mouse sensor configured for sensing a movement of the handheld controller relative to a physical surface;

a proximity sensor configured for sensing when the mouse sensor is proximate to the physical surface; and

a platform shaped and configured to rest against the physical surface when the mouse sensor is proximate to the physical surface, wherein the platform is shaped and positioned to form a gap directly between the platform and the handle, such that at least a portion of one or more of a user's fingers are positioned within the gap when the handle is gripped by the user; and

a switch configured to activate the mouse sensor and deactivate the multi-degree of freedom sensor module when the proximity sensor indicates that the mouse sensor is proximate to the physical surface and to deactivate the mouse sensor and activate the multi-degree of freedom sensor module when the proximity sensor indicates that the mouse sensor is not proximate to the physical surface.

2. The handheld controller of claim 1 , further comprising:

at least a first button and a second button configured as user inputs when the multi-degree of freedom sensor module is activated,

wherein the switch is further configured to route button signals from the first button and the second button to left-click and right-click inputs of the mouse module when the mouse sensor is activated.

3. The handheld controller of claim 1 , wherein the mouse module is removable and replaceable relative to the handle.

4. The handheld controller of claim 3 , further comprising an electronics interface configured for forming a communication connection between the mouse module and the multi-degree of freedom sensor module.

5. The handheld controller of claim 1 , wherein the platform is shaped, positioned, and sized to support at least a portion of the handheld controller on the physical surface and to maintain the mouse sensor proximate to the physical surface when the handheld controller is not held by a user.

6. The handheld controller of claim 1 , wherein the platform comprises at least one planar surface positioned to rest against the physical surface when the mouse sensor is activated.

7. The handheld controller of claim 6 , wherein the platform has a non-linear shape within the plane of the planar surface.

8. The handheld controller of claim 1 , wherein the mouse module further comprises a scroll wheel positioned to be manipulated by a thumb of a user when the handheld controller is held by the user.

9. The handheld controller of claim 8 , wherein the scroll wheel comprises a mechanical rotatable scroll wheel.

10. The handheld controller of claim 1 , further comprising an input thumbstick positioned for manipulation by the user's thumb.

11. An artificial-reality controller, comprising:

a handle shaped and sized for gripping by a user;

a multi-degree of freedom sensor module configured for sensing a position and orientation of the artificial-reality controller for use in a three-dimensional artificial-reality environment;

a mouse module comprising a mouse sensor configured for sensing movement of the artificial-reality controller relative to a physical surface for use in a two-dimensional computing environment; and

a switch configured to alternate the artificial-reality controller between a multi-degree of freedom mode that utilizes data from the multi-degree of freedom sensor module and a mouse mode that utilizes data from the mouse module,

wherein the mouse module comprises a platform shaped and configured to rest against the physical surface, wherein the platform is shaped and positioned to form a gap directly between the platform and the handle, such that at least a portion of one or more of a user's fingers are positioned within the gap when the handle is gripped by the user.

12. The artificial-reality controller of claim 11 , wherein the switch is configured to alternate the artificial-reality controller between the multi-degree of freedom mode and the mouse mode in response to a user input.

13. The artificial-reality controller of claim 12 , wherein the user input comprises at least one of:

manipulation of a mechanical input mechanism by the user;

placement of the artificial-reality controller against a physical surface; or

removal of the artificial-reality controller from a position against the physical surface.

14. The artificial-reality controller of claim 11 , wherein the mouse module further comprises a proximity sensor and the switch is configured to alternate between the multi-degree of freedom mode and the mouse mode in response to a signal from the proximity sensor.

15. The artificial-reality controller of claim 14 , wherein the proximity sensor comprises an optical proximity sensor.

16. The artificial-reality controller of claim 11 , wherein the mouse sensor comprises an optical mouse sensor.

17. The artificial-reality controller of claim 11 , further comprising a wireless communication module configured to provide data from the multi-degree of freedom sensor module and from the mouse module to at least one processor configured for controlling the three-dimensional artificial-reality environment and the two-dimensional computing environment.

18. A method of receiving user inputs in a computer environment, the method comprising:

receiving data from a multi-degree of freedom sensor module of a handheld controller to sense a position and orientation of the handheld controller;

receiving a signal from a proximity sensor indicating that the handheld controller is proximate to a physical surface;

in response to receiving the signal from the proximity sensor, deactivating the multi-degree of freedom sensor module and activating a mouse module; and

in response to the activation of the mouse module, receiving data from a mouse sensor of the mouse module to sense movement of the handheld controller relative to the physical surface while a user grips a handle of the handheld controller and positions at least one finger in a gap directly between a platform of the mouse module and the handle.

19. The method of claim 18 , further comprising:

receiving another signal from the proximity sensor, indicating that the handheld controller has been removed from its position proximate to the physical surface; and

in response to receiving the other signal from the proximity sensor, deactivating the mouse module and activating the multi-degree of freedom sensor module.

20. The method of claim 18 , further comprising, in response to the activation of the mouse module, routing a button signal from a button of the multi-degree of freedom sensor module to a mouse click input of the mouse module.

Assignments (2)
CHANGE OF NAME Recorded May 26, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060199/0876 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 20, 2019
From: JENTZ, LORENZ HENRIC; CHEN, CHUN LI; BOULOS, KHALED
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 050107/0546 →
Cited By (2)
US 1,060,272 US 12,675,160