IP Library Granted Patent US 10,712,818
Granted Patent B2
US 10,712,818 · App. 16/106,633 · Granted Jul 14, 2020

Fiducial rings in virtual reality

Inventors: Sean Jason Keller (Kirkland, WA); David R. Perek (Bellevue, WA); Tristan Thomas Trutna (Seattle, WA); Garett Andrew Ochs (Seattle, WA); Nicholas Roy Corson (Mukilteo, WA); Raymond King (Redmond, WA)
Assignee: Facebook Technologies, LLC
G06F3/014G02B27/017G02B27/0172G06F3/016G06F3/017G06F3/0304G06F3/147G09G5/003G02B2027/014G02B2027/0138G02B2027/0187G09G2320/0693
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,712,818
App. No.
16/106,633
Granted
Jul 14, 2020
Kind
B2
Abstract

A virtual reality system enables a user to interact with virtual objects. The system includes a fiducial ring, an imaging device and a console. The fiducial ring includes a ring body that includes a plurality of fiducial markers that each correspond to a different location on the ring body. An imaging device is configured to capture one or more images of the fiducial ring. The console receives the images that include an image of one or more fiducial markers. Based on the received images of the fiducial markers, the console determines a location on the fiducial ring that corresponds to the imaged fiducial marker. The console determines a position of the fiducial ring based on the determined location of the fiducial marker on the fiducial ring. The console provides content to a head mounted display (HMD) based on the determined position of the fiducial ring.

Claims (67)

1. A system comprising:

a fiducial device including a body that includes a plurality of fiducial markers that each are positioned at different locations on the body and that each emit light, the body configured to fit on a portion of a user's body;

an imaging device separate from the fiducial device and the user's body, the imaging device configured to capture one or more images of the fiducial device by capturing the light emitted from at least one of the fiducial markers; and

a console configured to:

determine that a virtual touch event occurred based on a movement of the portion of the user's body,

responsive to the determination, receive the one or more images including at least one image of at least one of the fiducial markers,

determine a position of the fiducial device in a virtual space based part on the at least one image of the at least one fiducial marker,

determine a position of the portion of the user's body in the virtual space, based on the determined position of the fiducial device, and

generate a haptic feedback signal comprising a haptic feedback for a user, based on the determined position of the portion of the user's body in the virtual space.

2. The system of claim 1 , wherein the console is further configured to:

provide content to a head-mounted display (HMD) based on the determined position of the fiducial device.

3. The system of claim 1 , wherein the fiducial device further comprises a sensor coupled to the body, the sensor configured to determine the movement of the portion of the user's body by sensing a motion on the fiducial device coupled to the portion of the user's body.

4. The system of claim 1 , wherein the fiducial device further comprises a sensor configured to:

determine a force applied on the body; and

in response to the determination,

generate an information signal including a value of the force, and

transmit the information signal to the system.

5. The system of claim 4 , wherein the sensor detects a change in pressure on the sensor to determine the force applied on the body.

6. The system of claim 1 , wherein the fiducial marker is a stationary locatable active device.

7. The system of claim 1 , wherein the console is further configured to:

transmit the haptic feedback signal to the fiducial device for providing the haptic feedback to the user.

8. The system of claim 1 , wherein the console is further configured to:

receive at least one of first calibration data from the fiducial device and second calibration data from the imaging device; and

determine the movement of the portion of the user's body, based on the at least one of the first calibration data and the second calibration data.

9. The system of claim 1 , wherein the console is further configured to:

receive information about a force applied on the body; and

determine that the virtual touch event occurred, based on the received information.

10. The system of claim 1 , wherein the fiducial device is configured to receive the haptic feedback signal including an actuation signal and an amount of actuation, and the system further comprising:

an actuation device coupled to the fiducial device, the actuation device configured to actuate the fiducial device to provide the haptic feedback to the user according to the amount of actuation.

11. A method comprising:

instructing at least one of a plurality of fiducial markers to emit light, each fiducial marker positioned at a different location on a body of a fiducial device, the body configured to fit on a portion of a user's body;

capturing, by an imaging device separate from the fiducial device and the user's body, one or more images of the fiducial device by capturing the light emitted from the at least one fiducial marker, the one or more images including an image with a fiducial marker of the plurality of fiducial markers;

determining that a virtual touch event occurred based on a movement of the portion of the user's body;

responsive to the determination, receiving the one or more images including at least one image of at least one of the fiducial markers;

determining a position of the fiducial device in a virtual space based in part on the at least one image of the at least one fiducial marker;

determining a position of the portion of the user's body in the virtual space, based on the determined position of the fiducial device; and

generating a haptic feedback signal comprising a haptic feedback for a user, based on the determined position of the portion of the user's body in the virtual space.

12. The method of claim 11 , further comprising:

providing content to a head-mounted display (HMD) based on the determined position of the fiducial device.

13. The method of claim 11 , further comprising:

determining, by a sensor of the fiducial device coupled to the body, the movement of the portion of the user's body by sensing a motion on the fiducial device coupled to the portion of the user's body.

14. The method of claim 11 , further comprising:

determining, by a sensor of the fiducial device, a force applied on the body;

in response to the determination,

generating an information signal including a value of the force, and

transmitting the information signal to the system.

15. The method of claim 11 , further comprising:

determining a change in pressure on the sensor to determine the force applied on the body.

16. The method of claim 11 , further comprising:

transmitting the haptic feedback signal to the fiducial device for providing the haptic feedback to the user.

17. The method of claim 11 , further comprising:

receiving at least one of first calibration data from the fiducial device and second calibration data from the imaging device; and

determining the movement of the portion of the user's body, based on the at least one of the first calibration data and the second calibration data.

18. The method of claim 11 , further comprising:

receiving information about a force applied on the body; and

determining that the virtual touch event occurred, based on the received information.

19. The method of claim 11 , further comprising:

receiving, at the fiducial device, the haptic feedback signal including an actuation signal and an amount of actuation; and

actuating, by an actuation device coupled to the fiducial device, the fiducial device to provide the haptic feedback to the user according to the amount of actuation.

20. A computer program product comprising a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by a processor, cause the processor to:

instruct at least one of a plurality of fiducial markers to emit light, each fiducial marker positioned at a different location on a body of a fiducial device, the body configured to fit on a portion of a user's body;

capture, by an imaging device separate from the fiducial device and the user's body, one or more images of the fiducial device by capturing the light emitted from the at least one fiducial marker, the one or more images including an image with a fiducial marker of the plurality of fiducial markers;

determine that a virtual touch event occurred based on a movement of the portion of the user's body;

responsive to the determination, receive the one or more images including at least one image of at least one of the fiducial markers;

determine a position of the fiducial device in a virtual space based in part on the at least one image of the at least one fiducial marker;

determine a position of the portion of the user's body in the virtual space, based on the determined position of the fiducial device; and

generate a haptic feedback signal comprising a haptic feedback for a user, based on the determined position of the portion of the user's body in the virtual space.

Assignments (2)
CHANGE OF NAME Recorded Jun 8, 2022
From: FACEBOOK TECHNOLOGIES, LLC
To: META PLATFORMS TECHNOLOGIES, LLC
Reel/Frame 060315/0224 →
CHANGE OF NAME Recorded Sep 12, 2018
From: OCULUS VR, LLC
To: FACEBOOK TECHNOLOGIES, LLC
Reel/Frame 047178/0616 →
Continuity (2)
Continuation 15340888 · Nov 1, 2016
Related Publication 20180373332A1 · Dec 27, 2018