IP Library Granted Patent US 10,120,445
Granted Patent B2
US 10,120,445 · App. 15/980,542 · Granted Nov 6, 2018

Glove interface object with flex sensing and wrist tracking for virtual interaction

Inventors: Shai Messingher (San Mateo, CA); Richard Stenson (San Mateo, CA)
Assignee: Sony Interactive Entertainment Inc.
G06F3/014A63F13/212G02B27/0093G02B27/017G02B27/0172G06F3/012G06F3/016G06F3/017G06F3/0346G06F3/041G06T19/006G02B2027/014G02B2027/0178G06F2203/013G06F2203/04102
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,120,445
App. No.
15/980,542
Granted
Nov 6, 2018
Kind
B2
Abstract

A glove interface object, including: a flex sensor configured to generate flex sensor data identifying a flex of a finger portion of the glove interface object; a trackable object configured to be illuminated during interactivity, the trackable object being positioned at a wrist portion of the glove interface object; a communications module configured to transmit the flex sensor data to a computing device for processing to determine a finger position pose of the glove interface object, applied for rendering a virtual hand in a view of a virtual environment on a head-mounted display (HMD), the virtual hand rendered based on the identified finger position pose, the computing device identifying the trackable object from captured image data to track a location of the glove interface object; wherein the virtual hand is rendered at a location in the virtual environment that is substantially defined by the location of the glove interface object.

Claims (52)

1. A glove interface object, comprising:

at least one flex sensor configured to generate flex sensor data identifying a flex of at least one finger portion of the glove interface object;

at least one trackable object that is configured to be illuminated during interactivity, the at least one trackable object being positioned at a wrist portion of the glove interface object;

a communications module configured to transmit the flex sensor data to a computing device for processing to determine a finger position pose of the glove interface object, the finger position pose being applied for rendering a virtual hand in a view of a virtual environment on a head-mounted display (HMD), the virtual hand being rendered based on the identified finger position pose, the computing device configured to identify the at least one trackable object from captured image data to enable tracking of a location of the glove interface object in an interactive environment;

wherein the virtual hand is rendered at a location in the virtual environment that is substantially defined by the location of the glove interface object in the interactive environment.

2. The glove interface object of claim 1 , wherein the at least one trackable object includes a plurality of trackable objects.

3. The glove interface object of claim 1 ,

wherein the computing device is configured to identify the plurality of trackable objects from the captured image data to enable tracking of an orientation of the glove interface object in the interactive environment;

wherein the virtual hand is rendered having an orientation in the virtual environment that is substantially defined by the orientation of the glove interface object in the interactive environment.

4. The glove interface object of claim 3 , wherein the plurality of trackable objects are configured to be illuminated to have different colors, the different colors being identified from the captured image data to enable the tracking of the orientation of the glove interface object in the interactive environment.

5. The glove interface object of claim 2 , wherein the plurality of trackable objects are configured to be illuminated according to a predefined pattern, the predefined pattern being identified from the captured image data to enable the tracking of the orientation of the glove interface object in the interactive environment.

6. The glove interface object of claim 1 , wherein the at least one trackable object includes at least one light or LED.

7. The glove interface object of claim 1 , wherein the wrist portion of the glove interface object is defined by a bracelet, the trackable object being attached to the bracelet.

8. The glove interface object of claim 1 , further comprising:

at least one inertial sensor for generating inertial sensor data;

wherein the communications module is configured to transmit the inertial sensor data to the computing device for processing to enable the tracking of the location of the glove interface object in the interactive environment.

9. The glove interface object of claim 8 ,

wherein the communications module is configured to transmit the inertial sensor data to the computing device for processing to enable tracking of an orientation of the glove interface object in the interactive environment;

wherein the virtual hand is rendered having an orientation in the virtual environment that is substantially defined by the orientation of the glove interface object in the interactive environment.

10. The glove interface object of claim 1 ,

wherein the view of the virtual environment is defined from a perspective of a virtual character in the virtual environment that is associated to the head-mounted display;

wherein the virtual hand is a hand of the virtual character.

11. The glove interface object of claim 1 , wherein the HMD includes an image capture device for capturing images of the interactive environment.

12. The glove interface object of claim 1 ,

wherein the communications module is configured to receive haptic feedback data from the computing device;

the glove interface object further comprising a haptic feedback mechanism that is configured to generate haptic feedback based on the haptic feedback data.

13. A glove interface object, comprising:

a plurality of flex sensors configured to generate flex sensor data identifying flexion of a plurality of finger portions of the glove interface object;

a plurality of trackable objects configured to be illuminated during interactivity, the plurality of trackable objects being positioned at a wrist portion of the glove interface object;

a communications module configured to transmit the flex sensor data to a computing device for processing to determine a finger position pose of the glove interface object, the finger position pose being applied for rendering a virtual hand in a view of a virtual environment on a head-mounted display (HMD), the virtual hand being rendered based on the identified finger position pose, the computing device configured to identify the plurality of trackable objects from captured image data to enable tracking of a location and orientation of the glove interface object in an interactive environment;

wherein the virtual hand is rendered at a location in the virtual environment that is substantially defined by the location of the glove interface object in the interactive environment;

wherein the virtual hand is rendered having an orientation in the virtual environment that is substantially defined by the orientation of the glove interface object in the interactive environment.

14. The glove interface object of claim 13 , wherein the plurality of trackable objects are configured to be illuminated to have different colors, the different colors being identified from the captured image data to enable the tracking of the location and orientation of the glove interface object in the interactive environment.

15. The glove interface object of claim 13 , wherein the plurality of trackable objects are configured to be illuminated according to a predefined pattern, the predefined pattern being identified from the captured image data to enable the tracking of the location and orientation of the glove interface object in the interactive environment.

16. The glove interface object of claim 13 , further comprising:

at least one inertial sensor for generating inertial sensor data;

wherein the communications module is configured to transmit the inertial sensor data to the computing device for processing to enable the tracking of the location and orientation of the glove interface object in the interactive environment.

17. A method, comprising:

receiving flex sensor data generated from at least one flex sensor of a glove interface object, the flex sensor data identifying a flex of at least one finger portion of the glove interface object;

receiving captured image data of an interactive environment in which the glove interface object is disposed;

processing the flex sensor data to determine a finger position pose of the glove interface object, and applying the finger position pose to render a virtual hand in a view of a virtual environment that is displayed through a head-mounted display (HMD);

processing the captured image data to identify at least one trackable object positioned at a wrist portion of the glove interface object, the trackable object configured to be illuminated during interactivity, wherein processing the captured image data enables tracking of a location of the glove interface object in the interactive environment;

wherein the virtual hand is rendered at a location in the virtual environment that is substantially defined by the location of the glove interface object in the interactive environment.

18. The method of claim 17 , further comprising:

receiving inertial sensor data generated from at least one inertial sensor of the glove interface object;

processing the inertial sensor data to enable the tracking of the location of the glove interface object in the interactive environment.

19. The method of claim 18 ,

wherein the processing of the inertial sensor data further enables tracking of an orientation of the glove interface object in the interactive environment;

wherein the virtual hand is rendered having an orientation in the virtual environment that is substantially defined by the orientation of the glove interface object in the interactive environment.

20. The method of claim 17 ,

wherein the view of the virtual environment is defined from a perspective of a virtual character in the virtual environment that is associated to the head-mounted display;

wherein the virtual hand is a hand of the virtual character.

Continuity (5)
Continuation 15087631 · Mar 31, 2016
Continuation 14517741 · Oct 17, 2014
Provisional Application 62041023 · Aug 22, 2014
Provisional Application 62058029 · Sep 30, 2014
Related Publication 20180260025A1 · Sep 13, 2018