IP Library › Granted Patent US 10,606,343
Granted Patent B2
US 10,606,343 · App. 15/476,988 · Granted Mar 31, 2020

Keyboard for virtual reality

Inventors: Karthik Veeramani (Hillsboro, OR); Jianfang Zhu (Hillsboro, OR); Sayan Lahiri (Hillsboro, OR); Bo Qiu (Hillsboro, OR); Bradley A. Jackson (Hillsboro, OR); Paul S. Diefenbaugh (Portland, OR); Kim Pallister (Portland, OR)
Assignee: Intel Corporation
G06F3/011G02B27/017G06F1/163G06F1/1686G06F3/017G06F3/0304G06F3/0425G06F3/0426
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,606,343
App. No.
15/476,988
Filed
Apr 1, 2017
Granted
Mar 31, 2020
Kind
B2
Art Unit
2616
USPC
345/473
Abstract

An embodiment of a graphics apparatus may include an image generator, and a gesture tracker communicatively coupled to the image generator. The image generator may be configured to generate an image of a virtual input device, the gesture tracker may be configured to determine a position of a user's finger relative to the virtual input device, and the image generator may be further configured to generate an image of a virtual finger based on the determined position of the user's finger relative to the virtual input device. Other embodiments are disclosed and claimed.

Claims (72)

1. An electronic processing system, comprising:

an application processor;

persistent storage media communicatively coupled to the application processor;

a graphics processor communicatively coupled to the application processor; and

a gesture tracker communicatively coupled to the application processor, wherein:

the graphics processor is to auto-detect a model of a physical input device a user has setup and automatically generate, in real-time and based on the auto-detected model of the physical input device, an image of a virtual input device that is visually the same as the physical input device, wherein an actual representation of the auto-detected physical input device is rendered,

the gesture tracker is to determine a position of a user's finger relative to the virtual input device, and

the graphics processor is further to generate an image of a virtual finger based on the determined position of the user's finger relative to the virtual input device.

2. The system of claim 1 , further comprising:

an input generator communicatively coupled to the gesture tracker to generate input data based on the determined position of the user's finger relative to the virtual input device.

3. The system of claim 1 , further comprising:

a device tracker communicatively coupled to the graphics processor to identify a characteristic of the physical input device, wherein the graphics processor is further to generate the image of the virtual input device based on the identified characteristic of the physical input device.

4. A graphics apparatus, comprising:

an image generator; and

a gesture tracker communicatively coupled to the image generator, wherein:

the image generator is to automatically generate, in real-time and based on an auto-detected model of the physical input device, an image of a virtual input device that is visually the same as the physical input device that is auto-detected, wherein an actual representation of the auto-detected physical input device is rendered,

the gesture tracker is to determine a position of a user's finger relative to the virtual input device, and

the image generator is further to generate an image of a virtual finger based on the determined position of the user's finger relative to the virtual input device.

5. The apparatus of claim 4 , wherein the gesture tracker is further to determine a position of a user's hand relative to the virtual input device, and wherein the image generator is further to generate an image of a virtual hand based on the determined position of the user's hand relative to the virtual input device.

6. The apparatus of claim 4 , further comprising:

an input generator communicatively coupled to the gesture tracker to generate input data based on the determined position of the user's finger relative to the virtual input device.

7. The apparatus of claim 4 , further comprising:

a device tracker communicatively coupled to the image generator to identify a characteristic of the physical input device, wherein the image generator is further to generate the image of the virtual input device based on the identified characteristic of the physical input device.

8. The apparatus of claim 7 , wherein:

the device tracker is further to determine a position of the physical input device relative to the user;

the gesture tracker is further to determine a position the user's hand relative to the position of the physical input device;

the image generator is further to generate an image of a virtual representation of the physical input device based on the position of the physical input device relative to the user; and wherein

the image generator is further to generate an image of a virtual hand based on the determined position of the user's hand relative to the physical input device.

9. The apparatus of claim 7 , wherein the image generator is further to load a three-dimensional model of the virtual input device based on the identified characteristic of the physical input device.

10. The apparatus of claim 4 , wherein the virtual input device comprises one of a virtual keyboard, a virtual mouse, a virtual touchpad, a virtual stylus, and a virtual scroll wheel.

11. A method of displaying virtual objects, comprising:

automatically generating, in real-time and based on an auto-detected model of a physical input device, an image of a virtual input device that is visually the same as the physical input device that is auto-detected, wherein an actual representation of the auto-detected physical input device is rendered;

determining a position of a user's finger relative to the virtual input device; and

generating an image of a virtual finger based on the determined position of the user's finger relative to the virtual input device.

12. The method of claim 11 , further comprising:

determining a position of a user's hand relative to the virtual input device; and

generating an image of a virtual hand based on the determined position of the user's hand relative to the virtual input device.

13. The method of claim 11 , further comprising:

generating input data based on the determined position of the user's finger relative to the virtual input device.

14. The method of claim 13 , further comprising:

generating a visual indication corresponding to the generated input data.

15. The method of claim 11 , further comprising:

identifying a characteristic of the physical input device; and

generating the image of the virtual input device based on the identified characteristic of the physical input device.

16. The method of claim 15 , further comprising:

determining a position of the physical input device relative to the user;

determining a position the user's hand relative to the position of the physical input device;

generating an image of a virtual representation of the physical input device based on the position of the physical input device relative to the user; and

generating an image of a virtual hand based on the determined position of the user's hand relative to the physical input device.

17. The method of claim 15 , further comprising:

loading a three-dimensional model of the virtual input device based on the identified characteristic of the physical input device.

18. The method of claim 11 , wherein the virtual input device comprises one of a virtual keyboard, a virtual mouse, a virtual touchpad, a virtual stylus, and a virtual scroll wheel.

19. At least one non-transitory computer readable medium, comprising a set of instructions, which when executed by a computing device, cause the computing device to:

automatically generate, in real-time and based on an auto-detected model of a physical input device, an image of a virtual input device that is visually the same as the physical input device that is auto-detected, wherein an actual representation of the auto-detected physical input device is rendered;

determine a position of a user's finger relative to the virtual input device; and

generate an image of a virtual finger based on the determined position of the user's finger relative to the virtual input device.

20. The at least one non-transitory computer readable medium of claim 19 , comprising a further set of instructions, which when executed by the computing device, cause the computing device to:

determine a position of a user's hand relative to the virtual input device; and

generate an image of a virtual hand based on the determined position of the user's hand relative to the virtual input device.

21. The at least one non-transitory computer readable medium of claim 19 , comprising a further set of instructions, which when executed by the computing device, cause the computing device to:

generate input data based on the determined position of the user's finger relative to the virtual input device.

22. The at least one non-transitory computer readable medium of claim 19 , comprising a further set of instructions, which when executed by the computing device, cause the computing device to:

identify a characteristic of the physical input device; and

generate the image of the virtual input device based on the identified characteristic of the physical input device.

23. The at least one non-transitory computer readable medium of claim 22 , comprising a further set of instructions, which when executed by the computing device, cause the computing device to:

determine a position of the physical input device relative to the user;

determine a position the user's hand relative to the position of the physical input device;

generate an image of a virtual representation of the physical input device based on the position of the physical input device relative to the user; and

generate an image of a virtual hand based on the determined position of the user's hand relative to the physical input device.

24. The at least one non-transitory computer readable medium of claim 22 , comprising a further set of instructions, which when executed by the computing device, cause the computing device to:

load a three-dimensional model of the virtual input device based on the identified characteristic of the physical input device.

25. The at least one non-transitory computer readable medium of claim 19 , wherein the virtual input device comprises one of a virtual keyboard, a virtual mouse, a virtual touchpad, a virtual stylus, and a virtual scroll wheel.

Continuity (1)
Related Publication 20180284982A1 · Oct 4, 2018