IP Library Granted Patent US 10,627,895
Granted Patent B2
US 10,627,895 · App. 15/465,522 · Granted Apr 21, 2020

Providing a virtual control

Inventors: Timothy Winthrop Kingsbury (Cary, NC); Matthew Jacyno (Fort Wayne, IN); Ryan Charles Knudson (Durham, NC); Christopher Donald Oman (Fort Wayne, IN)
Assignee: Lenovo (Singapore) PTE LTD
G06F3/011G06F3/016G06F3/017G06F3/0482G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,627,895
App. No.
15/465,522
Granted
Apr 21, 2020
Kind
B2
Abstract

For providing a virtual control, a processor identifies a hand of a user forming a specified control activation position in a physical image of the augmented reality display. The processor further presents a virtual control with one or more virtual buttons in a virtual image in the augmented reality display in response to identifying the control activation position.

Claims (24)

1. An apparatus comprising:

an augmented reality display that presents a physical image and a virtual image;

a processor;

a memory that stores code executable by the processor to:

identify a hand of a user forming a specified control activation position in the physical image of the augmented reality display, wherein in the control activation position, a normal of a palm of the hand is within 30 degrees of vertical up, all fingers of the hand, not including the thumb, are curved and not touching the palm with pads of two or more of the fingers forming at least one first plane within 30 degrees of perpendicular to the normal, and a pad of a thumb is within 30 degrees of parallel to the first plane, and wherein the hand holds no physical object; and

present a virtual control as a virtual remote control unit with one or more a virtual display that presents a menu and virtual buttons disposed on a virtual surface that is within 15 degrees of perpendicular to the first plane virtually held in the hand in the control activation position in the virtual image in the augmented reality display in response to identifying the control activation position, the virtual buttons comprising a user-customizable button, a volume up button, a volume down button, a channel up button, a channel down, one or more numerical buttons, a menu navigation button, an OK button, a back button, a home button, a play button, a fast-forward button, a rewind button, a pause button, a stop button, a select source button, and a sound configuration button.

2. The apparatus of claim 1 , wherein the code is further executable by the processor to determine an activation of a first virtual button in response to a digit of the user intersecting the first virtual button.

3. The apparatus of claim 1 , wherein the code is further executable by the processor to:

identify the hand of the user forming a specified control deactivation position; and

terminate presentation of the virtual control in response to the control deactivation position.

4. A method comprising:

identifying, by use of a processor, a hand of a user forming a specified control activation position in a physical image of an augmented reality display that presents the physical image and a virtual image, wherein in the control activation position, a normal of a palm of the hand is within 30 degrees of vertical up, all fingers of the hand, not including the thumb, are curved and not touching the palm with pads of two or more of the fingers forming at least one first plane within 30 degrees of perpendicular to the normal, and a pad of a thumb is within 30 degrees of parallel to the first plane, and wherein the hand holds no physical object; and

presenting a virtual control as a virtual remote control unit with a virtual display that presents a menu and virtual buttons disposed on a virtual surface that is within 15 degrees of perpendicular to the first plane virtually held in the hand in the control activation position in the virtual image in the augmented reality display in response to identifying the control activation position, the virtual buttons comprising a user-customizable button, a volume up button, a volume down button, a channel up button, a channel down, one ore more numerical buttons, a menu navigation button, an OK button, a back button, a home button, a play button, a fast-forward button, a rewind button, a pause button, a stop button, a select source button, and a sound configuration button.

5. The method of claim 4 , the method further determining an activation of a first virtual button in response to a digit of the user intersecting the first virtual button.

6. The method of claim 4 , the method further comprising:

identifying the hand of the user forming a specified control deactivation position; and

terminating presentation of the virtual control in response to the control deactivation position.

7. A program product comprising a non-transitory computer readable storage medium that stores code executable by a processor, the executable code comprising code to perform:

identifying a hand of a user forming a specified control activation position in a physical image of an augmented reality display that presents the physical image and a virtual image, wherein in the control activation position, a normal of a palm of the hand is within 30 degrees of vertical up, all fingers of the hand, not including the thumb, are curved and not touching the palm with pads of two or more of the fingers forming at least one first plane within 30 degrees of perpendicular to the normal, and a pad of a thumb is within 30 degrees of parallel to the first plane, and wherein the hand holds no physical object; and

presenting a virtual control as a virtual remote control unit with a virtual display that presents a menu and virtual buttons disposed on a virtual surface that is within 15 degrees of perpendicular to the first plane virtually held in the hand in the control activation position in the virtual image in the augmented reality display in response to identifying the control activation position, the virtual buttons comprising a user-customizable button, a volume up button, a volume down button, a channel up button, a channel down, one ore more numerical buttons, a menu navigation button, an OK button, a back button, a home button, a play button, a fast-forward button, a rewind button, a pause button, a stop button, a select source button, and a sound configuration button.

8. The program product of claim 7 , the processor further determining an activation of a first virtual button in response to a digit of the user intersecting the first virtual button.

9. The program product of claim 7 , the processor further performing:

identifying the hand of the user forming a specified control deactivation position; and

terminating presentation of the virtual control in response to identifying the control deactivation position.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 10, 2025
From: LENOVO PC INTERNATIONAL LIMITED
To: LENOVO SWITZERLAND INTERNATIONAL GMBH
Reel/Frame 069870/0670 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2021
From: LENOVO (SINGAPORE) PTE LTD
To: LENOVO PC INTERNATIONAL LTD
Reel/Frame 055110/0378 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 21, 2017
From: KINGSBURY, TIMOTHY WINTHROP; JACYNO, MATTHEW; KNUDSON, RYAN CHARLES; OMAN, CHRISTOPHER DONALD
To: LENOVO (SINGAPORE) PTE. LTD.
Reel/Frame 041669/0679 →
Continuity (1)
Related Publication 20180275744A1 · Sep 27, 2018
Cited By (2)
US 12,387,583 US 12,405,659