IP Library › Granted Patent US 11,500,512
Granted Patent B2
US 11,500,512 · App. 17/428,314 · Granted Nov 15, 2022

Method and system for viewing virtual elements

Inventors: Anna Reithmeir (Munich, DE); Robert Wilde (Munich, DE)
G06F3/04815G06F3/011G06F3/017G06F3/0485G06F3/04845G06T19/006G06V20/20G06V40/10G06V40/28
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,500,512
App. No.
17/428,314
Granted
Nov 15, 2022
Kind
B2
Abstract

A tracking device tracks hand motion of a user. An output device, for example an augmented reality headset or a virtual reality headset, is configured for the output of virtual elements in augmented or virtual reality. A processor recognizes a first gesture when the user turns a palm of a first hand towards his face. The processor then displays a set of virtual elements above the palm of the first hand, the virtual elements being arranged above each other like a card deck, using the output device. In other words, the virtual elements are visualized as cards on the palm of the first hand. In most embodiments, the virtual elements are attached to at least one of the user's hands. The method provides a user interface for hand interaction with virtual elements, for example for viewing a content gallery or data exploration.

Claims (63)

1. A method for viewing virtual elements,

with the following steps being executed by at least one processor:

tracking hand motion of a user, using a tracking device,

recognizing a first gesture when the user turns a palm of a first hand towards his face,

outputting a first virtual element and a set of virtual elements above the palm of the first hand,

the first virtual element acting as a control point for the set of virtual elements, the virtual elements being arranged above each other like a card deck, using an output device, with the output device being configured for outputting the virtual elements in augmented or virtual reality,

recognizing a second gesture when the user grabs the first virtual element with a second hand,

recognizing a third gesture when the user moves the second hand away from the first hand, and

outputting the set of virtual elements, the virtual elements extending between the first hand and the second hand, using the output device.

2. The method according to claim 1 ,

with the first virtual element being attached to the first hand and hovering above its palm, and in particular following movements of the first hand, until the second gesture is recognized.

3. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

recognizing a fourth gesture, in which the user is scrolling through the set of virtual elements, and

rotating the order of the elements of the set of virtual elements, using the output device.

4. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

recognizing a fifth gesture when the user moves the second hand away from the first hand along a curve, and

outputting the set of virtual elements, the virtual elements extending between the first hand and the second hand along the curve, using the output device.

5. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

recognizing a sixth gesture when the user moves the first hand and/or the second hand away from his body, and

outputting the set of virtual elements, the virtual elements facing and surrounding the user, using the output device.

6. The method according to claim 5 ,

with the following additional steps being executed by at least one processor:

recognizing a seventh gesture when the user moves the first hand and/or the second hand towards his body, and

outputting the set of virtual elements, the virtual elements extending between the first hand and the second hand along a curve, using the output device.

7. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

recognizing an eighth gesture when the user drags one of the virtual elements sideways, and

outputting a second set of virtual elements, the second set extending sideways, using the output device.

8. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

recognizing a ninth gesture when the user raises and/or drops the first hand,

calculating a swaying movement for the set of virtual elements based on a physics simulation of a spring, and

outputting the swaying movement, using the output device.

9. The method according to claim 1 ,

with the following additional steps being executed by at least one processor:

outputting additional virtual elements around the wrist of the first hand, using the output device, and

representing a different set of virtual elements with each additional virtual element.

10. The method according to claim 9 ,

with the following additional steps being executed by at least one processor:

recognizing a sixteenth gesture, and

rotating the first virtual element and the additional virtual elements around the wrist of the first hand.

11. A non-transitory computer-readable storage media having stored thereon:

instructions executable by one or more processors of a computer system, wherein execution of the instructions causes the computer system to perform the method according to claim 1 .

12. A system for viewing virtual elements,

with a tracking device, configured for tracking hand motion of a user,

with an output device, being configured for the output of virtual elements in augmented or virtual reality, and

with at least one processor, programmed for

recognizing a first gesture when the user turns a palm of a first hand towards his face, outputting a first virtual element and a set of virtual elements above the palm of the first hand, the first virtual element acting as a control point for the set of virtual elements, the virtual elements being arranged above each other like a card deck, using the output device, recognizing a second gesture when the user grabs the first virtual element with a second hand,

recognizing a third gesture when the user moves the second hand away from the first hand, and

outputting the set of virtual elements, the virtual elements extending between the first hand and the second hand, using the output device.

13. A system according to claim 12 ,

with the output device being an augmented reality headset, a virtual reality headset or a holographic display.

14. A computer program product, comprising a computer readable hardware storage device having computer readable program code stored therein, said program code executable by a processor of a computer system to implement a method,

the method comprising:

tracking hand motion of a user, using a tracking device,

recognizing a first gesture when the user turns a palm of a first hand towards his face,

outputting a first virtual element and a set of virtual elements above the palm of the first hand, the first virtual element acting as a control point for the set of virtual elements, the virtual elements being arranged above each other like a card deck, using an output device, with the output device being configured for outputting the virtual elements in augmented or virtual reality,

recognizing a second gesture when the user grabs the first virtual element with a second hand,

recognizing a third gesture when the user moves the second hand away from the first hand, and

outputting the set of virtual elements, the virtual elements extending between the first hand and the second hand, using the output device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2021
From: REITHMEIR, ANNA; WILDE, ROBERT
To: SIEMENS AKTIENGESELLSCHAFT
Reel/Frame 057477/0886 →
Priority Claims (1)
EP 19156426 · Feb 11, 2019 · regional
Continuity (1)
Related Publication 20220129079A1 · Apr 28, 2022
Cited By (6)
US 12,210,691 US 12,353,632 US 12,357,911 US 12,525,139 US 12,632,120 US 12,730,524