IP Library › Granted Patent US 10,607,418
Granted Patent B2
US 10,607,418 · App. 16/306,453 · Granted Mar 31, 2020

Method for operating a display system and display system

Inventor: Marcus Kuehne (Beilngries, DE)
Assignee: AUDI AG
G06T19/006G02B27/017G06F3/011G06F3/017G06Q10/20G06T13/20G02B2027/014G02B2027/0187G06T2200/04
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,607,418
App. No.
16/306,453
Granted
Mar 31, 2020
Kind
B2
Abstract

A virtual object arranged in a virtual environment is displayed by virtual reality glasses worn by a person. A virtual hand is positioned within the virtual environment in accordance with a hand detected in the real environment. As the virtual hand dips into an area of the virtual object, the representation of the area is changed.

Claims (37)

1. A method for operating a display system, comprising:

displaying a virtual object arranged in virtual surroundings by virtual reality goggles worn by a person;

detecting three dimensions of at least one hand of the person in real surroundings;

positioning at least one virtual hand within the virtual surroundings in accordance with the at least one hand detected in the real surroundings;

altering depiction of a first area of the virtual object that the virtual hand enters, as at least one of at least partially transparent and broken down into individual components in an explosion animation;

displaying an enveloping body around the virtual hand; and

at least one of including the area of the virtual object into which the enveloping body moves as at least partially transparent, and as soon as an extended index finger is detected, displaying one of a virtual pointer and a laser pointer that virtually lengthens a finger axis of the index finger within the virtual surroundings.

2. The method as claimed in claim 1 , wherein the virtual hand is displayed within the virtual surroundings by the virtual reality goggles.

3. The method as claimed in claim 2 , wherein the enveloping body is spherical.

4. The method as claimed in claim 3 , wherein inner structures of the virtual object that were not yet visible before the area was turned partially or completely transparent are displayed after the area is turned partially or completely transparent.

5. The method as claimed in claim 4 , further comprising:

detecting three-dimensional gestures by the person performed with the at least one hand; and

displaying manipulation actions, corresponding to the three-dimensional gestures, at least one of within the virtual surroundings and on the virtual object.

6. The method as claimed in claim 5 ,

further comprising detecting a virtual element in accordance with a grasping gesture performed by the fingers, and

wherein the displaying of the manipulation actions includes grasping by virtual fingers and moving the virtual element within the virtual surroundings in accordance with a movement performed with the at least one hand.

7. The method as claimed in claim 1 , wherein the enveloping body is spherical.

8. The method as claimed in claim 1 , wherein inner structures of the virtual object that were not yet visible before the area was turned partially or completely transparent are displayed after the area is turned partially or completely transparent.

9. The method as claimed in claim 1 , further comprising:

detecting three-dimensional gestures by the person performed with the at least one hand; and

displaying manipulation actions, corresponding to the three-dimensional gestures, at least one of within the virtual surroundings and on the virtual object.

10. The method as claimed in claim 1 , further comprising:

altering a position of the virtual hand in response to change of a position of the at least one hand detected by the detecting, and

displaying at least one other virtual object at least partially visible through the first area of the virtual object, when the depiction of the first area of the virtual object is altered to be at least partially transparent as the virtual hand enters the virtual object.

11. The method as claimed in claim 10 , wherein, the virtual object is a virtual door of a virtual vehicle and when the first area is altered to be at least partially transparent, a virtual interior of the virtual vehicle is at least partially visible through the virtual door without opening the door.

12. A display system, comprising:

virtual reality goggles, wearable by a person , configured to display a virtual object arranged in virtual surroundings;

a detection device configured to detect three dimensions of at least one hand of the person in real surroundings;

a control device configured to

position a virtual hand within the virtual surroundings in accordance with the at least one hand detected in the real surroundings,

alter depiction of a first area of the virtual object that the virtual hand enters, as at least one of at least partially transparent and broken down into individual components in an explosion animation,

display an enveloping body around the virtual hand, and

at least one of include the area of the virtual object into which the enveloping body moves as at least partially transparent, and as soon as an extended index finger is detected, display one of a virtual pointer and a laser pointer that virtually lengthens a finger axis of the index finger within the virtual surroundings.

13. The display system as claimed in claim 12 ,

wherein the control device is further configured to alter the position of the virtual hand in response to change of a position of the at least one hand detected by the detection device, and

wherein, when the depiction of the first area of the virtual object is altered to be at least partially transparent as the virtual hand enters the virtual object, at least one other virtual object is at least partially visible through the first area of the virtual object.

14. The display system as claimed in claim 13 , wherein, the virtual object is a virtual door of a virtual vehicle and when the first area is altered to be at least partially transparent, a virtual interior of the virtual vehicle is at least partially visible through the virtual door without opening the door.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 24, 2019
From: KUEHNE, MARCUS
To: AUDI AG
Reel/Frame 048118/0682 →
Priority Claims (1)
DE 10 2016 006 767 · Jun 2, 2016 · national
Continuity (1)
Related Publication 20190130653A1 · May 2, 2019