IP Library Granted Patent US 10,261,594
Granted Patent B2
US 10,261,594 · App. 15/587,173 · Granted Apr 16, 2019

Systems and methods of creating a realistic displacement of a virtual object in virtual reality/augmented reality environments

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,261,594
App. No.
15/587,173
Granted
Apr 16, 2019
Kind
B2
Abstract

The technology disclosed relates to a method of realistic displacement of a virtual object for an interaction between a control object in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the control object interacts with. In particular, it relates to detecting free-form gestures of a control object in a three-dimensional (3D) sensory space and generating for display a 3D solid control object model for the control object during the free-form gestures, including sub-components of the control object and in response to detecting a 2D sub-component free-form gesture of the control object in the 3D sensory space in virtual contact with the virtual object, depicting, in the generated display, the virtual contact and resulting rotation of the virtual object by the 3D solid control object model.

Claims (25)

1. A method of realistic displacement of a virtual object for an interaction between a hand in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the hand interacts with, the method including:

detecting free-form gestures of a hand in a three-dimensional (3D) sensory space;

generating for display within a virtual reality scene a 3D solid hand model for the hand during the free-form gestures, including fingers and thumb of the hand;

in response to detecting a one finger or one thumb free-form gesture of the hand in the 3D sensory space in virtual contact with the virtual object, depicting, in the virtual reality scene generated, the virtual contact and resulting displacement of the virtual object by the 3D solid hand model;

using an outline that is distinct from and contrasting to a boundary inherent to a displayed representation of the hand, outlining a modeled position of the hand; and

incorporating the outline into the virtual reality scene superimposed upon the displayed representation of the hand whenever the hand is in virtual contact with the virtual object.

2. The method of claim 1 , further including changing an appearance of the outline upon detection of a loss of virtual contact between the hand and the virtual object.

3. The method of claim 1 , further including changing an appearance of an image of the hand upon detection of a loss of virtual contact between the hand and the virtual object.

4. A system, including:

a processor and a computer readable storage medium storing computer instructions configured to cause the processor to:

detect free-form gestures of a hand in a three-dimensional (3D) sensory space;

generate for display within a virtual reality scene a 3D solid hand model for the hand during the free-form gestures, including fingers and thumb of the hand;

in response to detecting a one finger or one thumb free-form gesture of the hand in the 3D sensory space in virtual contact with the virtual object, depict, in the virtual reality scene generated, the virtual contact and resulting displacement of the virtual object by the 3D solid hand model;

outline a modeled position of the hand with an outline distinct from a boundary inherent to a displayed representation of the hand; and

incorporate the outline of the hand into the virtual reality scene superimposed upon the displayed representation of the hand whenever the hand is in virtual contact with the virtual object.

5. The system of claim 4 , further including instructions to cause the processor to change an appearance of the outline upon detection of a loss of virtual contact between the hand and the virtual object.

6. The system of claim 4 , further including instructions to cause the processor to change an appearance of an image of the hand upon detection of a loss of virtual contact between the hand and the virtual object.

7. One or more non-transitory computer readable media having instructions stored thereon for realistic displacement of a virtual object for an interaction between a hand in a three-dimensional (3D) sensory space and the virtual object in a virtual space that the hand interacts with, which instructions, when executed by one or more processors, perform:

detecting free-form gestures of a hand in a three-dimensional (3D) sensory space;

generating for display within a virtual reality scene a 3D solid hand model for the hand during the free-form gestures, including fingers and thumb of the hand;

in response to detecting a one finger or one thumb free-form gesture of the hand in the 3D sensory space in virtual contact with the virtual object, depicting, in the virtual reality scene generated, the virtual contact and resulting displacement of the virtual object by the 3D solid hand model;

outlining a modeled position of the hand with an outline distinct from a boundary inherent to a displayed representation of the hand; and

incorporating the outline of the hand into the virtual reality scene superimposed upon the displayed representation of the hand whenever the hand is in virtual contact with the virtual object.

8. The one or more non-transitory computer readable media of claim 7 , further including instructions that when executed change an appearance of the outline upon detection of a loss of virtual contact between the hand and the virtual object.

9. The one or more non-transitory computer readable media of claim 7 , further including instructions that when executed change an appearance of an image of the hand upon detection of a loss of virtual contact between the hand and the virtual object.

Assignments (12)
SECURITY INTEREST Recorded Apr 6, 2026
From: SIM IP HXR LLC
To: UNITY MASTER LLC SERIES XIX
Reel/Frame 075365/0907 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 19, 2026
From: ULTRAHAPTICS IP TWO LIMITED
To: SIM IP HXR LLC
Reel/Frame 075127/0488 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2026
From: ULTRAHAPTICS LIMITED; ULTRAHAPTICS IP LIMITED; ULTRAHAPTICS IP TWO LIMITED; ULTRALEAP LIMITED
To: SIM IP HXR LLC
Reel/Frame 074403/0864 →
SECURITY INTEREST Recorded Jun 10, 2020
From: LMI LIQUIDATING CO., LLC
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 052902/0571 →
SECURITY INTEREST Recorded Jun 5, 2020
From: ULTRAHAPTICS IP TWO LIMITED
To: LMI LIQUIDATING CO., LLC
Reel/Frame 052848/0240 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LEAP MOTION, INC.
To: LMI LIQUIDATING CO., LLC.
Reel/Frame 052914/0871 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2020
From: LMI LIQUIDATING CO., LLC.
To: ULTRAHAPTICS IP TWO LIMITED
Reel/Frame 051580/0165 →
RELEASE OF SECURITY INTEREST Recorded Jul 31, 2019
From: HAYNES BEFFEL WOLFELD LLP
To: LEAP MOTION, INC.
Reel/Frame 049926/0631 →
RELEASE OF SECURITY INTEREST Recorded May 31, 2019
From: TRIPLEPOINT CAPITAL LLC
To: LEAP MOTION, INC.
Reel/Frame 049337/0130 →
SECURITY INTEREST Recorded Apr 11, 2019
From: LEAP MOTION, INC.
To: HAYNES BEFFEL WOLFELD LLP
Reel/Frame 048919/0109 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 16, 2018
From: MARCOLINA, ALEX; HOLZ, DAVID S.; DURDIK, PAUL A.
To: LEAP MOTION, INC.
Reel/Frame 045554/0164 →
SECURITY INTEREST Recorded Dec 22, 2017
From: LEAP MOTION, INC.
To: TRIPLEPOINT CAPITAL LLC
Reel/Frame 044469/0592 →
Cited By (4)
US 12,386,430 US 12,579,747 US 12,586,294 US 12,651,413