IP Library Granted Patent US 10,168,789
Granted Patent B1
US 10,168,789 · App. 15/610,168 · Granted Jan 1, 2019

Systems and methods to facilitate user interactions with virtual content having two-dimensional representations and/or three-dimensional representations

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,168,789
App. No.
15/610,168
Granted
Jan 1, 2019
Kind
B1
Abstract

Systems and methods to facilitate user interactions with virtual content having two-dimensional representations and three-dimensional representations are presented herein. The system may include one or more of a headset, a mobile computing platform, and/or other components. The headset may be configured to provide an interactive space by generating images of virtual content that are superimposed over the user's view of the real-world. The interactive space may include views of virtual content having three-dimensional representation. The mobile computing platform may be configured to present virtual content having two-dimensional representations. The user may perform gestures to “move” virtual content from the two-dimensional representation on the mobile computing platform to a three-dimensional representation within the interactive space.

Claims (50)

1. A system configured to facilitate user interactions with virtual content having two-dimensional representations and three-dimensional representations, the system comprising:

a mobile computing platform comprising:

a display;

a first sensor configured to generate output signals conveying presence of a user object of a user at or near the display;

a first set of one or more physical processors configured by machine-readable instructions to:

effectuate presentation of first virtual content on the display, the first virtual content having a two-dimensional representation;

obtain the output signals generated by the first sensor; and

determine, from the output signals generated by the first sensor, the presence of the user object at or near the display;

a headset configured to be installed on a head of the user;

a depth sensor held by the headset configured to generate output signals conveying ranges of surfaces within a real-world environment;

one or more image forming components held by the headset configured to generate light rays to form images of virtual content, the one or more image forming components being configured such that when the headset is installed on the head of the user, the images are superimposed over a view of the real world environment to create the interactive space; and

a second set of one or more physical processors coupled to the headset, the second set of one or more physical processors being configured by machine-readable instructions to:

obtain the output signals from the depth sensor;

determine, from the output signals of the depth sensor, one or more gestures being performed by the user object;

obtain, from the mobile computing platform, an indication of the presence of the user object at or near the display; and

responsive to obtaining the indication of presence of the user object at or near the display and determining a first gesture is being performed by the user object, control the one or more image forming components to form images of second virtual content, the second virtual content being a three-dimensional representation of the first virtual content, wherein the images of the second virtual content are formed such that the second virtual content is superimposed over the user's view of the user object over a duration of the performance of the first gesture.

2. The system of claim 1 , wherein the second set of one or more physical processors are further configured by machine-readable instructions to:

responsive to determining a second gesture of the user object being performed following the first gesture, control the one or more image forming components to form an image of the second virtual content such that second virtual content is superimposed over the user's view of the real-world environment at or near a location of the performance of the second gesture.

3. The system of claim 2 , wherein the user object is a hand, the first gesture is a grab, and the second gesture is a release.

4. The system of claim 1 , wherein controlling the one or more image forming components to form images of the second virtual content, the second virtual content being the three-dimensional representation of the first virtual content, comprises:

obtaining information defining the three-dimensional representation of the first virtual content; or

obtaining a reference to the information defining the three-dimensional representation of the first virtual content.

5. The system of claim 4 , wherein the information defining the first virtual content is obtained from the mobile computing platform or an external resource, and the reference is obtained from the mobile computing platform, wherein the reference identifies the external resource.

6. The system of claim 1 , wherein the first set of one or more physical processors are further configured by machine-readable instructions to:

effectuate presentation of a user interface on the display, the user interface being configured to receive user input for creating virtual content, such that the first virtual content is created based on user input via the user interface.

7. The system of claim 6 , wherein the user interface is presented on a portion of the display that is adjacent to the first sensor of the mobile computing platform.

8. The system of claim 1 , wherein the second set of one or more physical processors are further configured by machine-readable instructions to:

obtain, from the mobile computing platform, an indication of user input being provided via the display; and

responsive to obtaining the indication of presence of the user object at or near the display, determining the first gesture is being performed by the user object, and obtaining the indication of the user input, determine that the images of the second virtual content should not be generated.

9. The system of claim 8 , wherein the display is a touchscreen and the user input is tactile input.

10. The system of claim 1 , wherein the interactive space is an augmented reality environment.

11. A method configured to facilitate user interactions with virtual content having two-dimensional representations and three-dimensional representations, the method comprising:

obtaining depth information conveying ranges of surfaces within a real-world environment;

determining, from the depth information, one or more gestures being performed by a user object of a user;

obtaining an indication of presence of the user object at or near a display of a mobile computing platform, the mobile computing platform presenting first virtual content, the first virtual content having a two-dimensional representation; and

responsive to obtaining the indication of presence of the user object at or near the display and determining a first gesture is being performed by the user object, generating images of second virtual content, the second virtual content being a three-dimensional representation of the first virtual content, wherein the images of the second virtual content are formed such that the second virtual content is superimposed over the user's view of the user object over a duration of the performance of the first gesture;

responsive to determining a second gesture of the user object being performed following the first gesture, generating an image of the second virtual content such that the second virtual content is superimposed over the user's view of the real-world environment at or near a location of the performance of the second gesture; and

wherein the user object is a hand, the first gesture is a grab, and the second gesture is a release.

12. The method of claim 11 , further comprising:

obtaining information defining the three-dimensional representation of the first virtual content; or

obtaining a reference to the information defining the three-dimensional representation of the first virtual content.

13. The method of claim 12 , wherein the information defining the first virtual content is obtained from the mobile computing platform or an external resource, and the reference is obtained from the mobile computing platform, wherein the reference identifies the external resource.

14. The method of claim 11 , further comprising:

effectuating presentation of a user interface, the user interface being configured to receive user input for creating virtual content, such that the first virtual content is created based on user input via the user interface.

15. The method of claim 14 , wherein the user interface is presented on a portion of the display that is adjacent to the first sensor of the mobile computing platform.

16. The method of claim 11 , further comprising:

obtaining an indication of user input being provided via the display; and

responsive to obtaining the indication of presence of the user object at or near the display, determining the first gesture is being performed by the user object, and obtaining the indication of the user input, determining that the images of the second virtual content should not be generated.

17. The method of claim 16 , wherein the display is a touchscreen and the user input is tactile input.

18. The method of claim 11 , wherein the interactive space is an augmented reality environment.

Assignments (9)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: CAMPFIRE 3D, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 067209/0066 →
CHANGE OF NAME Recorded Feb 16, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066619/0413 →
CHANGE OF NAME Recorded Feb 8, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066422/0129 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 15/587,105 PREVIOUSLY RECORDED AT REEL: 047240 FRAME: 0864. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 22, 2019
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 048964/0953 →
RELEASE OF SECURITY INTEREST Recorded Mar 1, 2019
From: K&L GATES LLP
To: META VIEW, INC.
Reel/Frame 050110/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2019
From: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
To: META VIEW, INC.
Reel/Frame 049038/0277 →
SECURITY INTEREST Recorded Oct 16, 2018
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 047240/0864 →
SECURITY INTEREST Recorded Oct 10, 2017
From: META COMPANY
To: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
Reel/Frame 043829/0038 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 13, 2017
From: SOTO, DIEGO LEYTON; ABADIE, CECILIA; RADKE, FLORIAN BENJAMIN
To: META COMPANY
Reel/Frame 042696/0905 →