IP Library Granted Patent US 10,127,727
Granted Patent B1
US 10,127,727 · App. 15/403,126 · Granted Nov 13, 2018

Systems and methods to provide an interactive environment over an expanded field-of-view

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,127,727
App. No.
15/403,126
Granted
Nov 13, 2018
Kind
B1
Abstract

Systems and methods to provide an interactive environment over an expanded field-of-view are presented herein. The system may include one or more of a headset, a first image forming component held by the headset, a second image forming component held by the headset, one or more physical processors, and/or other components. The first image forming component may be configured to generate light rays to form a first set of images of virtual content at a first resolution. The first set of images of virtual content may be presented to the user over a first angular portion of the user's field-of-view. The second image forming component may be configured to generate light rays to form a second set of images of virtual content at a second resolution. The second set of images of virtual content may be presented to the user over a second angular portion of the user's field-of-view.

Claims (59)

1. A system configured to provide an interactive environment over an expanded field-of-view, the system comprising:

a headset configured to be installed on a head of a user;

a first image forming component held by the headset configured to generate light rays to form a first set of images of virtual content at a first resolution, the first image forming component being configured such that (i) when the headset is installed on the head of the user, the first set of images of virtual content is presented to an eye of the user over a first angular portion of the user's monocular field-of-view from the eye, and (ii) the first set of images of virtual content is superimposed over a view of the real world to create at least part of an augmented reality environment;

a second image forming component held by the headset configured to generate light rays to form a second set of images of virtual content at a second resolution, the second image forming component being configured such that (i) when the headset is installed on the head of the user, the second set of images of virtual content is presented to the eye of the user over a second angular portion of the user's monocular field-of-view from the eye, the second angular portion being different from the first angular portion, and (ii) the second set of images of virtual content is superimposed over the view of the real world to create at least a second part of the augmented reality environment;

a third image forming component held by the headset configured to generate light rays to form a third set of images of virtual content, the second image forming component being configured such that (i) when the headset is installed on the head of the user, the third set of images of virtual content is presented to a second eye of the user over a third angular portion of the user's monocular field-of-view from the second eye, and (ii) the third set of images of virtual content is superimposed over the view of the real world to create at least a third part of the augmented reality environment;

a fourth image forming component held by the headset configured to generate light rays to form a fourth set of images of virtual content, the fourth image forming component being configured such that (i) when the headset is installed on the head of the user, the fourth set of images of virtual content is presented to the second eye of the user over a fourth angular portion of the user's monocular field-of-view from the second eye, and (ii) the fourth set of images of virtual content is superimposed over the view of the real world to create at least a fourth part of the augmented reality environment; and

one or more physical processors configured by machine-readable instructions to:

control the first image forming component to generate the light rays to form the first set of images of virtual content;

control the second image forming component to generate the light rays to form the second set of images of virtual content;

control the third image forming component to generate the light rays to form the third set of images of virtual content; and

control the fourth image forming component to generate the light rays to form the fourth set of images of virtual content.

2. The system of claim 1 , wherein the first image forming component comprises:

a first light source configured to generate the light rays to form the first set of images of virtual content at the first resolution;

a first optical element, the first optical element being configured to receive the light rays generated by the first light source that are coupled into the first optical element and guide the light rays to an eye to present the first set of images over the first angular portion of the user's field-of-view, wherein the first set of images of virtual content are superimposed over the view of the real world; and

wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the first image forming component comprises controlling the first light source to generate the light rays to form the first set of images of virtual content.

3. The system of claim 2 , wherein the second image forming component comprises:

a second light source held by the headset configured to generate the light rays to form the second set of images of virtual content at the second resolution;

a second optical element held by the headset, the second optical element being arranged on the headset such that (i) when the headset is installed on the head of the user, the user's vision over the second angular portion of the user's field-of-view is directed toward the second optical element, and (ii) the light rays generated by the second light source are directed onto the second optical element to form the second set of images of virtual content on the second optical element that reflect into the user's eye, wherein the second set of images of virtual content are superimposed over the view of the real world through the second optical element; and

wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the second image forming component comprises controlling the second light source to generate the light rays to form the second set of images of virtual content.

4. The system of claim 3 , wherein the first light source and second light source are individually one or more of a microelectromechanical systems (MEMS) RGB laser scanner, a microLED microdisplay, an LED or RGB lasers illuminated liquid crystal on silicon (LCOS) microdisplay, a digital light projector (DLP), a digital micromirror device (DMD), a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or an OLED microdisplay.

5. The system of claim 3 , wherein the first optical element comprises a waveguide, and the second optical element comprises a partially reflective visor portion.

6. The system of claim 3 , wherein the first optical element comprises a waveguide, and the second optical element comprises a beam splitter or a free form prism.

7. The system of claim 2 , wherein the second image forming component comprises:

a second light source configured to generate the light rays to form the second set of images of virtual content at the second resolution;

a second optical element, the second optical element being configured to receive the light rays generated by the second light source that are coupled into the second optical element and guide the light rays to the eye to present the second set of images over the second angular portion of the user's field-of-view, wherein the second set of images of virtual content are superimposed over the view of the real world; and

wherein the one or more physical processors are further configured by machine-readable instructions such that controlling the second image forming component comprises controlling the second light source to generate the light rays to form the second set of images of virtual content.

8. The system of claim 4 , wherein the first optical element includes a first waveguide, and the second optical element includes a second waveguide.

9. The system of claim 2 , wherein the second image forming component comprises a scanning fiber system configured to generate the light rays to form the second set of images of virtual content at the second resolution.

10. The system of claim 2 , wherein the second image forming component comprises:

a second light source held by the headset configured to generate the light rays to form the second set of images of virtual content at the second resolution; and

a deformable mirror.

11. The system of claim 10 , further comprising a lens or an image fiber bundle.

12. The system of claim 1 , wherein the first resolution is higher than the second resolution.

13. The system of claim 1 , wherein the first angular portion does not overlap with the second angular portion of the user's field-of-view.

14. The system of claim 1 , wherein the first resolution is the same as the second resolution.

15. A method to provide an interactive environment over an expanded field-of-view, the method being implemented in a headset configured to be installed on a head of a user, the headset comprising a first image forming component, a second image forming component, a third image forming component, and a fourth image forming component, one or more physical processors, and storage media storing machine-readable instructions, the method comprising:

generating, by the first image forming component, light rays to form a first set of images of virtual content at a first resolution;

presenting, by the first image forming component, the first set of images of virtual content to an eye of the user over a first angular portion of the user's monocular field-of-view from the eye, the first set of images of virtual content being superimposed over a view of the real world to create at least part of an augmented reality environment;

generating, by the second image forming component, light rays to form a second set of images of virtual content at a second resolution;

presenting, by the second image forming component, the second set of images to the eye of the user over a second angular portion of the user's monocular field-of-view from the eye, the second angular portion being different from the first angular portion, the second set of images of virtual content being superimposed over the view of the real world to create at least a second part of the augmented reality environment;

generating, by the third image forming component, light rays to form a third set of images of virtual content;

presenting, by the third image forming component, the third set of images to a second eye of the user over a third angular portion of the user's monocular field-of-view from the second eye, the third set of images of virtual content being superimposed over the view of the real world to create at least a third part of the augmented reality environment;

generating, by the fourth image forming component, light rays to form a fourth set of images of virtual content; and

presenting, by the fourth image forming component, the fourth set of images to the second eye of the user over a fourth angular portion of the user's monocular field-of-view from the second eye, the fourth set of images of virtual content being superimposed over the view of the real world to create at least a fourth part of the augmented reality environment.

16. The method of claim 15 , wherein the first image forming component comprises a first light source configured to generate the light rays to form the first set of images and a first optical element, and wherein the method further comprises:

coupling the light rays generated by the first light source into the first optical element and guiding the light rays coupled into the first optical element to an eye to form the first set of images of virtual content in the eye, wherein the first set of images of virtual content are superimposed over the view of the real world.

17. The method of claim 16 , wherein the second image forming component comprises a second light source configured to generate the light rays to form the second set of images, and a second optical element, and wherein the method further comprises:

directing the light rays generated by the second light source onto the second optical element to form the second set of images of virtual content on the second optical element and reflect the second set of images into the user's eye, wherein the second set of images of virtual content are superimposed over the view of the real world through the second optical element.

18. The method of claim 17 , wherein the first light source and second light source are individually one or more of a microelectromechanical systems (MEMS) RGB laser scanner, a microLED microdisplay, an LED or RGB lasers illuminated liquid crystal on silicon (LCOS) microdisplay, a digital light projector (DLP), a digital micromirror device (DMD), a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or an OLED microdisplay.

19. The method of claim 17 , wherein the first optical element comprises a waveguide, and the second optical element comprises a partially reflective visor portion.

20. The method of claim 17 , wherein the first optical element comprises a waveguide, and the second optical element comprises a beam splitter or a free form prism.

21. The method of claim 16 , wherein the second image forming component comprises a second light source configured to generate the light rays to form the second set of images and a second optical element, and wherein the method further comprises:

coupling the light rays generated by the second light source into the second optical element and guiding the light rays coupled into the second optical element to the eye to form the second set of images of virtual content in the eye, wherein the second set of images of virtual content are superimposed over the view of the real world.

22. The method of claim 21 , wherein the first optical element includes a first waveguide, and the second optical element includes a second waveguide.

23. The method of claim 16 , wherein the second image forming component comprises a scanning fiber system configured to generate the light rays to form the second set of images of virtual content at the second resolution.

24. The method of claim 16 , wherein the second image forming component comprises a second light source held by the headset configured to generate the light rays to form the second set of images of virtual content at the second resolution, and a deformable mirror.

25. The method of claim 15 , wherein the first resolution is higher than the second resolution.

26. The method of claim 15 , wherein the first angular portion does not overlap with the second angular portion of the user's field-of-view.

27. The method of claim 15 , wherein the first resolution is the same as the second resolution.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 24, 2024
From: CAMPFIRE 3D, INC.
To: QUALCOMM INCORPORATED
Reel/Frame 067209/0066 →
CHANGE OF NAME Recorded Feb 16, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066619/0413 →
CHANGE OF NAME Recorded Feb 8, 2024
From: META VIEW, INC.
To: CAMPFIRE 3D, INC.
Reel/Frame 066422/0129 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 15/587,105 PREVIOUSLY RECORDED AT REEL: 047240 FRAME: 0864. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Apr 22, 2019
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 048964/0953 →
RELEASE OF SECURITY INTEREST Recorded Mar 1, 2019
From: K&L GATES LLP
To: META VIEW, INC.
Reel/Frame 050110/0688 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2019
From: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
To: META VIEW, INC.
Reel/Frame 049038/0277 →
SECURITY INTEREST Recorded Oct 16, 2018
From: META COMPANY
To: K&L GATES LLP
Reel/Frame 047240/0864 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SPELLING OF 4TH INVENTOR'S NAME PREVIOUSLY RECORDED ON REEL 041347 FRAME 0138. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Dec 7, 2017
From: YUAN, SHENG; AHUJA, ASHISH; XIANG, JIE; LO, RAYMOND CHUN HING
To: META COMPANY
Reel/Frame 044746/0765 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 22, 2017
From: YUAN, SHENG; AHUJA, ASHISH; XIANG, JIE; CHUN HING LO, RAYMOND
To: META COMPANY
Reel/Frame 041347/0138 →
SECURITY INTEREST Recorded Jan 31, 2017
From: META COMPANY
To: VENTURE LENDING & LEASING VII, INC.; VENTURE LENDING & LEASING VIII, INC.
Reel/Frame 041578/0573 →
Cited By (9)
US 12,322,038 US 12,324,708 US 12,347,026 US 12,374,032 US 12,462,473 US 12,469,212 US 12,530,838 US 12,586,297 US 12,707,034