IP Library › Granted Patent US 11,308,686

Granted Patent B1

US 11,308,686 · App. 17/100,685 · Granted Apr 19, 2022

Captured image data in a computer-generated reality environment

Inventors: Clément Pierre Nicolas Boissière (San Francisco, CA); Samuel Lee Iglesias (Palo Alto, CA); Edwin Iskandar (San Jose, CA); Timothy R. Oriol (San Jose, CA)

Assignee: Apple Inc.

G06T15/20 G06F3/012 G06T19/006 G06F3/017 G06T13/40

View Patent ↗

Loading inventors, assignments & file history…

Monitor This Case

Get email alerts when status or documents change.

Order Certified Copies

Most orders are placed with the USPTO same day — all within 24 business hours.

Order via The Patent Place →

Pre-filled with this patent's details

Quick Facts

Patent No.: US 11,308,686
App. No.: 17/100,685
Granted: Apr 19, 2022
Kind: B1

External Links

USPTO Patent Center↗ Full Patent PDF↗

Abstract

The present disclosure relates generally to for displaying a set of images based on captured image data. In some embodiments, a system displays a first set of images corresponding to a first perspective in a virtual reality (VR) (or mixed reality (MR)) environment. The system receives a request while displaying the first set of images. The system captures image data corresponding to a second perspective in the VR (or MR) environment in response to receiving the request. The system displays a second set of images based on the captured image data.

Claims (62)

1. A system, comprising:

a display;

an orientation sensor;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for:

displaying, on a display, to a user, a first set of images corresponding to a first perspective in a virtual reality (VR) environment, wherein the first set of images is based on a first head position of the user;

while displaying the first set of images, receiving a request;

in response to receiving the request, capturing image data corresponding to a second perspective in the VR environment,

wherein the captured image data is based on a position of the user; and

wherein the first perspective is different from the second perspective;

displaying, on the display, a second set of images, wherein the second set of images is based on the captured image data corresponding to the second perspective and is based on a second head position of the user;

while displaying the second set of images, detecting, using an orientation sensor, a change in head position of the user from the second head position to a third head position; and

displaying, on the display, a third set of images, wherein the third set of images is based on the captured image data corresponding to the second perspective and is based on the third head position of the user.

2. The system of claim 1 , wherein the display is head-mounted.

3. The system of claim 1 , wherein the captured image data corresponds to a point in time.

4. The system of claim 1 , wherein the captured image data corresponds to a period of time.

5. The system of claim 1 , the one or more programs further including instructions for:

positioning a virtual camera at a location corresponding to the second perspective in the VR environment.

6. The system of claim 5 , wherein the location of the virtual camera is based on user input.

7. The system of claim 5 , wherein the positioning of the virtual camera occurs automatically without user input.

8. The system of claim 1 , wherein the captured image data further corresponds to the first perspective in the VR environment, the one or more programs further including instructions for:

while displaying the second set of images, concurrently displaying, on the display, a related set of images, wherein the related set of images is based on the captured image data corresponding to the first perspective.

9. The system of claim 1 , the one or more programs further including instructions for:

prior to receiving the request, not capturing image data.

10. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of a system with a display and an orientation sensor, the one or more programs including instructions for:

while displaying the first set of images, receiving a request;

in response to receiving the request, capturing image data corresponding to a second perspective in the VR environment,

wherein the captured image data is based on a position of the user; and

wherein the first perspective is different from the second perspective;

while displaying the second set of images, detecting, using an orientation sensor, a change in head position of the user from the second head position to a third head position; and

11. The non-transitory computer-readable storage medium of claim 10 , wherein the display is head-mounted.

12. The non-transitory computer-readable storage medium of claim 10 , wherein the captured image data corresponds to a point in time.

13. The non-transitory computer-readable storage medium of claim 10 , wherein the captured image data corresponds to a period of time.

14. The non-transitory computer-readable storage medium of claim 10 , the one or more programs further including instructions for:

positioning a virtual camera at a location corresponding to the second perspective in the VR environment.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the location of the virtual camera is based on user input.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the positioning of the virtual camera occurs automatically without user input.

17. The non-transitory computer-readable storage medium of claim 10 , wherein the captured image data further corresponds to the first perspective in the VR environment, the one or more programs further including instructions for:

18. The non-transitory computer-readable storage medium of claim 10 , the one or more programs further including instructions for:

prior to receiving the request, not capturing image data.

19. A method for capturing image data in a virtual reality (VR) environment, comprising:

displaying, on a display, to a user, a first set of images corresponding to a first perspective in the VR environment, wherein the first set of images is based on a first head position of the user;

while displaying the first set of images, receiving a request;

in response to receiving the request, capturing image data corresponding to a second perspective in the VR environment,

wherein the captured image data is based on a position of the user; and

wherein the first perspective is different from the second perspective;

while displaying the second set of images, detecting, using an orientation sensor, a change in head position of the user from the second head position to a third head position; and

20. The method of claim 19 , wherein the display is head-mounted.

21. The method of claim 19 , further comprising:

positioning a virtual camera at a location corresponding to the second perspective in the VR environment.

22. The method of claim 21 , wherein the location of the virtual camera is based on user input.

23. The method of claim 21 , wherein the positioning of the virtual camera occurs automatically without user input.

24. The method of claim 19 , wherein the captured image data further corresponds to the first perspective in the VR environment, further comprising:

25. The method of claim 19 , further comprising:

prior to receiving the request, not capturing image data.

Continuity (2)

Continuation 16141393 · Sep 25, 2018

Provisional Application 62566221 · Sep 29, 2017

Cited By (13)

US 12,189,422 US 12,236,008 US 12,265,655 US 12,356,054 US 12,360,557 US 12,360,558 US 12,380,238 US 12,474,816 US 12,530,102 US 12,530,103 US 12,537,877 US 12,619,774 US 12,669,848