Granted Patent B2

US 12,288,285 · App. 17/814,462 · Granted Apr 29, 2025

Inventors: Peter G. Zion (Lafayette, CO); Tyler L Casella (Martinez, CA); Omar Shaik (Menlo Park, CA); Benjamin B. Loggins (San Francisco, CA); Eric S. Peyton (Naperville, IL); Christopher H. Dempsey (Erie, CO)

Assignee: Apple Inc.

G06T15/005G02B27/017G02B27/0172G06T19/003G02B2027/014G06T2200/08G06T2200/24G06T2210/32

Abstract

Claims (88)

1. A method comprising:

at a first electronic device in communication with a display and one or more input devices:

capturing, via the one or more input devices, at least a portion of a real-world environment including a second electronic device displaying a content creation application and a first content item;

receiving a request from the second electronic device to preview the first content item in three-dimensions; and

in accordance with the request, generating a three-dimensional representation of the first content item and presenting the three-dimensional representation of the first content item within a three-dimensional environment;

transmitting the three-dimensional representation of the first content item to the second electronic device for display at the second electronic device;

receiving, via the one or more input devices, an input;

in accordance with the input:

updating an appearance of the three-dimensional representation of the first content item in the three-dimensional environment; and

transmitting the updated appearance of the three-dimensional representation of the first content item to the second electronic device.

2. The method of claim 1 , wherein:

the first electronic device is a head-mounted display; and

the second electronic device is a laptop computer, a desktop computer, or a tablet.

3. The method of claim 1 , further comprising:

presenting a representation of the captured portion of the real-world environment, wherein the representation of the captured portion of the real-world environment includes:

a representation of the second electronic device including a representation of the content creation application; and

a representation of the first content item displayed in the content creation application.

4. The method of claim 1 , further comprising:

capturing, via the one or more input devices, a light source of the real-world environment;

wherein:

presenting the three-dimensional representation of the first content item includes presenting a lighting effect due to interaction between the first content item and the light source;

updating the appearance of the three-dimensional representation of the first content item in the three-dimensional environment includes changing the appearance of the lighting effect.

5. The method of claim 4 , wherein transmitting the updated appearance of the three-dimensional representation of the first content item to the second electronic device does not include information regarding the lighting effect.

6. The method of claim 1 , wherein the input received via the one or more input devices is an interaction with the three-dimensional representation of the first content item that includes a selection of the three-dimensional representation of the first content item using one or more fingers and/or using the one or more input devices.

7. The method of claim 1 , wherein the input received via the one or more input devices is a reorientation or a repositioning of the first electronic device within the real-world environment.

8. The method of claim 1 , further comprising:

establishing a communication link between the first electronic device and the second electronic device;

wherein receiving the request from the second electronic device to preview the first content item in three-dimensions comprises:

receiving content item data corresponding to the first content item from the second electronic device at a three-dimensional graphic rendering application at the first electronic device via the communication link; and

wherein transmitting the three-dimensional representation of the first content item to the second electronic device for display at the second electronic device comprises:

transmitting the first content item generated in three-dimensions to the second electronic device via the communication link.

9. The method of claim 8 , wherein establishing the communication link comprises:

establishing a first communication link between a preview shell application at the first electronic device and the content creation application at the second electronic device and;

establishing a second communication link between the preview shell application and a preview agent application at the first electronic device; and

establishing a third communication link between the preview agent application and the three-dimensional graphic rendering application at the first electronic device.

10. The method of claim 9 , wherein receiving the content item data corresponding to the first content item from the second electronic device at the three-dimensional graphic rendering application comprises:

receiving the content item data via the first communication link from the content creation application at the second electronic device at the preview shell application at the first electronic device;

transmitting the content item data via the second communication link from the preview shell application to the preview agent application at the first electronic device; and

transmitting the content item data via the third communication link from the preview agent application to the three-dimensional graphic rendering application at the first electronic device.

11. An electronic device comprising:

one or more processors;

memory; and

one or more programs stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for performing a method comprising:

capturing, via one or more input devices, at least a portion of a real-world environment including a second electronic device displaying a content creation application and a first content item;

receiving a request from the second electronic device to preview the first content item in three-dimensions; and

in accordance with the request, generating a three-dimensional representation of the first content item and presenting the three-dimensional representation of the first content item within a three-dimensional environment;

transmitting the three-dimensional representation of the first content item to the second electronic device for display at the second electronic device;

receiving, via the one or more input devices, an input;

in accordance with the input:

updating an appearance of the three-dimensional representation of the first content item in the three-dimensional environment; and

transmitting the updated appearance of the three-dimensional representation of the first content item to the second electronic device.

12. The electronic device of claim 11 , wherein the method further comprises:

presenting a representation of the captured portion of the real-world environment, wherein the representation of the captured portion of the real-world environment includes:

a representation of the second electronic device including a representation of the content creation application; and

a representation of the first content item displayed in the content creation application.

13. The electronic device of claim 11 , wherein the method further comprises:

capturing, via the one or more input devices, a light source of the real-world environment;

wherein:

presenting the three-dimensional representation of the first content item includes presenting a lighting effect due to interaction between the first content item and the light source;

updating the appearance of the three-dimensional representation of the first content item in the three-dimensional environment includes changing the appearance of the lighting effect.

14. The electronic device of claim 13 , wherein transmitting the updated appearance of the three-dimensional representation of the first content item to the second electronic device does not include information regarding the lighting effect.

15. The electronic device of claim 11 , wherein the input received via the one or more input devices is an interaction with the three-dimensional representation of the first content item that includes a selection of the three-dimensional representation of the first content item using one or more fingers and/or using the one or more input devices.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by one or more processors of a first electronic device, cause the first electronic device to perform a method comprising:

capturing, via one or more input devices, at least a portion of a real-world environment including a second electronic device displaying a content creation application and a first content item;

receiving a request from the second electronic device to preview the first content item in three-dimensions; and

in accordance with the request, generating a three-dimensional representation of the first content item and presenting the three-dimensional representation of the first content item within a three-dimensional environment;

transmitting the three-dimensional representation of the first content item to the second electronic device for display at the second electronic device;

receiving, via the one or more input devices, an input;

in accordance with the input:

updating an appearance of the three-dimensional representation of the first content item in the three-dimensional environment; and

transmitting the updated appearance of the three-dimensional representation of the first content item to the second electronic device.

17. The non-transitory computer readable storage medium of claim 16 , wherein:

the first electronic device is a head-mounted display; and

the second electronic device is a laptop computer, a desktop computer, or a tablet.

18. The non-transitory computer readable storage medium of claim 16 , wherein the method further comprises:

establishing a communication link between the first electronic device and the second electronic device;

wherein receiving the request from the second electronic device to preview the first content item in three-dimensions comprises:

receiving content item data corresponding to the first content item from the second electronic device at a three-dimensional graphic rendering application at the first electronic device via the communication link; and

wherein transmitting the three-dimensional representation of the first content item to the second electronic device for display at the second electronic device comprises:

transmitting the first content item generated in three-dimensions to the second electronic device via the communication link.

19. The non-transitory computer readable storage medium of claim 18 , wherein establishing the communication link comprises:

establishing a first communication link between a preview shell application at the first electronic device and the content creation application at the second electronic device and;

establishing a second communication link between the preview shell application and a preview agent application at the first electronic device; and

establishing a third communication link between the preview agent application and the three-dimensional graphic rendering application at the first electronic device.

20. The non-transitory computer readable storage medium of claim 19 , wherein receiving the content item data corresponding to the first content item from the second electronic device at the three-dimensional graphic rendering application comprises:

receiving the content item data via the first communication link from the content creation application at the second electronic device at the preview shell application at the first electronic device;

transmitting the content item data via the second communication link from the preview shell application to the preview agent application at the first electronic device; and

transmitting the content item data via the third communication link from the preview agent application to the three-dimensional graphic rendering application at the first electronic device.

Assignments (1)

Continuity (2)

References Cited (251)