IP Library › Granted Patent US 10,916,220
Granted Patent B2
US 10,916,220 · App. 16/510,278 · Granted Feb 9, 2021

Detection and display of mixed 2D/3D content

Inventor: Long H. Ngo (San Jose, CA)
Assignee: Apple Inc.
G09G5/12G06F3/1423G09G2354/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,916,220
App. No.
16/510,278
Filed
Jul 12, 2019
Granted
Feb 9, 2021
Kind
B2
Art Unit
2628
USPC
345/3.1
Abstract

Various implementations disclosed herein include devices, systems, and methods that enable a first device to obtain two-dimensional (2D) content referenced by a webpage and a second device in communication with the first device to display 3D content referenced by the webpage. In an example, it is detected that the webpage references 3D content associated with 2D content and detected that a second device, capable of displaying the 3D content referenced by the webpage, is linked to or in communication with the first device. In one example, the second device receives input corresponding to a user selection to view the 3D content, and in response, displays an 3D environment including the 3D content.

Claims (66)

1. A non-transitory computer-readable storage medium storing program instructions that are computer-executable to perform operations comprising:

obtaining two-dimensional (2D) content referenced by a content item for display via an application on a display of a first device;

detecting that the content item references three-dimensional (3D) content associated with the 2D content;

detecting that a second device is in communication with the first device and capable of displaying the 3D content referenced by the content item, wherein detecting that the second device is capable of displaying the 3D content is based on detecting a type of the second device or detecting an application on the second device capable of displaying the 3D content; and

identifying the 3D content referenced by the content item to the second device.

2. The non-transitory computer-readable storage medium of claim 1 , wherein the content item is a webpage and detecting that the webpage references the 3D content comprises identifying a markup language statement in the webpage corresponding the 3D content.

3. The non-transitory computer-readable storage medium of claim 1 , wherein the 3D content is a virtual object having stereoscopic display information.

4. The non-transitory computer-readable storage medium of claim 1 , wherein the operations further comprise:

displaying an affordance indicating availability of the 3D content responsive to detecting that the second device is in communication with the first device.

5. The non-transitory computer-readable storage medium of claim 1 , wherein detecting that the second device is capable of displaying the 3D content referenced by the content item is based on:

detecting the type of the second device.

6. A non-transitory computer-readable storage medium storing program instructions that are computer-executable to perform operations comprising:

obtaining two-dimensional (2D) content referenced by a content item for display via an application on a display of a first device;

detecting that the content item references three-dimensional (3D) content associated with the 2D content;

detecting that a second device is in communication with the first device capable of displaying the 3D content referenced by the content item, wherein detecting that the second device is in communication with the first device comprises:

detecting that the first device and the second device are both associated with a same account;

detecting that the second device is within a threshold proximity of the first device; or

detecting that the first device is within a field of view of a camera of the second device; and

identifying the 3D content referenced by the content item to the second device.

7. A non-transitory computer-readable storage medium storing program instructions that are computer-executable to perform operations comprising:

obtaining two-dimensional (2D) content referenced by a content item for display via an application on a display of a first device;

detecting that the content item references three-dimensional (3D) content associated with the 2D content;

detecting that a second device is in communication with the first device capable of displaying the 3D content referenced by the content item; and

identifying the 3D content referenced by the content item to the second device;

determining a first spatial relationship between the first device and the second device; and

displaying the 3D content on the display of the detected second device based on the first spatial relationship.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the operations further comprise:

identifying a change in location of the first device relative to the second device;

determining a second spatial relationship between the first device and the second device; and

updating the 3D content on the display of the detected second device based on the second spatial relationship.

9. A non-transitory computer-readable storage medium storing program instructions that are computer-executable to perform operations comprising:

obtaining two-dimensional (2D) content referenced by a content item for display via an application on a display of a first device;

detecting that the content item references three-dimensional (3D) content associated with the 2D content;

detecting that a second device is in communication with the first device capable of displaying the 3D content referenced by the content item; and

identifying the 3D content referenced by the content item to the second device; and

sharing data associated with a change to the 2D content on the display of the first device; and

wherein identifying the 3D content referenced by the content item to the detected second device is based on the change to the 2D content.

10. A method comprising:

at a first device comprising a processor, a computer-readable storage medium, an image sensor, and a display:

obtaining image data representing a physical environment using the image sensor;

detecting that a second device is depicted in the image data, wherein the second device displays two-dimensional (2D) content referenced by a content item without three-dimensional (3D) content referenced by the content item;

based on the detecting, obtaining the 3D content referenced by the content item; and

providing a view of a 3D environment that includes the 3D content referenced by the content item for display on the display.

11. The method of claim 10 , wherein the content item is a webpage.

12. The method of claim 10 further comprising detecting, in the image data, a 3D content indicator displayed as part of the content item displayed by an application on the first device.

13. The method of claim 12 further comprising, based on detecting the 3D content indicator:

determining to obtain the 3D content from the first device; or

providing a user interface option to display the 3D content via the first device.

14. The method of claim 10 , further comprising detecting that the second device is in communication with the first device.

15. The method of claim 10 , wherein the 3D content is obtained from the first device.

16. The method of claim 10 , wherein the view of the 3D environment includes:

a depiction of the second device displaying the 2D content referenced by the content item; and

the 3D content referenced by the content item adjacent to the depiction of the second device.

17. The method of claim 16 , wherein an association indicator in the view of the 3D environment indicates an association between the 3D content referenced by the content item and the depiction of the second device displaying the 2D content referenced by the content item.

18. A system comprising:

an electronic device with a display and an image sensor;

a processor; and

a computer-readable storage medium comprising instructions that upon execution by the processor cause the system to perform operations, the operations comprising:

obtaining two-dimensional (2D) content referenced by a webpage for display on a display of a first device;

detecting that the webpage references three-dimensional (3D) content associated with the 2D content;

detecting that a second device is in communication with the first device, wherein the second device is capable of displaying the 3D content referenced by the webpage; and

identifying the 3D content referenced by the webpage to the second device.

19. The system of claim 18 , wherein the 3D content is a virtual object having stereoscopic display information.

20. The system of claim 18 , wherein the operations further comprise:

detecting that the second device is in communication with the first device; and

displaying an affordance indicating availability of the 3D content responsive to detecting that the second device is in communication with the first device.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2019
From: NGO, LONG H.
To: APPLE INC.
Reel/Frame 049760/0471 →
Continuity (2)
Provisional Application 62715331 · Aug 7, 2018
Related Publication 20200051527A1 · Feb 13, 2020
Cited By (11)
US 12,205,076 US 12,217,347 US 12,218,944 US 12,223,104 US 12,266,061 US 12,277,301 US 12,346,396 US 12,353,482 US 12,524,757 US 12,547,237 US 12,737,996