UNIVERSAL APPLICATION PROGRAMMING INTERFACE FOR AUGMENTED REALITY
An application programming interface (API) server accesses first data of a non-augmented reality (AR) application. The first data including first content data, first control data, first user interface data, and a first data format. The API server maps the first data from the non-AR application to second data compatible with an AR application in a display device. The second data includes AR content data, AR control data, AR user interface data, and an AR data format. The second data is generated using an API module of the API server. The API server provides the second data to the AR application in the display device. The display device is configured to display the AR content data, to operate on the content data based on the AR control data, and to generate an AR user interface for the display device with the AR user interface data.
1 . A method comprising:
accessing first data, at an application programming interface (API) server, of a non-augmented reality (AR) application, the first data including first content data, first control data, first user interface data, and a first data format;
mapping the first data of the non-AR application to second data compatible with an AR application in a display device, the second data including AR content data, AR control data, AR user interface data, and an AR data format, the second data generated using an API module of the API server; and
providing the second data to the AR application in the display device, the display device being configured to display the AR content data, to operate on the content data based on the AR control data, and to generate an AR user interface for the display device with the AR user interface data.
2 . The method of claim 1 , wherein the first content data includes an audio and video content, and the method further comprises:
mapping a first format of the audio and video content to a second format of the audio and video content using the API module, the first format being incompatible with the AR application of the display device, the second format being compatible with the AR application of the display device.
3 . The method of claim 2 , further comprising:
generating the AR content data based on the second format of the audio and video content; and
rendering the AR content data in a display of the display device, in a location of the display relative to a physical object perceived by a user of the display device.
4 . The method of claim 1 , further comprising:
converting the first content data to a three-dimensional model of a virtual object using the API module, the AR content data including the three-dimensional model.
5 . The method of claim 1 , wherein the first control data includes commands from the non-AR application, and further comprising:
mapping a first command of the first control data to a second command, the first command being incompatible with the AR application of the display device using the API module, the second command being compatible with the AR application of the display device.
6 . The method of claim 5 , further comprising:
generating the AR control data based on the mapped second command,
wherein the AR application of the display device is configured to operate on the AR content data based on the AR control data.
7 . The method of claim 1 , wherein the first user interface data includes a first user interface of the non-AR application, and further comprising:
mapping the first user interface of the non-AR application to a second user interface, the second user interface being part of an AR user interface of the AR application of the display device.
8 . The method of claim 7 , further comprising:
displaying the AR user interface in a display of the display device;
receiving an AR command via the AR user interface; and
operating on the AR content data in response to the AR command.
9 . The method of claim 8 , further comprising:
mapping the AR content data operated by the AR command to a second content data that is compatible with the non-AR application using the API module.
10 . The method of claim 1 , wherein the data format includes a first sensor data format for the non-AR application, and the method further comprises:
mapping a first sensor data format to a second sensor data format, the first sensor data format being incompatible with the AR application of the display device, the second sensor data format being compatible with the AR application of the display device.
11 . A server comprising:
one or more hardware processors; and
a memory storing instructions that, when executed by the one or more hardware processors, configure the server to perform operations comprising:
accessing first data, at an application programming interface (API) server, of a non-augmented reality (AR) application, the first data including first content data, first control data, first user interface data, and a first data format;
mapping the first data from the non-AR application to second data compatible with an AR application in a display device, the second data including AR content data, AR control data, AR user interface data, and an AR data format, the second data generated using an API module of the API server; and
providing the second data to the AR application in the display device, the display device being configured to display the AR content data, to operate on the content data based on the AR control data, and to generate an AR user interface for the display device with the AR user interface data.
12 . The server of claim 11 , wherein the first content data includes audio and video content, wherein the operations further comprise:
configuring the server to map a first format of the audio and video content to a second format of the audio and video content using the API module, the first format incompatible with the AR application of the display device, the second format compatible with the AR application of the display device.
13 . The server of claim 12 , wherein the operations further comprise:
generating AR content data based on the second format of the audio and video content; and
rendering the AR content data in a display of the display device in a location of the display relative to a physical object perceived by a user of the display device.
14 . The server of claim 11 , wherein the operations further comprise:
converting the first content data to a three-dimensional model of a virtual object using the API module, the AR content data including the three-dimensional model.
15 . The server of claim 13 , wherein the first control data includes commands from the non-AR application, wherein the operations further comprise:
mapping a first command of the first control data to a second command, the first command incompatible with the AR application of the display device using the API module, the second command compatible with the AR application of the display device.
16 . The server of claim 15 , wherein the operations further comprise:
generating the AR control data based on the second command,
wherein the AR application of the display device is configured to operate on the AR content data based on the AR control data.
17 . The server of claim 11 , wherein the first user interface data includes a first user interface of the non-AR application, and the operations further comprise:
mapping the first user interface of the non-AR application to a second user interface, the second user interface being part of an AR user interface of the AR application of the display device.
18 . The server of claim 17 , wherein the operations further comprise:
displaying the AR user interface in a display of the display device;
receiving an AR command via the AR user interface;
operating on the AR content data in response to the AR command; and
mapping the AR content data operated by the AR command to a second content data that is compatible with the non-AR application using the API module.
19 . The server of claim 11 , wherein the data format includes a first sensor data format for the non-AR application, wherein the operations further comprise:
mapping a first sensor data format to a second sensor data format, the first sensor data format incompatible with the AR application of the display device, the second sensor data format compatible with the AR application of the display device.
20 . A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by one or more processors of a computer, cause the computer to perform operations comprising:
accessing first data of a non-augmented reality (AR) application, the first data including first content data, first control data, first user interface data, and first data format;
mapping the first data from the non-AR application to second data compatible with an AR application of a display device, the second data including AR content data, AR control data, AR user interface data, and AR data format, the second data generated using an API module of the computer; and
providing the second data to the AR application of the display device, the display device configured to display the AR content data, to operate on the content data based on the AR control data, and to generate an AR user interface for the display device with the AR user interface data.