IP Library › Granted Patent US 11,500,606
Granted Patent B2
US 11,500,606 · App. 17/036,792 · Granted Nov 15, 2022

AR display device and method

Inventors: Qingwen Fan (Beijing, CN); Jinghua Miao (Beijing, CN); Xuefeng Wang (Beijing, CN); Shuai Hao (Beijing, CN); Shuo Zhang (Beijing, CN); Huidong He (Beijing, CN); Hao Zhang (Beijing, CN); Lili Chen (Beijing, CN)
Assignees: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
G06F3/1454G06F3/1423H04L65/65H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,500,606
App. No.
17/036,792
Granted
Nov 15, 2022
Kind
B2
Abstract

The embodiments of the present disclosure provide an AR display device and method. The device includes a terminal and an AR wearable device. The terminal is configured to: configure the AR wearable device as an extended display device of the terminal to put the AR wearable device and a display screen of the terminal in a dual-screen heterogeneous display mode; and transmit image data to the AR wearable device to allow the AR wearable device to display the image data.

Claims (43)

1. An Augmented Reality (AR) display device, comprising:

a terminal; and

an AR wearable device,

wherein the terminal is configured to:

configure the AR wearable device as an extended display device of the terminal to put the AR wearable device and a display screen of the terminal in a dual-screen heterogeneous display mode; and

transmit image data to the AR wearable device to allow the AR wearable device to display the image data;

wherein the terminal is further configured to acquire streaming media data and process the acquired streaming media data into the image data;

wherein the AR display device further comprises a computing device configured to transmit the streaming media data to the terminal in response to a request from the terminal;

wherein the streaming media data comprises Real-Time Streaming Protocol (RTSP) streaming media data; and

wherein the computing device is further configured to transmit the streaming media data to the terminal in response to a request from the terminal by transmitting the RTSP streaming media data for a URL address contained in the request to the terminal in response to the request containing the URL address from the terminal.

2. The device according to claim 1 , wherein the terminal is further configured to configure the AR wearable device as an extended display device of the terminal by:

instantiating a Presentation class;

acquiring a display buffer of the AR wearable device through a DisplayManager service in the Presentation class;

creating a layout file for image data, adding a TextureView component to the layout file, and displaying the image data in the TextureView component; and

transmitting the image data displayed in the TextureView component to the display buffer of the AR wearable device.

3. The device according to claim 1 , wherein the terminal is further configured to configure the AR wearable device as an extended display device of the terminal by:

instantiating a Presentation class;

acquiring a display buffer of the AR wearable device through a DisplayManager service in the Presentation class;

creating a layout file according to the display buffer, adding a TextureView component to the layout file, and displaying the image data in the TextureView component obtained by processing the received streaming media data from the computing device; and

transmitting the image data displayed in the TextureView component to the display buffer of the AR wearable device.

4. The device according to claim 1 , wherein the streaming media data comprises streaming media data obtained by performing real-time screen recording on a display screen of the computing device.

5. An AR display method applied in the AR display device according to claim 1 , the method comprising:

configuring, by the terminal, the AR wearable device as an extended display device of the terminal to put the AR wearable device and a display screen of the terminal in a dual-screen heterogeneous display mode; and

transmitting, by the terminal, image data to the AR wearable device to allow the AR wearable device to display the image data.

6. The method according to claim 5 , further comprising:

processing, by the terminal, acquired streaming media data into the image data.

7. The method according to claim 6 , further comprising:

transmitting, by a computing device, the streaming media data to the terminal in response to a request transmitted from the terminal.

8. The method according to claim 6 , wherein the streaming media data is RTSP streaming media data.

9. The method according to claim 7 , wherein the transmitting, by a computing device, the streaming media data to the terminal in response to a request transmitted from the terminal further comprises:

transmitting the RTSP streaming media data for the URL address contained in the request to the terminal in response to the request containing a URL address transmitted from the terminal.

10. The method according to claim 5 , wherein the configuring, by the terminal, the AR wearable device as an extended display device of the terminal to put the AR wearable device and a display screen of the terminal in a dual-screen heterogeneous display mode, and transmitting, by the terminal, image data to the AR wearable device to allow the AR wearable device to display the image data further comprises:

instantiating a Presentation class;

acquiring a display buffer of the AR wearable device through a DisplayManager service in the Presentation class;

creating a layout file for image data, adding a TextureView component to the layout file, and displaying the image data in the TextureView component; and

transmitting the image data displayed in the TextureView component to the display buffer of the AR wearable device.

11. The method according to claim 7 , wherein the configuring, by the terminal, the AR wearable device as an extended display device of the terminal to put the AR wearable device and a display screen of the terminal in a dual-screen heterogeneous display mode, and transmitting, by the terminal, image data to the AR wearable device to allow the AR wearable device to display the image data further comprises:

instantiating a Presentation class;

acquiring a display buffer of the AR wearable device through a DisplayManager service in the Presentation class;

creating a layout file for the image data, adding a TextureView component to the layout file, and displaying the image data in the TextureView component obtained by processing the received streaming media data from the computing device; and

transmitting the image data displayed in the TextureView component to the display buffer of the AR wearable device.

12. The method according to claim 7 , wherein the streaming media data is streaming media data screen recorded in real-time on a display screen of the computing device.

13. A non-transitory computer storage medium storing a computer program that, when executed, executes the method according to claim 5 .

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2022
From: BOE TECHNOLOGY GROUP CO., LTD.
To: BEIJING BOE TECHNOLOGY DEVELOPMENT CO., LTD.
Reel/Frame 061158/0690 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2020
From: FAN, QINGWEN; MIAO, JINGHUA; WANG, XUEFENG; HAO, SHUAI; ZHANG, SHUO; HE, HUIDONG; ZHANG, HAO; CHEN, LILI
To: BEIJING BOE OPTOELECTRONICS TECHNOLOGY CO., LTD.; BOE TECHNOLOGY GROUP CO., LTD.
Reel/Frame 053920/0105 →
Priority Claims (1)
CN 201911028259.6 · Oct 28, 2019 · national
Continuity (1)
Related Publication 20210124547A1 · Apr 29, 2021