IP Library Granted Patent US 10,498,801
Granted Patent B2
US 10,498,801 · App. 14/582,544 · Granted Dec 3, 2019

Transmitting and displaying screen content

Inventor: Zhijun Yuan (Hangzhou, CN)
Assignee: Alibaba Group Holding Limited
H04L67/10G06F3/1454H04L65/1093H04L65/60H04L67/02H04L67/38H04L65/4069
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,498,801
App. No.
14/582,544
Granted
Dec 3, 2019
Kind
B2
Abstract

A projecting terminal and a displaying terminal use a point-to-point connection interface provided by a web-based operating system (OS) to establish a point-to-point communication link. The projecting terminal uses a screen visiting interface provided by the web-based OS to access a screen content, converts the screen content into screen content data in real-time, and transmits the screen content data through the communication link. The displaying terminal receives the screen content data and uses a content displaying control provided by the web-based OS to display the screen content data onto a screen. The present techniques enable two devices that are equipped with the web-based OS to implement screen projecting, expand the usage of the screen projecting technology, and are easy for implementation.

Claims (85)

1. A method comprising:

registering a projecting terminal at a web server, the registering the projecting terminal at the web server including:

loading computer-executable codes for initialization from the web server to the projecting terminal;

executing the computer-executable codes for initialization at the projecting terminal to establish a web-based operating system (OS) that supports a real-time webpage communication; and

sending device information of the projecting terminal to the web server, the device information of the projecting terminal including an IP address, a device identification, and a screen resolution of the projecting terminal;

establishing a point to point communication link with a displaying terminal through a point to point link interface provided by the web-based OS at the projecting terminal;

using a screen visiting interface provided by the web-based OS to retrieve a screen content;

converting the screen content to screen content data supported by the web-based OS, the converting including:

converting the screen content into an OGG format in response to determining that the screen content is an audio signal; and

converting the screen content into a WEBM format or a MP4 format in response to determining that the screen content is a video signal; and

sending the screen content data to the displaying terminal through the point to point communication link.

2. The method of claim 1 , wherein the converting the screen content to the screen content data comprises converting the screen content to the screen content data in real time.

3. The method of claim 1 , wherein the registering the projecting terminal at the web server further includes:

prior to the establishing the point to point communication link with the displaying terminal through the point to point link interface provided by the web-based OS, visiting the web server through the web-based OS.

4. The method of claim 1 , wherein the registering the projecting terminal at the web server further includes:

uploading registration related information of the projecting terminal to the web server through the web-based OS that completes initialization; and

completing a registration.

5. The method of claim 1 , wherein the web-based OS supports HyperText Markup Language (HTML) 5 operating environment with a web Real-Time Communication (WebRTC) application.

6. The method of claim 5 , wherein the establishing the point to point communication link with the displaying terminal through the point to point link interface provided by the web-based OS at the projecting terminal comprises:

defining an RTCPeerConnection interface through the web-based OS;

completing an initiation of the RTCPeerConnection interface;

sending a point to point connecting message to the displaying terminal;

receiving a responding message from the displaying terminal;

executing computer-executable codes related to the RTCPeerConnection interface; and

establishing the point to point communication link with the displaying terminal.

7. The method of claim 6 , wherein the using the screen visiting interface provided by the web-based OS to retrieve the screen content comprises:

defining and initializing a MediaStream interface; and

accessing the screen content through the MediaStream interface.

8. The method of claim 7 , wherein the sending the screen content data to the displaying terminal through the point to point communication link comprises:

sending the screen content data to the RTCPeerConnection interface; and

sending the screen content data to the displaying terminal through the point to point communication link from the RTCPeerConnection interface.

9. The method of claim 1 , wherein the point to point communication link includes at least one of the following:

a wired communication link in a local area network (LAN);

a wireless communication link established through WiFi or Bluetooth in the LAN; or

a remote point-to-point communication link established through Internet.

10. A method for displaying a screen content by a displaying terminal, the method comprising:

registering the displaying terminal at a web server, the registering the displaying terminal at the web server including:

loading computer-executable codes for initialization from the web server to the displaying terminal;

executing the computer-executable codes for initialization at the displaying terminal to establish a web-based operating system (OS) that supports a real-time webpage communication; and

sending device information of the displaying terminal to the web server, the device information of the displaying terminal including a screen resolution of the displaying terminal;

establishing a point to point communication link with a projecting terminal through a point to point link interface provided by the web-based OS at the displaying terminal; and

displaying screen content data received from the projecting terminal at a screen, the displaying including:

converting the screen content data into a format supported by the web-based OS, the converting including:

converting the screen content data into an OGG format in response to determining that the screen content is an audio signal; and

converting the screen content data into a WEBM format or a MP4 format in response to determining that the screen content is a video signal.

11. The method of claim 10 , wherein the displaying the screen content data received from the projecting terminal at the screen comprises using a video control provided by the web-based OS to display the screen content data.

12. The method of claim 10 , wherein the registering the displaying terminal at the web server further includes:

prior to the establishing the point to point communication link with the projecting terminal through the point to point link interface provided by the web-based OS, visiting the web server through the web-based OS.

13. The method of claim 10 , wherein the registering the displaying terminal at the web server further includes:

uploading registration related information of the displaying terminal to the web server through the web-based OS that completes initialization; and

completing a registration.

14. The method of claim 10 , wherein the web-based OS supports HyperText Markup Language (HTML) 5 operating environment with a web Real-Time Communication (WebRTC) application.

15. The method of claim 14 , wherein the establishing the point to point communication link with the projecting terminal through the point to point link interface provided by the web-based OS at the displaying terminal comprises:

defining an RTCPeerConnection interface through the web-based OS;

completing an initiation of the RTCPeerConnection interface;

receiving a point to point connecting message from the projecting terminal;

returning a responding message to the projecting terminal;

executing computer-executable codes related to the RTCPeerConnection interface; and

establishing the point to point communication link with the projecting terminal.

16. The method of claim 15 , wherein the displaying screen content data received from the projecting terminal at the screen comprises using a content displaying control provided by the web-based OS to display the screen content data at the screen.

17. The method of claim 16 , wherein the using the content displaying control provided by the web-based OS to display the screen content data at the screen comprises:

defining and initializing a video control;

using the content displaying control to retrieve the screen content data received from the RTCPeerConnection interface;

selecting a screen resolution to display the screen content data; and

using the video control to display the screen content data at the screen according to the screen resolution.

18. The method of claim 17 , wherein the screen resolution includes at least one of the following:

a screen resolution of the projecting terminal;

a screen resolution of the displaying terminal; or

a screen resolution defined by a user.

19. An apparatus comprising:

one or more processors; and

one or more memories stored thereon computer-readable instructions that, when executed by one or more processors, cause the one or more processors to perform acts comprising:

connecting a projecting terminal and a displaying terminal to a same local area network (LAN) or a router;

sending computer-executable codes for initialization from a web server to the projecting terminal and the displaying terminal respectively to establish a web-based operating system (OS) that supports a real-time webpage communication at the projecting terminal and the displaying terminal respectively;

establishing a point-to-point communication link through a point-to-point communication interface provided by the web-based OS between the projecting terminal and the displaying terminal;

converting the screen content, when the projecting terminal uses a screen visiting interface provided by the web-based OS to access the screen content, into screen content data in real-time supported by the web-based OS, the converting including:

converting the screen content into an OGG format in response to determining that the screen content is an audio signal; and

converting the screen content into a WEBM format or a MP4 format in response to determining that the screen content is a video signal, the converting the screen convent into the WEBM format or the MP4 format including:

converting the screen content into the MP4 format in response to determining that the displaying terminal does not support the WEBM format;

receiving a designated screen resolution to display the screen content data;

sending the screen content data to the displaying terminal through the point-to-point communication link; and

using a content displaying control provided by the web-based OS, when the displaying terminal receives the screen content data, to display the screen content data onto a screen.

20. The apparatus of claim 19 , wherein the acts further comprise:

establishing a connection between the displaying terminal or the project terminal and the web server respectively through the web-based OS operating environments; and

when the projecting terminal or the displaying terminal visits the web server, loading computer-readable codes or logical codes that are required for registration and initialization of the projecting terminal or the displaying terminal from the web server, and executing the computer-executable codes relating to registration and initialization.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 25, 2020
From: ALIBABA GROUP HOLDING LIMITED
To: BANMA ZHIXING NETWORK (HONGKONG) CO., LIMITED
Reel/Frame 054469/0946 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2015
From: YUAN, ZHIJUN
To: ALIBABA GROUP HOLDING LIMITED
Reel/Frame 034842/0877 →
Priority Claims (1)
CN 2013 1 0741237 · Dec 27, 2013 · national
Continuity (1)
Related Publication 20150188998A1 · Jul 2, 2015