IP Library Granted Patent US 11,265,356
Granted Patent B2
US 11,265,356 · App. 16/967,053 · Granted Mar 1, 2022

Network assistance functions for virtual reality dyanmic streaming

Inventors: Rickard Ljung (Lund, SE); Peter Karlsson (Lund, SE)
Assignee: Sony Group Corporation
H04L65/602G06T19/006H04L65/4084H04L65/4092
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,265,356
App. No.
16/967,053
Granted
Mar 1, 2022
Kind
B2
Abstract

Network assistance is provided for the streaming of multi-segment data from a data source ( 12 ) to a streaming client ( 54 ) in a network. The network assistance for multi-segment data streaming may be carried out in an automated manner by the respective devices. The systems and methods include new functions that allow for more efficient handling of data segments that make up a data stream. The network assistance for multi-segment streaming may improve, for example, virtual reality (VR) streaming performance.

Claims (30)

1. A method of streaming data with a streaming client, comprising:

establishing a network assistance (NA) session with a network element for streaming data from a data source;

receiving data from the data source, the data comprising a plurality of data segments, wherein the data represents a virtual reality (VR) environment, and each segment of the plurality of segments represents a tile of the VR environment;

assigning relative priorities indicative of at least two different transmission priorities to at least two different data segments of the plurality of data segments, wherein the relative priorities are assigned based on a user's field of view (FOV) with respect to the VR environment, and assigning relative priorities comprises assigning at least one of a first priority corresponding with a first recommended rate to an in-FOV tile, a second priority corresponding with a second recommended rate to a peripheral FOV tile, or a third priority corresponding to a third recommended rate to an out of FOV tile, wherein the first recommended rate corresponds to higher quality video than the second recommended rate, and the second recommended rate corresponds to higher quality video than the third recommended rate; and

informing the network element of the relative priorities.

2. The method of claim 1 , further comprising receiving a network assistance response that comprises information indicative of recommended rates for one or more of the relative priorities.

3. The method of claim 2 , further comprising requesting, from the data source, the at least two different data segments corresponding to the respective recommended rates.

4. The method of claim 1 , further comprising:

assigning a highest priority indicative of a highest priority request for an upcoming data segment reception; and

receiving a recommended rate for the upcoming data segment.

5. The method of claim 4 , further comprising receiving an acknowledgement message indicating whether the recommended rate for the upcoming data segment was assigned as a highest available rate by the network element in response to the highest priority request.

6. The method of claim 1 , further comprising receiving information specifying an allocation of network resources dedicated for at least one of communication with the network element or downloading the data.

7. The method of claim 6 , wherein the information specifying an allocation of network resources comprises at least one of an access point name, a quality of service indicator, an IP address, a mobile cell ID, or a radio access technology.

8. The method of claim 1 , wherein the network element is configured to provide a NA service that supports network assistance under dynamic adaptive streaming over hypertext transfer protocol (HTTP) (DASH), the network element being a DASH-aware network element (DANE).

9. A user equipment comprising a wireless interface and a control circuit configured to:

establish a network assistance (NA) session with a network element for streaming data from a data source;

receive data from the data source, the data comprising a plurality of data segments, wherein the data represents a virtual reality (VR) environment, and each segment of the plurality of segments represents a tile of the VR environment;

assign relative priorities indicative of at least two different transmission priorities to at least two different data segments of the plurality of data segments, wherein the relative priorities are assigned based on a user's field of view (FOV) with respect to the VR environment, and the control circuit is configured to assign relative priorities by assigning at least one of a first priority corresponding with a first recommended rate to an in-FOV tile, a second priority corresponding with a second recommended rate to a peripheral FOV tile, or a third priority corresponding to a third recommended rate to an out of FOV tile, wherein the first recommended rate corresponds to higher quality video than the second recommended rate, and the second recommended rate corresponds to higher quality video than the third recommended rate; and

inform the network element of the relative priorities.

10. A method of providing network assistance (NA) by a network element during streaming of data from a data source to a streaming client ( 54 ), comprising:

establishing a network assistance (NA) session with the streaming client;

receiving from the streaming client a network assistance request that comprises relative priorities pertaining to at least two different segments of data, wherein the data represents a virtual reality (VR) environment, and each segment of the one or more segments represents a tile of the VR environment, and wherein the relative priorities correspond to a user's field of view (FOV) with respect to the VR environment; and

responding to the streaming client with a network assistance response that provides a recommended rate for at least one of the relative priorities, wherein the recommended rate associates at least one of a first recommended rate with an in field of view (FOV) tile, a second recommended rate with a peripheral FOV tile, or a third recommended rate to an out of FOV tile, wherein the first recommended rate corresponds to higher quality video than the second recommended rate, and the second recommended rate corresponds to higher quality video than the third recommended rate.

11. The method of claim 10 , further comprising:

receiving a highest priority request for an upcoming data segment; and

responding to the highest priority request with a recommended rate for the upcoming data segment.

12. The method of claim 11 , wherein responding to the high priority request includes sending an acknowledgement message indicating whether the recommended rate for the upcoming data segment was assigned as a highest available rate in response to the highest priority request.

13. The method of claim 10 , further comprising providing the streaming client with information specifying an allocation of network resources dedicated for at least one of communication with the network element or downloading the data.

14. The method of claim 13 , wherein the information specifying an allocation of network resources comprises at least one of an access point name, a quality of service indicator, an IP address, a mobile cell ID, or a radio access technology.

15. The method of claim 10 , wherein the network element is configured to provide a NA service that supports network assistance under dynamic adaptive streaming over hypertext transfer protocol (HTTP) (DASH), the network element being a DASH-aware network element (DANE).

Assignments (3)
CHANGE OF NAME Recorded Jan 18, 2022
From: SONY CORPORATION
To: SONY GROUP CORPORATION
Reel/Frame 058752/0890 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2020
From: SONY MOBILE COMMUNICATIONS INC.
To: SONY CORPORATION
Reel/Frame 053912/0656 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 3, 2020
From: LJUNG, RICKARD; KARLSSON, PETER
To: SONY MOBILE COMMUNICATIONS INC.
Reel/Frame 053385/0090 →
Priority Claims (1)
SE 1830058-2 · Feb 22, 2018 · national
Continuity (1)
Related Publication 20210051189A1 · Feb 18, 2021