IP Library › Granted Patent US 12,475,628
Granted Patent B2
US 12,475,628 · App. 18/255,934 · Granted Nov 18, 2025

Methods, user equipment and apparatus for controlling VR image in a communication network

Inventors: Devaki Chandramouli (Plano, TX); Kalle Petteri Kela (Kaarina, FI); Benoist Pierre Sebire (Tokyo, JP)
Assignee: Nokia Technologies Oy
G06T15/00G06T7/0002H04L65/80H04N13/117G06T2207/30168
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,628
App. No.
18/255,934
Granted
Nov 18, 2025
Kind
B2
Abstract

Methods, user equipment and apparatus for controlling VR image in a communication network. The VR image is represented by image data being associated to respective parts of the image. The VR image data is handled on the basis of identifications indicating different viewports for a user.

Claims (61)

1 . An apparatus, comprising:

at least one processor; and

at least one memory including computer program code;

the at least one memory and the computer code are configured to, with the at least one processor, cause the apparatus at least to:

determine at least two viewports for a user, each of the at least two user viewports corresponding to a portion of a Virtual Reality (VR) image to be provided to the user, wherein the VR image is represented by image data, and wherein the image data comprises at least two image part data, each of the at least two image part data being associated with a respective part of the VR image;

associate a viewport identification with each of the at least two user viewports;

determine, for each of the at least two user viewports, image part data including an image portion of the VR image to be provided to or received from the user;

associate the viewport identifications respectively to the image part data determined for the user viewport; and

agree, between a network node and a user equipment of the user, that rules with respect to quality of service for each of the at least two user viewports are applied to an uplink communication from the user equipment to the network node for each corresponding viewport of the at least two user viewports.

2 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

create a packet detection rule based on the viewport identification for detecting traffic of a portion of the VR image associated with the viewport identification.

3 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data to the user according to the corresponding associated viewport identification.

4 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data to the user by

creating a separate data flow for each of the at least two image part data, wherein each of the separate data flows supports a quality of service corresponding to the viewport identification associated with respective image part data.

5 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data to the user by

creating a common data flow supporting a common quality of service, wherein the common quality of service supports an image quality at least corresponding to a best image quality of one of the viewport identifications, and

the image part data is provided in association with respective viewport identification.

6 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data to the user by

defining at least two data flows, each of the two data flows having a quality of service, and

mapping the image part data to one of the at least two data flows based on the viewpoint identification.

7 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data to the user by

defining a common data flow for the image data, wherein the common data flow is associated with multiple 5G quality of service (QOS) identifiers associated with the respective viewport identification, and

mapping the image part data to different data radio bearers (DRBs) based on respective 5G QoS identifier and the viewpoint identification.

8 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

map each data flow to a data radio bearer supporting a quality of service of respective data flow and the viewport identification.

9 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

mark a packet of each data flow with the viewport identification in a GPRS Tunneling Protocol (GTP) header based on a packet detecting rule.

10 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

include the viewport identification in a Medium Access Control (MAC) control element.

11 . The apparatus according to claim 10 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

include the viewport identification in an enhanced buffer status report (eBSR) or packet data convergence protocol (PDCP) control packet unit by the user equipment.

12 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data by

associating an image quality indicator to the image part data, and

transmitting the image part data together with a respective image quality indicator via a common data flow supporting a common quality of service.

13 . The apparatus according to claim 12 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

map the image part data to a data radio bearer supporting a quality of service of the respective image quality indicator.

14 . The apparatus according to claim 1 , wherein the at least one memory and the computer code are further configured to, with the at least one processor, cause the apparatus at least to:

provide, from the network node to the user equipment, the image part data by

transmitting the viewport identifications from the user equipment to the network node,

wherein the apparatus is caused to determine, for each of the at least two user viewports, the image part data including image data of the image portion to be provided to the user, based on the viewport identifications received from the user.

15 . The apparatus according to claim 1 , wherein the apparatus comprises the network node or the user equipment.

16 . The apparatus according to claim 1 , wherein the apparatus comprises the network node comprising at least one of a user plane function (UPF), a session management function (SMF), an application function (AF), a policy control function (PCF), or a base station.

17 . A user equipment, comprising:

at least one processor; and

at least one memory including computer program code;

the at least one memory and the computer code are configured to, with the at least one processor, cause the user equipment at least to:

determine at least two viewports for a user, each of the at least two user viewports corresponding to a portion of a Virtual Reality (VR) image to be provided to the user, wherein the VR image is represented by image data, and wherein the image data comprises at least two image part data, each of the at least two image part data being associated with a respective part of the VR image;

associate a viewport identification with each of the at least two user viewports;

agree, between a network node and the user equipment of the user, that rules with respect to quality of service for each of the at least two user viewports are applied to an uplink communication from the user equipment to the network node for each corresponding viewport of the at least two user viewports; and

transmit the associated viewport identifications to the network node.

18 . A method of operating a user equipment, comprising:

determining at least two viewports for a user, each of the at least two user viewports corresponds to a portion of a Virtual Reality (VR) image to be provided to the user, wherein the VR image is represented by image data, and wherein the image data comprises at least two image part data, each of the at least two image part data being associated with a respective part of the VR image;

associating a viewport identification with each of the at least two user viewports;

agreeing, between a network node and a user equipment of the user, that rules with respect to quality of service for each of the at least two user viewports are applied to uplink communication from the user equipment to the network node for each corresponding viewport of the at least two user viewports; and

transmitting the associated viewport identifications to the network node.

Assignments (6)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: CHANDRAMOULI, DEVAKI
To: NOKIA OF AMERICA CORPORATION
Reel/Frame 064147/0782 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: SEBIRE, BENOIST
To: NOKIA SOLUTIONS AND NETWORKS JAPAN G.K.
Reel/Frame 064147/0785 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: PETTERI KELA, KALLE
To: NOKIA SOLUTIONS AND NETWORKS OY
Reel/Frame 064147/0811 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: NOKIA OF AMERICA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 064147/0844 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: NOKIA SOLUTIONS AND NETWORKS JAPAN G.K.
To: NOKIA TECHNOLOGIES OY
Reel/Frame 064147/0855 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 5, 2023
From: NOKIA SOLUTIONS AND NETWORKS OY
To: NOKIA TECHNOLOGIES OY
Reel/Frame 064147/0859 →
Continuity (1)
Related Publication 20240037833A1 · Feb 1, 2024
References Cited (6)
US 10785674B2 · Cakulev · 2020 [cited by examiner]
US 11044643B2 · Centonza · 2021 [cited by examiner]
US 20200210764A1 · Hamedi · 2020 [cited by examiner]
US 20210067758A1 · Choi · 2021 [cited by examiner]
Chen, Mingzhe, Walid Saad, and Changchuan Yin. “Virtual reality over wireless networks: Quality-of-service model and learning-based resource management.” IEEE Transactions on Communications 66.11 (2018): 5621-5635. (Yea… [cited by examiner]
Tsioliaridou, Ageliki, et al. “Packet routing in 3D nanonetworks: A lightweight, linear-path scheme.” Nano communication networks 12 (2017): 63-71. (Year: 2017). [cited by examiner]