Granted Patent B2

US 12,464,172 · App. 17/768,598 · Granted Nov 4, 2025

Inventors: Saba Ahsan (Espoo, FI); Igor Danilo Diego Curcio (Tampere, FI); Ari Hourunranta (Tampere, FI)

Assignee: Nokia Technologies Oy

H04N21/21805H04N21/234345H04N21/41407H04N21/6587H04N21/816

Abstract

Claims (65)

1 . A method comprising:

receiving, from a client device, a message comprising one or more margin parameters associated with a margin area;

in response to the message, causing transmission of panoramic video content in accordance with the one or more margin parameters to the client device;

receiving viewport data and at least one motion signal from the client device;

determining, based on the viewport data and the at least one motion signal and at least one of video content or audio content associated with the panoramic video content, an updated margin area for the panoramic video content, wherein the updated margin area is determined further based on at least one threshold for an acceleration of the client device, wherein the acceleration is determined based, at least partially, on the at least one motion signal; and

causing transmission of updated panoramic video content based on the updated margin area for display.

2 . A method according to claim 1 , further comprising:

causing transmission, to the client device, of an offer comprising one or more video quality parameters, wherein the message is received in response to the offer, wherein the offer comprises a session description protocol offer; and wherein the transmission of the panoramic video content is further based on the one or more video quality parameters.

3 . A method according to claim 2 , further comprising:

determining, based at least on the updated margin area, one or more updated video quality parameters associated with the updated panoramic video content, wherein the updated panoramic video content is transmitted in further accordance with the one or more updated video quality parameters.

4 . A method according to claim 1 , wherein the at least one motion signal comprises at least one of: an orientation value, a speed value, or an acceleration value; and wherein the viewport data comprises an orientation of the client device.

5 . A method according to claim 1 , wherein the one or more margin parameters of an acceptance message comprise at least one of the following:

one or more maximum values at which a respective margin of the panoramic video content is extendible; or

one or more minimum values at which the respective margin of the panoramic video content is extendible.

6 . A method according to claim 5 , wherein the one or more margin parameters of the acceptance message are associated with a fixed-size margin area, further comprising:

determining one or more updated margin parameters for the updated panoramic video content in accordance with the fixed-size margin area.

7 . A method according to claim 1 , wherein the margin area around a viewport area is extended unevenly according to head turning direction and direction of an updated viewport.

8 . The method of claim 1 , wherein the updated panoramic video content is caused to be transmitted to the client device via a source device.

9 . An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:

receive a message comprising one or more margin parameters associated with a margin area;

in response to the message, cause transmission of panoramic video content in accordance with the one or more margin parameters;

receive viewport data and at least one motion signal;

determine, based on the viewport data and the at least one motion signal and at least one of video content or audio content associated with the panoramic video content, an updated margin area for the panoramic video content, wherein the updated margin area is determined further based on at least one threshold for an acceleration of the client device, wherein the acceleration is determined based, at least partially, on the at least one motion signal; and

cause transmission of updated panoramic video content based on the updated margin area for display.

10 . An apparatus according to claim 9 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:

cause transmission of an offer comprising one or more video quality parameters, wherein the message is received in response to the offer, wherein the offer comprises a session description protocol offer, and wherein the transmission of the panoramic video content is further based on the one or more video quality parameters.

11 . An apparatus according to claim 9 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:

determine, based at least on the updated margin area, one or more updated video quality parameters associated with the updated panoramic video content, wherein the updated panoramic video content is transmitted in further accordance with the one or more updated video quality parameters.

12 . An apparatus according to claim 9 , wherein the at least one motion signal comprises at least one of: an orientation value, a speed value, or an acceleration value; and wherein the viewport data comprises an orientation of the client device.

13 . An apparatus according to claim 9 , wherein the one or more margin parameters of an acceptance message comprise at least one of the following:

one or more maximum values at which a respective margin of the panoramic video content is extendible, or

one or more minimum values at which the respective margin of the panoramic video content is extendible.

14 . An apparatus according to claim 13 , wherein the one or more margin parameters of the acceptance message are associated with a fixed-size margin area, wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:

determine one or more updated margin parameters for the updated panoramic video content in accordance with the fixed-size margin area.

15 . A method comprising:

receiving, at a client device, panoramic video content from a source device;

determining, at the client device, at least one motion signal;

determining, based on the at least one motion signal, a viewport area, a margin area, and a background area for the panoramic video content, wherein a width of the margin area is increased based at least on a direction of the at least one motion signal;

determining a respective quality level for the viewport area, the margin area, and the background area;

causing reception of an updated panoramic video content at the client device, wherein the updated panoramic video content is based on the viewport area, the margin area, and the background area and in accordance with the respective quality level for the viewport area, the margin area, and the background area, wherein an updated margin area of the updated panoramic video content is based, at least partially, on at least one of video content or audio content associated with the panoramic video content, and further based on at least one threshold for an acceleration of the client device, wherein the acceleration is determined based, at least partially, on the at least one motion signal; and

causing rendering of the updated panoramic video content for display.

16 . A method according to claim 15 ,

wherein the at least one motion signal comprises data associated with the direction and an acceleration value;

wherein the width of the margin area is increased based at least on the direction and the acceleration value of the at least one motion signal;

wherein the panoramic video content is tile-based;

wherein the viewport area, the margin area, and the background area respectively comprise a subset of tiles of a plurality of tiles associated with the panoramic video content; and

wherein the client device comprises a head-mounted display.

17 . An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:

receive panoramic video content;

determine at least one motion signal;

determine, based on the at least one motion signal, a viewport area, a margin area, and background area for the panoramic video content, wherein a width of the margin area is increased based at least on a direction of the at least one motion signal;

determine a respective quality level for the viewport area, the margin area, and the background area;

cause reception of an updated panoramic video content at the client device, wherein the updated panoramic video content is based on the viewport area, the margin area, and the background area and in accordance with the respective quality level for the viewport area, the margin area, and the background area, wherein an updated margin area of the updated panoramic video content is based, at least partially, on at least one of video content or audio content associated with the panoramic video content, and further based on at least one threshold for an acceleration of the client device, wherein the acceleration is determined based, at least partially, on the at least one motion signal; and

cause rendering of the updated panoramic video content for display.

18 . An apparatus according to claim 17 ,

wherein the at least one motion signal comprises data associated with the direction and an acceleration value;

wherein the width of the margin area is increased based at least on the direction and the acceleration value of the at least one motion signal;

wherein the panoramic video content is tile-based;

wherein the viewport area, the margin area, and the background area respectively comprise a subset of tiles of a plurality of tiles associated with the panoramic video content.

19 . A computer program product comprising a non-transitory computer readable storage medium having program code portions stored thereon, the program code portions configured, upon execution, to cause the method as claimed in claim 1 to be performed.

20 . A computer program product comprising a non-transitory computer readable storage medium having program code portions stored thereon, the program code portions configured, upon execution, to cause the method as claimed in claim 15 to be performed.

Assignments (1)

Continuity (2)

References Cited (12)