METHODS, SERVERS AND DEVICES FOR TRANSMITTING AND RENDERING MULTIPLE VIEWS COMPRISING NON-DIFFUSE OBJECTS

1 . A method of media processing, comprising:

encoding, by processing circuitry of a server device, first media data of a basic view of a scene and second media data of an alternate view of the scene into a bitstream, the second media data lacking reflectance information for one or more non-diffuse objects of the scene in the alternate view;

generating non-diffuse data that indicates the reflectance information for the one or more non-diffuse objects of the scene, the non-diffuse data including a first number of data pieces that indicate the reflectance information, the first number being smaller than a second number of pixels in the one or more non-diffuse objects; and

transmitting the bitstream and the non-diffuse data to a client device.

2 . The method of claim 1 , wherein the generating the non-diffuse data further comprises:

selecting a portion of the pixels in the one or more non-diffuse objects; and

generating the non-diffuse data that includes the reflectance information of the portion of the pixels in the one or more non-diffuse objects.

3 . The method of claim 2 , wherein the selecting the portion of the pixels in the one or more non-diffuse objects further comprises:

selecting the portion of the pixels according to at least one of a pixel processing rate of the client device or a transmission rate between the server device and the client device.

4 . The method of claim 2 , wherein the selecting the portion of the pixels in the one or more non-diffuse objects further comprises:

selecting the portion of the pixels based on differences of first textures of the pixels in the basic view and second textures of the pixels in the alternate view.

5 . The method of claim 2 , wherein the selecting the portion of the pixels in the one or more non-diffuse objects further comprises:

associating the pixels in the one or more non-diffuse objects to epipolar plane image lines;

determining respective values for the epipolar plane image lines; and

selecting the portion of the pixels according to the respective values for the epipolar plane image lines.

6 . The method of claim 1 , further comprises:

selecting an encoding scheme for coding the non-diffuse data according to at least one of a pixel processing rate of the client device or a transmission rate between the server device and the client device.

7 . The method of claim 1 , wherein the non-diffuse data comprises the data pieces for the reflectance information respectively corresponding to the one or more non-diffuse objects.

8 . The method of claim 7 , wherein one of the data pieces for the reflectance information corresponding to a non-diffuse object in the one or more non-diffuse objects comprises a texture difference of the non-diffuse object in the basic view and the alternate view.

9 . The method of claim 7 , wherein one of the data pieces for the reflectance information corresponding to a non-diffuse object in the one or more non-diffuse objects comprises a set of parameters of a reflectance model of the non-diffuse object.

10 . The method of claim 1 , wherein the generating the non-diffuse data further comprises:

receiving a position for a specific view of the scene;

generating the specific view associated with the position; and

generating the non-diffuse data that indicates the reflectance information for the one or more non-diffuse objects in the specific view.

11 . The method of claim 10 , wherein the non-diffuse data comprises a difference of a first texture of a non-diffuse object of the one or more non-diffuse objects in the specific view and a second texture of the non-diffuse object in at least one of the basic view or the alternate view.

12 . The method of claim 10 , wherein the generating the specific view further comprises:

computing a texture of a non-diffuse object of the one or more non-diffuse objects in the specific view as a weighted average of a first texture of the non-diffuse object in the basic view and a second texture of the non-diffuse object in the alternate view.

13 . A server device for media processing, comprising processing circuitry configured to:

encode first media data of a basic view of a scene and second media data of an alternate view of the scene into a bitstream, the second media data lacking reflectance information for one or more non-diffuse objects of the scene in the alternate view;

generate non-diffuse data that indicates the reflectance information for the one or more non-diffuse objects of the scene, the non-diffuse data including a first number of data pieces for the reflectance information, the first number being smaller than a second number of pixels in the one or more non-diffuse objects; and

transmit the bitstream and the non-diffuse data to a client device.

14 . The server device of claim 13 , wherein the processing circuitry is configured to:

select a portion of the pixels in the one or more non-diffuse objects; and

generate the non-diffuse data that includes the reflectance information of the portion of the pixels in the one or more non-diffuse objects.

15 . The server device of claim 14 , wherein the processing circuitry is configured to:

select the portion of the pixels according to at least one of a pixel processing rate of the client device or a transmission rate between the server device and the client device.

16 . The server device of claim 14 , wherein the processing circuitry is configured to:

select the portion of the pixels based on differences of first textures of the pixels in the basic view and second textures of the pixels in the alternate view.

17 . The server device of claim 13 , wherein the processing circuitry is configured to:

select an encoding scheme for coding the non-diffuse data according to at least one of a pixel processing rate of the client device or a transmission rate between the server device and the client device.

18 . The server device of claim 13 , wherein the non-diffuse data comprises the data pieces for the reflectance information respectively corresponding to the one or more non-diffuse objects.

19 . The server device of claim 13 , wherein the processing circuitry is configured to:

receive a position for a specific view of the scene;

generate the specific view associated with the position; and

generate the non-diffuse data that indicates the reflectance information for the one or more non-diffuse objects in the specific view.

20 . A non-transitory computer-readable storage medium storing instructions which when executed by at least one processor in a server device cause the server device to perform:

encoding first media data of a basic view of a scene and second media data of an alternate view of the scene into a bitstream, the second media data lacking reflectance information for one or more non-diffuse objects of the scene in the alternate view;

generating non-diffuse data that indicates the reflectance information for the one or more non-diffuse objects of the scene, the non-diffuse data including a first number of pieces for the reflectance information, the first number being smaller than a second number of pixels in the one or more non-diffuse objects; and

transmitting the bitstream and the non-diffuse data to a client device.