METHOD, APPARATUS AND STREAM FOR IMMERSIVE VIDEO FORMAT
Method and device for generating a stream from image(s) of an object is disclosed. The method includes the steps of obtaining data associated with points of a point cloud representing at least a part of the object, obtaining a parametric surface according to at least a geometric characteristic associated with the at least a part of the object and pose information of an acquisition device used to acquire the at least one image, obtaining a height map and one or more texture maps associated with the parametric surface, and generating the stream by combining together a first syntax element relative to the at least a parameter, a second syntax element relative to the height map, a third syntax element relative to the at least one texture map and a fourth syntax element relative to a position of the acquisition device. The disclosure relates further to a method and device for rendering an image of the object from the stream thus obtained.
1 . A method of generating a stream from at least one image of an object of a scene, the method comprising:
obtaining data associated with points of a point cloud representing at least a part of said object;
obtaining parameters representative of a parametric surface according to at least a geometric characteristic associated with said at least a part of the object and pose information of an acquisition device used to acquire said at least one image, said at least a geometric characteristic being obtained from said data associated with points of said point cloud associated with said at least a part of the object;
obtaining a height map associated with said parametric surface from said data, said height map comprising information representative of distance between said at least a part of the object and said parametric surface;
obtaining at least one color map associated with said parametric surface from color information associated with points of said point cloud associated with said at least a part of the object;
generating said stream by combining together a first syntax element relative to the parameters, a second syntax element relative to the height map, a third syntax element relative to the at least one color map and a fourth syntax element relative to a position of said acquisition device.
2 . The method according to claim 1 , wherein said point cloud represents said object as seen from a range of points of view.
3 . The method according to claim 1 , wherein said parameters vary over time according to a deformation of said at least a part of the object.
4 . A device configured to generate a stream from at least one image of an object of a scene, the device comprising a memory associated with at least one processor configured to:
obtain data associated with points of a point cloud representing at least a part of said object;
obtain parameters representative of a parametric surface according to at least a geometric characteristic associated with said at least a part of the object and pose information of an acquisition device used to acquire said at least one image, said at least a geometric characteristic being obtained from said data associated with points of said point cloud associated with said at least a part of the object;
obtain a height map associated with said parametric surface from said data, said height map comprising information representative of distance between said at least a part of the object and said parametric surface;
obtain at least one color map associated with said parametric surface from color information associated with points of said point cloud associated with said at least a part of the object;
generate said stream by combining together a first syntax element relative to the parameters, a second syntax element relative to the height map, a third syntax element relative to the at least one color map and a fourth syntax element relative to a position of said acquisition device.
5 . The method according to claim 4 , wherein said point cloud represents said object as seen from a range of points of view.
6 . The device according to claim 4 , wherein said at least a parameter varies over time according to a deformation of said at least a part of the object.
7 . A stream carrying first data representative of an object of a scene, wherein the data comprises:
a first syntax element relative to parameters representative of a parametric surface obtained according to at least a geometric characteristic associated with said at least a part of the object and pose information of an acquisition device used to acquire said at least one image, said at least a geometric characteristic being obtained from said data associated with points of said point cloud associated with said at least a part of the object;
a second syntax element relative to a height map obtained from second data associated with points of a point cloud representing said at least a part of the object, the height map comprising information representative of distance between said at least a part of the object and said parametric surface;
a third syntax element relative to at least one color map obtained from said color information associated with points of said point cloud associated with said at least a part of the object; and
a fourth syntax element relative to a position of said acquisition device.
8 . The stream according to claim 7 , wherein said point cloud represents said object as seen from a range of points of view.
9 . The stream according to claim 7 , wherein said first syntax element varies over time according to a change of said at least a parameter that varies according to a deformation of said at least a part of the object.
10 . A method of rendering an image of at least a part of an object from a stream carrying data representative of said object, the method comprising:
obtaining parameters representative of a parametric surface from a first syntax element of the stream;
obtaining a height map from a second syntax element of the stream, the height map comprising information representative of distance between said at least a part of the object and said parametric surface;
obtaining at least one color map from a third syntax element of the stream;
obtaining data associated with points of a point cloud representing said at least a part of the object from said parametric surface, said height map and said at least one color map;
rendering said image based on said data and information representative of a position of an acquisition device from a fourth syntax element of the stream.
11 . The method according to claim 10 , wherein said point cloud represents said object as seen from a range of points of view.
12 . The method according to claim 10 , wherein the rendering comprises splat rendering of said data.
13 . A device configured to render an image of at least a part of an object from a stream carrying data representative of said object, the device comprising a memory associated with at least one processor configured to:
obtain parameters representative of a parametric surface from a first syntax element of the stream;
obtain a height map from a second syntax element of the stream, the height map comprising information representative of distance between said at least a part of the object and said parametric surface;
obtain at least one color map from a third syntax element of the stream;
obtain data associated with points of a point cloud representing said at least a part of the object from said parametric surface, said height map and said at least one color map;
render said image based on said data and information representative of a position of an acquisition device from a fourth syntax element of the stream.
14 . The device according to claim 13 , wherein said point cloud represents said object as seen from a range of points of view
15 . The device according to claim 13 , wherein the at least one processor is further configured to perform splat rendering of said data to render said image.