Backward-compatible 3D messaging
An example server device for sending media data includes a memory configured to store media data; and a processing system implemented in circuitry and configured to: receive a set of three-dimensional (3D) media data being sent to a client device; transcode the set of 3D media data to a set of one or more images; and send the set of one or more images to the client device. The server device may receive a message from a source client device destined for the client device, where the message includes the 3D media data. The message may be a Multimedia Message Service (MMS) message including the 3D media data. The client device may initially provide data representing rendering capabilities of the client device to the server device, such that the server device may determine that the client device is not capable of rendering the 3D media data.
1 . A method of sending media data, the method comprising:
receiving, by a server device, a set of three-dimensional (3D) media data being sent to a client device;
transcoding, by the server device, the set of 3D media data to a set of one or more images;
sending, by the server device, the set of one or more images to the client device; and
receiving data indicative of a camera path along which to render the set of one or more images, the camera path including an initial pose associated with a virtual camera.
2 . The method of claim 1 , further comprising determining that the client device is not capable of rendering the set of 3D media data.
3 . The method of claim 2 , wherein determining that the client device is not capable of rendering the set of 3D media data comprises receiving data from the client device representing rendering capabilities of the client device.
4 . The method of claim 1 , wherein the client device comprises a first client device, and wherein receiving the set of 3D media data comprises receiving the set of 3D media data from a second client device as a message from the second client device to the first client device.
5 . The method of claim 4 , wherein the message includes one or more multimedia messaging body parts (MMBPs), at least one of the MMBPs including the 3D media data.
6 . The method of claim 4 , wherein receiving the set of 3D media data as a message comprises receiving a Multimedia Message Service (MMS) message.
7 . The method of claim 6 , wherein the MMS message is formatted as a multi-part Multipurpose Internet Mail Extensions (MIME) message.
8 . The method of claim 6 , wherein the MMS message includes a Graphics Library Transmission Format (glTF) or a Graphics Library Transmission Format Binary (glB) file including the 3D media data.
9 . The method of claim 1 , wherein the camera path further includes a set of pose and time sample pairs, where each pair among the set of pose and time sample pairs provides a pose for the virtual camera and a time offset at which to activate the pose.
10 . The method of claim 1 , wherein the camera path further includes a description of the camera path including a shape of each segment of the camera path and a velocity of camera movement along each segment.
11 . The method of claim 1 , wherein transcoding the 3D media data comprises forming a High Efficiency Image File (HEIF) encoded image sequence including the set of one or more images.
12 . The method of claim 1 , wherein transcoding the 3D media data comprises rendering the set of one or more images to include an alpha channel corresponding to portions of images around one or more 3D objects of the 3D media data.
13 . A server device for sending media data, the server device comprising:
a memory configured to store the media data; and
a processing system implemented in circuitry and configured to:
receive a set of three-dimensional (3D) media data being sent to a client device;
transcode the set of 3D media data to a set of one or more images;
send the set of one or more images to the client device; and
receive data indicative of a camera path along which to render the set of one or more images, the camera path including an initial pose associated with a virtual camera.
14 . The server device of claim 13 , wherein the processing system is further configured to receive data, from the client device, representing rendering capabilities of the client device and indicating that the client device is not capable of rendering the set of 3D media data.
15 . The server device of claim 13 , wherein the client device comprises a first client device, and wherein to receive the set of 3D media data, the processing system is configured to receive the set of 3D media data from a second client device as a message from the second client device to the first client device.
16 . The server device of claim 15 , wherein the message includes one or more multimedia messaging body parts (MMBPs), at least one of the MMBPs including the 3D media data.
17 . The server device of claim 15 , wherein the message comprises a Multimedia Message Service (MMS) message, the MMS message including a Graphics Library Transmission Format (glTF) or a Graphics Library Transmission Format Binary (glB) file including the 3D media data.