Client-server communication for live filtering in a camera view
Provided are mechanisms and processes for performing live filtering in a camera view via client-server communication. In one example, a first video frame in a raw video stream is transmitted from a client device to a server. The client device receives a filter processing message associated with the first video frame that includes filter data for applying a filter to the first video frame. A processor at the client device creates a filtered video stream by applying the filter to a second video frame that occurs in the video stream later than the first video frame.
1. A method implemented at a client device, the method comprising:
automatically transmitting a first video frame in a raw video stream from the client device to a server via a network;
in response to the automatically transmitting the first video frame, receiving from the server a filter processing message associated with the first video frame, the filter processing message including filter data for applying a filter using the filter data to the first video frame, wherein the filter processing message is received at the client device while a second video frame is being processed at the client device, wherein the raw video stream comprises the first video frame and the second video frame;
creating a filtered video stream in real time via a processor at the client device by applying the filter directly to the second video frame in the raw video stream, wherein the first video frame precedes the second video frame in the video stream, wherein the second video frame comes directly from the raw video stream without being transmitted to the server or another device; and
presenting the filtered video stream as a live video on display screen of the client device.
2. The method of claim 1 , wherein the raw video frame captured live by the client device.
3. The method of claim 1 , wherein the filter is applied to the second video frame by propagating information from the first video frame to the second video frame.
4. The method of claim 1 , wherein the second video frame is neither transmitted nor received from the server at the time the filter processing message is received from the server.
5. The method of claim 1 , wherein the first video frame is captured at the client device and then subsequently transmitted to the server.
6. A system comprising:
a processor; and
memory comprising instructions to cause the processor to execute operations comprising:
automatically transmitting a first video frame in a raw video stream from a client device to a server via a network;
in response to the automatically transmitting the first video frame, receiving from the server a filter processing message associated with the first video frame, the filter processing message including filter data for applying a filter using the filter data to the first video frame, wherein the filter processing message is received at the client device while a second video frame is being processed at the client device, wherein the raw video stream comprises the first video frame and the second video frame;
creating a filtered video stream in real time via a processor at the client device by applying the filter directly to the second video frame in the raw video stream, wherein the first video frame precedes the second video frame in the video stream, wherein the second video frame comes directly from the raw video stream without being transmitted to the server or another device; and
presenting the filtered video stream as a live video on a display screen of the client device.
7. The system of claim 6 , wherein the raw video frame captured live by the client device.
8. The system of claim 6 , wherein the filter is applied to the second video frame by propagating information from the first video frame to the second video frame.
9. The system of claim 6 , wherein the second video frame is neither transmitted nor received from the server at the time the filter processing message is received from the server.
10. The system of claim 6 , wherein the first video frame is captured at the client device and then subsequently transmitted to the server.
11. A non-transitory computer readable medium comprising instructions that are executed by a processor to perform operations, the operations comprising:
automatically transmitting a first video frame in a raw video stream from a client device to a server via a network;
in response to the automatically transmitting the first video frame, receiving from the server a filter processing message associated with the first video frame, the filter processing message including filter data for applying a filter using the filter data to the first video frame, wherein the filter processing message is received at the client device while a second video frame is being processed at the client device, wherein the raw video stream comprises the first video frame and the second video frame;
creating a filtered video stream in real time via a processor at the client device by applying the filter directly to the second video frame in the raw video stream, wherein the first video frame precedes the second video frame in the video stream, wherein the second video frame comes directly from the raw video stream without being transmitted to the server or another device; and
presenting the filtered video stream as a live video on a display screen of the client device.
12. The non-transitory computer readable medium of claim 11 , wherein the raw video frame captured live by the client device.
13. The non-transitory computer readable medium of claim 11 , wherein the filter is applied to the second video frame by propagating information from the first video frame to the second video frame.
14. The non-transitory computer readable medium of claim 11 , wherein the second video frame is neither transmitted nor received from the server at the time the filter processing message is received from the server.