Lossy video encoding for battery-constrained devices
Systems, methods, and computer readable media for lossy video encoding for battery-constrained devices where the methods performed on a system include accessing a gaze location of a user viewing a first frame of a video on a wearable device, determining a first portion of a second frame based on the gaze location, compressing, in accordance with a first lossy compression standard, the first portion of the second frame to generate a first compressed portion of the second frame, compressing, in accordance with a second lossy compression standard a second portion of the second frame, to generate a second compressed portion of the second frame, the second portion comprising a portion of the second frame not included in the first portion, and causing the first compressed portion and the second compressed portion to be sent wirelessly to the wearable device.
1 . A system comprising:
at least one processor;
at least one memory component storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
accessing at least one gaze location of a user viewing at least one previous frame of a video on a wearable device;
detecting objects in a next frame;
determining a gaze location for the next frame based on the at least one gaze location and at least one object of the objects;
determining a first portion of the next frame based on the gaze location and the at least one object;
compressing, in accordance with a first lossy compression standard, the first portion of the next frame to generate a first compressed portion of the next frame;
compressing, in accordance with a second lossy compression standard, a second portion of the next frame to generate a second compressed portion of the next frame, the second portion comprising a portion of the next frame not included in the first portion; and
causing the first compressed portion and the second compressed portion to be sent wirelessly to the wearable device.
2 . The system of claim 1 , wherein the causing further comprises:
causing an indication of the first lossy compression standard and an indication of the second lossy compression standard to be sent wirelessly to the wearable device.
3 . The system of claim 1 , wherein the first lossy compression standard and the second lossy compression standard are a same lossy compression standard with the first lossy compression standard using parameters of the same lossy compression standard that generate the first compressed portion as less lossy than the second compressed portion.
4 . The system of claim 1 , wherein the operations further comprise:
compressing, in accordance with a third lossy compression standard, a third portion of the next frame to generate a third compressed portion of the next frame, the third portion comprising a portion of the next frame not included in the first portion and not included in the second portion, and wherein the third portion is sent wirelessly to the wearable device.
5 . The system of claim 4 , wherein the first lossy compression standard, the second lossy compression standard, and the third lossy compression standard are a same lossy compression standard with the first lossy compression standard using parameters of the same lossy compression standard that generate the first compressed portion as less lossy than the second compressed portion, and wherein the second lossy compression standard uses parameters of the same lossy compression standard that generate the second compressed portion as less lossy than the third compressed portion.
6 . The system of claim 1 , wherein the first portion and the second portion comprise an entire portion of the next frame.
7 . The system of claim 1 , wherein the first lossy compression standard and the second lossy compression standard are at least one of: an Advanced Video Coding (AVC) lossy compression standard, an H.264 lossy compression standard, a Moving Picture Experts Group (MPEG) lossy compression standard, a Huffman Coding lossy compression standard, a Run-Length Encoding (RLE) lossy compression standard, a Lempel-Ziv-Welch (LZW) lossy compression standard, a Dictionary Coding lossy compression standard, or a proprietary lossy compression standard.
8 . The system of claim 1 , wherein the operations further comprise:
compressing, in accordance with the first lossy compression standard, the at least one object to generate a compressed objects portion; and
adding the compressed objects portion to the first compressed portion of the next frame.
9 . The system of claim 1 , wherein the operations further comprise:
extending the first portion of the next frame based on the at least one object being near the first portion of the next frame.
10 . The system of claim 1 , wherein the determining the first portion of the next frame is further based on a recorded gaze location, the recorded gaze location indicating a gaze location of a user when recording the at least one previous frame.
11 . The system of claim 1 , wherein the operations further comprise:
selecting the first lossy compression standard and the second lossy compression standard based on a bitrate of communications with the wearable device.
12 . A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor of a system, cause the at least one processor to perform operations comprising:
accessing at least one gaze location of a user viewing at least one previous frame of a video on a wearable device;
detecting objects in a next frame;
determining a gaze location for the next frame based on the at least one gaze location and at least one object of the objects;
determining a first portion of the next frame based on the gaze location and the at least one object;
compressing, in accordance with a first lossy compression standard, the first portion of the next frame to generate a first compressed portion of the next frame;
compressing, in accordance with a second lossy compression standard, a second portion of the next frame to generate a second compressed portion of the next frame, the second portion comprising a portion of the next frame not included in the first portion; and
causing the first compressed portion and the second compressed portion to be sent wirelessly to the wearable device.
13 . The non-transitory computer-readable storage medium of claim 12 , wherein the causing further comprises:
causing an indication of the first lossy compression standard and an indication of the second lossy compression standard to be sent wirelessly to the wearable device.
14 . The non-transitory computer-readable storage medium of claim 12 , wherein the first lossy compression standard and the second lossy compression standard are a same lossy compression standard with the first lossy compression standard using parameters of the same lossy compression standard that generate the first compressed portion as less lossy than the second compressed portion.
15 . The non-transitory computer-readable storage medium of claim 12 , wherein the operations further comprise:
compressing, in accordance with a third lossy compression standard, a third portion of the next frame to generate a third compressed portion of the next frame, the third portion comprising a portion of the next frame not included in the first portion and not included in the second portion, and wherein the third portion is sent wirelessly to the wearable device.
16 . The non-transitory computer-readable storage medium of claim 15 , wherein the first lossy compression standard, the second lossy compression standard, and the third lossy compression standard are a same lossy compression standard with the first lossy compression standard using parameters of the same lossy compression standard that generate the first compressed portion as less lossy than the second compressed portion, and wherein the second lossy compression standard uses parameters of the same lossy compression standard that generate the second compressed portion as less lossy than the third compressed portion.
17 . The non-transitory computer-readable storage medium of claim 12 , wherein the first portion and the second portion comprise an entire portion of the next frame.
18 . A method comprising:
accessing at least one gaze location of a user viewing at least one previous first frame of a video on a wearable device;
detecting objects in a next frame;
determining a gaze location for the next frame based on the at least one gaze location and at least one object of the objects;
determining a first portion of the next frame based on the gaze location and the at least one object;
compressing, in accordance with a first lossy compression standard, the first portion of the next frame to generate a first compressed portion of the next frame;
compressing, in accordance with a second lossy compression standard, a second portion of the next frame to generate a second compressed portion of the next frame, the second portion comprising a portion of the next frame not included in the first portion; and
causing the first compressed portion and the second compressed portion to be sent wirelessly to the wearable device.
19 . The method of claim 18 , wherein the causing further comprises:
causing an indication of the first lossy compression standard and an indication of the second lossy compression standard to be sent wirelessly to the wearable device.
20 . The method of claim 18 , wherein the first lossy compression standard and the second lossy compression standard are a same lossy compression standard with the first lossy compression standard using parameters of the same lossy compression standard that generate the first compressed portion as less lossy than the second compressed portion.