Systems and methods for multiple bit rate content encoding
Systems and methods for encoding a video stream at multiple bit rates is disclosed herein. An encoder divides each frame of a video stream into a plurality of portions and allocates an available number of bits between the plurality of portions based on user preference information. Portions having one or more objects of interest to the viewer determined based on the user preference information are allocated a higher number of available bits while portions of the frames that do not include one or more objects of interest are allocated a minimum number of bits from the available bits.
1 . A method comprising:
receiving, at a server from a requesting device, a request to display a content item;
receiving, at the server from the requesting device, an image of an environment in which the content item is requested for display;
accessing the content item, the content item comprising a plurality of frames;
analyzing, by the server, a frame of the plurality of frames to identify, based on the image of the environment in which the content item is requested for display, (a) a key portion of the frame and (b) a non-key portion of the frame;
encoding, by the server, the frame by allocating a higher number of bits to the key portion of the frame and a lower number of bits to the non-key portion of the frame; and
transmitting, by the server, the encoded frame for display by the requesting device.
2 . The method of claim 1 , wherein the requesting device comprises a camera, and wherein the method further comprises:
capturing, using the camera of the requesting device, an image of a room in which the content item is requested to be displayed by the requesting device; and
receiving, from the requesting device, the image of the room, wherein the image of the room is the image of the environment in which the content item is requested for display.
3 . The method of claim 2 , further comprising:
analyzing the image of the room to identify a color of clothing worn by a person in the image of the room; and
identifying the key portion of the frame by comparing the color of the clothing worn by the person in the image of the room to one or more colors in the frame.
4 . The method of claim 2 , further comprising:
identifying, based on the image of the room, a sports team associated with clothing worn by a person in the image; and
identifying the key portion of the frame based on the identified sports team.
5 . The method of claim 1 , further comprising:
identifying the key portion of the frame based on the image of the environment in which the content item is requested for display, and based on a user profile associated with the request to display the content item.
6 . The method of claim 1 , further comprising:
identifying the key portion of the frame, and then identifying the non-key portion as any portion of the frame other than the key portion.
7 . The method of claim 1 , further comprising:
determining network conditions for a communications network for encoding the frame; and
calculating an available number of bits for the frame based on the network conditions.
8 . The method of claim 7 , wherein allocating the lower number of bits to the non-key portion of the frame comprises allocating a predefined number of bits of the calculated available number of bits, and wherein allocating the higher number of bits to the key portion of the frame comprises allocating a remaining number of bits of the calculated available number of bits.
9 . The method of claim 1 , wherein the content item is a live video stream.
10 . The method of claim 1 , further comprising:
generating a color map corresponding to the frame;
comparing the color map to the image of the environment in which the content item is request for display; and
identifying the key portion and the non-key portion based on the comparison.
11 . A system comprising:
communication circuitry configured to:
receive, from a requesting device, a request to display a content item; and
receive an image of an environment in which the content item is requested for display; and
control circuitry configured to:
access the content item, the content item comprising a plurality of frames;
analyze a frame of the plurality of frames to identify, based on the image of the environment in which the content item is requested for display, (a) a key portion of the frame and (b) a non-key portion of the frame; and
encode the frame by allocating a higher number of bits to the key portion of the frame and a lower number of bits to the non-key portion of the frame,
wherein the communication circuitry is further configured to transmit the encoded frame to the requesting device for display by the requesting device.
12 . The system of claim 11 , wherein the requesting device comprises a camera configured to capture an image of a room in which the content item is requested to be displayed by the requesting device, wherein the image of the room is the image of the environment in which the content item is requested for display, and wherein the communication circuitry is further configured to receive the image of the room.
13 . The system of claim 12 , wherein the control circuitry is further configured to:
analyze the image of the room to identify a color of clothing worn by a person in the image of the room; and
identify the key portion of the frame by comparing the color of the clothing worn by the person in the image of the room to one or more colors of the frame.
14 . The system of claim 12 , wherein the control circuitry is further configured to:
identify, based on the image of the room, a sports team associated with clothing worn by a person in the image; and
identify the key portion of the frame based on the identified sports team.
15 . The system of claim 11 , wherein the control circuitry is further configured to:
identify the key portion of the frame based on the image of the environment in which the content item is requested for display, and based on a user profile associated with the request to display the content item.
16 . The system of claim 11 , wherein the control circuitry is further configured to:
identify the key portion of the frame, and then identify the non-key portion as any portion of the frame other than the key portion.
17 . The system of claim 11 , wherein the control circuitry is further configured to:
determine network conditions for a communications network for encoding the frame; and
calculate an available number of bits for the frame based on the network conditions.
18 . The system of claim 17 , wherein the control circuitry is configured to allocate the lower number of bits to the non-key portion of the frame by allocating a predefined number of bits of the calculated available number of bits, and allocate the higher number of bits to the key portion of the frame by allocating a remaining number of bits of the calculated available number of bits.
19 . The system of claim 11 , wherein the content item is a live video stream.
20 . The system of claim 11 , wherein the control circuitry is further configured to:
generate a color map corresponding to the frame;
compare the color map to the image of the environment in which the content item is request for display; and
identify the key portion and the non-key portion based on the comparison.