Video compression system
View Patent ↗A video compression system is disclosed that is optimized to take advantage of the types of redundancies typically occurring on computer screens and the types of video loss acceptable to real time interactive computer users. It automatically adapts to a wide variety of changing network bandwidth conditions and can accommodate any video resolution and an unlimited number of colors. The disclosed video compression encoder can be implemented with either hardware or software and it compresses the source video into a series of data packets that are a fixed length of 8 bits or more. Sequences of one or more of these packets create unique encoding “commands” that can be sent over any network and easily decoded (decompressed) with either software or hardware. The commands include 3 dimensional copying (horizontal, vertical and time) and unique efficiencies for screen segments that are comprised of only two colors (such as text). Embodiments are also disclosed that improve the video compression depending on the popularity of pixel colors.
1. A video system receiving a source of serial video data defined by 2 a available color values, comprising:
a video compressor to read the serial video data and render from the serial video data packeted and compressed video into packet types in accordance with at least:
a primary n-color packet type, where n is less than a, formatted to include an n-color code having a portion (1) identifying the n-color packet type as one that encodes a consecutive run of pixel colors comprised only from a set of n number of unique colors and a portion (2) identifying a packet extension condition in which a subsequently identified packet contains a continuation of a payload begun in the primary n-color packet type, the n-color code followed by at least a portion of the payload identifying a consecutive series of color identifiers in which (1) the color identifiers correspond respectively to the set of n number of unique colors, (2) the consecutive series is identical in length to the consecutive run of pixel colors, and (3) the color identifiers are ordered in the consecutive series to correspond to an order of the consecutive run of pixel colors; and
an extension n-color packet type formatted to include the n-color code portion identifying the packet extension condition followed by another portion of the payload of the consecutive series of color identifiers; and
a network interface to deliver the packeted and compressed video to a network.
2. A video system according to claim 1 , wherein:
the video compressor further includes an encoder.
3. A video system according to claim 1 , wherein the packet types include:
a pixel draw packet type having a pixel color code identifying a pixel draw condition and a payload identifying an individual pixel color.
4. A video system according to claim 1 , wherein the packet types include:
a copy packet type formatted to include a copy code identifying a location in the serial video data of a known pixel color that is redundant to a current pixel color and a payload identifying an extent of the redundancy.
5. A video system according to claim 4 , wherein:
the copy packet type includes multiple copy packet types identifying multiple redundancy conditions including at least one of: horizontal position redundancy, vertical position redundancy and time redundancy.
6. A video system according to claim 1 , further including:
a color depth reducer to increase a number of available gray colors.
7. A video system according to claim 1 , wherein n=2.
8. A video system according to claim 1 , wherein the network interface employs a UDP communication type.
9. A video system according to claim 1 , wherein the network interface employs a TCP communication type.
10. A video system according to claim 1 , wherein at least one of the video compressor or network interface employs an encryption protocol to encrypt the packeted and compressed video prior to delivery on the network.
11. A video system according to claim 1 , wherein, when a bandwidth condition on the network interferes with the ability of the network interface to deliver a part of the packeted and compressed video to the network, then one or more frames from the packeted and compressed video are dropped from potential delivery without thereafter attempting to deliver the dropped one or more frames.
12. A video system according to claim 1 , wherein the packet types are a fixed number of bits per packet.
13. A video system according to claim 4 , wherein the video compressor reads ahead of a current pixel in the serial video data to subsequent pixels to determine which of the packet types most efficiently packets and compresses the current and subsequent pixels.
14. A video system according to claim 4 , wherein:
the copy packet type includes multiple copy packet types identifying multiple redundancy conditions including at least one of: horizontal position redundancy, vertical position redundancy and time redundancy, and the video compressor evaluates the copy packet types based on an efficiency; and
the video compressor reads ahead of a current pixel in the serial video data to subsequent pixels to determine which of the copy packet types most efficiently packets and compresses the current and subsequent pixels.
15. A video system according to claim 4 , wherein:
the packet types further include a pixel draw packet type having a pixel color code identifying a pixel draw condition and a payload identifying an individual pixel color;
the copy packet type includes multiple copy packet types identifying multiple redundancy conditions including at least one of: horizontal position redundancy, vertical position redundancy and time redundancy, and the video compressor evaluates the copy packet types based on an efficiency; and
the video compressor reads ahead of a current pixel in the serial video data to subsequent pixels to determine which of the packet types most efficiently packets and compresses the current and subsequent pixels.
16. A video system according to claim 3 , wherein:
the pixel draw packet payload identifying an individual pixel color is a fixed number of x binary bits resulting in 2 x possible words in the pixel draw packet payload, the pixel color being defined by three color components each having a predetermined number y of possible color component shades resulting in 3 y possible colors including y number of gray values in which each color component has an identical one of they number of shades; and
the 3 y possible colors being encoded uniquely in the 2 x number of possible words and a non-zero number of 3 y −2 x additional gray values other than they number of gray values uniquely encoded in the remaining 2 x number of possible words.
17. A video system according to claim 1 , wherein the packet types include:
a primary copy packet type formatted to include a copy code identifying the primary copy packet type as one that encodes a consecutive run of pixel colors based on a location in the serial video data of a known pixel color that is redundant to a current pixel color, the copy code followed by at least a portion of the payload identifying an extent of the redundancy; and
an extension copy packet type formatted the same as the primary copy packet type wherein the copy code is followed by at least another portion of the payload identifying the extent of the redundancy.
18. A video system according to claim 1 , wherein the packet types include:
a primary pixel draw packet type having a pixel color code identifying a pixel draw condition and a payload identifying an individual pixel color; and
an extension pixel draw packet type formatted to include another portion of the payload of the consecutive series of color identifiers.
19. A video system according to claim 1 , wherein the packet types include:
a primary copy packet type formatted to include a copy code identifying the primary copy packet type as one that encodes a consecutive run of pixel colors based on a location in the serial video data of a known pixel color that is redundant to a current pixel color, the copy code followed by at least a portion of the payload identifying an extent of the redundancy;
an extension copy packet type formatted the same as the primary copy packet type wherein the copy code is followed by at least another portion of the payload identifying the extent of the redundancy;
a primary pixel draw packet type having a pixel color code identifying a pixel draw condition and a payload identifying an individual pixel color; and
an extension pixel draw packet type formatted to include another portion of the payload of the consecutive series of color identifiers.
20. A video system according to claim 19 , wherein:
the primary and extension copy packet types include multiple copy packet types identifying multiple redundancy conditions including at least one of: horizontal position redundancy, vertical position redundancy and time redundancy, and the video compressor evaluates the copy packet types based on an efficiency; and
the video compressor reads ahead of a current pixel in the serial video data to subsequent pixels to determine which of the copy packet types most efficiently packets and compresses the current and subsequent pixels.