IP Library Granted Patent US 9,503,756
Granted Patent B2
US 9,503,756 · App. 13/315,409 · Granted Nov 22, 2016

Encoding and decoding using perceptual representations

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,503,756
App. No.
13/315,409
Granted
Nov 22, 2016
Kind
B2
Abstract

Encoding a video signal including pictures includes generating perceptual representations based on the pictures. Reference pictures are selected and motion vectors are generated based on the perceptual representations and the reference pictures. The motion vectors and pointers for the reference pictures are provided in an encoded video signal. Decoding may include receiving pointers for reference pictures and motion vectors based on perceptual representations of the reference pictures. The decoding of the pictures in the encoded video signal may include selecting reference pictures using the pointers and determining predicted pictures, based on the motion vectors and the selected reference pictures. The decoding may include generating reconstructed pictures from the predicted pictures and the residual pictures.

Claims (76)

1. A system for encoding, the system comprising:

an interface configured to receive a video signal including original pictures in a video sequence; and

a processor configured to:

generate target perceptual representations from received original pictures,

select reference perceptual representations from a plurality of reference perceptual representations of pictures,

determine perceptual-reference representation motion vector information from the target perceptual representations and the reference perceptual representations, wherein the perceptual-representation motion vector information corresponds to the entire received original picture of the reference pictures,

encode the determined perceptual-representation motion vector information as data, and

store the target perceptual representations with the plurality of reference perceptual representations of pictures,

select reference pictures from a plurality of reference pictures to process independent of the perceptual-representation motion vector data, and

apply the perceptual-representation motion vector data to the selected reference pictures to generate a motion compensated representation of the original pictures,

wherein the processor is configured to generate the target perceptual representations by

generating spatial detail maps for pixel values of the original pictures,

determining sign information of the generated spatial detail maps,

determining absolute value information of the generated spatial detail maps, and

processing the determined sign information and the determined absolute value information to generate the target perceptual representations.

2. The system of claim 1 , wherein the generated spatial detail maps include values associated with pixels in the original pictures.

3. The system of claim 1 , wherein the generated spatial detail maps include values determined using a model of human perceptibility of features in the respective original pictures.

4. The system of claim 1 , wherein the processor is configured to determine the absolute value information by

determining absolute value maps based on the respective generated spatial detail map; and

generating companded absolute value spatial detail maps based on a companding factor, the respective determined absolute value maps and the respective generated spatial detail maps.

5. The system of claim 1 , wherein the original pictures in the video sequence are in a transition sequence of pictures in the video sequence.

6. The system of claim 5 , wherein the transition sequence is characterized by at least one of a changing contrast attribute and a changing brightness attribute of pictures in a plurality of pictures in the video sequence.

7. A method for encoding, the method comprising:

receiving a video signal including original pictures in a video sequence;

generating target perceptual representations from the received original pictures;

selecting reference perceptual representations from a plurality of reference perceptual representations of pictures;

determining, utilizing a processor, perceptual-representation motion vector information from the target perceptual representations and the reference perceptual representations, wherein the perceptual-representation motion vector information corresponds to the entire received original picture;

encoding the determined perceptual-representation motion vector information as data;

storing the target perceptual representation with the plurality of reference perceptual representations of pictures;

selecting reference pictures from the plurality of reference pictures to process independent of the perceptual-representation motion vector data, and

applying the perceptual-representation motion vector data to the selected reference pictures to generate a motion compensated representation of the original pictures,

wherein the target perceptual representations are generated by

generating spatial detail maps for pixel values of the original pictures,

determining sign information of the generated spatial detail maps,

determining absolute value information of the generated spatial detail maps, and

processing the determined sign information and the determined absolute value information to generate the target perceptual representations.

8. A non-transitory computer readable medium (CRM) storing computer readable instructions for executing the method of claim 7 .

9. A system for decoding, the system comprising:

an interface configured to

receive perceptual-representation vector information wherein the perceptual-representation motion vector information is based on:

target perceptual representations of original pictures from a video sequence including pictures, and

reference perceptual representations selected from a plurality of reference perceptual representations of pictures,

receive residual pictures associated with the received perceptual-representation motion vector information; and

a processor configured to:

select reference pictures from a plurality of reference pictures to process independent of the perceptual-representation motion vector information,

determine predicted pictures from the received perceptual-representation motion vector information and the selected reference pictures, and

generate reconstructed pictures from the predicted pictures and the residual pictures,

wherein the target perceptual representations are generated by

generating spatial detail maps for pixel values of the original pictures,

determining sign information of the generated spatial detail maps,

determining absolute value information of the generated spatial detail maps, and

processing the determined sign information and the determined absolute value information to generate the target perceptual representations.

10. The system of claim 9 , wherein the generated spatial detail maps include values associated with pixels in the original picture.

11. The system of claim 9 , wherein the generated spatial detail maps include values determined using a model of human perceptibility of features in the original picture.

12. The system of claim 9 , wherein the determined absolute value information is based on

absolute value maps based on the respective generated spatial detail maps, and

generated companded absolute value spatial detail maps based on,

a companding factor,

the respective absolute value maps, and

the respective generated spatial detail maps.

13. The system of claim 9 , wherein the original pictures in the video sequence are in a transition sequence of pictures in the video sequence.

14. The system of claim 13 , wherein the transition sequence is characterized by at least one of a changing contrast attribute and a changing brightness attribute of pictures in the transition sequence.

15. A method for decoding, the method comprising:

receiving perceptual-representation motion vector information, wherein the perceptual-representation motion vector information is based on:

target perceptual representations of original pictures from a video sequence including pictures, and

reference perceptual representations selected from a plurality of reference perceptual representations of pictures,

receiving residual pictures associated with the received perceptual-representation motion vector information;

selecting reference pictures from a plurality of reference pictures to process independent of the perceptual-representation motion vector data;

determining, utilizing a processor, predicted pictures from the received perceptual-representation motion vector information and the selected reference pictures; and

generating reconstructed pictures from the determined predicted pictures and the received residual pictures,

wherein the target perceptual representations are generated by

generating spatial detail maps for pixel values of the original pictures,

determining sign information of the generated spatial detail maps,

determining absolute value information of the generated spatial detail maps, and

processing the determined sign information and the determined absolute value information to generate the target perceptual representations.

16. A non-transitory computer readable medium (CRM) storing computer readable instructions for executing the method of claim 15 .

Assignments (9)
RELEASE OF SECURITY INTEREST AT REEL/FRAME 049905/0504 Recorded Dec 19, 2024
From: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
To: ARRIS ENTERPRISES LLC (F/K/A ARRIS ENTERPRISES, INC.); ARRIS TECHNOLOGY, INC.; ARRIS SOLUTIONS, INC.; COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; RUCKUS WIRELESS, LLC (F/K/A RUCKUS WIRELESS, INC.)
Reel/Frame 071477/0255 →
SECURITY INTEREST Recorded Dec 17, 2024
From: ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE INC., OF NORTH CAROLINA; OUTDOOR WIRELESS NETWORKS LLC; RUCKUS IP HOLDINGS LLC
To: APOLLO ADMINISTRATIVE AGENCY LLC
Reel/Frame 069889/0114 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 23, 2022
From: ARRIS TECHNOLOGY, INC.
To: ARRIS ENTERPRISES, INC.
Reel/Frame 060791/0583 →
SECURITY INTEREST Recorded Nov 19, 2021
From: ARRIS SOLUTIONS, INC.; ARRIS ENTERPRISES LLC; COMMSCOPE TECHNOLOGIES LLC; COMMSCOPE, INC. OF NORTH CAROLINA; RUCKUS WIRELESS, INC.
To: WILMINGTON TRUST
Reel/Frame 060752/0001 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 049820 FRAME: 0495. ASSIGNOR(S) HEREBY CONFIRMS THE CHANGE OF NAME. Recorded Jul 25, 2019
From: ARRIS ENTERPRISES, INC.
To: ARRIS ENTERPRISES LLC
Reel/Frame 049858/0161 →
TERM LOAN SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049905/0504 →
PATENT SECURITY AGREEMENT Recorded Jul 3, 2019
From: ARRIS ENTERPRISES LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 049820/0495 →
ABL SECURITY AGREEMENT Recorded Jul 3, 2019
From: COMMSCOPE, INC. OF NORTH CAROLINA; COMMSCOPE TECHNOLOGIES LLC; ARRIS ENTERPRISES LLC; ARRIS TECHNOLOGY, INC.; RUCKUS WIRELESS, INC.; ARRIS SOLUTIONS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 049892/0396 →
CHANGE OF NAME Recorded Jul 2, 2019
From: ARRIS ENTERPRISES. INC
To: ARRIS
Reel/Frame 049669/0652 →