IP Library Granted Patent US 9,967,568
Granted Patent B2
US 9,967,568 · App. 15/479,966 · Granted May 8, 2018

Upsampling and downsampling of motion maps and other auxiliary maps in a tiered signal quality hierarchy

Inventors: Luca Rossato (Milan, IT); Guido Meardi (Milan, IT)
Assignee: V-Nova International Limited
H04N19/139H04N19/136H04N19/187H04N19/192H04N19/30H04N19/31H04N19/33H04N19/513H04N19/52H04N19/523H04N19/53H04N19/59
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,967,568
App. No.
15/479,966
Filed
Apr 5, 2017
Granted
May 8, 2018
Kind
B2
Art Unit
2487
USPC
375/240.16
Abstract

Certain configurations herein include changing the resolution of an auxiliary map (e.g., a motion map, a z-map, etc.) at a first level of quality to obtain an auxiliary map at a second level of quality. For example, changing the resolution can include receiving a respective auxiliary map of one or more vectors at one or more lower levels of quality and progressively refining, via novel operations, the auxiliary map to higher or lower levels of quality in a hierarchy.

Claims (48)

1. A method comprising:

via computer processor hardware, performing image-processing operations of:

receiving a first map of motion vectors defining image motion, the first map of motion vectors defined at a first resolution;

selecting a motion vector from the first map of motion vectors;

identifying a group of motion vectors in the first map of motion vectors, the group including the selected motion vector in the first map of motion vectors;

utilizing the identified group of motion vectors to derive a setting for a given motion vector in a second map of motion vectors, the second map of motion vectors defined at a second resolution, the second resolution higher than the first resolution; and

applying residual data to the second map of motion vectors to adjust settings of corresponding motion vectors in the second map of motion vectors.

2. The method as in claim 1 further comprising:

subdividing the selected motion vector into multiple sub-elements, the given motion vector in the second map of motion vectors being one of the multiple sub-elements of the selected motion vector, each of the multiple sub-elements in the second map of motion vectors being a respective motion vector.

3. The method as in claim 1 further comprising:

generating the setting for the given motion vector to indicate motion to a fraction of an image element at the second resolution.

4. The method as in claim 1 , wherein the second map of motion vectors supports a process of reconstructing an image signal based on reference image information at the second resolution.

5. The method as in claim 1 , wherein utilizing the identified group of motion vectors to derive the setting for the given motion vector in the second map of motion vectors includes:

upsampling the first map of motion vectors to produce the second map of motion vectors.

6. The method as in claim 1 , wherein the identified group of motion vectors includes a particular motion vector from the first map of motion vectors, the particular motion vector being contiguous with respect to the selected motion vector from the first map of motion vectors.

7. The method as in claim 1 , wherein identifying the group of motion vectors in the first map of motion vectors includes:

selecting motion vectors in a vicinity of the selected motion vector for inclusion in the group.

8. The method as in claim 1 further comprising:

upsampling the second map of motion vectors into a third map of motion vectors.

9. The method as in claim 8 , wherein the third map of motion vectors is defined at a third resolution, the third resolution greater than the second resolution.

10. The method as in claim 9 further comprising:

applying residual data to the third map of motion vectors to adjust settings of corresponding motion vectors in the third map of motion vectors.

11. The method as in claim 1 , wherein the first map of motion vectors is applicable to a respective first level of quality of a current image; and

wherein the second map of motion vectors is applicable to a respective second level of quality of the current image, the second level of quality greater than the first level of quality.

12. A system comprising:

computer processor hardware; and

a hardware storage resource coupled to communicate with the computer processor hardware, the hardware storage resource storing instructions that, when executed by the computer processor hardware, causes the computer processor hardware to:

receive a first map of motion vectors defining image motion, the first map of motion vectors defined at a first resolution;

select a motion vector from the first map of motion vectors;

identify a group of motion vectors in the first map of motion vectors, the group including the selected motion vector in the first map of motion vectors, the second map of motion vectors defined at a second resolution, the second resolution higher than the first resolution;

utilize the identified group of motion vectors to derive a setting for a given motion vector in a second map of motion vectors; and

apply residual data to the second map of motion vectors to adjust settings of corresponding motion vectors in the second map of motion vectors.

13. The system as in claim 12 , wherein execution of the instructions further causes the computer processor hardware to:

subdivide the selected motion vector into multiple sub-elements, the given motion vector in the second map of motion vectors being one of the multiple sub-elements of the selected motion vector, each of the multiple sub-elements in the second map of motion vectors being a respective motion vector.

14. The system as in claim 12 , wherein execution of the instructions further causes the computer processor hardware to:

generate the setting for the given motion vector to indicate motion to a fraction of an image element at the second resolution.

15. The system as in claim 12 , wherein the second map of motion vectors supports a process of reconstructing an image signal based on reference image information at the second resolution.

16. The system as in claim 12 , wherein execution of the instructions further causes the computer processor hardware to:

upsample the first map of motion vectors to produce the second map of motion vectors.

17. The system as in claim 12 , wherein the identified group of motion vectors includes a particular motion vector from the first map of motion vectors, the particular motion vector being contiguous with respect to the selected motion vector from the first map of motion vectors.

18. The system as in claim 12 , wherein execution of the instructions further causes the computer processor hardware to:

select motion vectors in a vicinity of the selected motion vector for inclusion in the group.

19. Computer-readable storage hardware having instructions stored thereon, the instructions, when carried out by computer processor hardware, causing the computer processor hardware to:

receive a first map of motion vectors defining image motion, the first map of motion vectors defined at a first resolution;

select a motion vector from the first map of motion vectors;

identify a group of motion vectors in the first map of motion vectors, the group including the selected motion vector in the first map of motion vectors;

utilize the identified group of motion vectors to derive a setting for a given motion vector in a second map of motion vectors, the second map of motion vectors defined at a second resolution, the second resolution higher than the first resolution; and

apply residual data to the second map of motion vectors to adjust settings of corresponding motion vectors in the second map of motion vectors.

Assignments (6)
CORRECTIVE ASSIGNMENT TO CORRECT THE PROPERTY ASSIGNMENT PREVIOUSLY RECORDED ON REEL 051433 FRAME 0654. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY AGREEMENT. Recorded Mar 4, 2020
From: TIME WARNER CABLE ENTERPRISES, LLC; CHARTER COMMUNICATIONS OPERATING, LLC
To: WELLS FARGO TRUST COMPANY, N.A.
Reel/Frame 052091/0071 →
SECURITY INTEREST Recorded Dec 27, 2019
From: TIME WARNER CABLE ENTERPRISES, LLC; CHARTER COMMUNICATIONS OPERATING, LLC
To: WELLS FARGO TRUST COMPANY, N.A.
Reel/Frame 051433/0654 →
SECURITY INTEREST Recorded Dec 4, 2019
From: TIME WARNER CABLE ENTERPRISES, LLC; CHARTER COMMUNICATIONS OPERATING, LLC; BRIGHT HOUSE NETWORKS, LLC
To: BANK OF AMERICA, N.A.
Reel/Frame 051287/0057 →
SECURITY INTEREST Recorded Dec 4, 2019
From: CHARTER COMMUNICATIONS OPERATING, LLC; TIME WARNER CABLE ENTERPRISES, LLC; BRIGHT HOUSE NETWORKS, LLC
To: THE BANK OF NEW YORK MELLON TRUST COMPANY, N.A.
Reel/Frame 051287/0087 →
CHANGE OF ADDRESS Recorded Nov 15, 2017
From: TIME WARNER CABLE ENTERPRISES LLC
To: TIME WARNER CABLE ENTERPRISES LLC
Reel/Frame 044456/0167 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 30, 2017
From: GELLER, STEVEN I.; STERN, PETER; CERBONE, ROBERT A.; ROUDI, MICHAEL C.
To: TIME WARNER CABLE ENTERPRISES LLC
Reel/Frame 042615/0005 →
Continuity (4)
Continuation 15071369 · Mar 16, 2016
Continuation 13303554 · Nov 23, 2011
Provisional Application 61558302 · Nov 10, 2011
Related Publication 20170208333A1 · Jul 20, 2017