IP Library Granted Patent US 9,571,857
Granted Patent B2
US 9,571,857 · App. 12/998,123 · Granted Feb 14, 2017

Methods and apparatus for video imaging pruning

Inventors: Dung Trung Vo (La Jolla, CA); Joel Sole (Plainsboro, NJ); Peng Yin (Ithaca, NY); Yunfei Zheng (Plainsboro, NJ)
Assignee: THOMSON LICENSING
H04N19/59H04N19/587H04N19/85
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,571,857
App. No.
12/998,123
Granted
Feb 14, 2017
Kind
B2
Abstract

Methods and apparatus are provided for video image pruning. An apparatus includes a data pruner for pre-processing a picture prior to, and in preparation for, compression by encoding. The data pruner selectively removes, in the spatial domain, at least one region within the picture. At the decoder end, an apparatus includes a data restorer for receiving a decompressed picture subsequent to decompression by decoding, and post-processing the decompressed picture by selectively restoring, in the spatial domain, at least one region in the decompressed picture based on information indicating a removal of the at least one region prior to a previously performed encoding process.

Claims (41)

1. An apparatus, comprising:

a data pruner for pre-processing a picture prior to, and in preparation for, compression by encoding, wherein said data pruner selectively removes, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portions of said picture to be encoded.

2. The apparatus of claim 1 , wherein said data pruner is comprised in an encoder.

3. The apparatus of claim 1 , further comprising an encoder coupled to said data pruner for encoding the picture with the at least one region removed.

4. The apparatus of claim 1 , wherein side information indicating a location of the at least one region within the picture is transmitted to a decoder.

5. The apparatus of claim 1 , wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

6. The apparatus of claim 1 , wherein only even or odd lines are removed by said data pruner.

7. The apparatus of claim 1 , wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

8. The apparatus of claim 1 , wherein the at least one region selectively removed is determined responsive to an evaluation of at least one of an image distortion metric, a rate distortion metric, a dropped pixel metric, and a complexity metric.

9. The apparatus of claim 1 , wherein 6-order interpolation is used for removing the at least one region in one dimension, and 8-order interpolation is used for removing the at least one region in two dimensions.

10. A method, comprising:

pre-processing a picture prior to, and in preparation for, compression by encoding, wherein said pre-processing comprises selectively removing, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portions of said picture to be encoded, using a data pruner having a processor.

11. The method of claim 10 , wherein the method is comprised in an encoder.

12. The method of claim 10 , further comprising encoding the picture with the at least one region removed.

13. The method of claim 10 , wherein side information indicating a location of the at least one region within the picture is transmitted to a decoder.

14. The method of claim 10 , wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

15. The method of claim 10 , wherein only even or odd lines are removed by said pre-processing.

16. The method of claim 10 , wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

17. The method of claim 10 , wherein the at least one region selectively removed is determined responsive to an evaluation of at least one of an image distortion metric, a rate distortion metric, a dropped pixel metric, and a complexity metric.

18. The method of claim 10 , wherein 6-order interpolation is used for removing the at least one region in one dimension, and 8-order interpolation is used for removing the at least one region in two dimensions.

19. An apparatus, comprising:

a data restorer for receiving a decompressed picture subsequent to decompression by decoding, and post-processing the decompressed picture by selectively restoring, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the decompressed picture, from the remaining portions of said picture that was encoded, based on information indicating a removal of the at least one region prior to a previously performed encoding process.

20. The apparatus of claim 19 , wherein said data restorer is comprised in a decoder.

21. The apparatus of claim 19 , further comprising a decoder coupled to said data restorer for decoding the picture with the at least one region removed.

22. The apparatus of claim 19 , wherein said data restorer receives side information indicating a location of the at least one region within the picture is transmitted to a decoder.

23. The apparatus of claim 19 , wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

24. The apparatus of claim 19 , wherein only even or odd lines are restored by said data restorer.

25. The apparatus of claim 19 , wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

26. The apparatus of claim 19 , wherein 6-order interpolation is used for restoring the at least one region in one dimension, and 8-order interpolation is used for restoring the at least one region in two dimensions.

27. A method, comprising:

receiving a decompressed picture subsequent to decompression by decoding; and

post-processing, using a data restorer having a processor, the decompressed picture by selectively restoring, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising at least one region, line or segment comprising arbitrary lines within the decompressed picture, from the remaining portions of said picture that was encoded, based on information indicating a removal of the at least one region prior to a previously performed encoding process.

28. The method of claim 27 , wherein the method is comprised in a decoder.

29. The method of claim 27 , further comprising decoding the picture with the at least one region removed prior to said receiving.

30. The method of claim 27 , wherein said data restorer receives side information indicating a location of the at least one region within the picture is transmitted to a decoder.

31. The method of claim 27 , wherein the at least one region comprises at least one of a straight line, a non-linear curve, and a region.

32. The method of claim 27 , wherein only even or odd lines are restored by said post-processing.

33. The method of claim 27 , wherein the picture is comprised in a group of pictures, and all pictures within the group of pictures are assigned a same removal pattern.

34. The method of claim 27 , wherein 6-order interpolation is used for restoring the at least one region in one dimension, and 8-order interpolation is used for restoring the at least one region in two dimensions.

35. A non-transitory computer readable media having video signal data encoded thereupon, comprising:

an encoded picture pre-processed prior to compression by encoding, wherein the picture is pre-processed to selectively remove, based on location of pixels within the spatial domain of the picture, and not on the frequency domain, only portions of said picture comprising, at least one region, line or segment comprising arbitrary lines within the picture, and leaving the remaining portion of said picture to be encoded.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 10, 2018
From: THOMSON LICENSING DTV
To: INTERDIGITAL MADISON PATENT HOLDINGS
Reel/Frame 046763/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 17, 2017
From: THOMSON LICENSING
To: THOMSON LICENSING DTV
Reel/Frame 041378/0630 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 13, 2017
From: THOMSON LICENSING
To: THOMSON LICENSING DTV
Reel/Frame 041370/0433 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2011
From: VO, DUNG TRUNG; SOLE, JOEL; YIN, PENG; ZHENG, YUNFEI
To: THOMSON LICENSING
Reel/Frame 026026/0925 →
Continuity (2)
Provisional Application 61098125 · Sep 18, 2008
Related Publication 20110170615A1 · Jul 14, 2011