IP Library Granted Patent US 8,340,188
Granted Patent B2
US 8,340,188 · App. 12/684,298 · Granted Dec 25, 2012

Method and device for motion vector estimation in video transcoding using union of search areas

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,340,188
App. No.
12/684,298
Granted
Dec 25, 2012
Kind
B2
Abstract

A transcoder and methods of encoding inter-prediction frames of a downsampled video wherein the downsampled video is a spatially downsampled version of a full-resolution video. Full-resolution motion vectors are downscaled and each downscaled motion vector pinpoints a search area within a reference frame. The union or combination of search areas defines the search field for candidate motion vectors. A motion vector is selected from the candidates based on realizing a minimum rate-distortion cost.

Claims (42)

1. A method of encoding a downsampled video in a video encoder, wherein the downsampled video is a spatially downsampled version of a full-resolution video, the downsampled video including a frame having a macroblock partitioned into at least one partition, wherein one partition of the at least one partition corresponds to at least two full-resolution partitions in a corresponding frame of the full-resolution video, each of the at least two full-resolution partitions having an associated full-resolution motion vector relative to a reference frame, the method comprising:

downscaling the associated full-resolution motion vectors;

identifying, for each of the downscaled motion vectors, a search area within a downscaled reference frame, wherein that search area is centered at a pixel indicated by that downscaled motion vector;

searching within each of the search areas for candidate motion vectors for said one partition, including determining for each candidate motion vector a rate-distortion cost;

selecting as a desired motion vector for said one partition that candidate motion vector having a minimum rate-distortion cost; and

encoding the downsampled video to generate an encoded downsampled video, including the desired motion vector for said one partition.

2. The method claimed in claim 1 , wherein said identifying further includes defining a unified search area comprising the union of the search areas, and wherein said searching comprises searching the unified search area.

3. The method claimed in claim 1 , wherein said one partition corresponds to at least four full-resolution partitions in the corresponding frame of the full-resolution video, wherein said identifying includes defining at least four search areas and unifying the at least four search areas into a unified search area, and wherein said searching includes searching within the unified search area for said candidate motion vectors for said one partition.

4. The method claimed in claim 1 , wherein the spatially downsampled video has been downsampled by a downsampling ratio, and wherein the downscaling comprises downscaling by the downsampling ratio.

5. The method claimed in claim 1 , further including:

decoding a full-resolution encoded video to produce the full-resolution video, including decoding the at least two full-resolution partitions and their associated full-resolution motion vectors; and

spatially downsampling the full-resolution video in the pixel domain to produce the downsampled video.

6. An encoder for encoding a downsampled video, wherein the downsampled video is a spatially downsampled version of a full-resolution video, the downsampled video including a frame having a macroblock partitioned into at least one partition, wherein one partition of the at least one partition corresponds to at least two full-resolution partitions in a corresponding frame of the full-resolution video, each of the at least two full-resolution partitions having an associated full-resolution motion vector relative to a reference frame, the encoder comprising:

a processor;

a memory;

a communications system for outputting an encoded downsampled video; and

an encoding application stored in memory and containing instructions for configuring the processor to encode the downsampled video by,

downscaling the associated full-resolution motion vectors;

identifying, for each of the downscaled motion vectors, a search area within a downscaled reference frame, wherein that search area is centered at a pixel indicated by that downscaled motion vector;

searching within each of the search areas for candidate motion vectors for said one partition, including determining for each candidate motion vector a rate-distortion cost;

selecting as a desired motion vector for said one partition that candidate motion vector having a minimum rate-distortion cost; and

encoding the downsampled video to generate an encoded downsampled video, including the desired motion vector for said one partition.

7. The encoder claimed in claim 6 , wherein the encoding application configures the processor to combine the search areas to define a unified search area comprising the union of the search areas, and wherein the encoding application configures the processor to search for candidate motion vectors within the unified search area.

8. The encoder claimed in claim 6 , wherein said one partition corresponds to at least four full-resolution partitions in the corresponding frame of the full-resolution video, and wherein the encoding application configures the processor to define at least four search areas based on the at least four downscaled full-resolution motion vectors, to unify the at least four search areas into a unified search area, and to search within the unified search area for candidate motion vectors.

9. The encoder claimed in claim 6 , wherein the spatially downsampled video has been downsampled by a downsampling ratio, and wherein the encoding application configures the processor to downscale the full-resolution motion vectors by the downsampling ratio.

10. A transcoder, comprising:

a decoder configured to decode a full-resolution encoded video to produce the full-resolution video, including decoding the at least two full-resolution partitions and their associated full-resolution motion vectors;

a spatial downsampler configured to spatially downsample the full-resolution video in the pixel domain to produce the downsampled video; and

the encoder claimed in claim 6 .

11. A computer-readable medium having stored thereon computer-executable instructions which, when executed by a processor, configure the processor to encode a downsampled video, wherein the downsampled video is a spatially downsampled version of a full-resolution video, the downsampled video including a frame having a macroblock partitioned into at least one partition, wherein one partition of the at least one partition corresponds to at least two full-resolution partitions in a corresponding frame of the full-resolution video, each of the at least two full-resolution partitions having an associated full-resolution motion vector relative to a reference frame, wherein the computer-executable instructions comprise instructions that configure the processor to:

downscale the associated full-resolution motion vectors;

identify, for each of the downscaled motion vectors, a search area within a downscaled reference frame, wherein that search area is centered at a pixel indicated by that downscaled motion vector;

search within each of the search areas for candidate motion vectors for said one partition;

determine for each candidate motion vector a rate-distortion cost;

select as a desired motion vector for said one of the partitions that candidate motion vector having a minimum rate-distortion cost; and

encode the downsampled video to generate an encoded downsampled video, including the desired motion vector for said one partition.

12. The computer-readable medium claimed in claim 11 , wherein the computer-executable instructions configure the processor to combine the search areas to define a unified search area comprising the union of the search areas, and wherein the computer-executable instructions configure the processor to search for candidate motion vectors within the unified search area.

13. The computer-readable medium claimed in claim 11 , wherein said one partition corresponds to at least four full-resolution partitions in the corresponding frame of the full-resolution video, and wherein the computer-executable instructions configure the processor to define at least four search areas based on the four downscaled full-resolution motion vectors, to unify the at least four search areas into a unified search area, and to search within the unified search area for candidate motion vectors.

14. The computer-readable medium claimed in claim 11 , wherein the spatially downsampled video has been downsampled by a downsampling ratio, and wherein the computer-executable instructions configure the processor to downscale the full-resolution motion vectors by the downsampling ratio.

15. The computer-readable medium claimed in claim 11 , further including computer-executable instructions that, when executed, configure the processor to:

decode a full-resolution encoded video to produce the full-resolution video, including decoding the at least two full-resolution partitions and their associated full-resolution motion vectors; and

spatially downsample the full-resolution video in the pixel domain to produce the downsampled video.

Assignments (6)
NUNC PRO TUNC ASSIGNMENT Recorded Jun 19, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064270/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 16, 2023
From: BLACKBERRY LIMITED
To: MALIKIE INNOVATIONS LIMITED
Reel/Frame 064104/0103 →
CHANGE OF NAME Recorded Feb 26, 2016
From: RESEARCH IN MOTION LIMITED
To: BLACKBERRY LIMITED
Reel/Frame 037940/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2010
From: SLIPSTREAM DATA INC.
To: RESEARCH IN MOTION LIMITED
Reel/Frame 024653/0412 →
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY DATA PREVIOUSLY RECORDED ON REEL 023760 FRAME 0249. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT FROM SHI, YU AND HE TO SLIPSTREAM DATA INC. COVERSHEET MISIDENTIFIED RESEARCH IN MOTION LIMITED AS RECEIVING PARTY.. Recorded Jan 22, 2010
From: SHI, XUN; YU, XIANG; HE, DAKE
To: SLIPSTREAM DATA INC.
Reel/Frame 023835/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 11, 2010
From: SHI, XUN; YU, XIANG; HE, DAKE
To: RESEARCH IN MOTION LIMITED
Reel/Frame 023760/0249 →