IP Library › Granted Patent US 11,315,211
Granted Patent B2
US 11,315,211 · App. 16/987,983 · Granted Apr 26, 2022

Methods and apparatus for efficient motion estimation

Inventors: Samuel Benjamin Holmes (Sterling, MA); Jonathan Wicks (Louisville, CO)
Assignee: QUALCOMM Incorporated
G06T1/20G06T7/20A63F13/52A63F2300/538
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,315,211
App. No.
16/987,983
Granted
Apr 26, 2022
Kind
B2
Abstract

The present disclosure relates to methods and apparatus for graphics processing. The apparatus can determine a motion estimation priority for one or more regions in a frame. In some aspects, each of the one or more regions can include a group of pixels. Additionally, the apparatus can adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels. The apparatus can also perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Claims (44)

1. A method for graphics processing, comprising:

determining a motion estimation priority for one or more regions in a frame, wherein each of the one or more regions includes at least one group of pixels;

adjusting a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels, wherein adjusting the quality of the motion estimation procedure comprises determining to set a constant value for the at least one group of pixels in a region having a lowest motion estimation priority; and

performing the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

2. The method of claim 1 , wherein the one or more regions include a central region and a peripheral region.

3. The method of claim 2 , wherein the one or more regions include at least one intermediate region between the central region and the peripheral region.

4. The method of claim 1 , further comprising:

tracking a position of an eye, wherein the one or more regions in the frame are defined with respect to the position of the eye.

5. The method of claim 1 , wherein adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels comprises setting a size of the at least one group of pixels based on the motion estimation priority of the region.

6. The method of claim 1 , wherein adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels comprises adjusting a size of a search window to be covered during the motion estimation procedure based on the motion estimation priority of the region.

7. The method of claim 1 , wherein adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels comprises determining inclusion or omission of a multi-pass algorithm with motion vector refinement in the motion estimation procedure based on the motion estimation priority of the region.

8. The method of claim 1 , wherein adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels comprises determining a block size for a sum of absolute differences (SAD) operation or a sum of squared differences (SSD) operation based on the motion estimation priority of the region.

9. The method of claim 1 , wherein adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels comprises adjusting an amount of filtering performed during motion search filtering or performed on final motion vectors based on the motion estimation priority of the region.

10. The method of claim 1 , further comprising extrapolating a new frame from the frame based on the motion vector for each group of pixels.

11. An apparatus for graphics processing, comprising:

a memory; and

at least one processor coupled to the memory and configured to:

determine a motion estimation priority for one or more regions in a frame, wherein each of the one or more regions includes at least one group of pixels;

adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels,

wherein the at least one processor is configured to determine to set a constant value for the at least one group of pixels in a region having a lowest motion estimation priority; and

perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

12. The apparatus of claim 11 , wherein the one or more regions include a central region and a peripheral region.

13. The apparatus of claim 12 , wherein the one or more regions include at least one intermediate region between the central region and the peripheral region.

14. The apparatus of claim 11 , wherein the at least one processor is configured to track a position of an eye, wherein the one or more regions in the frame are defined with respect to the position of the eye.

15. The apparatus of claim 11 , wherein the at least one processor is configured to set a size of the at least one group of pixels based on the motion estimation priority of the region.

16. The apparatus of claim 11 , wherein the at least one processor is configured to adjust a size of a search window to be covered during the motion estimation procedure based on the motion estimation priority of the region.

17. The apparatus of claim 11 , wherein the at least one processor is configured to determine inclusion or omission of a multi-pass algorithm with motion vector refinement in the motion estimation procedure based on the motion estimation priority of the region.

18. The apparatus of claim 11 , wherein the at least one processor is configured to determine a block size for a sum of absolute differences (SAD) operation or a sum of squared differences (SSD) operation based on the motion estimation priority of the region.

19. The apparatus of claim 11 , wherein the at least one processor is configured to adjust an amount of filtering performed during motion search filtering or performed on final motion vectors based on the motion estimation priority of the region.

20. The apparatus of claim 11 , wherein the at least one processor is configured to extrapolate a new frame from the frame based on the motion vector for each group of pixels.

21. An apparatus for graphics processing, comprising:

means for determining a motion estimation priority for one or more regions in a frame, wherein each of the one or more regions includes at least one group of pixels;

means for adjusting a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels,

wherein the means for adjusting the quality of the motion estimation procedure is configured to determine to set a constant value for the at least one group of pixels in a region having a lowest motion estimation priority; and

means for performing the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

22. The apparatus of claim 21 , further comprising means for tracking a position of an eye, wherein the one or more regions in the frame are defined with respect to the position of the eye.

23. The apparatus of claim 21 , wherein the one or more regions include a central region and a peripheral region.

24. The apparatus of claim 21 , wherein the means for adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels is configured to set a size of the at least one group of pixels based on the motion estimation priority of the region.

25. The apparatus of claim 21 , wherein the means for adjusting the quality of the motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels is configured to adjust a size of a search window to be covered during the motion estimation procedure based on the motion estimation priority of the region.

26. The apparatus of claim 21 , further comprising means for extrapolating a new frame from the frame based on the motion vector for each group of pixels.

27. A non-transitory computer-readable medium storing computer executable code for graphics processing, comprising code to:

determine a motion estimation priority for one or more regions in a frame based on a distance of each of the one or more regions from a focal point of the frame, wherein each of the one or more regions includes at least one group of pixels;

adjust a quality of a motion estimation procedure for each group of pixels based on the motion estimation priority of the region including the group of pixels, wherein the code to adjust the quality of the motion estimation procedure includes code to set a constant value for the at least one group of pixels in a region having a lowest motion estimation priority; and

perform the motion estimation procedure for each of the at least one group of pixels to generate a motion vector for the at least one group of pixels based on the adjusted quality of the motion estimation procedure.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 20, 2021
From: HOLMES, SAMUEL BENJAMIN; WICKS, JONATHAN
To: QUALCOMM INCORPORATED
Reel/Frame 054974/0689 →
Continuity (2)
Provisional Application 62888974 · Aug 19, 2019
Related Publication 20210056661A1 · Feb 25, 2021