Supporting motion vectors outside picture boundaries in motion estimation process
View Patent ↗An apparatus generally having a reference memory and a motion estimation circuit is disclosed. The reference memory may store reference samples used in a motion estimation of a current block beyond a boundary of a picture. The motion estimation circuit may (i) buffer the reference samples as copied from the reference memory, the reference samples as buffered residing both (a) inside the boundary and (b) inside a search window of the motion estimation, (ii) shift a sub-set of the reference samples to align with a corner of a sub-window, the sub-window being (a) completely within the search window and (b) at least partially outside of the boundary, (iii) fill an empty portion of the sub-window with copies of the reference samples within the sub-set and (iv) generate difference values by comparing the current block against the reference samples within the sub-window a plurality of times.
1. An apparatus comprising:
a reference memory storing a plurality of reference samples used in a motion estimation of a current block beyond a boundary of a picture; and
a motion estimation circuit having a search memory and (i) copying a portion of said reference samples from a given window within said reference memory into a sub-window buffered in said search memory, said given window spatially matching said sub-window in size and shape, said given window residing both (a) inside said boundary and (b) inside a search window of said motion estimation, (ii) shifting a sub-set of said reference samples as buffered to align with a corner of said sub-window, said sub-window being (a) completely within said search window, (b) at least partially outside of said boundary and (c) smaller than said search window, (iii) filling an empty portion of said sub-window with a plurality of copies of said reference samples within said sub-set and (iv) generating a plurality of difference values by comparing said current block against said reference samples within said sub-window a plurality of times.
2. The apparatus according to claim 1 , wherein said search memory receives all of said reference samples from within said given window.
3. The apparatus according to claim 1 , wherein said motion estimation circuit further comprises a memory controller (i) receiving said reference samples from said search memory, (ii) filling said sub-window and (iii) generating a sample signal conveying said reference samples of said sub-window.
4. The apparatus according to claim 3 , wherein said motion estimation circuit further comprises a processing circuit generating an output signal conveying said difference values calculated from said reference samples received in said sample signal.
5. The apparatus according to claim 1 , wherein said motion estimation circuit comprises a first read controller generating (i) a first address signal that controls reading of said reference samples from said reference memory, (ii) a map address signal and (iii) a state signal all in response to a position of said sub-window in said search window relative to said boundary.
6. The apparatus according to claim 5 , wherein said motion estimation circuit further comprises a second read controller generating a second address signal that controls reading of said reference samples from said search memory in response to both said map address signal and said state signal.
7. The apparatus according to claim 1 , wherein said motion estimation circuit further comprises a write controller generating a write address signal that controls writing of said reference samples into said search memory.
8. The apparatus according to claim 1 , wherein said motion estimation circuit comprises a read controller generating a read address signal that controls reading of said reference samples from said search memory to a shifter internal to said motion estimation circuit.
9. The apparatus according to claim 1 , wherein said motion estimation circuit further comprises a datapath controller generating a plurality of control signals that control said shifting of said reference samples to align with said corner of said sub-window.
10. The apparatus according to claim 9 , wherein said control signals further control copying of said reference samples by said shifter to fill said sub-window.
11. The apparatus according to claim 1 , wherein said motion estimation circuit further comprises a shifter which generates a sample signal that conveys said reference samples within said sub-window in response to a plurality of control signals.
12. A method of a motion estimation of a current block beyond a boundary of a picture stored in a reference memory, said picture having a plurality of reference samples, comprising the steps of:
(A) copying a portion of said reference samples from a given window within said reference memory into a sub-window buffered in a search memory of a circuit, said given window spatially matching said sub-window in size and shape, said given window residing both (i) inside said boundary and (ii) inside a search window of said motion estimation;
(B) shifting a sub-set of said reference samples as buffered to align with a corner of said sub-window, said sub-window being (i) completely within said search window, (ii) at least partially outside of said boundary and (iii) smaller than said search window;
(C) filling an empty portion of said sub-window with a plurality of copies of said reference samples within said sub-set; and
(D) generating a plurality of difference values by comparing said current block against said reference samples within said sub-window a plurality of times.
13. The method according to claim 12 , further comprising the step of:
generating a first address signal that controls reading of said reference samples from said reference memory in response to a position of said sub-window in said search window relative to said boundary.
14. The method according to claim 13 , further comprising the step of:
generating a map address signal in response to said position of said sub-window in said search window relative to said boundary.
15. The method according to claim 13 , further comprising the step of:
generating a state signal in response to said position of said sub-window in said search window relative to said boundary.
16. The method according to claim 12 , further comprising the step of:
generating a read address signal that controls reading of said reference samples from said search memory to a shifter in response to both a map address signal and a state signal.
17. The method according to claim 16 , further comprising the step of:
generating a write address signal that controls writing of said reference samples received from said reference memory into said search memory.
18. The method according to claim 12 , further comprising the step of:
generating a plurality of control signals that control said shifting of said reference samples to align with said corner of said sub-window.
19. The method according to claim 18 , wherein said control signals further control copying of said reference samples to fill said sub-window.
20. An apparatus comprising:
means for storing a plurality of reference samples used in a motion estimation of a current block beyond a boundary of a picture; and
means for motion estimating having a search memory and (i) copying a portion of said reference samples from a given window within said means for storing into a sub-window buffered in said search memory, said given window spatially matching said sub-window in size and shape, said given window residing both (a) inside said boundary and (b) inside a search window of said motion estimation, (ii) shifting a sub-set of said reference samples as buffered to align with a corner of said sub-window, said sub-window being (a) completely within said search window, (b) at least partially outside of said boundary and (c) smaller than said search window, (iii) filling an empty portion of said sub-window with a plurality of copies of said reference samples within said sub-set and (iv) generating a plurality of difference values by comparing said current block against said reference samples within said sub-window a plurality of times.
21. The method according to claim 12 , further comprising the step of:
generating a write address signal that controls writing of said reference samples into said search memory.
22. The method according to claim 12 , further comprising the step of:
generating a sample signal that conveys said reference samples within said sub-window in response to a plurality of control signals.