IP Library › Granted Patent US 11,909,999
Granted Patent B2
US 11,909,999 · App. 17/601,848 · Granted Feb 20, 2024

Coding management method and apparatus based on high efficiency video coding

Inventors: Ke Xu (Shenzhen, CN); Jianjun Song (Shenzhen, CN)
Assignee: SANECHIPS TECHNOLOGY CO., LTD.
H04N19/50H04N19/119H04N19/159H04N19/70
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,909,999
App. No.
17/601,848
Granted
Feb 20, 2024
Kind
B2
Abstract

Disclosed are a coding management method and apparatus based on High Efficiency Video Coding (HEVC). The method includes: obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result including a spatial correlation result for the basic unit before the division and N basic units generated after the division, and N being an integer greater than 1; and judging whether or not to perform the division on the basic unit according to the calculated correlation result.

Claims (649)

1. A coding management method based on high efficiency video coding (HEVC), comprising:

obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result comprising spatial correlation α s between the basic unit before the division and the N basic units generated after the division, and spatial correlation β s between the N basic units generated after the division of the basic unit, and N being an integer greater than 1; and

judging whether or not to perform the division on the basic unit according to the calculated correlation result.

2. The method of claim 1 , wherein:

α s is obtained by the following formula:

α

s

=

N

*

D

⁡

(

X

)

d

D

⁡

(

X

)

1

d

+

1

+

D

⁡

(

X

)

2

d

+

1

+

D

⁡

(

X

)

3

d

+

1

+

…

+

D

⁡

(

X

)

N

d

+

1

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X) d denotes a spatial correlation degree before the division of the basic unit; and D(X) i d+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and

β s is obtained by the following formula:

β

s

=

max

⁡

(

D

⁡

(

X

)

1

d

+

1

,

D

⁡

(

X

)

2

d

+

1

,

D

⁡

(

X

)

3

d

+

1

,

…

,

D

⁡

(

X

)

N

d

+

1

)

min

⁡

(

D

⁡

(

X

)

1

d

+

1

,

D

⁡

(

X

)

2

d

+

1

,

D

⁡

(

X

)

3

d

+

1

,

…

,

D

⁡

(

X

)

N

d

+

1

)

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X) d denotes a spatial correlation degree before the division of the basic unit; and D(X) i d+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

3. The method of claim 1 , wherein the calculated correlation result further comprises: a temporal correlation result of the basic unit before the division and the N basic units generated after the division.

4. The method of claim 3 , wherein the temporal correlation result comprises at least one of:

temporal correlation α t between the basic unit before the division and the N basic units generated after the division; and

temporal correlation β t between the N basic units generated after the division of the basic unit.

5. The method of claim 4 , wherein:

α t is obtained by the following formula:

α

t

=

N

*

D

⁡

(

Y

)

d

D

⁡

(

Y

)

1

d

+

1

+

D

⁡

(

Y

)

2

d

+

1

+

D

⁡

(

Y

)

3

d

+

1

+

…

+

D

⁡

(

Y

)

N

d

+

1

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(Y) d denotes a temporal correlation degree before the division of the basic unit; and D(Y) i d+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and

β t is obtained by the following formula:

β

t

=

max

⁡

(

D

⁡

(

Y

)

1

d

+

1

,

D

⁡

(

Y

)

2

d

+

1

,

D

⁡

(

Y

)

3

d

+

1

,

…

,

D

⁡

(

Y

)

N

d

+

1

)

min

⁡

(

D

⁡

(

Y

)

1

d

+

1

,

D

⁡

(

Y

)

2

d

+

1

,

D

⁡

(

Y

)

3

d

+

1

,

…

,

D

⁡

(

Y

)

N

d

+

1

)

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; and D(Y) d denotes a temporal correlation degree before the division of the basic unit; and D(Y) i d+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

6. The method of claim 3 , wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:

acquiring a video frame type corresponding to the basic unit;

judging whether or not to perform the division on the basic unit according to the calculated correlation result in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and

judging whether or not to perform the division on the basic unit according to the spatial correlation result and the temporal correlation result in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

7. The method of claim 6 , wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:

judging whether or not to perform the division on the basic unit according to a spatial correlation degree of the basic unit before the division in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and

judging whether or not to perform the division on the basic unit according to the spatial correlation degree and a temporal correlation degree before the division of the basic unit in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

8. The method of claim 7 , after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:

collecting statistics on the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing the division after a result of judging whether or not to perform the division on the basic unit is obtained; and

determining a threshold used in an execution of a next judgment on whether or not to perform the division on the basic unit according to the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing division, wherein the threshold comprise at least one of a threshold for performing the division and a threshold for not performing the division.

9. The method of claim 1 , after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:

calculating residual information of the basic unit after determining not to perform the division on the basic unit; and

performing the division on the basic unit in response to the obtained residual information meeting a preset residual judgment condition.

10. A coding management device based on high efficiency video coding (HEVC), comprising a processor and a memory, wherein the memory stores a computer program which, when called by the processor, causes the processor to perform a coding management method based on HEVC comprising:

obtaining a calculated correlation result for a HEVC basic unit before and after division, the correlation result comprising spatial correlation α s between the basic unit before the division and the N basic units generated after the division, and spatial correlation β s between the N basic units generated after the division of the basic unit, and N being an integer greater than 1; and

judging whether or not to perform the division on the basic unit according to the calculated correlation result.

11. The device of claim 10 , wherein:

α s is obtained by the following formula:

α

s

=

N

*

D

⁡

(

X

)

d

D

⁡

(

X

)

1

d

+

1

+

D

⁡

(

X

)

2

d

+

1

+

D

⁡

(

X

)

3

d

+

1

+

…

+

D

⁡

(

X

)

N

d

+

1

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X) d denotes a spatial correlation degree before the division of the basic unit; and D(X) i d+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and

β s is obtained by the following formula:

β

s

=

max

⁡

(

D

⁡

(

X

)

1

d

+

1

,

D

⁡

(

X

)

2

d

+

1

,

D

⁡

(

X

)

3

d

+

1

,

…

,

D

⁡

(

X

)

N

d

+

1

)

min

⁡

(

D

⁡

(

X

)

1

d

+

1

,

D

⁡

(

X

)

2

d

+

1

,

D

⁡

(

X

)

3

d

+

1

,

…

,

D

⁡

(

X

)

N

d

+

1

)

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; D(X) d denotes a spatial correlation degree before the division of the basic unit; and D(X) i d+1 denotes a spatial correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

12. The device of claim 10 , wherein the calculated correlation result further comprises:

a temporal correlation result of the basic unit before the division and the N basic units generated after the division.

13. The device of claim 12 , wherein the temporal correlation result comprises at least one of:

temporal correlation α t between the basic unit before the division and the N basic units generated after the division; and

temporal correlation β t between the N basic units generated after the division of the basic unit.

14. The device of claim 13 , wherein:

α t is obtained by the following formula:

α

t

=

N

*

D

⁡

(

Y

)

d

D

⁡

(

Y

)

1

d

+

1

+

D

⁡

(

Y

)

2

d

+

1

+

D

⁡

(

Y

)

3

d

+

1

+

…

+

D

⁡

(

Y

)

N

d

+

1

;

wherein N denotes a total number of the basic units generated after the division; d denotes a depth before the division of the basic unit; d+1 denotes a depth after the division of the basic unit; and D(Y) d denotes a temporal correlation degree before the division of the basic unit; and D(Y) i d+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N; and

β t is obtained by the following formula:

β

t

=

max

⁡

(

D

⁡

(

Y

)

1

d

+

1

,

D

⁡

(

Y

)

2

d

+

1

⁢

D

⁡

(

Y

)

3

d

+

1

,

…

,

D

⁡

(

Y

)

N

d

+

1

)

min

⁡

(

D

⁡

(

Y

)

1

d

+

1

,

D

⁡

(

Y

)

2

d

+

1

,

D

⁡

(

Y

)

3

d

+

1

,

…

,

D

⁡

(

Y

)

N

d

+

1

)

;

wherein N denotes a total number of the basic units generated after denotes a depth after the division of the basic unit; and D(Y) d denotes a temporal correlation degree before the division of the basic unit; and D(Y) i d+1 denotes a temporal correlation degree of the ith basic unit generated after the division of the basic unit, and i=1, 2, 3, . . . , N.

15. The device of claim 12 , wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:

acquiring a video frame type corresponding to the basic unit;

judging whether or not to perform the division on the basic unit according to the calculated correlation result in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and

judging whether or not to perform the division on the basic unit according to the spatial correlation result and the temporal correlation result in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

16. The device of claim 15 , wherein the judging whether or not to perform the division on the basic unit according to the calculated correlation result comprises:

judging whether or not to perform the division on the basic unit according to a spatial correlation degree of the basic unit before the division in response to the video frame type corresponding to the basic unit being an intra-frame video frame; and

judging whether or not to perform the division on the basic unit according to the spatial correlation degree and a temporal correlation degree before the division of the basic unit in response to the video frame type corresponding to the basic unit being an unidirectionally predictively coded frame or a bidirectionally predictively coded frame.

17. The device of claim 16 , after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:

collecting statistics on the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing the division after a result of judging whether or not to perform the division on the basic unit is obtained; and

determining a threshold used in an execution of a next judgment on whether or not to perform the division on the basic unit according to the correlation result of the basic unit undergoing the division and the correlation result of the basic unit not undergoing division, wherein the threshold comprise at least one of a threshold for performing the division and a threshold for not performing the division.

18. The device of claim 10 , after the judging whether or not to perform the division on the basic unit according to the calculated correlation result, the method further comprising:

calculating residual information of the basic unit after determining not to perform the division on the basic unit; and

performing the division on the basic unit in response to the obtained residual information meeting a preset residual judgment condition.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2022
From: ZTE CORPORATION
To: SANECHIPS TECHNOLOGY CO., LTD.
Reel/Frame 061789/0596 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 6, 2021
From: XU, KE; SONG, JIANJUN
To: ZTE CORPORATION
Reel/Frame 057718/0447 →
Priority Claims (1)
CN 201910512079.9 · Jun 13, 2019 · national
Continuity (1)
Related Publication 20220210459A1 · Jun 30, 2022