IP Library Granted Patent US 12,355,986
Granted Patent B2
US 12,355,986 · App. 18/376,980 · Granted Jul 8, 2025

Intra mode coding

Inventors: Liang Zhao (Palo Alto, CA); Xin Zhao (San Diego, CA); Xiang Li (Los Gatos, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H04N19/167H04N19/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,355,986
App. No.
18/376,980
Granted
Jul 8, 2025
Kind
B2
Abstract

A method of and an apparatus for controlling intra prediction for encoding of a video sequence are provided. The method includes determining a ratio of a width to a height of a coding unit, and based on the determined ratio being different than one, adding, to a table including intra prediction modes corresponding to intra prediction angles, first wide angles toward a bottom-left edge of the coding unit, second wide angles toward a top-right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles. The method further includes signaling, for encoding the video sequence, one of the intra prediction modes and the additional intra prediction modes added to the table.

Claims (234)

1. A method of controlling intra prediction for decoding a video sequence, the method being performed by at least one processor, and the method comprising:

determining a ratio of a width to a height of a coding unit;

based on the ratio being different than one, determining that a table comprises a plurality of intra prediction modes corresponding to intra prediction angles, first wide angles toward a left portion of bottom edge of the coding unit, second wide angles toward a top portion of right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles, wherein each of the intra prediction angles included in the table has an angular direction α with tan(α) equal to {0/32, 1/32, 2/32, 3/32, 4/32, 6/32, 8/32, 10/32, 12/32, 14/32, 16/32, 18/32, 20/32, 23/32, 26/32, 29/32, 32/32}; and

determining, for decoding the video sequence, one of the plurality of intra prediction modes and the additional intra prediction modes comprised in the table.

2. The method of claim 1 , wherein a number of the first wide angles added to the table is 14.

3. The method of claim 2 , wherein each of the first wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32}.

4. The method of claim 1 , wherein a number of the second wide angles added to the table is 14.

5. The method of claim 4 , wherein each of the second wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32}.

6. The method of claim 1 , wherein a number of the first wide angles added to the table is 15.

7. The method of claim 6 , wherein each of the first wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32, 1024/32}.

8. The method of claim 1 , wherein a number of the second wide angles added to the table is 15.

9. The method of claim 8 , wherein each of the second wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32, 1024/32}.

10. The method of claim 1 , wherein a first number of the plurality of intra prediction modes included in the table is 67,

a second number of the additional intra prediction modes added to the table is 28, and the table includes:

predModeIntra

−14

−13

−12

−11

intraPredAngle

512

341

256

171

predModeIntra

−10

−9

−8

−7

−6

−5

−4

−3

−2

−1

2

3

4

5

6

7

8

intraPredAngle

128

102

86

73

64

57

51

45

39

35

32

29

26

23

20

18

16

predModeIntra

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

intraPredAngle

14

12

10

8

6

4

3

2

1

0

−1

−2

−3

−4

−6

−8

−10

predModeIntra

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

intraPredAngle

−12

−14

−16

−18

−20

−23

−26

−29

−32

−29

−26

−23

−20

−18

−16

−14

−12

predModeIntra

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

intraPredAngle

−10

−8

−6

−4

−3

−2

−1

0

1

2

3

4

6

8

10

12

14

predModeIntra

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

intraPredAngle

16

18

20

23

26

29

32

35

39

45

51

57

64

73

86

102

128

predModeIntra

77

78

79

80

intraPredAngle

171

256

341

512

where predModeIntra denotes the plurality of intra prediction modes, and intraPredAngle denotes the intra prediction angles.

11. An apparatus for controlling intra prediction for decoding of a video sequence, the apparatus comprising:

at least one memory configured to store computer program code; and

at least one processor configured to access the at least one memory and operate according to the computer program code, the computer program code comprising:

determining code configured to cause the at least one processor to determine a ratio of a width to a height of a coding unit;

adding code configured to cause the at least one processor to, based on the ratio being different than one, add, to a table including a plurality of intra prediction modes corresponding to intra prediction angles, first wide angles toward a left portion of bottom edge of the coding unit, second wide angles toward a top portion of right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles, wherein each of the intra prediction angles included in the table has an angular direction α with tan(α) equal to {0/32, 1/32, 2/32, 3/32, 4/32, 6/32, 8/32, 10/32, 12/32, 14/32, 16/32, 18/32, 20/32, 23/32, 26/32, 29/32, 32/32}; and

selecting code configured to cause the at least one processor to determine, for decoding the video sequence, one of the plurality of intra prediction modes and the additional intra prediction modes comprised in the table.

12. The apparatus of claim 11 , wherein a number of the first wide angles added to the table is 14.

13. The apparatus of claim 12 , wherein each of the first wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32}.

14. The apparatus of claim 11 , wherein a number of the second wide angles added to the table is 14.

15. The apparatus of claim 14 , wherein each of the second wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32}.

16. The apparatus of claim 11 , wherein a number of the first wide angles added to the table is 15.

17. The apparatus of claim 16 , wherein each of the first wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32, 1024/32}.

18. The apparatus of claim 11 , wherein a number of the second wide angles added to the table is 15.

19. The apparatus of claim 18 , wherein each of the second wide angles added to the table has the angular direction α with tan(α) equal to {35/32, 39/32, 45/32, 51/32, 57/32, 64/32, 73/32, 86/32, 102/32, 128/32, 171/32, 256/32, 341/32, 512/32, 1024/32}.

20. A non-transitory computer-readable storage medium storing instructions that cause at least one processor to:

perform a conversion between a visual media file and a bitstream of a visual media data according to a format rule, the format rule indicating that the bitstream comprises a plurality of syntax elements and to implement:

determining a ratio of a width to a height of a coding unit;

based on the ratio being different than one, adding to or retrieving from a table that comprises a plurality of intra prediction modes corresponding to intra prediction angles, first wide angles toward a left portion of bottom edge of the coding unit, second wide angles toward a top portion of right edge of the coding unit, and additional intra prediction modes respectively corresponding to the first wide angles and the second wide angles, wherein each of the intra prediction angles included in the table has an angular direction α with tan(α) equal to {0/32, 1/32, 2/32, 3/32, 4/32, 6/32, 8/32, 10/32, 12/32, 14/32, 16/32, 18/32, 20/32, 23/32, 26/32, 29/32, 32/32}; and

selecting, for the performing the conversion, one of the plurality of intra prediction modes and the additional intra prediction modes comprised in the table.

Continuity (6)
Continuation 17550486 · Dec 14, 2021
Continuation 17036342 · Sep 29, 2020
Continuation 16549524 · Aug 23, 2019
Continuation 16198951 · Nov 23, 2018
Provisional Application 62734996 · Sep 21, 2018
Related Publication 20240048728A1 · Feb 8, 2024
References Cited (19)
US 10469845B1 · Zhao · 2019 [cited by examiner]
US 11240514B2 · Zhao · 2022 [cited by examiner]
US 20130336398A1 · Lee et al. · 2013 [cited by applicant]
US 20150043641A1 · Gamei et al. · 2015 [cited by applicant]
US 20160373770A1 · Zhao · 2016 [cited by examiner]
WO 2018117892A1 · 2018 [cited by applicant]
Office Action issued Dec. 15, 2022 in Chinese Application No. 201980044472.8. [cited by applicant]
Benjamin Bross et al., Versatile Video Coding (Draft 2), Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K1001-v4, Jul. 10-18, 2018, 11th Meeting, Ljubljana, SI (86 pages total). [cited by applicant]
Fabien Racape et al., “CE3-related: Wide-angle intra prediction for non-square blocks”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0500_r3, Jul. 10-18, 2018, 11th Meeting, L… [cited by applicant]
Liang Zhao et al., “CE3-related: Wide angular intra prediction for non-square blocks”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, JVET-K0289_v1, Jul. 10-20, 2018, 11th Meeting… [cited by applicant]
International Search Report issued Sep. 30, 2019 in International Application No. PCT/US2019/049636. [cited by applicant]
Written Opinion of the International Searching Authority issued Sep. 30, 2019 in International Application No. PCT/US2019/049636. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, pp. 60-61, Jul. 10-18, 2018 (136 pages total). [cited by applicant]
Extended European Search Report issued May 3, 2021 in European Application No. 19861637.7. [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 3)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12, 2018, JVET-L1001-v9 (235 pages total). [cited by applicant]
Zhao et al., “CE3-related: Unification of angular intra prediction for square and non-square blocks”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 12th Meeting: Macao, CN, Oct. 3-12… [cited by applicant]
Bross et al., “Versatile Video Coding (Draft 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018, JVET-K1001-v3 (72 pages total). [cited by applicant]
Chen et al., “Algorithm description for Versatile Video Coding and Test Model 2 (VTM 2)”, Joint Video Experts Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 11th Meeting: Ljubljana, SI, Jul. 10-18, 2018,… [cited by applicant]
Sjoberg et al., “Description of SDR and HDR video coding technology proposal by Ericsson and Nokia”, Joint Video Exploration Team (JVET) of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC 29/WG 11, 10th Meeting: San Diego, CA, US… [cited by applicant]