IP Library Granted Patent US 11,594,008
Granted Patent B2
US 11,594,008 · App. 17/085,212 · Granted Feb 28, 2023

Method and apparatus for escape reorder mode using a codebook index for neural network model compression

Inventors: Wei Wang (Palo Alto, CA); Wei Jiang (San Jose, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
G06V10/424G06F9/3836G06N3/08
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,594,008
App. No.
17/085,212
Granted
Feb 28, 2023
Kind
B2
Abstract

A method of an escape reorder mode for neural network model compression, is performed by at least one processor, and includes determining whether a frequency count of a codebook index included in a predicted codebook is less than a predetermined value, the codebook index corresponding to a neural network. The method further includes, based on the frequency count of the codebook index being determined to be greater than the predetermined value, maintaining the codebook index, and based on the frequency count of the codebook index being determined to be less than the predetermined value, assigning the codebook index to be an escape index of 0 or a predetermined number. The method further includes encoding the codebook index, and transmitting the encoded codebook index.

Claims (45)

1. A method of an escape reorder mode for neural network model compression, the method being performed by at least one processor, and the method comprising:

determining whether a frequency count of a codebook index included in a predicted codebook is less than a predetermined value, the codebook index corresponding to a neural network;

based on the frequency count of the codebook index being determined to be greater than the predetermined value, maintaining the codebook index;

based on the frequency count of the codebook index being determined to be less than the predetermined value, assigning the codebook index to be an escape index of 0 or a predetermined number;

encoding the codebook index; and

transmitting the encoded codebook index.

2. The method of claim 1 , further comprising determining whether a first flag indicates that the escape reorder mode is used,

wherein the determining whether the frequency count of the codebook index is less than the predetermined value comprises, based on the first flag being determined to indicate that the escape reorder mode is used, determining whether the frequency count of the codebook index is less than the predetermined value.

3. The method of claim 2 , wherein the first flag is included in a syntax section of a three-dimensional coding unit (CU3D) corresponding to the codebook index.

4. The method of claim 3 , further comprising determining whether a second flag indicates that the first flag is included in the syntax section of the CU3D,

wherein the determining whether the first flag indicates that the escape reorder mode is used comprises, based on the second flag being determined to indicate that the first flag is included in the syntax section of the CU3D, determining whether the first flag indicates that the escape reorder mode is used.

5. The method of claim 1 , wherein the encoding the codebook index comprises determining whether the codebook index is the escape index.

6. The method of claim 5 , wherein the encoding the codebook index further comprises, based on the codebook index being determined to be the escape index, encoding a non-zero flag of the codebook index.

7. The method of claim 5 , wherein the encoding the codebook index further comprises, based on the codebook index being determined to not be the escape index, encoding a sign bit followed by an absolute value of the codebook index.

8. An apparatus for an escape reorder mode for neural network model compression, the apparatus comprising:

at least one memory configured to store program code; and

at least one processor configured to read the program code and operate as instructed by the program code, the program code comprising:

first determining code configured to cause the at least one processor to determine whether a frequency count of a codebook index included in a predicted codebook is less than a predetermined value, the codebook index corresponding to a neural network;

maintaining code configured to cause the at least one processor to, based on the frequency count of the codebook index being determined to be greater than the predetermined value, maintain the codebook index;

assigning code configured to cause the at least one processor to, based on the frequency count of the codebook index being determined to be less than the predetermined value, assign the codebook index to be an escape index of 0 or a predetermined number;

encoding code configured to cause the at least one processor to encode the codebook index; and

transmitting code configured to cause the at least one processor to transmit the encoded codebook index.

9. The apparatus of claim 8 , further comprising second determining code configured to cause the at least one processor to determine whether a first flag indicates that the escape reorder mode is used,

wherein the first determining code is further configured to cause the at least one processor to, based on the first flag being determined to indicate that the escape reorder mode is used, determine whether the frequency count of the codebook index is less than the predetermined value.

10. The apparatus of claim 9 , wherein the first flag is included in a syntax section of a three-dimensional coding unit (CU3D) corresponding to the codebook index.

11. The apparatus of claim 10 , further comprising third determining code configured to cause the at least one processor to determine whether a second flag indicates that the first flag is included in the syntax section of the CU3D,

wherein the second determining code is further configured to cause the at least one processor to, based on the second flag being determined to indicate that the first flag is included in the syntax section of the CU3D, determine whether the first flag indicates that the escape reorder mode is used.

12. The apparatus of claim 8 , wherein the encoding code is further configured to cause the at least one processor to determine whether the codebook index is the escape index.

13. The apparatus of claim 12 , wherein the encoding code is further configured to cause the at least one processor to, based on the codebook index being determined to be the escape index, encode a non-zero flag of the codebook index.

14. The apparatus of claim 12 , wherein the encoding code is further configured to cause the at least one processor to, based on the codebook index being determined to not be the escape index, encode a sign bit followed by an absolute value of the codebook index.

15. A non-transitory computer-readable medium storing instructions that, when executed by at least one processor for an escape reorder mode for neural network model compression, cause the at least one processor to:

determine whether a frequency count of a codebook index included in a predicted codebook is less than a predetermined value, the codebook index corresponding to a neural network;

based on the frequency count of the codebook index being determined to be greater than the predetermined value, maintain the codebook index;

based on the frequency count of the codebook index being determined to be less than the predetermined value, assign the codebook index to be an escape index of 0 or a predetermined number;

encode the codebook index; and

transmit the encoded codebook index.

16. The non-transitory computer-readable medium of claim 15 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:

determine whether a first flag indicates that the escape reorder mode is used; and

based on the first flag being determined to indicate that the escape reorder mode is used, determine whether the frequency count of the codebook index is less than the predetermined value.

17. The non-transitory computer-readable medium of claim 16 , wherein the first flag is included in a syntax section of a three-dimensional coding unit (CU3D) corresponding to the codebook index.

18. The non-transitory computer-readable medium of claim 17 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to:

determine whether a second flag indicates that the first flag is included in the syntax section of the CU3D; and

based on the second flag being determined to indicate that the first flag is included in the syntax section of the CU3D, determine whether the first flag indicates that the escape reorder mode is used.

19. The non-transitory computer-readable medium of claim 15 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to determine whether the codebook index is the escape index.

20. The non-transitory computer-readable medium of claim 19 , wherein the instructions, when executed by the at least one processor, further cause the at least one processor to, based on the codebook index being determined to be the escape index, encode a non-zero flag of the codebook index.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 30, 2020
From: WANG, WEI; JIANG, WEI; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 054225/0940 →
Continuity (2)
Provisional Application 62975481 · Feb 12, 2020
Related Publication 20210248410A1 · Aug 12, 2021