IP Library Granted Patent US 11,611,355
Granted Patent B2
US 11,611,355 · App. 17/324,623 · Granted Mar 21, 2023

Techniques for parameter set and header design for compressed neural network representation

Inventors: Byeongdoo Choi (Palo Alto, CA); Wei Wang (Palo Alto, CA); Wei Jiang (Sunnyvale, CA); Stephan Wenger (Hillsborough, CA); Shan Liu (San Jose, CA)
Assignee: TENCENT AMERICA LLC
H03M7/3059H03M7/6005H03M7/70H04L65/75
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,355
App. No.
17/324,623
Granted
Mar 21, 2023
Kind
B2
Abstract

Systems and methods for encoding and decoding neural network data is provided. A method includes: receiving a neural network representation (NNR) bitstream including a group of NNR units (GON) that represents an independent neural network with a topology, the GON including an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit; and reconstructing the independent neural network with the topology by decoding the GON.

Claims (29)

1. A method performed by at least one processor, the method comprising:

receiving a neural network representation (NNR) bitstream including a group of NNR units (GON) that represents an independent neural network with a topology, the GON including an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit; and

reconstructing the independent neural network with the topology by decoding the GON,

wherein each of the NNR model parameter set unit, the NNR layer parameter set unit, the NNR topology unit, the NNR quantization unit, and the NNR compressed data unit is a respective at least one NNR unit, of the GON, that each includes a header and a payload.

2. The method of claim 1 , wherein the GON is included in one or more aggregate NNR units of the NNR bitstream, and the one or more aggregate NNR units each include an aggregate NNR unit header and an aggregate NNR unit payload, the aggregate NNR unit payload including at least a portion of the NNR units of the GON.

3. The method of claim 2 , wherein the GON is included in a single aggregate NNR unit.

4. The method of claim 3 , wherein the single aggregate NNR unit includes a syntax element that indicates a type of the single aggregate NNR unit as a self-contained NNR aggregate unit.

5. The method of claim 4 , wherein the syntax element is included in an aggregate NNR unit header of the single aggregate NNR unit.

6. The method of claim 1 , wherein the NNR model parameter set unit includes a syntax element that indicates that NNR units, that refer to the NNR model parameter set unit, are independently decodable.

7. The method of claim 6 , wherein the syntax element is included in a header of the NNR model parameter set unit.

8. The method of claim 1 , wherein the NNR layer parameter set unit includes a syntax element that indicates that NNR units, that refer to the NNR layer parameter set unit, are independently decodable.

9. The method of claim 8 , wherein the syntax element is included in a header of the NNR layer parameter set unit.

10. The method of claim 1 , wherein, in the GON, the NNR model parameter set unit is followed by the NNR layer parameter set unit.

11. A system comprising:

at least one processor that is configured to receive a neural network representation (NNR) bitstream including a group of NNR units (GON) that represents an independent neural network with a topology, the GON including an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit; and

memory storing computer code, the computer code comprising reconstructing code configured to cause the at least one processor to reconstruct the independent neural network with the topology by decoding the GON,

wherein each of the NNR model parameter set unit, the NNR layer parameter set unit, the NNR topology unit, the NNR quantization unit, and the NNR compressed data unit is a respective at least one NNR unit, of the GON, that each includes a header and a payload.

12. The system of claim 11 , wherein the GON is included in one or more aggregate NNR units of the NNR bitstream, and the one or more aggregate NNR units each include an aggregate NNR unit header and an aggregate NNR unit payload, the aggregate NNR unit payload including at least a portion of the NNR units of the GON.

13. The system of claim 12 , wherein the GON is included in a single aggregate NNR unit.

14. The system of claim 13 , wherein the single aggregate NNR unit includes a syntax element that indicates a type of the single aggregate NNR unit as a self-contained NNR aggregate unit, and the computer code comprises determining code that is configured to determine that the single aggregate NNR unit is self-contained based on the syntax element.

15. The system of claim 14 , wherein the syntax element is included in an aggregate NNR unit header of the single aggregate NNR unit.

16. The system of claim 11 , wherein the NNR model parameter set unit includes a syntax element that indicates that NNR units, that refer to the NNR model parameter set unit, are independently decodable, and the computer code comprises determining code that is configured to determine that the NNR units, that refer to the NNR model parameter set unit, are independently decodable based on the syntax element.

17. The system of claim 16 , wherein the syntax element is included in a header of the NNR model parameter set unit.

18. The system of claim 11 , wherein the NNR layer parameter set unit includes a syntax element that indicates that NNR units, that refer to the NNR layer parameter set unit, are independently decodable, and the computer code comprises determining code that is configured to determine that the NNR units, that refer to the NNR layer parameter set unit, are independently decodable based on the syntax element.

19. The system of claim 18 , wherein the syntax element is included in a header of the NNR layer parameter set unit.

20. A non-transitory computer-readable medium storing computer instructions that, when executed by at least one processor that receives a neural network representation (NNR) bitstream including a group of NNR units (GON) that represents an independent neural network with a topology, cause the at least one processor to:

reconstruct the independent neural network with the topology by decoding the GON,

wherein the GON comprises an NNR model parameter set unit, an NNR layer parameter set unit, an NNR topology unit, an NNR quantization unit, and an NNR compressed data unit,

wherein each of the NNR model parameter set unit, the NNR layer parameter set unit, the NNR topology unit, the NNR quantization unit, and the NNR compressed data unit is a respective at least one NNR unit, of the GON, that each includes a header and a payload.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 19, 2021
From: CHOI, BYEONGDOO; WANG, WEI; JIANG, WEI; WENGER, STEPHAN; LIU, SHAN
To: TENCENT AMERICA LLC
Reel/Frame 056289/0798 →
Continuity (5)
Provisional Application 63090131 · Oct 9, 2020
Provisional Application 63088304 · Oct 6, 2020
Provisional Application 63047214 · Jul 1, 2020
Provisional Application 63042298 · Jun 22, 2020
Related Publication 20210399739A1 · Dec 23, 2021
Cited By (1)
US 12,294,390