IP Library › Granted Patent US 12,417,374
Granted Patent B2
US 12,417,374 · App. 18/577,217 · Granted Sep 16, 2025

Non-linear encoding and decoding for reliable wireless communication

Inventors: Sewoong Oh (Seattle, WA); Xiyang Liu (Seattle, WA); Hessam Mahdavifar (Ann Arbor, MI); Mohammad Vahid Jamali (Ann Arbor, MI); Pramod Viswanath (Champaign, IL); Ashok Makkuva (Champaign, IL)
Assignees: University of Washington; The Regents of the University of Michigan; The Board of Trustees of the University of Illinois
G06N3/0455G06N7/046H03M13/21H03M13/611
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,417,374
App. No.
18/577,217
Granted
Sep 16, 2025
Kind
B2
Abstract

A method of encoding a set of information bits to produce a codeword that encodes the set of information bits for reliable communication is provided. The set of information bits is received. The set of information bits are provided to a plurality of permutation layers separated by neural network processing layers. Each permutation layer accepts an input vector and generates a reordered output vector that is a reordering of the input vector. Each neural network processing layer accepts a vector of input values and generates a vector of output values based on a non-linear function of the vector of input values. The reordered output vector of a final permutation layer of the plurality of permutation layers is provided as the codeword. In some embodiments, a corresponding method of decoding a codeword to retrieve a set of information bits is provided.

Claims (39)

1. A method of encoding a set of information bits to produce a codeword that encodes the set of information bits for reliable communication, the method comprising:

receiving the set of information bits;

providing the set of information bits to a plurality of permutation layers separated by neural network processing layers, wherein each permutation layer accepts an input vector and generates a reordered output vector that is a reordering of the input vector, and wherein each neural network processing layer accepts a vector of input values and generates a vector of output values based on a non-linear function of the vector of input values; and

providing the reordered output vector of a final permutation layer of the plurality of permutation layers as the codeword.

2. The method of claim 1 , wherein each neural network processing layer includes a single neural network that accepts an entirety of the vector of input values.

3. The method of claim 1 , wherein each neural network processing layer includes a plurality of neural networks that each accepts a subset of the vector of input values.

4. The method of claim 3 , wherein for a given neural network processing layer, weights of each neural network in the plurality of neural networks are the same.

5. The method of claim 3 , wherein each neural network of the plurality of neural networks accepts a pair of input values from the vector of input values as input.

6. The method of claim 1 , wherein at least one neural network processing layer of the neural network processing layers uses SeLU activation.

7. The method of claim 1 , further comprising adding one or more zero values to pad the set of information bits to a size expected by the plurality of permutation layers and the plurality of neural network layers.

8. The method of claim 1 , wherein the codeword is a real-valued vector.

9. A method of reliable wireless transmission of a set of information bits, the method comprising:

determining a set of information bits to be transmitted;

encoding the set of information bits in a codeword; and

wirelessly transmitting the codeword;

wherein encoding the set of information bits in a codeword comprises a method as recited in claim 1 .

10. A method of decoding a codeword to retrieve a set of information bits, the method comprising:

receiving the codeword;

providing the codeword to a plurality of permutation layers separated by neural network processing layers, wherein each permutation layer accepts an input vector and generates a reordered output vector that is a reordering of the input vector, and wherein each neural network processing layer accepts a vector of input values and generates a vector of output values based on a non-linear function of the vector of input values; and

performing a plurality of forward calculations and backward calculations using the plurality of permutation layers separated by the neural network processing layers to retrieve the set of information bits.

11. The method of claim 10 , wherein performing the plurality of forward calculations and backward calculations using the plurality of permutation layers separated by the neural network processing layers to retrieve the set of information bits includes:

performing a forward calculation;

extracting an information bit of the set of information bits from a result of the forward calculation;

performing a backward calculation; and

repeating at least the forward calculation to extract each information bit of the set of information bits.

12. The method of claim 10 , wherein performing the plurality of forward calculations and backward calculations using the plurality of permutation layers separated by the neural network processing layers to retrieve the set of information bits includes:

performing the plurality of forward calculations and backward calculations; and

extracting the set of information bits from a result of the plurality of forward calculations and backward calculations.

13. The method of claim 10 , wherein each neural network processing layer includes a single neural network that accepts an entirety of the vector of input values.

14. The method of claim 10 , wherein each neural network processing layer includes a plurality of neural networks that each accepts a subset of the vector of input values.

15. The method of claim 14 , wherein for a given neural network processing layer, weights of each neural network in the plurality of neural networks are the same.

16. The method of claim 14 , wherein each neural network of the plurality of neural networks accepts a pair of input values from the vector of input values as input.

17. The method of claim 10 , wherein at least one neural network processing layer of the neural network processing layers uses SeLU activation.

18. The method of claim 10 , further comprising removing one or more zero values from an output of the plurality of permutation layers separated by the neural network processing layers to retrieve the set of information bits.

19. The method of claim 10 , wherein the codeword is a real-valued vector.

20. A method of reliable wireless reception of a set of information bits, the method comprising:

wirelessly receiving a codeword; and

decoding a set of information bits from the codeword;

wherein decoding the set of information bits from the codeword comprises a method as recited in claim 10 .

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: OH, SEWOONG; LIU, XIYANG
To: UNIVERSITY OF WASHINGTON
Reel/Frame 071634/0787 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: MAHDAVIFAR, HESSAM; JAMALI, MOHAMMAD VAHID
To: THE REGENTS OF THE UNIVERSITY OF MICHIGAN
Reel/Frame 071634/0831 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 8, 2025
From: VISWANATH, PRAMOD; MAKKUVA, ASHOK
To: THE BOARD OF TRUSTEES OF THE UNIVERSITY OF ILLINOIS
Reel/Frame 071634/0950 →
Continuity (2)
Provisional Application 63219264 · Jul 7, 2021
Related Publication 20250105859A1 · Mar 27, 2025
References Cited (74)
US 9059739B2 · Arikan · 2015 [cited by applicant]
US 9846836B2 · Gao · 2017 [cited by examiner]
US 10735141B2 · Bennatan · 2020 [cited by applicant]
US 10970441B1 · Zhang · 2021 [cited by applicant]
US 20020090024A1 · Tan · 2002 [cited by applicant]
US 20020106004A1 · Tan · 2002 [cited by applicant]
US 20100077282A1 · Shen · 2010 [cited by applicant]
US 20120185757A1 · Jeong · 2012 [cited by applicant]
US 20170117945A1 · Kim · 2017 [cited by applicant]
US 20180174042A1 · Srinivasa · 2018 [cited by applicant]
US 20210111936A1 · Sahin · 2021 [cited by applicant]
US 20220343152A1 · Dai · 2022 [cited by examiner]
US 20250125854A1 · Liu · 2025 [cited by examiner]
CN 104410593 · 2015 [cited by applicant]
CN 105207749 · 2015 [cited by applicant]
CN 110335217 · 2019 [cited by applicant]
CN 112769858 · 2021 [cited by applicant]
CN 113037726 · 2021 [cited by applicant]
CN 113067672 · 2021 [cited by applicant]
JP 2014138218 · 2014 [cited by applicant]
WO 2021018402 · 2021 [cited by applicant]
Chiu. Interleaved Polar (I-Polar) Codes.⋅ In: Cornell University Library/ Computer Science/ Information Theory, Aug. 2, 2019, [online] [retrieved on Oct. 19, 2022 (Oct. 19, 2022)] Retrieved from the Internet< URL: https… [cited by applicant]
Abbe, E., Shpilka, A., and Wigderson, A. Reed-muller codes for random erasures and errors. IEEE Transactions on Information Theory, 61(10):5229-5252, 2015. [cited by applicant]
Abbe, E., Shpilka, A., and Ye, M. Reed-muller codes: Theory and algorithms, 2020. pp. 1-44. [cited by applicant]
Alon, N., Kaufman, T., Krivelevich, M., Litsyn, S., and Ron, D. Testing reed-muller codes. IEEE Transactions on Information Theory, 51(11):4032-4039, 2005. [cited by applicant]
Arikan, E. Channel polarization: A method for constructing capacity-achieving codes for symmetric binary-input memoryless channels. IEEE Transactions on information Theory, 55(7):3051-3073, 2009. [cited by applicant]
Cammerer, S., Gruber, T., Hoydis, J., and Ten Brink, S. Scaling deep learning-based decoding of polar codes via partitioning. In GLOBECOM 2017—2017 IEEE global communications conference, pp. 1-6. IEEE, 2017. [cited by applicant]
Carpi, F., Hager, C., Martalò, M., Raheli, R., and Pfister, H. D. Reinforcement learning for channel coding: Learned bit-flipping decoding. In 2019 57th Annual Allerton Conference on Communication, Control, and Computin… [cited by applicant]
Doan, N., Hashemi, S. A., and Gross, W. J. Neural successive cancellation decoding of polar codes. In 2018 IEEE 19th international workshop on signal processing advances in wireless communications (SPAWC), pp. 1-5. IEEE… [cited by applicant]
Dorner, S., Cammerer, S., Hoydis, J., and Ten Brink, S. Deep learning based communication over the air. IEEE Journal of Selected Topics in Signal Processing, 12(1): 132-143, 2017. [cited by applicant]
Dumer, I. Recursive decoding and its performance for lowrate reed-muller codes. IEEE Transactions on Information Theory, 50(5):811-823, 2004. [cited by applicant]
Dumer, I. Soft-decision decoding of reed-muller codes: a simplified algorithm. IEEE transactions on information theory, 52(3):954-963, 2006. [cited by applicant]
Dumer, I. and Shabunov, K. Near-optimum decoding for subcodes of reed-muller codes. In Proceedings. 2001 IEEE International Symposium on Information Theory, pp. 329. IEEE, 2001. [cited by applicant]
Dumer, I. and Shabunov, K. Soft-decision decoding of reed-muller codes: recursive lists. IEEE Transactions on information theory, 52(3):1260-1266, 2006. [cited by applicant]
Ebada, M., Cammerer, S., Elkelesh, A., and ten Brink, S. Deep learning-based polar code design. In 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 177-183. IEEE, 2019. [cited by applicant]
Gruber, T., Cammerer, S., Hoydis, J., and ten Brink, S. On deep learning-based channel decoding. In 2017 51st Annual Conference on Information Sciences and Systems (CISS), pp. 1-6. IEEE, 2017. [cited by applicant]
Jamali, M. V., Liu, X., Makkuva, A. V., Mahdavifar, H., Oh, S., and Viswanath, P. Reed-Muller subcodes: Machine learning-aided design of efficient soft recursive decoding. arXiv preprint arXiv:2102.01671, 2021. pp. 1-8. [cited by applicant]
Jiang, Y., Kannan, S., Kim, H., Oh, S., Asnani, H., and Viswanath, P. Deepturbo: Deep turbo decoder. In 2019 IEEE 20th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC), pp. 1-5. IE… [cited by applicant]
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., and Viswanath, P. Turbo autoencoder: Deep learning based channel codes for point-to-point communication channels. In Advances in Neural Information Processing Systems,… [cited by applicant]
Jiang, Y., Kim, H., Asnani, H., Kannan, S., Oh, S., and Viswanath, P. Learn codes: Inventing low-latency codes via recurrent neural networks. IEEE Journal on Selected Areas in Information Theory, 2020. pp. 1-11. [cited by applicant]
Kaufman, T., Lovett, S., and Porat, E. Weight distribution and list-decoding size of reed-muller codes. IEEE transactions on information theory, 58(5):2689-2696, 2012. [cited by applicant]
Kim, H., Jiang, Y., Rana, R., Kannan, S., Oh, S., and Viswanath, P. Communication algorithms via deep learning. arXiv preprint arXiv:1805.09317, 2018. pp. 1-19. [cited by applicant]
Kim, H., Oh, S., and Viswanath, P. Physical layer communication via deep learning. IEEE Journal on Selected Areas in Information Theory, 2020. pp. 1-15. [cited by applicant]
Kudekar, S., Kumar, S., Mondelli, M., Pfister, H. D., Sasoglu, E., and Urbanke, R. L. Reed-muller codes achieve capacity on erasure channels. IEEE Transactions on information theory, 63(7):4298-4316, 2017. [cited by applicant]
Lapidoth, A. Nearest neighbor decoding for additive nongaussian noise channels. IEEE Transactions on Information Theory, 42(5):1520-1529, 1996. [cited by applicant]
Ma, Z., Xiao, M., Xiao, Y., Pang, Z., Poor, H. V., and Vucetic, B. High-reliability and low-latency wireless communication for internet of things: challenges, fundamentals, and enabling technologies. IEEE Internet of Th… [cited by applicant]
Nachmani, E., Be'ery, Y., and Burshtein, D. Learning to decode linear codes using deep learning. In 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton), pp. 341-346. IEEE, 2016. [cited by applicant]
Nachmani, E., Marciano, E., Lugosch, L., Gross, W. J., Burshtein, D., and Be'ery, Y. Deep learning methods for improved decoding of linear codes. IEEE Journal of Selected Topics in Signal Processing, 12(1):119-131, 2018. [cited by applicant]
O'Shea, T. J., Karra, K., and Clancy, T. C. Learning to communicate: Channel auto-encoders, domain specific regularizers, and attention. In 2016 IEEE International Symposium on Signal Processing and Information Technolo… [cited by applicant]
O'shea, T. and Hoydis, J. An introduction to deep learning for the physical layer. IEEE Transactions on Cognitive Communications and Networking, 3(4):563-575, 2017. [cited by applicant]
Plotkin, M. Binary codes with specified minimum distance. IRE Transactions on Information Theory, 6(4):445-450, 1960. [cited by applicant]
Polyanskiy, Y., Poor, H. V., and Verdú, S. Channel coding rate in the finite blocklength regime. IEEE Transactions on Information Theory, 56(5):2307-2359, 2010. [cited by applicant]
Reed, I. A class of multiple-error-correcting codes and the decoding scheme. Transactions of the IRE Professional Group on Information Theory, 4(4):38-49, 1954. [cited by applicant]
Richardson, T. and Urbanke, R. Modern coding theory. Cambridge University Press, 2008. 590 pages. [cited by applicant]
Sason, I. and Shamai, S. Performance analysis of linear codes under maximum-likelihood decoding: A tutorial. 2006. 222 pages. [cited by applicant]
Sberlo, O. and Shpilka, A. On the performance of reedmuller codes with respect to random errors and erasures. In Proceedings of the Fourteenth Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1357-1376. SIAM, 2020. [cited by applicant]
Senior, A. W., Evans, R., Jumper, J., Kirkpatrick, J., Sifre, L., Green, T., Qin, C., Zidek, A., Nelson, A. W., Bridgland, A., et al. Protein structure prediction using multiple deep neural networks in the 13th critical… [cited by applicant]
Shannon, C. E. A mathematical theory of communication. The Bell system technical journal, 27(3):379-423, 1948. [cited by applicant]
Silver, D., Hubert, T., Schrittwieser, J., Antonoglou, I., Lai, M., Guez, A., Lanctot, M., Sifre, L., Kumaran, D., Graepel, T., et al. A general reinforcement learning algorithm that masters chess, shogi, and go through… [cited by applicant]
Sybis, M., Wesolowski, K., Jayasinghe, K., Venkatasubramanian, V., and Vukadinovic, V. Channel coding for ultrareliable low-latency communication in 5g systems. In 2016 IEEE 84th vehicular technology conference (VTCFall… [cited by applicant]
Tal, I. and Vardy, A. How to construct polar codes. IEEE Trans. Inf. Theory, 59(10):6562-6582, 2013. [cited by applicant]
Tal, I. and Vardy, A. List decoding of polar codes. IEEE Transactions on Information Theory, 61(5):2213-2226, 2015. [cited by applicant]
Udrescu, S.-M. and Tegmark, M. Ai feynman: A physicsinspired method for symbolic regression. Science Advances, 6(16):eaay2631, 2020. pp. 1-16. [cited by applicant]
Welling, M. Neural augmentation in wireless communication, 2020. 32 pages. [cited by applicant]
Xu, W., Wu, Z., Ueng, Y.-L., You, X., and Zhang, C. Improved polar decoder based on deep learning. In 2017 IEEE International workshop on signal processing systems (SiPS), pp. 1-6. IEEE, 2017. [cited by applicant]
Ye, M. and Abbe, E. Recursive projection-aggregation decoding of reed-muller codes. IEEE Transactions on Information Theory, 66(8):4948-4965, 2020. [cited by applicant]
Xu, H. “Semi-supervised manifold learning based on polynomial mapping for localization in wireless sensor networks,” Elsevier: Signal Processing vol. 172, Jul. 2020, 107570. [cited by applicant]
Marshall, T. “Coding of Real-Number Sequences for Error Correction: A Digital Signal Processing Problem,” IEEE Journal on Selected Areas in Communications ( vol. 2, Issue: 2, Mar. 1984), pp. 381-392. [cited by applicant]
Z. Han, X. Yuan, C. Xu, S. Jiang and X. Wang, “Sparse Kronecker-Product Coding for Unsourced Multiple Access,” in IEEE Wireless Communications Letters, vol. 10, No. 10, pp. 2274-2278, Oct. 2021, doi: 10.1109/LWC.2021.30… [cited by applicant]
R. D. J. van Nee, “OFDM codes for peak-to-average power reduction and error correction,” Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference, London, UK, 1996, pp. 740-744 vol. 1, doi: 10.1109/GLO… [cited by applicant]
R. Zhang, F. Liu, Z. Zeng, Q. Shang and S. Zhao, “Neural Network Based Successive Cancellation Decoding Algorithm for Polar Codes in URLLC,” 2019 16th International Symposium on Wireless Communication Systems (ISWCS), O… [cited by applicant]
T. V. Luong, Y. Ko, M. Matthaiou, N. A. Vien, M.-T. Le and V.-D. Ngo, “Deep Learning-Aided Multicarrier Systems,” in IEEE Transactions on Wireless Communications, vol. 20, No. 3, pp. 2109-2119, Mar. 2021, doi: 10.1109/T… [cited by applicant]
Makkuva, A. V et al. “KO codes: inventing nonlinear encoding and decoding for reliable wireless communication via deep-learning,” Proceedings of the 38th International Conference on Machine Learning, PMLR 139:7368-7378,… [cited by applicant]
International Search Report and Writen Opinion mailed on Nov. 21, 2022, issued in PCT/US2022/36251, filed on Jul. 6, 2022; 12 pages. [cited by applicant]