IP Library Granted Patent US 11,936,869
Granted Patent B2
US 11,936,869 · App. 18/246,470 · Granted Mar 19, 2024

Image compression sampling method and assembly

Inventors: Yuan Ge (Jiangsu, CN); Hongzhi Shi (Jiangsu, CN); Jian Zhao (Jiangsu, CN)
Assignee: INSPUR SUZHOU INTELLIGENT TECHNOLOGY CO., LTD.
H04N19/126H04N19/119H04N19/132H04N19/176H04N19/88H04N19/895
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,936,869
App. No.
18/246,470
Granted
Mar 19, 2024
Kind
B2
Abstract

An image compression sampling method and assembly are provided. The method includes: performing sparse representation on a target image by using an initial sparse matrix, quantifying an initial sparse representation result to obtain an optimized sparse representation result, and obtaining an optimized sparse matrix; constructing a product matrix by using the optimized sparse matrix and an initial measurement matrix, and adjusting absolute values of off-diagonal elements in the product matrix to be less than a correlation threshold; performing singular value decomposition on the product matrix to obtain a diagonal matrix and a left singular matrix, and updating the diagonal matrix according to a quantity of samplings of the initial measurement matrix; and optimizing the initial measurement matrix by using the left singular matrix and the updated diagonal matrix to obtain an optimized measurement matrix, and collecting image data by using the optimized sparse matrix and the optimized measurement matrix.

Claims (66)

1. An image compression sampling method, comprising:

performing sparse representation on a target image by using an initial sparse matrix to obtain an initial sparse representation result;

quantifying the initial sparse representation result to obtain an optimized sparse representation result, and optimizing the initial sparse matrix according to the optimized sparse representation result to obtain an optimized sparse matrix;

constructing a product matrix by using the optimized sparse matrix and an initial measurement matrix, and adjusting absolute values of off-diagonal elements in the product matrix to be less than a correlation threshold;

performing singular value decomposition on the adjusted product matrix to obtain a diagonal matrix and a left singular matrix, and updating the diagonal matrix according to a quantity of samplings of the initial measurement matrix; and

optimizing the initial measurement matrix by using the left singular matrix and the updated diagonal matrix to obtain an optimized measurement matrix, and collecting image data by using the optimized sparse matrix and the optimized measurement matrix.

2. The image compression sampling method according to claim 1 , wherein the step of performing sparse representation on a target image by using an initial sparse matrix to obtain an initial sparse representation result comprises:

dividing the target image into multiple blocks, and representing each block by a single column;

splicing all the single columns, and obtaining an image matrix of the target image; and

determining a product of the image matrix and the initial sparse matrix as the initial sparse representation result.

3. The image compression sampling method according to claim 2 , wherein the step of updating the initial sparse matrix according to the optimized sparse representation result to obtain an optimized sparse matrix comprises:

determining a sparse error between the optimized sparse representation result and the initial sparse representation result, and solving a minimum value of the sparse error according to a target function to obtain the optimized sparse matrix; and the target function is: min{∥S−ψ 0 X∥ F 2 }, wherein S is the optimized sparse representation result; ψ 0 is the initial sparse matrix; X is the image matrix; and F is an F-norm.

4. The image compression sampling method according to claim 3 , wherein solving a minimum value of the sparse error according to a target function to obtain the optimized sparse matrix comprises:

updating each column in the initial sparse matrix according to a first formula to solve the minimum value, and obtaining the optimized sparse matrix, the first formula being ψ n =S n X n T ×(X n X n T ) −1 ;

where ψ n is an nth column in the optimized sparse matrix; S n is an nth column in the optimized sparse representation result; X n is an nth column in the image matrix; and X n T is an nth column of a transposed matrix of the image matrix.

5. The image compression sampling method according to claim 3 , wherein solving a minimum value of the sparse error according to a target function to obtain the optimized sparse matrix comprises:

updating the initial sparse matrix according to a second formula to solve the minimum value, and

obtaining the optimized sparse matrix, the second formula being ψ=SX T ×(XX T ) −1 ;

where ψ is the optimized sparse matrix; S is the optimized sparse representation result; X is the image matrix; and X T is a transposed matrix of the image matrix.

6. The image compression sampling method according to claim 1 , wherein the step of performing sparse representation on a target image by using an initial sparse matrix to obtain an initial sparse representation result comprises:

performing the sparse representation on the target image by using the initial sparse matrix, and performing rearrangement according to a preset rule to obtain the initial sparse representation result, wherein the preset rule is a zigzag shape, or a hollow square shape, or a column/row rearrangement after column stretching.

7. The image compression sampling method according to claim 1 , wherein the step of quantifying the initial sparse representation result to obtain an optimized sparse representation result comprises:

setting part of elements in the initial sparse representation result to be 0 according to a preset quantification table to obtain the optimized sparse representation result.

8. The image compression sampling method according to claim 1 , wherein the step of adjusting absolute values of off-diagonal elements in the product matrix to be less than a correlation threshold comprises:

determining, from the product matrix, off-diagonal elements with absolute values greater than the correlation threshold as target elements; and

calculating a product of any target element and a preset iteration factor, and replacing the current target element with the product until the absolute values of the off-diagonal elements in the product matrix are all less than the correlation threshold.

9. The image compression sampling method according to claim 1 , wherein the step of updating the diagonal matrix according to a quantity of samplings of the initial measurement matrix comprises:

randomly reserving M nonzero elements in the diagonal matrix, and setting remaining nonzero elements to be 0, so as to update the diagonal matrix, wherein the M is a quantity of rows of the initial measurement matrix.

10. The image compression sampling method according to claim 1 , wherein the step of updating the initial measurement matrix by using the left singular matrix and the updated diagonal matrix to obtain an optimized measurement matrix comprises:

optimizing the initial measurement matrix according to a third formula to obtain the optimized measurement matrix, the third formula being φ=√{square root over (W)}×U T ;

where φ is the optimized measurement matrix; W is the updated diagonal matrix; and U is the left singular matrix.

11. An image compression sampling device, comprising:

a memory, configured to store a computer program; and

a processor, configured to execute the computer program to:

perform sparse representation on a target image by using an initial sparse matrix to obtain an initial sparse representation result;

quantify the initial sparse representation result to obtain an optimized sparse representation result, and optimize the initial sparse matrix according to the optimized sparse representation result to obtain an optimized sparse matrix;

construct a product matrix by using the optimized sparse matrix and an initial measurement matrix, and adjust absolute values of off-diagonal elements in the product matrix to be less than a correlation threshold;

perform singular value decomposition on the adjusted product matrix to obtain a diagonal matrix and a left singular matrix, and update the diagonal matrix according to a quantity of samplings of the initial measurement matrix; and

optimize the initial measurement matrix by using the left singular matrix and the updated diagonal matrix to obtain an optimized measurement matrix, and collect image data by using the optimized sparse matrix and the optimized measurement matrix.

12. The image compression sampling device according to claim 11 , the processor is further configured to:

divide the target image into multiple blocks, and represent each block by a single column;

splice all the single columns, and obtain an image matrix of the target image; and

determine a product of the image matrix and the initial sparse matrix as the initial sparse representation result.

13. The image compression sampling device according to claim 12 , the processor is further configured to:

determine a sparse error between the optimized sparse representation result and the initial sparse representation result, and solve a minimum value of the sparse error according to a target function to obtain the optimized sparse matrix; and the target function is: min{∥S−ψ 0 X∥F 2 }, wherein S is the optimized sparse representation result; ψ 0 is the initial sparse matrix; X is the image matrix; and F is an F-norm.

14. The image compression sampling device according to claim 13 , the processor is further configured to:

updating each column in the initial sparse matrix according to a first formula to solve the minimum value, and obtaining the optimized sparse matrix, the first formula being ψ n =S n X n T ×(X n X n T ) −1 ;

where ψ n is an nth column in the optimized sparse matrix; Sn is an nth column in the optimized sparse representation result; X n is an nth column in the image matrix; and X n T is an nth column of a transposed matrix of the image matrix.

15. The image compression sampling device according to claim 13 , the processor is further configured to:

updating the initial sparse matrix according to a second formula to solve the minimum value, and obtaining the optimized sparse matrix, the second formula being ψ=SX T ×(XX T ) −1 ;

where ψ is the optimized sparse matrix; S is the optimized sparse representation result; X is the image matrix; and X T is a transposed matrix of the image matrix.

16. The image compression sampling device according to claim 11 , the processor is further configured to:

perform the sparse representation on the target image by using the initial sparse matrix, and perform rearrangement according to a preset rule to obtain the initial sparse representation result, wherein the preset rule is a zigzag shape, or a hollow square shape, or a column/row rearrangement after column stretching.

17. The image compression sampling device according to claim 11 , the processor is further configured to:

set part of elements in the initial sparse representation result to be 0 according to a preset quantification table to obtain the optimized sparse representation result.

18. The image compression sampling device according to claim 11 , the processor is further configured to:

determining, from the product matrix, off-diagonal elements with absolute values greater than the correlation threshold as target elements; and

calculating a product of any target element and a preset iteration factor, and replacing the current target element with the product until the absolute values of the off-diagonal elements in the product matrix are all less than the correlation threshold.

19. The image compression sampling device according to claim 11 , the processor is further configured to:

randomly reserve M nonzero elements in the diagonal matrix, and setting remaining nonzero elements to be 0, so as to update the diagonal matrix, wherein the M is a quantity of rows of the initial measurement matrix.

20. A non-transitory computer-readable storage medium, storing a computer program, wherein when executed by a processor, the computer program is configured to:

perform sparse representation on a target image by using an initial sparse matrix to obtain an initial sparse representation result;

quantify the initial sparse representation result to obtain an optimized sparse representation result, and optimize the initial sparse matrix according to the optimized sparse representation result to obtain an optimized sparse matrix;

construct a product matrix by using the optimized sparse matrix and an initial measurement matrix, and adjust absolute values of off-diagonal elements in the product matrix to be less than a correlation threshold;

perform singular value decomposition on the adjusted product matrix to obtain a diagonal matrix and a left singular matrix, and update the diagonal matrix according to a quantity of samplings of the initial measurement matrix; and

optimize the initial measurement matrix by using the left singular matrix and the updated diagonal matrix to obtain an optimized measurement matrix, and collect image data by using the optimized sparse matrix and the optimized measurement matrix.

Assignments (2)
LICENSE Recorded Jun 30, 2026
From: IEIT SYSTEMS CO., LTD
To: AIVRES SYSTEMS INC.
Reel/Frame 075857/0939 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 3, 2024
From: GE, YUAN; SHI, HONGZHI; ZHAO, JIAN
To: INSPUR SUZHOU INTELLIGENT TECHNOLOGY CO., LTD.
Reel/Frame 066628/0090 →
Priority Claims (1)
CN 202011363452.8 · Nov 27, 2020 · national
Continuity (1)
Related Publication 20230353739A1 · Nov 2, 2023