Granted Patent B2

US 12,243,281 · App. 17/802,451 · Granted Mar 4, 2025

Inventors: Yun Li (Lund, SE); Fredrik Dahlgren (Lund, SE); Héctor Caltenco (Oxie, SE); Alexander Hunt (Tygelsjö, SE); Saeed Bastani (Dalby, SE)

Assignee: TELEFONAKTIEBOLAGET LM ERICSSON (publ)

G06V10/20G06T7/11G06T9/002G06V10/96G06T2207/20012G06T2207/20081G06T2207/20084

Abstract

Claims (114)

1. A system comprising a first image processing arrangement and a second image processing arrangement, wherein the first image processing arrangement comprises a controller configured to:

a) receive an image;

b) select a task and a task identifier associated with task data;

c) compress the image based on the task data; and

d) transmit the compressed image to the second image processing arrangement for processing, and wherein the second image processing arrangement comprises a controller configured to:

e) receive the compressed image and task identifier;

f) retrieve task parameters associated with the task identifier;

g) process the compressed image based on the task parameters;

h) determine results and

i) transmit the at least indications of the determined results to the first image processing arrangement, and the controller of the first image processing arrangement is further configured to:

j) receive at least indications of a result of the processing from the second image processing arrangement; and

k) indicate the result.

2. The image processing arrangement according to claim 1 , wherein the image data file is in raw format.

3. The image processing arrangement according to claim 1 , wherein the controller of the first image processing arrangement is further configured to b) select the task in communication with the controller of the second image processing arrangement and wherein the controller of the second image processing arrangement is further configured to select the task in communication with the controller of the first image processing arrangement.

4. The image processing arrangement according to claim 1 , wherein the controller of the first image processing arrangement is further configured to c) compress the image utilizing a compressing neural network.

5. The image processing arrangement according to claim 1 , wherein the controller of the second image processing arrangement is further configured to g) process the compressed image utilizing a processing neural network.

6. The image processing arrangement according to claim 5 , wherein the processing neural network comprises a decompression neural network and a task performing neural network.

7. The image processing arrangement according to claim 4 ,

wherein the controller of the second image processing arrangement is further configured to g) process the compressed image utilizing a processing neural network, and

wherein the controller of the first image processing arrangement and the controller of the second image processing arrangement are further configured to train the compressing neural network and the processing neural network respectively end-to-end.

8. The image processing arrangement according to claim 7 , wherein the controller of the first image processing arrangement and the controller of the second image processing arrangement are further configured to train the compressing neural network and the processing neural network respectively end-to-end by minimizing the bit rate and the task accuracy loss.

9. The image processing arrangement according to claim 7 , wherein the controller of the first image processing arrangement and the controller of the second image processing arrangement are further configured to train the compressing neural network and the processing neural network respectively end-to-end by minimizing the distortion of the image, the bit rate and the task accuracy loss.

10. The image processing arrangement according to claim 1 , wherein the processing is object detection.

11. The image processing arrangement according to claim 1 , wherein the first image processing arrangement is an optical see-through device.

12. The image processing arrangement according to claim 1 , wherein the second image processing arrangement is a smartphone or a computer.

13. The image processing arrangement according to claim 1 , wherein the image processing arrangement is arranged to be used in image retrieval, industrial use, robotic vision and/or video surveillance.

14. A method for image processing in a system comprising a first image processing arrangement and a second image processing arrangement, wherein the method comprises in the first image processing arrangement:

a) receiving an image;

b) selecting a task and a task identifier associated with task data;

c) compressing the image based on the task data; and

d) transmitting the compressed image to the second image processing arrangement for processing, and wherein the method comprises in the second image processing arrangement:

e) receiving the compressed image and task identifier;

f) retrieving task parameters associated with the task identifier;

g) processing the compressed image based on the task parameters;

h) determining results and

i) transmitting the at least indications of the determined results to the first image processing arrangement, and the method further comprises in the first image processing arrangement:

j) receiving at least indications of a result of the processing from the second image processing arrangement; and

k) indicating the result.

15. An image processing arrangement for image processing in an image processing arrangement system comprising a first image processing arrangement and a second image processing arrangement, the image processing arrangement comprising circuitry for processing images comprising:

a) a circuitry for receiving an image in the first image processing arrangement;

b) a circuitry for selecting a task and a task identifier associated with task data in the first image processing arrangement;

c) a circuitry for compressing the image based on the task data in the first image processing arrangement; and

d) a circuitry for transmitting the compressed image to the second image processing arrangement for processing;

e) a circuitry for receiving the compressed image and task identifier in the second image processing arrangement;

f) a circuitry for retrieving task parameters associated with the task identifier in the second image processing arrangement;

g) a circuitry for processing the compressed image based on the task parameters in the second image processing arrangement;

h) a circuitry for determining results and

i) a circuitry for transmitting the at least indications of the determined results to the first image processing arrangement;

j) a circuitry for receiving at least indications of a result of the processing from the second image processing arrangement in the first image processing arrangement; and

k) a circuitry for indicating the result.

16. A first image processing arrangement comprising a controller configured to:

a) receive an image;

b) select a task and a task identifier associated with task data;

c) compress the image based on the task data; and

d) transmit the compressed image to the second image processing arrangement for processing;

j) receive at least indications of a result of the processing from the second image processing arrangement; and

k) indicate the result.

17. A method for image processing in a first image processing arrangement, said method comprising:

a) receiving an image;

b) selecting a task and a task identifier associated with task data;

c) compressing the image based on the task data; and

d) transmitting the compressed image to the second image processing arrangement for processing;

j) receiving at least indications of a result of the processing from the second image processing arrangement; and

k) indicating the result.

18. An arrangement comprising circuitry for image processing in a first image processing arrangement, said arrangement comprising circuitry comprising:

a) a circuitry for receiving an image;

b) a circuitry for selecting a task and a task identifier associated with task data;

c) a circuitry for compressing the image based on the task data; and

d) a circuitry for transmitting the compressed image to the second image processing arrangement for processing;

j) a circuitry for receiving at least indications of a result of the processing from the second image processing arrangement; and

k) a circuitry for indicating the result.

19. A second image processing arrangement comprising a controller configured to:

e) receive a compressed image and a task identifier from a first image processing arrangement;

f) retrieve task parameters associated with the task identifier;

g) process the compressed image based on the task parameters;

h) determine results; and

i) transmit at least indications of the determined results to the first image processing arrangement.

20. A method for image processing in a second image processing arrangement, said method comprising:

e) receiving a compressed image and a task identifier from a first image processing arrangement;

f) retrieving task parameters associated with the task identifier;

g) processing the compressed image based on the task parameters;

h) determining results; and

i) transmitting at least indications of the determined results to the first image processing arrangement.

21. An arrangement comprising circuitry for image processing in a second image processing arrangement, said arrangement comprising circuitry comprising:

e) a circuitry for receiving a compressed image and a task identifier from a first image processing arrangement;

f) a circuitry for retrieving task parameters associated with the task identifier;

g) a circuitry for processing the compressed image based on the task parameters;

h) a circuitry for determining results; and

i) a circuitry for transmitting at least indications of the determined results to the first image processing arrangement.

22. A non-transitory computer-readable medium carrying computer instructions that when loaded into and executed by a controller of an image processing arrangement enables the image processing arrangement to implement a method for image processing in a system comprising a first image processing arrangement and a second image processing arrangement, wherein the method comprises in the first image processing arrangement:

a) receiving an image;

b) selecting a task and a task identifier associated with task data;

c) compressing the image based on the task data; and

d) transmitting the compressed image to the second image processing arrangement for processing, and wherein the method comprises in the second image processing arrangement:

e) receiving the compressed image and task identifier;

f) retrieving task parameters associated with the task identifier;

g) processing the compressed image based on the task parameters;

h) determining results and

i) transmitting the at least indications of the determined results to the first image processing arrangement, and the method further comprises in the first image processing arrangement:

j) receiving at least indications of a result of the processing from the second image processing arrangement; and

k) indicating the result.

23. A non-transitory computer-readable medium carrying computer instructions that when loaded into and executed by a controller of an image processing arrangement enables the image processing arrangement to implement a method for image processing in a first image processing arrangement, said method comprising:

a) receiving an image;

b) selecting a task and a task identifier associated with task data;

c) compressing the image based on the task data; and

d) transmitting the compressed image to the second image processing arrangement for processing;

j) receiving at least indications of a result of the processing from the second image processing arrangement; and

k) indicating the result.

24. A non-transitory computer-readable medium carrying computer instructions that when loaded into and executed by a controller of an image processing arrangement enables the image processing arrangement to implement a method for image processing in a second image processing arrangement, said method comprising:

e) receiving a compressed image and a task identifier from a first image processing arrangement;

f) retrieving task parameters associated with the task identifier;

g) processing the compressed image based on the task parameters;

h) determining results; and

i) transmitting at least indications of the determined results to the first image processing arrangement.

Assignments (1)

Continuity (1)

References Cited (27)

Cited By (1)

US 12,567,976