IP Library Granted Patent US 12,641,348
Granted Patent B2
US 12,641,348 · App. 18/862,971 · Granted May 26, 2026

Data processing system for processing pixel data to be indicative of contrast

Inventors: Henrik Jörntell (Lund, SE); Udaya Bahskar Rongala (Lund, SE); Elias Högbom Aronsson (Lund, SE)
Assignee: IntuiCell AB
H04N25/60G06N3/049G06V10/50G06V10/62H04N23/54H04N23/61H04N23/675H04N25/47G06V10/75G06V20/69H04N23/617H04N25/707
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,641,348
App. No.
18/862,971
Granted
May 26, 2026
Kind
B2
Abstract

The disclosure relates to a data processing system, configured to receive pixel data, comprising central pixel data and neighboring pixel data, from each image of a sequence of images captured by an imaging device as system input and configured to have a system output, comprising: a network comprising: a plurality of input nodes, each input node configured to receive pixel data from a respective pixel as input, each input node comprising an input node leaky integrator, LI, having a first time constant and a weight for the input, and each input node being configured to produce an input node output by applying the input node LI and a respective weight to the input; and an output node, comprising an output node weight and a multiple input LI having a second time constant, wherein the output node is configured to receive each of the input node outputs, wherein the output node is configured to receive pixel data from the central pixel, wherein the output node is configured to combine the pixel data from the central pixel with the output node weight to produce weighted central pixel data and wherein the output node is configured to apply the multiple input LI to the weighted central pixel data and to each of the node outputs and wherein the output node is configured to produce the system output as a combination of the weighted central pixel data and each of the node outputs; and wherein the second time constant is smaller than the first time constant, and wherein the system output is indicative of a contrast.

Claims (52)

1 . A data processing system for processing pixel data, configured to receive pixel data, comprising central pixel data and neighboring pixel data, from each image of a sequence of images captured by an imaging device as system input and configured to have a system output, the system comprising:

a plurality of input nodes, each input node configured to receive pixel data from a respective pixel as input, each input node comprising an input node leaky integrator having a first time constant and a weight for the input, and each input node being configured to produce an input node output by applying the input node leaky integrator and a respective weight to the input; and

an output node, comprising an output node weight and a multiple input leaky integrator having a second time constant,

wherein the output node is configured to:

receive each of the input node outputs,

receive pixel data from the central pixel,

combine the pixel data from the central pixel with the output node weight to produce weighted central pixel data,

apply the multiple input leaky integrator to the weighted central pixel data and to each of the input node outputs, and

produce the system output as a combination of the weighted central pixel data and each of the node outputs; and

wherein the second time constant is smaller than the first time constant, and wherein the system output is indicative of a contrast.

2 . The data processing system of claim 1 , wherein the method further comprises obtaining, by applying the leaky integrators and feed the data processing system with pixel data from multiple images, a temporal differential signal indicative of a contrast between the pixels in the same position of the different images.

3 . The data processing system of claim 1 , wherein the method further comprises obtaining, by inputting data from a central pixel and data from neighboring pixels to the data processing system, a spatial differential signal indicative of a contrast between the central pixel and the neighboring pixels in the same image.

4 . The data processing system of claim 1 , comprising a threshold unit configured to receive the system output, wherein the threshold unit is configured to compare the system output with a threshold and wherein the threshold unit is configured to output a signal indicative of a detected event.

5 . The data processing system of claim 1 , wherein the weight of an input node is larger the closer the central pixel is to the pixel.

6 . The data processing system of claim 1 , wherein the sum of all weights of the input nodes are equal to the output node weight.

7 . A device comprising the data processing system of claim 1 and an imaging device, the imaging device being configured to capture the pixel data and to transmit the captured pixel data to the data processing system.

8 . A device comprising the data processing system of claim 1 and an imaging device, the imaging device being configured to capture the pixel data and to transmit the captured pixel data to the processing system, wherein the imaging device is a multiphoton microscope, a laser confocal microscope or a digital video camera.

9 . An arrangement comprising:

the data processing system of claim 1 for each of the pixels of the pixel data;

a database comprising images of known objects; and

a post-processing unit configured to receive the system output from each of the data processing systems, configured to compare the system outputs to the images of the known objects, and configured to identify an object present in the pixel data, based on the comparison, as the known object with the image differing the least from the system output.

10 . The data processing system of claim 1 , wherein the system output produced as a combination of the weighted central pixel data and each of the node outputs comprises differential data generated by subtracting each of the input node outputs from the weighted central pixel data.

11 . A computer-implemented method for processing pixel data, the method comprising:

receiving pixel data comprising data from a central pixel and data from neighboring pixels from each image of a sequence of images as system input;

providing each of the pixels as input to a respective input node;

applying a respective input node leaky integrator, having a first time constant, and a respective weight to each of the inputs, thereby producing an input node output;

receiving, by an output node, each of the input node outputs and pixel data from the central pixel;

combining the pixel data from the central pixel with an output node weight, thereby producing weighted central pixel data;

applying a multiple input leaky integrator having a second time constant, the second time constant being smaller than the first time constant, to the weighted central pixel data and to each of the input node outputs, thereby combining the weighted central pixel data and each of the input node outputs to produce a system output; and

utilizing the system output to indicate a contrast.

12 . A computer program product comprising a non-transitory computer-readable storage medium storing instructions, which, when executed on at least one processor of a processing device, cause the processing device to carry out the method of claim 11 .

13 . A computer-implemented method for auto-focusing of an imaging device, the method comprising:

receiving images of a sequence of images, each image comprising pixel data;

determining of a preliminary region of interest of an image based on a user input;

selecting a preliminary region of interest, based on the determined size;

providing each of the pixels of the preliminary region of interest as input to a respective input node;

applying a respective input node leaky integrator, having a first time constant, and a respective weight to each of the inputs, thereby producing input node outputs;

receiving, by an output node, each of the input node outputs and pixel data from the central pixel;

combining the pixel data from the central pixel with an output node weight, thereby producing weighted central pixel data;

applying a multiple input leaky integrator having a second time constant, the second time constant being smaller than the first time constant, to the weighted central pixel data and to each of the input node outputs, thereby combining the weighted central pixel data and each of the input node outputs to produce a system output;

storing at a first position of a memory the system output and at a second position of the memory a position of the preliminary region of interest if the system output is higher than the value currently stored at the first position of the memory;

shifting the preliminary region of interest one pixel step;

repeating the steps of receiving images, determining, selecting, providing, applying, receiving each of the input node outputs and pixel data from the central pixel, combining, applying, storing, and shifting until a stop criterion is met;

setting the position stored at the second position of the memory as a position of a region of interest;

scanning through a focal range to find the highest contrast value for the region of interest; and

utilizing the focal point at the highest contrast value, thereby focusing the imaging device.

14 . The computer-implemented method of claim 13 , wherein the stop criterion is that all possible regions of interest within the pixel data has been checked.

15 . The computer-implemented method of claim 14 , wherein the stop criterion is that the preliminary region of interest has reached an end position.

16 . The computer-implemented method of claim 13 , wherein the imaging device is a digital video camera.

17 . The computer-implemented method of claim 13 , wherein the preliminary region of interest is an region of interest located in one of the images.

18 . The computer-implemented method of claim 13 , wherein the system output produced as a combination of the weighted central pixel data and each of the node outputs comprises differential data generated by subtracting each of the input node outputs from the weighted central pixel data.

19 . The computer-implemented method of claim 13 , wherein the method is implemented as a hardware-implemented method.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2024
From: JÖRNTELL, HENRIK; RONGALA, UDAYA BAHSKAR; HÖGBOM ARONSSON, ELIAS
To: INTUICELL AB
Reel/Frame 069218/0156 →
Priority Claims (1)
SE 2250550-7 · May 6, 2022 · national
Continuity (1)
Related Publication 20250317661A1 · Oct 9, 2025
References Cited (37)
US 10628699B2 · Zamir · 2020 [cited by examiner]
US 11507805B2 · Rongala et al. · 2022 [cited by applicant]
US 11651199B2 · Srinivasa · 2023 [cited by examiner]
US 11941510B2 · Rongala et al. · 2024 [cited by applicant]
US 20080258767A1 · Snider et al. · 2008 [cited by applicant]
US 20120131309A1 · Johnson et al. · 2012 [cited by applicant]
US 20120249827A1 · Wootton et al. · 2012 [cited by applicant]
US 20150106306A1 · Birdwell et al. · 2015 [cited by applicant]
US 20180357504A1 · Zamir · 2018 [cited by examiner]
US 20190244079A1 · George et al. · 2019 [cited by applicant]
US 20190392306A1 · Negishi et al. · 2019 [cited by applicant]
US 20200218959A1 · Srinivasa · 2020 [cited by examiner]
US 20210142086A1 · Berkovich · 2021 [cited by examiner]
US 20220292331A1 · Zimmermann et al. · 2022 [cited by applicant]
US 20220329847A1 · Parashar et al. · 2022 [cited by applicant]
US 20220374679A1 · Bazhenov et al. · 2022 [cited by applicant]
US 20230079847A1 · Ren · 2023 [cited by applicant]
US 20230087722A1 · Ren · 2023 [cited by applicant]
CN 115004220A · 2022 [cited by applicant]
EP 3866105A1 · 2021 [cited by applicant]
JP 2006285489A · 2006 [cited by applicant]
JP 2009027036A · 2009 [cited by applicant]
JP 2019040421A · 2019 [cited by applicant]
WO 2017148536A1 · 2017 [cited by applicant]
WO 2022141445A1 · 2022 [cited by applicant]
Bouvier Maxence; Valentian Alexandre; Sicard Gilles, 1-16 “Scalable Pitch-Constrained Neural Processing Unit for 3D Integration with Event-Based Imagers”, 2021 58th ACM/IEEE Design Automation Conference (DAG), Dec. 5, 2… [cited by applicant]
WO2023214915A1 publication of PCT/SE2023/050406 including the search report, ISA/SE, May 16, 2023 Stockholm Sweden. [cited by applicant]
Camunas-Mesa Luis A. et al: “A Configurable Event-Driven Convolutional Node with Rate Saturation Mechanism for Modular ConvNet Systems Implementation”, Frontiers in Neuroscience, vol. 12, Feb. 20, 2018 (Feb. 20, 2018), … [cited by applicant]
Daniel Neil et al: “Deep Neural Networks and Hardware Systems for Event-driven Data” In: “Doctoral Thesis”, Jul. 31, 2017 (Jul. 31, 2017), ETH Zurich,XP055571322, pp. 1-154. [cited by applicant]
Neil Daniel et al: “Minitaur, an Event-Driven FPGA-Based Spiking Network Accelerator”, IEEE Transactions on Very Large Scaleintegration (VLSI) Systems, IEEE Service Center, Piscataway, NJ, USA, vol. 22, No. 12, Dec. 1, … [cited by applicant]
Search report dated Sep. 18, 2024 in GB application 2403874.7, Intellectual property Office UK. [cited by applicant]
U.S. Appl. No. 18/822,333, filed Sep. 2, 2024, “A method of providing a representation of temporal dynamics of a first system, middleware systems, a controller system, computer program products and non-transitory comput… [cited by applicant]
U.S. Appl. No. 18/836,809, filed Aug. 8, 2024, “A data processing system comprising first and second networks, a second network connectable to a first network, a method, and a computer program product therefor”, Intuice… [cited by applicant]
U.S. Appl. No. 18/840,928, filed Aug. 23, 2024. “A data processing system comprising a network, a method, and a computer program product”, Intuicell AB. [cited by applicant]
U.S. Appl. No. 18/686,897, filed Feb. 27, 2024 “A computer-implemented or hardware-implemented method for processing data, a computer program product, a data processing system and a first control unit therefor”, Intuice… [cited by applicant]
U.S. Appl. No. 18/686,895, filed Feb. 27, 2024 “A computer-implemented or hardware-implemented method, a computer program product, an apparatus, a transfer function unit and a system for identification or separation of … [cited by applicant]
U.S. Appl. No. 18/615,189, filed Mar. 25, 2024, “A computer-implemented or hardware-implemented method of entity identification, a computer program product and an apparatus for entity identification”, Intuicell AB. [cited by applicant]