IP Library Granted Patent US 8,315,305
Granted Patent B2
US 8,315,305 · App. 12/869,573 · Granted Nov 20, 2012

Systems and methods for invariant pulse latency coding

Assignee: Brain Corporation
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,315,305
App. No.
12/869,573
Granted
Nov 20, 2012
Kind
B2
Abstract

Image processing systems and methods extract information from an input signal representative of an element of an image and to encode the information in a pulsed output signal. A plurality of channels communicates the pulsed output signal, each of the plurality of channels being characterized by a latency. The information may be encoded as a pattern of relative pulse latencies observable in pulses communicated through the plurality of channels and the pattern of relative pulse latencies is substantially insensitive to image contrast and/or image luminance. A filter can be employed to provide a generator signal based on the input signal and pulse latencies can be determined using a logarithmic function of the generator signal. The filter may be temporally and/or spatially balanced and characterized by an integral along spatial and/or temporal dimensions of the filter that is substantially zero for all values of a temporal and/or a spatial variable.

Claims (47)

1. An image processing system, the system comprising:

an input signal conveying information associated with an element of the image;

one or more processors configured to encode the information in a pattern of relative pulse latencies communicated via a plurality of channels; and

a filter configured to provide a generator signal based on the input signal such that:

g ( t )= LM∫∫S ( x,t−s ) F ( x,s ) dxds,

where g(t) represents the generator signal as a function of time, L represents an image luminance, M represents an image contrast, S(x, t−s) represents a feature in the image as a function of space and time, and F(x, s) represents a filter kernel as a function of space and time;

wherein the pattern of relative pulse latencies is insensitive to one or both of the image contrast or the image luminance.

2. The system of claim 1 , wherein the pulse latencies are determined using a logarithmic function of the generator signal.

3. The system of claim 2 , wherein the logarithmic function is applied to a rectified version of the generator signal.

4. The system of claim 2 , wherein:

the image is characterized by a spatial dimension; and

the filter kernel comprises a spatially balanced kernel having an integral of the filter kernel along the spatial dimensions that is zero for one or more values of a temporal variable.

5. The system of claim 2 , wherein:

the image is characterized by a spatial dimension; and

the filter kernel is temporally balanced by an integral of the filter kernel along a temporal dimension of the filter that is zero for individual values of a spatial variable along the spatial dimension.

6. The system of claim 2 , wherein the filter is balanced by an integral along one or more dimensions of the filter equal to zero.

7. The system of claim 1 , wherein individual ones of the pulse latencies include a common latency associated with the image contrast.

8. The system of claim 1 , further comprising a decoder that decodes a pulsed output signal based on the relative pulse latencies.

9. The system of claim 8 , wherein the decoder receives the pulsed output signal from the plurality of channels.

10. The system of claim 9 , wherein the decoder detects coincident arrival of pulses on different ones of the plurality of channels.

11. The system of claim 9 , wherein the decoder produces secondary information and encodes the secondary information into the timing of pulses in a decoder output.

12. The system of claim 8 , wherein the decoder receives the pulsed output signal from the plurality of channels and at least two of the plurality of channels have different transmission delays.

13. An image processing system, the system comprising:

one or more processors configured to (i) extract information from an input signal conveying information associated with an element of the image and (ii) encode the information in a pattern of relative pulse latencies; and

a filter configured to provide a generator signal based on the input signal;

wherein a given latency in the pattern of relative pulse latencies is defined by:

Lat= C −log B |g ( t )/ a ( t )| + ,

where Lat represents the given latency, C represents an offset, B represents a base of the logarithmic function, g(t) represents the generator signal as a function of time, and a(t) represents an adaptation variable as a function of time.

14. The system of claim 13 , wherein the filter comprises a linear filter.

15. The system of claim 13 , wherein the offset and the base of the logarithmic function are optimized to obtain a range of the generator signal.

16. The system of claim 15 , wherein the range is set to match the dynamic range of the latency values and the dynamic range of the input signal.

17. The system of claim 13 , wherein pulsed outputs are generated in a pulsed output signal responsive to an occurrence of one or more of a cyclic event, arrival of an input frame, appearance of a new feature in the image, or a time related to a previous event.

18. The system of claim 17 , wherein the image processing system is at least partially embodied in a prosthetic device.

19. The system of claim 17 , wherein the image processing system is at least partially embodied in an autonomous robot.

20. The system of claim 17 , wherein the image processing system is at least partially embodied in a remote server.

21. The system of claim 13 , further comprising bounding the latencies of the pulses within a selected interval.

22. The system of claim 13 , wherein the plurality of channels comprises one or more virtual channels carried in a physical transmission medium.

23. The system of claim 13 , wherein the filter comprises a non-linear filter.

24. The system of claim 23 , wherein the filter is motion sensitive.

25. The system of claim 24 , wherein the filter is direction sensitive.

26. A method of processing an input signal conveying information associated with an image, the method being performed by one or more processors configured to execute computer program modules, the method comprising:

based on the input signal, determining a generator signal using a filter such that:

g ( t )= LM∫∫S ( x,t−s ) F ( x,s ) dxds,

where g(t) represents the generator signal as a function of time, L represents image luminance, M represents the image contrast, S(x, t−s) represents a feature in the image as a function of space and time, and F(x, s) represents filter kernel as a function of space and time; and

based on the generator signal, encoding the information in a pattern of relative pulse latencies;

wherein the pattern of relative pulse latencies is insensitive to one or both of image contrast or image luminance.

27. The method of claim 26 , wherein the pulse latencies are determined using a logarithmic function of the generator signal.

Assignments (2)
SECURITY INTEREST Recorded Oct 8, 2021
From: BRAIN CORPORATION
To: HERCULES CAPITAL, INC.
Reel/Frame 057851/0574 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2011
From: PETRE, CSABA; SZATMARY, BOTOND; IZHIKEVICH, EUGENE M.
To: BRAIN CORPORATION
Reel/Frame 027128/0636 →
Continuity (2)
Provisional Application 61318191 · Mar 26, 2010
Related Publication 20110235698A1 · Sep 29, 2011