IP Library Granted Patent US 9,927,604
Granted Patent B2
US 9,927,604 · App. 14/853,460 · Granted Mar 27, 2018

Biologically inspired algorithm based method for near real-time tracking of moving objects in three dimensional environment

Inventors: M. Umit Uyar (New York, NY); Stephen Gundry (New York, NY)
Assignee: Research Foundation of the City University of New York
G02B21/241G02B21/365G06K9/00127G06K2009/3291
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,927,604
App. No.
14/853,460
Granted
Mar 27, 2018
Kind
B2
Abstract

A method for tracking three-dimensional movement of an object and focusing thereon is provided. Software repeatedly detects three-dimensional locations of one or more objects and image quality by sampling images at many parameter settings as the objects move in three-dimensional environment. The images are ranked occurring to a fitness score and parameter settings for subsequent images to established using a biologically-inspired algorithm.

Claims (40)

1. A method for tracking three-dimensional movement of an object and focusing thereon, the method comprising steps of:

obtaining, with an information capturing device, multiple captures of information of an object, the information capturing device having both a field of view and multiple parameter settings, wherein the multiple capture of information are obtained at a corresponding number of different parameter settings;

analyzing, with a computer, each capture of information to locate the object in the field of view and to obtain corresponding information metrics for each capture of information;

assigning each capture of information a fitness score based on the corresponding information metric;

ranking the fitness scores of the multiple captures of information to identify at least two captures of information with the highest fitness scores;

constructing a second generation of parameter settings using a biologically-inspired algorithm based on the at least two captures of information identified in the step of ranking, wherein at least half of the multiple captures of information are omitted from the at least two captures of information;

adjusting the information capturing device to the second generation of parameter settings, including adjusting a position of the information capturing device to track the object in the field of view as the object moves in three-dimensional environment;

repeating the method at least once with the second generation of parameter settings.

2. The method as recited in claim 1 , wherein the information capturing device is an optical microscope and the first capture of information is a digital image.

3. The method as recited in claim 1 , wherein the object is a biological cell.

4. The method as recited in claim 1 , wherein the object is a biological cell and the step of repeating repeats at least twice within forty-eight hours.

5. The method as recited in claim 1 , wherein the object is a biological cell and the step of repeating repeats at least once per hour for forty-eight hours.

6. The method as recited in claim 1 , wherein the object is a biological cell in a three-dimensional cell culture and the object moves due to alterations in cell culture morphology.

7. The method as recited in claim 1 , wherein the biologically-inspired algorithm is selected from the group consisting of a genetic algorithm, a particle swarm optimization algorithm, and a differential evolution algorithm.

8. The method as recited in claim 1 , wherein the information capturing device is a telescope and the object is located outside of the Earth's atmosphere.

9. The method as recited in claim 1 , wherein the multiple parameters settings include at least two parameter settings from the group consisting of sharpness, brightness, Chebyshev, Fourier, Wavelet, and moment analyses, three-dimensional location of the field of view.

10. A program storage device readable by machine, tangibly embodying a program of instructions executable by machine to perform method steps for tracking three-dimensional movement of an object and focusing thereon, the method comprising the steps of:

obtaining, with an information capturing device, multiple captures of information of an object, the information capturing device having both a field of view and multiple parameter settings, wherein the multiple capture of information are obtained at a corresponding number of different parameter settings;

analyzing, with a computer, each capture of information to locate the object in the field of view and to obtain corresponding information metrics for each capture of information;

assigning each capture of information a fitness score based on the corresponding information metric;

ranking the fitness scores of the multiple captures of information to identify at least two captures of information with the highest fitness scores;

constructing a second generation of parameter settings using a biologically-inspired algorithm based on the at least two captures of information identified in the step of ranking, wherein at least half of the multiple captures of information are omitted from the at least two captures of information;

adjusting the information capturing device to the second generation of parameter settings, including adjusting a position of the information capturing device to track the object in the field of view as the object moves in three-dimensional environment;

repeating the method at least once with the second generation of parameter settings.

11. The program storage device as recited in claim 10 , wherein the information capturing device is an optical microscope and the first capture of information is a digital image.

12. The program storage device as recited in claim 10 , wherein the object is a biological cell.

13. The program storage device as recited in claim 10 , wherein the object is a biological cell and the step of repeating repeats at least twice within forty-eight hours.

14. The program storage device as recited in claim 10 , wherein the object is a biological cell and the step of repeating repeats at least once per hour for forty-eight hours.

15. The program storage device as recited in claim 10 , wherein the object is a biological cell in a three-dimensional cell culture and the object moves due to alterations in cell culture morphology.

16. The program storage device as recited in claim 10 , wherein the biologically-inspired algorithm is selected from the group consisting of a genetic algorithm, a particle swarm optimization algorithm, and a differential evolution algorithm.

17. The program storage device as recited in claim 10 , wherein the multiple parameters settings include at least two parameter settings from the group consisting of sharpness, brightness, Chebyshev, Fourier, Wavelet, and moment analyses.

18. The program storage device as recited in claim 10 , wherein the information capturing device is a telescope and the object is located outside of the Earth's atmosphere.

19. A method for tracking three-dimensional movement of an object and focusing thereon, the method comprising steps of:

obtaining, with an optical microscope, multiple digital images of an object, the optical microscope having both a field of view and multiple parameter settings, wherein the multiple digital images are obtained at a corresponding number of different parameter settings;

analyzing, with a computer, each digital image to locate the object in the field of view and to obtain corresponding information metrics for each digital image;

assigning each digital image a fitness score based on the corresponding information metric;

ranking the fitness scores of the multiple digital images to identify at least two digital images with the highest fitness scores;

constructing a second generation of parameter settings using a biologically-inspired algorithm based on the at least two digital images identified in the step of ranking, wherein at least half of the multiple digital images are omitted from the at least two digital images;

adjusting the optical microscope to the second generation of parameter settings, including adjusting a position of the optical microscope to track the object in the field of view as the object moves in three-dimensional environment;

repeating the method at least once with the second generation of parameter settings.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2015
From: UYAR, M. UMIT
To: RESEARCH FOUNDATION OF THE CITY UNIVERSITY OF NEW YORK
Reel/Frame 036619/0178 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2015
From: GUNDRY, STEPHEN
To: RESEARCH FOUNDATION OF THE CITY UNIVERSITY OF NEW YORK
Reel/Frame 036565/0004 →
Continuity (2)
Provisional Application 62049657 · Sep 12, 2014
Related Publication 20160077321A1 · Mar 17, 2016