IP Library Granted Patent US 12,270,983
Granted Patent B2
US 12,270,983 · App. 17/794,579 · Granted Apr 8, 2025

Method and apparatus for determination of a trajectory and imaging device

Inventors: Maciej Szkulmowski (Torun, PL); Krzysztof Dalasinski (Torun, PL); Michal Meina (Torun, PL); Maciej Nowakowski (Torun, PL); Krystian Wrobel (Torun, PL); Maciej Bartuzel (Pszenno, PL); Szymon Tamborski (Torun, PL); Patrycjusz Stremplewski (Torun, PL)
Assignee: Inoko Vision Spółka z ograniczon odpowiedzialnościa
G02B21/367G06T2207/20221
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,270,983
App. No.
17/794,579
Granted
Apr 8, 2025
Kind
B2
Abstract

A method of determination of a trajectory of a living tissue, in which subsequent frames representing images of living tissue are acquired with at least a first imaging device and at least a first segment of a trajectory of the living tissue is determined with a use of relative displacements of at least first subset of subsequent frames and recalculation thereof to coordinates corresponding to time of frame acquisition to form a vector Tm elements tm wherein element tm is at least one coordinate of living tissue, element tm of vector Tm is determined with a use of relative displacements p m,k of at least two preceding frames.

Claims (38)

1. A method for determining a trajectory and controlling a position of a living tissue, the method comprising:

acquiring subsequent frames representing images of the living tissue by a first imaging device having a frame acquisition rate of at least 500 FPS and a frame size of at least 1000 pixels and a field of view of at least 1° in X plane and Y plane;

determining, by a processing unit, at least a first segment of the trajectory of the living tissue using relative displacements of at least a first subset of subsequent frames;

recalculating, by the processing unit, the relative displacements to coordinates corresponding to time of frame acquisition to form a vector Tm of elements tm, wherein element tm is at least one coordinate of the living; and

controlling, by the processing unit, a movement of the living tissue based on the determined trajectory.

2. The method according to claim 1 , further comprising:

using at least a second subset of frames to calculate alignment frames corresponding to the at least first segment and at least a second segment of the trajectory.

3. The method according to the claim 2 , wherein the alignment frames are acquired with the first imaging device.

4. The method according to claim 3 , further comprising:

detecting a loop in the trajectory wherein at least two non-adjacent segments are in proximity with each other; and

identifying alignment frames contained in the at least two non-adjacent segments.

5. Method according to claim 2 , wherein the alignment frames are obtained with a second imaging apparatus.

6. The method according to claim 1 , further comprising repositioning, by an imaging system, images acquired with the first imaging device, to compensate for the movement of the living tissue.

7. The method according to claim 1 , further comprising acquiring images of the living tissue with a second imaging device.

8. The method according to claim 7 , further comprising repositioning, by an imaging system, images acquired with either the first imaging device or the second imaging device, to compensate for the movement of the living tissue.

9. The method of claim 1 , wherein controlling the movement of the living tissue comprises adjusting a position of the living tissue to maintain a desired trajectory.

10. The method of claim 1 , wherein the adjusting of the position of the living tissue to maintain a desired trajectory is achieved by moving the tissue with respect to the imaging device, moving the imaging device with respect to the tissue, or a combination of both.

11. A device for determining a trajectory of a movement and controlling of a living tissue, comprising:

a first imaging apparatus adapted to acquire subsequent frames with a frame acquisition rate of at least 500 FPS, and frame size of at least 1000 pixels and a field of view of at least 1° in X plane and Y plane; and

a processing unit, adapted to execute a method comprising:

determining at least a first segment of the trajectory of the living tissue using relative displacements of at least a first subset of subsequent frames;

recalculating the relative displacements to coordinates corresponding to time of frame acquisition to form a vector Tm of elements tm wherein element tm is at least one coordinate of the living tissue;

controlling a movement of the living tissue based on the determined trajectory; and

repositioning images acquired with a second imaging device to compensate for the movement of the living tissue.

12. The device of claim 11 , wherein the device is configured to use at least a second subset of subsequent frames to calculate alignment frames corresponding to the at least first segment and at least a second segment.

13. The device of claim 12 , wherein the alignment frames are acquired with the first imaging apparatus.

14. The device of claim 11 , further comprising a second imaging apparatus configured to reposition images acquired with the second imaging apparatus to compensate for movement of the living tissue.

15. The device of claim 14 , wherein the processing unit is configured to receive frames from the second imaging device to use as alignment frames.

16. The device of claim 11 , wherein controlling the movement of the living tissue comprises adjusting a position of the living tissue to maintain a desired trajectory.

17. The device of claim 11 , wherein the adjusting of the position of the living tissue to maintain a desired trajectory is achieved by moving the tissue with respect to the imaging device, moving the imaging device with respect to the tissue, or a combination of both.

18. A non-transitory computer readable medium having a computer program product for determining a trajectory and controlling the position of a living tissue, the computer product program comprising computer-readable instructions that when executed by a processing unit coupled to at least one memory device, cause the processing unit to perform a method comprising:

acquiring subsequent frames representing images of the living tissue with the first imaging apparatus having a frame acquisition rate of at least 500 frames per second (FPS), a frame size of at least 1000 pixels, and a field of view of at least 1° in both X and Y planes; and

determining at least a first segment of the trajectory of the living tissue using relative displacements of at least a first subset of subsequent frames;

recalculating the relative displacements to coordinates corresponding to a time of frame acquisition to form a vector of elements, wherein each element is at least one coordinate of the living tissue;

controlling a movement of the living tissue based on the determined trajectory; and

repositioning images acquired with a second imaging device to compensate for the movement of the living tissue.

19. The non-transitory computer-readable medium of claim 18 , wherein the method further comprises: using at least a second subset of the subsequent frames to calculate alignment frames corresponding to the at least first segment and at least a second segment.

20. The non-transitory computer-readable medium of claim 19 , wherein the method further comprises minimizing a cumulative error in determining the trajectory of the living tissue by recalculating relative displacement between elements of the trajectory in the at least first segment and the at least second segment.

Priority Claims (1)
EP 20154381 · Jan 29, 2020 · regional
Continuity (1)
Related Publication 20230147006A1 · May 11, 2023
References Cited (19)
US 8970495B1 · Biffle · 2015 [cited by examiner]
US 9775512B1 · Tyler · 2017 [cited by examiner]
US 11490809B2 · Krueger · 2022 [cited by examiner]
US 11762461B2 · Young · 2023 [cited by examiner]
US 20160066781A1 · Thompson · 2016 [cited by examiner]
US 20160210497A1 · Rougeaux · 2016 [cited by examiner]
US 20200305708A1 · Krueger · 2020 [cited by examiner]
WO WO2013125547 · 2013 [cited by applicant]
WO WO2016115203 · 2016 [cited by applicant]
WO WO2018017751 · 2018 [cited by applicant]
Thompson Ben; Stimulus and Eye Tracking System; 2018 (Year: 2018). [cited by examiner]
Zizi Martin; Unique Patterns Extracted From Involuntary Eye Motions to Identify Individuals; 2018 (Year: 2018). [cited by examiner]
Popovich Milan Momcilo; Holographic Waveguide Optical Tracker; 2017 (Year: 2017). [cited by examiner]
Anthony Brian W; Circular Scanning Technique for Large Area Inspection (Year: 2016). [cited by examiner]
Unique Patterns Extracted From Involuntary Eye Motions to Identify Individuals (Year: 2018). [cited by examiner]
Circular Scanning Technique for Large Area Inspection (Year: 2016). [cited by examiner]
Holographic Waveguide Optical Tracker (Year: 2017). [cited by examiner]
Stimulus and Eye Tracking System (Year: 2018). [cited by examiner]
WO2021152537 International Search Report and Written Opinion of the International Searching Authority. [cited by applicant]