IP Library Granted Patent US 10,334,168
Granted Patent B2
US 10,334,168 · App. 16/236,043 · Granted Jun 25, 2019

Threshold determination in a RANSAC algorithm

Inventors: Manu Alibay (Alfortville, FR); Stéphane Auberger (Saint-Maur-des-Fosses, FR)
Assignee: STMICROELECTRONICS SA
H04N5/23254G06T7/33G06T7/35H04N5/145H04N5/23267G06T2207/20076
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,334,168
App. No.
16/236,043
Granted
Jun 25, 2019
Kind
B2
Abstract

A method determines a movement of an apparatus between capturing first and second images. The method includes testing model hypotheses of the movement by for example a RANSAC algorithm, operating on a set of first points in the first image and assumed corresponding second points in the second image to deliver the best model hypothesis. The testing includes, for each first point, calculating a corresponding estimated point using the tested model hypothesis, determining the back-projection error between the estimated point and the second point in the second image, and comparing each back projection error with a threshold. The testing comprises for each first point, determining a correction term based on an estimation of the depth of the first point in the first image and an estimation of the movement between the first and second images, and determining the threshold associated with the first point by using said correction term.

Claims (31)

1. A device, comprising:

a memory;

processing circuitry coupled to the memory, wherein the processing circuitry, in operation:

tests a plurality of model hypotheses of movement of an imaging device between capturing successive first and second video images using a deterministic algorithm operating on a first set of points in the first video image and second points in the second video image, the testing including, for each point of the first set of points and for each model hypothesis, calculating a corresponding estimated point using the model hypothesis, determining a back-projection error between said estimated point and a corresponding point of the second points in the second video image, and comparing each back projection error with a threshold associated with the first point, wherein for each first point of the first video image, a correction term is determined based on a depth of said first point in said first video image and an estimated movement of the imaging device between capturing the first and the second video images, and the threshold associated with said first point is determined by using said correction term;

selects a model hypothesis of the plurality of model hypotheses based on the testing; and

determines a movement of the imaging device between capturing the successive first and second video images using the selected model hypothesis.

2. The device of claim 1 wherein said movement is an orientation modification of said imaging device between capturing the first video image and the second video image.

3. The device according to claim 2 wherein each model hypothesis comprises Euler angles.

4. The device according to claim 1 wherein each model hypothesis is obtained from motion vectors.

5. The device according to claim 1 wherein said movement between capturing the first and second video images comprises a translational movement of the imaging device.

6. The device according to claim 1 wherein, for each first point, the threshold associated with the first point is a sum of a fixed threshold and said correction term for the first point.

7. An apparatus, comprising:

an imaging device, which, in operation, captures successive first and second video images; and

processing circuitry coupled to the imaging device, wherein the processing circuitry, in operation:

tests a plurality of model hypotheses of movement of an imaging device between capturing successive first and second video images using a deterministic algorithm operating on a first set of points in the first video image and second points in the second video image, the testing including, for each point of the first set of points and for each model hypothesis, calculating a corresponding estimated point using the model hypothesis, determining a back-projection error between said estimated point and a corresponding point of the second points in the second video image, and comparing each back projection error with a threshold associated with the first point, wherein for each first point of the first video image, a correction term is determined based on a depth of said first point in said first video image and an estimated movement of the imaging device between capturing the first and the second video images, and the threshold associated with said first point is determined by using said correction term;

selects a model hypothesis of the plurality of model hypotheses based on the testing; and

determines a movement of the imaging device between capturing the successive first and second video images using the selected model hypothesis.

8. The apparatus according to claim 7 , comprising telecommunication circuitry.

9. The apparatus according to claim 7 wherein, for each first point, the threshold associated with the first point is a sum of a fixed threshold and said correction term for the first point.

10. A apparatus, comprising:

a memory;

processing circuitry coupled to the memory, wherein the processing circuitry, in operation:

tests a plurality of model hypotheses of movement of an imaging device between capturing successive first and second video images, the testing including, for each point of a first set of points of the first video image and for each model hypothesis, calculating a corresponding estimated point using the model hypothesis, determining a back-projection error between said estimated point and a corresponding point of points in the second video image, and comparing each back projection error with a threshold associated with the first point, wherein for each point of the first set of points of the first video image, a correction term is determined based on a depth of said first point in said first video image and an estimated movement of the imaging device between capturing the first and the second video images, and the threshold associated with said first point is determined based on said correction term;

selects a model hypothesis of the plurality of model hypotheses based on the testing; and

determines a movement of the imaging device between capturing the successive first and second video images using the selected model hypothesis.

11. The apparatus of claim 10 wherein said movement is an orientation modification of said imaging device between capturing the first video image and the second video image.

12. The apparatus according to claim 11 wherein each model hypothesis comprises Euler angles.

13. The apparatus according to claim 10 wherein each model hypothesis is obtained from motion vectors.

14. The apparatus according to claim 10 wherein said movement between capturing the first and second video images comprises a translational movement of the imaging device.

15. The apparatus according to claim 10 wherein, for each first point, the threshold associated with the first point is a sum of a fixed threshold and said correction term for the first point.

16. The apparatus of claim 10 comprising the imaging device.

Assignments (1)
CHANGE OF NAME Recorded Apr 11, 2024
From: STMICROELECTRONICS SA
To: STMICROELECTRONICS FRANCE
Reel/Frame 067095/0021 →
Priority Claims (2)
FR 15 62591 · Dec 17, 2015 · national
EP 16199466 · Nov 18, 2016 · regional
Continuity (2)
Continuation 15382013 · Dec 16, 2016
Related Publication 20190141247A1 · May 9, 2019
Cited By (1)
US 12,283,001