IP Library Granted Patent US 10,410,372
Granted Patent B1
US 10,410,372 · App. 16/008,682 · Granted Sep 10, 2019

Methods, systems, and computer-readable media for utilizing radial distortion to estimate a pose configuration

Inventors: Akash Abhijit Bapat (Chapel Hill, NC); James True Price (Chapel Hill, NC); Jan-Michael Frahm (Chapel Hill, NC)
Assignee: The University of North Carolina at Chapel Hill
G06T7/74G06T3/0093G06T7/248G06T7/292H04N5/247
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,372
App. No.
16/008,682
Granted
Sep 10, 2019
Kind
B1
Abstract

Methods, systems, and computer-readable media for utilizing radial distortion to estimate a pose configuration are disclosed. According to one aspect, the method includes receiving, from each of a plurality of camera devices, an input pixel row of a radially distorted image and conducting a row comparison between each of the input pixel rows and a respectively associated synthesized pixel row. The method further includes approximating, for each row comparison, a span of a curve in an image space with a plurality of segments and computing, for each of the plurality of segments, a constraint. The method also includes utilizing the constraints to estimate a pose configuration.

Claims (32)

1. A method for utilizing radial distortion to estimate a pose configuration, the method comprising:

receiving, from each of a plurality of camera devices, an input pixel row of a radially distorted image;

conducting a row comparison between each of the input pixel rows and a respectively associated synthesized pixel row;

approximating, for each row comparison, a span of a curve in an image space with a plurality of segments;

computing, for each of the plurality of segments, a constraint; and

utilizing the constraints to estimate a pose configuration.

2. The method of claim 1 wherein the plurality of camera devices includes a plurality of rolling shutter cameras.

3. The method of claim 1 wherein conducting the row comparison comprises generating the curve by synthesizing a distorted pixel row from previously captured frames of the radially distorted image using a homography-based warping technique.

4. The method of claim 3 comprising comparing the synthesized distorted pixel row with the input pixel row at multiple points that correspond to the centers of the plurality of segments.

5. The method of claim 3 wherein synthesizing a distorted pixel row includes extracting a distorted pixel row from the previously captured frames.

6. The method of claim 1 comprising storing data corresponding to each of the input pixel row and subsequently computing the constraints.

7. The method of claim 1 wherein the plurality of camera devices is configured as a camera cluster positioned on a head-mounted display.

8. A system utilizing radial distortion to estimate a pose configuration, the system comprising:

a plurality of camera devices; and

a pose-tracking device including at least one processor and a memory, wherein a tracking engine is stored in the memory and when executed by the at least one processor is configured for receiving an input pixel row of a radially distorted image from each of a plurality of camera devices, conducting a row comparison between each of the input pixel rows and a respectively associated synthesized pixel row, approximating, for each row comparison, a span of a curve in an image space with a plurality of segments, computing, for each of the plurality of segments, a constraint, and utilizing the constraints to estimate a pose configuration.

9. The system of claim 8 wherein the plurality of camera devices includes a plurality of rolling shutter cameras.

10. The system of claim 8 wherein the pose-tracking device is further configured for generating the curve by synthesizing a distorted pixel row from previously captured frames of the radially distorted image using a homography-based warping technique.

11. The system of claim 10 wherein the pose-tracking device is further configured for comparing the synthesized distorted pixel row with the input pixel row at multiple points that correspond to the centers of the plurality of segments.

12. The system of claim 10 wherein the pose-tracking device is further configured for extracting a distorted pixel row from the previously captured frames.

13. The system of claim 8 wherein the pose-tracking device is further configured for storing data corresponding to each of the input pixel row and subsequently computing the constraints.

14. The system of claim 8 wherein the plurality of camera devices is configured as a camera cluster positioned on a head-mounted display.

15. A non-transitory computer-readable medium having stored thereon executable instructions that when executed by a processor of a computer control the computer to perform steps comprising:

receiving, from each of a plurality of camera devices, an input pixel row of a radially distorted image;

conducting a row comparison between each of the input pixel rows and a respectively associated synthesized pixel row;

approximating, for each row comparison, a span of a curve in an image space with a plurality of line segments;

computing, for each of the plurality of segments, a constraint; and

utilizing the constraints to estimate a pose configuration.

16. The non-transitory computer-readable medium of claim 15 wherein the plurality of camera devices includes a plurality of rolling shutter cameras.

17. The non-transitory computer-readable medium of claim 15 wherein conducting a row comparison comprises generating the curve by synthesizing a distorted pixel row from previously captured frames of the radially distorted image using a homography-based warping technique.

18. The non-transitory computer-readable medium of claim 17 comprising comparing the synthesized distorted pixel row with the input pixel row at multiple points that correspond to the centers of the plurality of segments.

19. The non-transitory computer-readable medium of claim 17 wherein synthesizing a distorted pixel row includes extracting a distorted pixel row from the previously captured frames.

20. The non-transitory computer-readable medium of claim 17 comprising storing data corresponding to each of the input pixel row and subsequently computing the constraints.

Assignments (2)
CONFIRMATORY LICENSE Recorded Aug 31, 2018
From: UNIVERSITY OF NORTH CAROLINA, CHAPEL HILL
To: NATIONAL SCIENCE FOUNDATION
Reel/Frame 046993/0904 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 29, 2018
From: BAPAT, AKASH ABHIJIT; PRICE, JAMES TRUE; FRAHM, JAN-MICHAEL
To: THE UNIVERSITY OF NORTH CAROLINA AT CHAPEL HILL
Reel/Frame 046240/0565 →
Cited By (1)
US 12,641,211