IP Library Granted Patent US 12,430,730
Granted Patent B2
US 12,430,730 · App. 17/998,185 · Granted Sep 30, 2025

Correcting distortion from camera pitch angle

Inventor: Karlton David Powell (Lake Stevens, WA)
Assignee: Microsoft Technology Licensing, LLC
G06T5/80G06T3/047G06T2207/10016
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,430,730
App. No.
17/998,185
Granted
Sep 30, 2025
Kind
B2
Abstract

One disclosed example provides a videoconferencing system comprising a processor and a storage device storing instructions executable by the processor to obtain an image of a scene acquired via a camera, the image of the scene comprising image distortion arising from a camera pitch angle at which the image of the scene was acquired. The instructions are further executable to apply a projection mapping to the image of the scene to map the image of the scene to a projection comprising a tilt parameter that is based upon the camera pitch angle at which the image of the scene was acquired, thereby obtaining a corrected image, and output the corrected image.

Claims (38)

1. A videoconferencing system, comprising:

a processor; and

a storage device storing instructions executable by the processor to

obtain an image of a scene acquired via a camera, the image of the scene comprising image distortion arising from a camera pitch angle at which the image of the scene was acquired;

apply a projection mapping to the image of the scene to map the image of the scene to a projection comprising a tilt parameter that is based upon the camera pitch angle at which the image of the scene was acquired, thereby obtaining a corrected image; and

output the corrected image;

wherein the projection mapping comprises a tilted cylindrical projection, a tilted spherical projection, or a tilted rectilinear projection,

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted by the tilt parameter with respect to an optical axis of the camera, and

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted at a pivot point located on the optical axis of the camera and spaced from the camera.

2. The videoconferencing system of claim 1 , wherein the camera comprises a tilt sensor configured to provide output based upon the camera pitch angle, and wherein the instructions are further executable to, based upon the output from the tilt sensor, select the projection mapping from a plurality of projection mappings, each projection mapping being based upon a different camera pitch angle.

3. The videoconferencing system of claim 1 , wherein the camera comprises a f-θ lens.

4. The videoconferencing system of claim 1 , wherein the instructions are further executable to select the projection mapping based upon a rotational position of the camera.

5. The video conference system of claim 1 , wherein the camera comprises an oversized image sensor, and wherein the instructions are executable to crop the image, using a cropping region vertically offset from the image center, to form a vertically offset region of interest.

6. The videoconferencing system of claim 1 , wherein the image of the scene comprises a horizontal field of view of between 70° and 145° degrees.

7. The videoconferencing system of claim 1 , wherein the instructions are further executable to apply the projection mapping based upon a location of a camera-specific optical center of a camera lens relative to the image sensor.

8. The videoconferencing system of claim 1 , wherein the instructions are executable to crop the image of the scene before applying the projection mapping.

9. A method for operating a videoconferencing system, the method comprising:

obtaining an image of a scene acquired via a camera, the image of the scene comprising image distortion arising from a camera pitch angle at which the image of the scene was acquired;

applying a projection mapping to the image of the scene to map the image of the scene to a projection comprising a tilt parameter that is based upon a camera pitch angle at which the image of the scene was acquired, thereby obtaining a corrected image; and

outputting the corrected image;

wherein applying the projection mapping to the image of the scene comprises applying a tilted cylindrical projection, a tilted spherical projection, or a tilted rectilinear projection,

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted by the tilt parameter with respect to an optical axis of the camera, and

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted at a pivot point located on the optical axis of the camera and spaced from the camera.

10. The method of claim 9 , further comprising selecting the projection mapping from a plurality of projection mappings each corresponding to a different camera pitch angle.

11. The method of claim 9 , wherein applying the projection mapping is based upon a position of an optical center of a camera lens relative to an image sensor of the camera.

12. The method of claim 9 , further comprising cropping the image of the scene before applying the projection mapping.

13. The method of claim 9 , wherein the image of the scene comprises a horizontal field of view of between 70° and 180° degrees.

14. The method of claim 13 , wherein the image of the scene comprises a horizontal field of view of between 70° and 145° degrees.

15. A computer-readable storage device comprising instructions executable by a videoconferencing system to correct for image distortion by:

obtaining an image of a scene acquired via a camera;

applying a projection mapping to the image of the scene to map the image of the scene to a projection comprising a tilt parameter that is based upon a camera pitch angle at which the image of the scene was acquired, thereby obtaining a corrected image; and

outputting the corrected image; wherein the instructions are executable to apply the projection mapping to the image of the scene of the scene by applying a tilted cylindrical projection, a tilted spherical projection, or a tilted rectilinear projection,

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted by the tilt parameter with respect to an optical axis of the camera, and

wherein the tilted cylindrical projection, the tilted spherical projection, or the tilted rectilinear projection is tilted at a pivot point located on the optical axis of the camera and spaced from the camera.

16. The computer-readable storage device of claim 15 , wherein the instructions are further executable to receive input from a tilt sensor regarding the camera pitch angle, and to select the projection mapping from a plurality of projections mappings each corresponding to a different camera pitch angle.

17. The computer-readable storage device of claim 16 , wherein the instructions are further executable to select the projection mapping based upon a rotational position of the camera.

18. The computer-readable storage device of claim 15 , wherein the instructions are executable to crop the image of the scene before applying the projection mapping.

19. The computer-readable storage device of claim 15 , wherein the instructions are executable to apply the projection mapping based upon a position of an optical center of a camera lens relative to an image sensor of the camera.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 8, 2022
From: POWELL, KARLTON DAVID
To: MICROSOFT TECHNOLOGY LICENSING, LLC
Reel/Frame 061690/0288 →
Priority Claims (1)
NL 2025575 · May 13, 2020 · national
Continuity (1)
Related Publication 20230230210A1 · Jul 20, 2023
References Cited (34)
US 7058237B2 · Liu et al. · 2006 [cited by applicant]
US 7961980B2 · Shih · 2011 [cited by applicant]
US 8643747B2 · Chou · 2014 [cited by applicant]
US 8687070B2 · Chen et al. · 2014 [cited by applicant]
US 11277544B2 · Powell · 2022 [cited by applicant]
US 20060033999A1 · Liu et al. · 2006 [cited by applicant]
US 20060209194A1 · Liu et al. · 2006 [cited by applicant]
US 20090051797A1 · Yao · 2009 [cited by applicant]
US 20100208032A1 · Kweon · 2010 [cited by applicant]
US 20110069148A1 · Jones et al. · 2011 [cited by applicant]
US 20130229482A1 · Vilcovsky et al. · 2013 [cited by applicant]
US 20130335451A1 · Tsuji · 2013 [cited by applicant]
US 20140184850A1 · Raju · 2014 [cited by examiner]
US 20150109401A1 · Kasatani et al. · 2015 [cited by applicant]
US 20160027158A1 · An et al. · 2016 [cited by applicant]
US 20190012766A1 · Yoshimi · 2019 [cited by applicant]
US 20190082114A1 · Jeon · 2019 [cited by applicant]
US 20190258149A1 · Ishii · 2019 [cited by applicant]
US 20200137379A1 · Tsunashima · 2020 [cited by examiner]
US 20200259347A1 · Pereira et al. · 2020 [cited by applicant]
US 20210044725A1 · Powell · 2021 [cited by applicant]
US 20210127059A1 · Powell et al. · 2021 [cited by applicant]
US 20220366547A1 · Powell · 2022 [cited by applicant]
WO 2006090320A1 · 2006 [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 17/243,405”, Mailed Date : Feb. 17, 2022, 10 Pages. [cited by applicant]
“Non Final Office Action Issued in U.S. Appl. No. 17/243,405”, Mailed Date: Oct. 7, 2022, 11 Pages. [cited by applicant]
“Notice of Allowance Issued in U.S. Appl. No. 17/243,405”, Mailed Date: Jun. 24, 2022, 5 Pages. [cited by applicant]
Cao, et al., “The Two-Dimensional Code Image Tilt Correction Method based on Least Squares Support Vector Machines”, In Proceedings of International Conference on Audio, Language and Image Processing, Jul. 7, 2014, pp. … [cited by applicant]
“International Search Report Issued in Netherland Patent Application No. N2025575”, Mailed Date: Mar. 2, 2021, 14 Pages. [cited by applicant]
“International Search Report & Written Opinion issued in PCT Application No. PCT/US21/030566”, Mailed Date: Jul. 21, 2021, 14 Pages. [cited by applicant]
“International Search Report and Written Opinion Issued in PCT Application No. PCT/US22/023237”, Mailed Date: Jul. 18, 2022, 12 Pages. [cited by applicant]
“Notice of Allowance Issued in U.S. Appl. No. 17/243,405”, Mailed Date: Feb. 7, 2023, 5 Pages. [cited by applicant]
U.S. Appl. No. 17/243,405, filed Apr. 28, 2021. [cited by applicant]
U.S. Appl. No. 16/582,183, filed Sep. 25, 2019. [cited by applicant]