IP Library Granted Patent US 9,674,429
Granted Patent B2
US 9,674,429 · App. 15/011,253 · Granted Jun 6, 2017

Conversion between aspect ratios in camera

Inventors: Nicholas D. Woodman (Woodside, CA); Sumit Chawla (San Carlos, CA); Loic Segapelli (Oakland, CA); Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
H04N5/23229G06T3/0093G06T3/4069G09G5/005H04N7/0122H04N21/234372G09G2340/0442H04N21/440272
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,674,429
App. No.
15/011,253
Granted
Jun 6, 2017
Kind
B2
Abstract

A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Claims (44)

1. A method for converting between aspect ratios, comprising:

obtaining an input image having a source aspect ratio;

applying, by a processing device, a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio, the target aspect ratio different than the source aspect ratio, the output image non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image, wherein applying the transformation comprises shifting pixels of the input image by an amount represented by a non-linear function of original pixel positions of the pixels, wherein applying the transformation to the input image to scale and warp the input image comprises:

applying a scaling function to the input image to linearly stretch or compress the input image to generate a scaled image having the target aspect ratio; and

applying a non-linear warping function to the scaled image to reduce distortion of a center region of the scaled image relative to the input image and increase distortion of a corner region of the scaled image relative to the input image; and

outputting the output image having the target aspect ratio.

2. The method of claim 1 , wherein applying the transformation comprises applying a combined function that performs both warping and scaling.

3. The method of claim 1 , wherein the processing device comprises a camera.

4. The method of claim 1 , wherein the output image has a same field of view as the input image.

5. The method of claim 1 , wherein the source aspect ratio comprises a 4:3 aspect ratio and the target aspect ratio comprises a 16:9 aspect ratio.

6. A method for converting between aspect ratios, comprising:

obtaining an input image having a source aspect ratio;

applying, by a processing device, a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio, the target aspect ratio different than the source aspect ratio, the output image non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image, wherein applying the transformation comprises shifting pixels of the input image by an amount represented by a non-linear function of original pixel positions of the pixels, wherein applying the transformation to the input image to scale and warp the input image comprises:

applying a non-linear warping function to the input image to generate a warped image, the warped image having a reduced distortion of a center region of the warped image relative to the input image and an increased distortion of a corner region of the warped image relative to the input image; and

applying a scaling function to the warped image to linearly stretch or compress the warped image to generate the output image having the target aspect ratio; and

outputting the output image having the target aspect ratio.

7. The method of claim 6 , wherein applying the transformation comprises applying a combined function that performs both warping and scaling.

8. The method of claim 6 , wherein the output image has a same field of view as the input image.

9. The method of claim 6 , wherein the source aspect ratio comprises a 4:3 aspect ratio and the target aspect ratio comprises a 16:9 aspect ratio.

10. The method of claim 6 , wherein the processing device comprises a camera.

11. A computing apparatus comprising:

an input device to obtain an input image having a source aspect ratio;

a processor to process the input image captured by the image sensor; and

a non-transitory computer-readable storage medium storing instructions that when executed by the processor cause the processor to perform steps including:

applying a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio, the target aspect ratio different than the source aspect ratio, the output image non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image, wherein applying the transformation comprises shifting pixels of the input image by an amount represented by a non-linear function of original pixel positions of the pixels, wherein applying the transformation to the input image to scale and warp the input image comprises:

applying a scaling function to the input image to linearly stretch or compress the input image to generate a scaled image having the target aspect ratio; and

applying a non-linear warping function to the scaled image to reduce distortion of a center region of the scaled image relative to the input image and increase distortion of a corner region of the scaled image relative to the input image; and

an output device to output the output image having the target aspect ratio.

12. The computing apparatus of claim 11 , wherein applying the transformation comprising applying a combined function that performs both warping and scaling.

13. The computing apparatus of claim 11 , wherein the computing apparatus comprises a camera.

14. The computing apparatus of claim 11 , wherein the output image has a same field of view as the input image.

15. The computing apparatus of claim 11 , wherein the source aspect ratio comprises a 4:3 aspect ratio and the target aspect ratio comprises a 16:9 aspect ratio.

16. A computing apparatus comprising:

an input device to obtain an input image having a source aspect ratio;

a processor to process the input image captured by the image sensor; and

a non-transitory computer-readable storage medium storing instructions that when executed by the processor cause the processor to perform steps including:

applying a transformation to the input image to scale and warp the input image to generate an output image having a target aspect ratio, the target aspect ratio different than the source aspect ratio, the output image non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image, wherein applying the transformation comprises shifting pixels of the input image by an amount represented by a non-linear function of original pixel positions of the pixels, wherein applying the transformation to the input image to scale and warp the input image comprises:

applying a non-linear warping function to the input image to generate a warped image, the warped image having a reduced distortion of a center region of the warped image relative to the input image and an increased distortion of a corner region of the warped image relative to the input image;

applying a scaling function to the warped image to linearly stretch or compress the warped image to generate the output image having the target aspect ratio; and

an output device to output the output image having the target aspect ratio.

17. The computing apparatus of claim 16 , wherein applying the transformation comprises applying a combined function that performs both warping and scaling.

18. The computing apparatus of claim 16 , wherein the computing apparatus comprises a camera.

19. The computing apparatus of claim 16 , wherein the output image has a same field of view as the input image.

20. The computing apparatus of claim 16 , wherein the source aspect ratio comprises a 4:3 aspect ratio and the target aspect ratio comprises a 16:9 aspect ratio.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY AGREEMENT Recorded Mar 28, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038184/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 11, 2016
From: WOODMAN, NICHOLAS D.; CHAWLA, SUMIT; SEGAPELLI, LOIC; CAMPBELL, SCOTT PATRICK
To: GOPRO, INC.
Reel/Frame 037956/0477 →
Continuity (4)
Continuation 14536315 · Nov 7, 2014
Continuation 14180887 · Feb 14, 2014
Provisional Application 61869029 · Aug 22, 2013
Related Publication 20160173767A1 · Jun 16, 2016