IP Library Granted Patent US 10,015,413
Granted Patent B1
US 10,015,413 · App. 15/492,738 · Granted Jul 3, 2018

Conversion between aspect ratios in camera

Inventors: Nicholas D. Woodman (Woodside, CA); Sumit Chawla (San Carlos, CA); Loic Segapelli (Oakland, CA); Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
H04N5/2628G06T3/0093G06T3/4069G06T3/20G06T3/40G06T3/4084
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,015,413
App. No.
15/492,738
Granted
Jul 3, 2018
Kind
B1
Abstract

A camera system captures an image in a source aspect ratio and applies a transformation to the input image to scale and warp the image to generate an output image having a target aspect ratio different than the source aspect ratio. The output image has the same field of view as the input image, maintains image resolution, and limits distortion to levels that do not substantially affect the viewing experience. In one embodiment, the output image is non-linearly warped relative to the input image such that a distortion in the output image relative to the input image is greater in a corner region of the output image than a center region of the output image.

Claims (44)

1. An image capture apparatus, comprising:

an image sensor configured to capture an input image having a source aspect ratio, the input image including pixels located at input positions defined along a first axis and a second axis, the first axis perpendicular to the second axis;

a display coupled to one or more physical processors; and

the one or more physical processors configured by machine-readable instructions to:

obtain the input image;

determine a portion within the input image, the portion including a subset of the pixels; and

apply a transformation to the input image to generate an output image, the output image having a target aspect ratio different than the source aspect ratio, the output image including the pixels located at output positions defined along the first axis and the second axis, wherein:

the transformation non-uniformly shifts the pixels from the input positions to the output positions based on (1) the input positions along the first axis, and (2) the input positions along the second axis; and

the transformation non-uniformly shifts the pixels such that differences between the input positions and the output positions of the subset of the pixels within the portion are less than differences between the input positions and the output positions of others of the pixels; and

present the output image on the display.

2. A system that converts between aspect ratios, the system comprising:

one or more physical processors configured by machine-readable instructions to:

obtain an input image, the input image having a source aspect ratio, the input image including pixels located at input positions defined along a first axis and a second axis, the first axis perpendicular to the second axis;

determine a portion within the input image, the portion including a subset of the pixels; and

apply a transformation to the input image to generate an output image, the output image having a target aspect ratio different than the source aspect ratio, the output image including the pixels located at output positions defined along the first axis and the second axis, wherein:

the transformation non-uniformly shifts the pixels from the input positions to the output positions based on (1) the input positions along the first axis, and (2) the input positions along the second axis; and

the transformation non-uniformly shifts the pixels such that differences between the input positions and the output positions of the subset of the pixels within the portion are less than differences between the input positions and the output positions of others of the pixels.

3. The system of claim 2 , wherein the transformation includes:

a scaling function to uniformly stretch or compress the input image along the first axis; and

a warping function to non-uniformly warp the input image along the second axis.

4. The system of claim 3 , wherein the scaling function and the warping function preserves the input positions of the subset of the pixels as the output positions of the subset of the pixels.

5. The system of claim 3 , wherein the scaling function changes the source aspect ratio to the target aspect ratio.

6. The system of claim 2 , wherein the one or more physical processors are included within a camera.

7. The system of claim 6 , wherein the output image is presented on a display of the camera.

8. The system of claim 2 , wherein the portion corresponds to a center portion of the input image.

9. The system of claim 2 , wherein the portion corresponds to a non-center portion of the input image.

10. The system of claim 2 , wherein the transformation non-uniformly shifts the pixels from the input positions to the output positions further based on distances between the input positions and the portion.

11. The system of claim 2 , wherein the one or more physical processors are further configured by machine-readable instructions to determine the portion based on a location of an object within the input image such that the portion includes the object.

12. The system of claim 2 , wherein the input image includes a video frame of a video.

13. A method for converting between aspect ratios, the method performed by a computing system including one or more physical processors, the method comprising:

obtaining, by the computing system, an input image, the input image having a source aspect ratio, the input image including pixels located at input positions defined along a first axis and a second axis, the first axis perpendicular to the second axis;

determining a portion within the input image, the portion including a subset of the pixels; and

applying, by the computing system, a transformation to the input image to generate an output image, the output image having a target aspect ratio different than the source aspect ratio, the output image including the pixels located at output positions defined along the first axis and the second axis, wherein:

the transformation non-uniformly shifts the pixels from the input positions to the output positions based on (1) the input positions along the first axis, and (2) the input positions along the second axis; and

the transformation non-uniformly shifts the pixels such that differences between the input positions and the output positions of the subset of the pixels within the portion are less than differences between the input positions and the output positions of others of the pixels.

14. The method of claim 13 , wherein the transformation includes:

a scaling function to uniformly stretch or compress the input image along the first axis; and

a warping function to non-uniformly warp the input image along the second axis.

15. The method of claim 14 , wherein the scaling function and the warping function preserves the input positions of the subset of the pixels as the output positions of the subset of the pixels.

16. The method of claim 13 , wherein the portion corresponds to a center portion of the input image.

17. The method of claim 13 , wherein the portion corresponds to a non-center portion of the input image.

18. The method of claim 13 , wherein the transformation non-uniformly shifts the pixels from the input positions to the output positions further based on distances between the input positions and the portion.

19. The method of claim 13 , further comprising determining the portion based on a location of an object within the input image such that the portion includes the object.

20. The method of claim 13 , wherein the input image includes a video frame of a video.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Dec 3, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047713/0309 →
SECURITY INTEREST Recorded Jul 31, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 043380/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 20, 2017
From: WOODMAN, NICHOLAS D.; CHAWLA, SUMIT; SEGAPELLI, LOIC; CAMPBELL, SCOTT PATRICK
To: GOPRO, INC.
Reel/Frame 042083/0989 →
Continuity (4)
Continuation 15044253 · Jan 29, 2016
Continuation 14536315 · Nov 7, 2014
Continuation 14180887 · Feb 14, 2014
Provisional Application 61869029 · Aug 22, 2013
Cited By (2)
US 12,302,000 US 12,302,028