IP Library Granted Patent US 10,402,938
Granted Patent B1
US 10,402,938 · App. 15/476,884 · Granted Sep 3, 2019

Systems and methods for modifying image distortion (curvature) for viewing distance in post capture

Inventors: David Newman (San Diego, CA); Balu Adsumilli (San Francisco, CA)
Assignee: GoPro, Inc.
G06T3/0018G06K9/2054G06T3/0025H04N5/23206H04N5/23238H04N5/2624
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,402,938
App. No.
15/476,884
Granted
Sep 3, 2019
Kind
B1
Abstract

Systems and methods for modifying image distortion (curvature) for viewing distance in post capture. Presentation of imaging content on a content display device may be characterized by a presentation field of view (FOV). Presentation FOV may be configured based on screen dimensions of the display device and distance between the viewer and the screen. Imaging content may be obtained by an activity capture device characterized by a wide capture field of view lens (e.g., fish-eye). Images may be transformed into rectilinear representation for viewing. When viewing images using presentation FOV that may narrower than capture FOV, transformed rectilinear images may appear distorted. A transformation operation may be configured to account for presentation FOV-capture FOV mismatch. In some implementations, the transformation may include fish-eye to rectilinear transformation characterized by a transformation strength that may be configured based on a ratio of the presentation FOV to the capture FOV.

Claims (40)

1. A system for providing images of imaging content, the system comprising:

an electronic storage configured to store the imaging content;

a communications interface configured to communicate a bit stream to a client device, the client device including a display; and

one or more processors configured to execute a plurality of computer readable instructions configured to:

access the imaging content characterized by a capture field of view and a capture projection;

determine a presentation field of view associated with displaying the images of the imaging content on the display, wherein the presentation field of view is determined based on dimensions of the display and a viewing distance between the display and a user;

obtain a transformation operation configured to transform the images of the imaging content from the capture projection based on the capture field of view and the presentation field of view; and

transform the images of the imaging content for presentation on the display using the transformation operation.

2. The system of claim 1 , wherein the capture projection includes a fish eye projection.

3. The system of claim 1 , wherein the viewing distance between the display and the user is determined based on sensor information generated by a sensor.

4. The system of claim 3 , wherein the sensor includes a proximity sensor or a light sensor.

5. The system of claim 1 , wherein the viewing distance between the display and the user is determined based on a typical viewing distance associated with a type of the client device.

6. The system of claim 1 , wherein the transformation operation accounts for a mismatch between the capture field of view and the presentation field of view.

7. The system of claim 1 , wherein the transformation operation includes a curve-to-rectilinear transformation based on a match between the capture field of view and the presentation field of view.

8. A method for transforming images of imaging content, the method comprising:

obtaining an image capture field of view using a meta data portion of the imaging content;

determining a dimension of a display of a content display device;

obtaining a viewing distance between the display and a user using sensor information;

obtaining a viewing field of view based on the viewing distance and the dimension of the display; and

obtaining an image transformation operation to transform the images of the imaging content from an image source projection based on the capture field of view and the viewing field of view.

9. The method of claim 8 , wherein the image transformation operation reduces apparent motion within the images of the imaging content.

10. The method of claim 8 , wherein the image transformation operation is applied to the images of the imaging content by a server.

11. The method of claim 8 , wherein the image transformation operation is applied to the images of the imaging content by a camera or a smartphone.

12. The method of claim 8 , wherein the image transformation operation is applied to the images of the imaging content in real-time as a function of the viewing distance between the display and the user.

13. The method of claim 12 , wherein the image transformation operation includes a first image transformation operation obtained based on a first viewing field of view and a second image transformation operation obtained based on a second viewing field of view.

14. A portable content display system, comprising:

a display;

a communications interface; and

one or more processors configured to execute a plurality of computer readable instructions configured to:

access a source image of imaging content via the communications interface;

obtain a capture field of view of the source image;

obtain dimensions of the display;

obtain a presentation field of view based on a viewing distance between the display and a user and the dimensions of the display;

obtain an image transformation to transform the source image from a capture projection to a display projection, the image transformation configured based on the capture field of view and the presentation field of view; and

obtain a transformed image based on applying the image transformation to the source image.

15. The portable content display system of claim 14 , wherein the image transformation is configured based on a ratio of the capture field of view to the presentation field of view.

16. The portable content display system of claim 14 , wherein the imaging content includes a video or a sequence of images.

17. The portable content display system of claim 14 , wherein the capture field of view is obtained based on curvature information of an optical element used to capture the imaging content.

18. The portable content display system of claim 17 , wherein the curvature information includes coefficients of a polynomial representation characterizing a curvature of the optical element.

19. The portable content display system of claim 17 , wherein the curvature information is stored in meta data of the imaging content.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 7, 2017
From: NEWMAN, DAVID; ADSUMILLI, BALU
To: GOPRO, INC.
Reel/Frame 043221/0718 →
SECURITY INTEREST Recorded Jul 31, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 043380/0163 →
Continuity (1)
Provisional Application 62316476 · Mar 31, 2016
Cited By (3)
US 12,332,439 US 12,387,389 US 12,400,532