IP Library Granted Patent US 10,484,621
Granted Patent B2
US 10,484,621 · App. 15/414,403 · Granted Nov 19, 2019

Systems and methods for compressing video content

Inventors: Balineedu Chowdary Adsumilli (San Francisco, CA); Adeel Abbas (Carlsbad, CA); David Newman (San Diego, CA)
Assignee: GoPro, Inc.
H04N5/247G06T3/20H04N5/23238H04N19/124H04N19/167H04N19/17H04N19/36H04N19/597H04N19/85G06T19/006
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,484,621
App. No.
15/414,403
Granted
Nov 19, 2019
Kind
B2
Abstract

Systems and methods for providing imaging content using spatially varying encoding quality. Imaging content may be acquired using spherical lenses (e.g., fisheye). When viewing spherical imaging content, spherical to planar image transformations may be utilized. Such transformations (e.g., equirectangular) may be characterized by spatially varying image distortion. Transformed images may be encoded. Encoding process may be configured based on spatially varying encoding quality. Encoding quality may be configured based on the transformation such that portions of the transformed image characterized by greater distortion may be encoded using lower quality (e.g. greater QP values); portions of the transformed image characterized by lower distortion may be encoded using greater quality (e.g. lower QP values). Such encoding may produce a bitstream characterized by a lower bitrate for a given quality and/or better quality for a given bitrate as compared to an encoding process that may apply a uniform encoding quality.

Claims (55)

1. A system for providing imaging content, the system comprising:

an electronic storage configured to store a sequence of images of a first frame resolution;

a communications interface configured to communicate a bit stream associated with the stored sequence of images to a client device; and

one or more physical processors configured to execute a plurality of computer readable instructions, the plurality of computer readable instructions configured to, when executed by the one or more physical processors, cause the system to:

access one or more source images, individual source images of the one or more source images characterized by a spherical field of view;

transform the one or more source images into a planar image using a spherical to planar transformation;

obtain a fixed spatial quality distribution map for image encoding based on the spherical to planar transformation, the fixed spatial quality distribution map comprising at least a plurality of encoding parameters continuously varying along a curve relative to an equatorial line associated with the planar image; and

encode the planar image using the fixed spatial quality distribution map such that:

one or more first portions of the planar image are encoded at a first quality according to a first one of the plurality of encoding parameters; and

one or more second portions of the planar image are encoded at a second quality according to a second one of the plurality of coding parameters, the one or more second portions of the planar image being more proximate to an equatorial line associated with the planar image as compared to the one or more first portions of the planar image, the second quality being greater than the first quality.

2. The system of claim 1 , wherein the spherical to planar transformation comprises an equirectangular projection.

3. The system of claim 2 , wherein the equatorial line resides near the middle of a latitudinal dimension of the planar image.

4. The system of claim 3 , wherein:

the plurality of encoding parameters comprises a plurality of quantization parameter (QP) values for the encoding of planar image; and

the second quality is characterized by a lower QP value as compared with a higher QP value for the first quality.

5. The system of claim 4 , wherein the one or more source images are obtained using a plurality of image capturing devices, the plurality of image capturing devices are configured to obtain panoramic content.

6. The system of claim 5 , wherein the higher QP value is configured to reduce a transmission bitrate as compared with the transmission of a non-encoded planar image that does not utilize the spatial quality distribution map for encoding.

7. The system of claim 1 , wherein the one or more source images are obtained using a plurality of image capturing devices, the plurality of image capturing devices are configured to obtain panoramic content.

8. The system of claim 7 , wherein the plurality of computer readable instructions is further configured to, when executed by the one or more physical processors, cause the system:

receive a first current viewport position for a user viewing the obtained panoramic content; and

provide the one or more second portions of the planar image at the second quality, the first quality; the one or more second portions of the planar image representative of the current viewport position.

9. The system of claim 8 , wherein the one or more first portions of the planar image that are encoded at the first quality represent portions of the image that are not associated with the current viewport position for the user.

10. A method for providing imaging content, the method comprising:

accessing a planar image characterized by a spatially varying image distortion parameter;

obtaining a spatial quality distribution map for encoding of the planar image based on the spatially varying image distortion parameter, the spatial quality distribution map comprising at least a plurality of quantization parameter (QP) values each associated with one or more of a plurality of positions within the planar image, the plurality of QP values varying along a curve relative to an equatorial line disposed at a central latitudinal dimension of the planar image; and

encoding the planar image using the spatial quality distribution map such that:

one or more first portions of the planar image are encoded at a first quality according to a first QP value, the one or more first portions corresponding to one or more first ones of the plurality of positions;

one or more second portions of the planar image are encoded at a second quality according to a second QP value, the one or more second portions corresponding to one or more second ones of the plurality of positions, the one or more first ones of the plurality of positions distal to the equatorial line relative to the one or more second ones of the plurality of positions, the second quality being greater than the first quality.

11. The method of claim 10 , further comprising:

obtaining one or more source images; and

transforming the one or more source images into the planar image.

12. The method of claim 11 , further comprising transmitting the encoded planar image, the transmitted encoded planar image characterized by a lower bitrate for a given quality as compared with transmission of the planar image using an encoding process that applies a uniform encoding quality to the planar image.

13. The method of claim 11 , further comprising transmitting the encoded planar image, the transmitted encoded planar image characterized by a higher quality for a given bitrate as compared with transmission of the planar image using an encoding process that applies a uniform encoding quality to the planar image.

14. An imaging system for providing imaging content, the apparatus comprising:

an optical element characterized by a spherical field of view;

an imaging sensor optically coupled to the optical element, the imaging sensor configured to obtain a source image;

a communications interface configured to communicate a representation of the source image; and

one or more physical processors configured to execute a plurality of computer readable instructions, the plurality of computer readable instructions configured to, when executed by the one or more physical processors, cause the imaging system to:

obtain, via the imaging sensor, the source image;

during the obtainment of the source image:

transform the source image into a planar image using a spherical to planar transformation;

obtain a fixed spatial quality distribution map for image encoding based on the spherical to planar transformation, the fixed spatial quality distribution map comprising at least data related to spatial distribution relative to a fixed reference line within the planar image, the spatial distribution utilized to identify an encoding quality;

utilize the fixed spatial quality distribution map to encode one or more first portions of the planar image according to a first quality; and

utilize the spatial quality distribution map to encode one or more second portions of the planar image according to a second quality, the second quality being greater than the first quality, the one or more second portions being more proximate to the fixed reference line as compared with the one or more first portions; and

provide the encoded planar image via the communications interface to a target destination.

15. The imaging system of claim 14 , wherein the source images comprises panoramic content.

16. The imaging system of claim 14 , wherein the spherical to planar transformation comprises an equirectangular projection.

17. The imaging system of claim 16 , wherein:

the first quality and the second quality are effectuated by the utilization of a quantization parameter (QP) for the encoded planar image; and

the second quality is characterized by a lower QP value as compared with a higher QP value for the first quality.

18. The imaging system of claim 17 , wherein the higher QP value is configured to reduce a transmission bitrate as compared with the transmission of a non-encoded planar image that does not utilize the fixed spatial quality distribution map for encoding.

19. The imaging system of claim 14 , wherein the encode of the one or more first portion at the first quality and the encode of the one or more second portions at the second quality occurs prior to receipt of data indicative of a direction of interest from a computerized user device.

20. The imaging system of claim 14 , wherein the plurality of computer readable instructions is further configured to, when executed by the one or more physical processors, cause the imaging system to:

receive a current viewport position via the communications interface for a user viewing the panoramic content; and

provide the one or more first portions of the planar image at the first quality, the one or more first portions of the planar image being representative of the current viewport position.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2017
From: ADSUMILLI, BALINEEDU CHOWDARY; ABBAS, ADEEL; NEWMAN, DAVID
To: GOPRO, INC.
Reel/Frame 041095/0583 →
Cited By (3)
US 12,335,325 US 12,375,693 US 12,439,063