IP Library Granted Patent US 10,244,167
Granted Patent B2
US 10,244,167 · App. 15/432,700 · Granted Mar 26, 2019

Apparatus and methods for image encoding using spatially weighted encoding quality parameters

Inventors: Balineedu Chowdary Adsumilli (San Francisco, CA); Adeel Abbas (Carlsbad, CA); Sumit Chawla (Carlsbad, CA)
Assignee: GOPRO, INC.
H04N5/23238H04N13/178H04N13/243H04N13/296H04N13/344H04N19/115H04N19/117H04N19/122H04N19/126H04N19/167H04N19/57H04N19/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,244,167
App. No.
15/432,700
Granted
Mar 26, 2019
Kind
B2
Abstract

Methods and apparatus for encoding and decoding image data based on one or more parameters. In one embodiment, various spatial portions or regions of image data (e.g., a still or moving image) are weighted according to the perceived or measured quality. Processing for these weighted regions can be selectively altered or adjusted so as to optimize one or more operational parameters including for example processing and/or memory requirements, or speed.

Claims (41)

1. A computerized apparatus, comprising:

one or more processors in operative communication with a computer readable storage apparatus having a storage medium, the storage medium comprising one or more computer-executable instructions that, when executed by the one or more processors is configured to:

obtain visual content, the visual content comprised of a plurality of spatial portions;

encode each of the plurality of spatial portions of the visual content;

store the encoded plurality of spatial portions along with respective spatially weighted encoding quality parameters;

retrieve the stored encoded plurality of spatial portions along with the respective spatially weighted encoding quality parameters; and

encode individual spatial portions of the visual content using the respective spatially weighted encoding quality parameters;

wherein the respective spatially weighted encoding quality parameters are derived based on a spatial distortion introduced by an image capture device that describes a spatially weighted encoding quality over an image space of the visual content.

2. The computerized apparatus of claim 1 , wherein the spatial distortion comprises a pre-defined spatial distortion specification associated with a lens of the image capture device.

3. The computerized apparatus of claim 1 , wherein the spatial distortion comprises a user-configurable spatial distortion parameter.

4. The computerized apparatus of claim 1 , wherein the visual content comprises panoramic content that was captured using two or more image capturing devices.

5. The computerized apparatus of claim 4 , wherein the respective spatially weighted encoding quality parameters are separately retrievable so as to enable provision of the visual content to legacy display devices, the legacy display devices not being compatible with the spatially weighted encoding quality parameters.

6. The computerized apparatus of claim 4 , wherein the encoding of the individual spatial portions of the visual content using the respective spatially weighted encoding quality parameters occurs prior to provision of the visual content to a display device.

7. The computerized apparatus of claim 4 , wherein the encoding of the individual spatial portions of the visual content using the respective spatially weighted encoding quality parameters is dynamically determined based at least in part on a capability of differing display devices.

8. A computer readable storage apparatus having a storage medium, the storage medium comprising one or more computer-executable instructions which, when executed, is configured to:

retrieve visual content, the visual content comprised of a plurality of spatial portions;

retrieve stored spatially weighted encoding quality parameters, the spatially weighted encoding quality parameters associated with respective ones of the plurality of spatial portions;

encode individual spatial portions of the plurality of spatial portions of the visual content using respective ones of the spatially weighted encoding quality parameters, the encoded individual spatial portions of the visual content being based at least in part on one or more parameters associated with a display device; encode the individual spatial; and

provide the encoded individual spatial portions of the visual content to the display device.

9. The computer readable storage apparatus of claim 8 , wherein the stored spatially weighted encoding quality parameters are determined at least in part on lens parameters associated with an image capture device utilized to capture the visual content.

10. The computer readable storage apparatus of claim 9 , wherein the image capture device comprises two or more lenses configured to capture panoramic content.

11. The computer readable storage apparatus of claim 8 , further comprising one or more computer-executable instructions which, when executed, is configured to:

receive an adjusted spatially weighted encoding quality parameter from a user subsequent to the provision of the encoded individual spatial portions of the visual content to the display device;

encode at least a portion of the individual spatial portions of the visual content using the adjusted spatially weighted encoding quality parameter; and

provide the encoded at least a portion of the individual spatial portions of the visual content using the adjusted spatially weighted encoding quality parameter to the display device.

12. The computer readable storage apparatus of claim 8 , wherein the spatially weighted encoding quality parameters are separately retrievable so as to enable provision of the visual content to legacy display devices, the legacy display devices not being compatible with the spatially weighted encoding quality parameters.

13. The computer readable storage apparatus of claim 8 , wherein the encoding of the individual spatial portions of the visual content using the spatially weighted encoding quality parameters occurs prior to provision of the visual content to the display device.

14. The computer readable storage apparatus of claim 8 , wherein the encoding of the individual spatial portions of the visual content using the spatially weighted encoding quality parameters is dynamically determined based at least in part on a capability of differing display devices.

15. A method of processing digital image data, the method comprising:

encoding each of a plurality of spatial portions of captured visual content;

storing the encoded plurality of spatial portions along with respective associated spatially weighted encoding quality parameters;

determining the stored respective associated spatially weighted encoding quality parameters based at least in part on lens parameters associated with a device utilized to capture the visual content;

retrieving the stored pre-encoded plurality of spatial portions along with the respective associated spatially weighted encoding quality parameters;

encoding individual ones of the encoded plurality of spatial portions of the visual content using the respective associated spatially weighted encoding quality parameters, the spatially weighted encoding quality parameters comprising at least a first quality parameter associated with a first spatial portion of the captured visual content and a second quality parameter associated with a second spatial portion of the captured visual content, each of the first and second quality parameters comprising information identifying computing resources required for processing the first and second spatial portions, respectively.

16. The method of claim 15 , wherein the encoding of the each of the plurality of spatial portions comprises compressing at least one of the plurality of spatial portions.

17. The method of claim 15 , wherein the captured visual content comprises capturing areas of differing measurable qualities, the plurality of spatial portions each comprising respective ones of the differing measurable qualities.

18. The method of claim 15 , wherein:

the encoding of the individual ones of the encoded plurality of spatial portions comprises encoding based at least in part on one or more parameters associated with a display device; and

the method further comprises providing the encoded individual ones of the pre-encoded plurality of spatial portions of the visual content to the display device.

19. The method of claim 15 , wherein the encoding of the individual spatial portions of the visual content using the respective spatially weighted encoding quality parameters occurs prior to providing the visual content to a display device.

20. The method of claim 15 , wherein the encoding of the individual spatial portions of the visual content using the respective spatially weighted encoding quality parameters is dynamically determined based at least in part on a capability of differing display devices.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
PATENT AND TRADEMARK SECURITY AGREEMENT Recorded Jun 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 049454/0352 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 14, 2017
From: ADSUMILLI, BALINEEDU CHOWDARY; ABBAS, ADEEL; CHAWLA, SUMIT
To: GOPRO, INC.
Reel/Frame 041255/0561 →
Continuity (2)
Provisional Application 62351818 · Jun 17, 2016
Related Publication 20170366814A1 · Dec 21, 2017
Cited By (1)
US 12,477,231