IP Library Granted Patent US 11,671,712
Granted Patent B2
US 11,671,712 · App. 17/215,362 · Granted Jun 6, 2023

Apparatus and methods for image encoding using spatially weighted encoding quality parameters

Inventors: Balineedu Chowdary Adsumilli (San Mateo, CA); Adeel Abbas (Carlsbad, CA); Sumit Chawla (San Carlos, CA)
Assignee: GoPro, Inc.
H04N23/698H04N13/178H04N13/243H04N13/296H04N13/344H04N19/115H04N19/117H04N19/122H04N19/126H04N19/167H04N19/57H04N19/597
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,671,712
App. No.
17/215,362
Granted
Jun 6, 2023
Kind
B2
Abstract

A method includes obtaining visual content comprising spatial portions; determining respective spatial qualities of the spatial portions, wherein the respective spatial qualities are based on locations of the spatial portions within the visual content; and encoding the spatial portions of the visual content based on the respective spatial qualities. An apparatus includes a camera, a display, and a processor. The processor is configured to identify, using facial recognition, a face of a user of the apparatus; identify a distance of the face of the user to the display; and render visual content on the display using a quality that is based on the distance.

Claims (50)

1. An apparatus, comprising:

a camera;

a display; and

a processor configured to:

identify, using facial recognition, a face of a user of the apparatus;

identify a distance of the face of the user to the display; and

render visual content on the display using a quality that is based on the distance,

wherein the visual content comprises spatial portions,

wherein the spatial portions of the visual content are encoded using respective spatially weighted encoding quality parameters, the respective spatially weighted encoding quality parameters comprising information associated with resources useful for post-processing the visual content, and

wherein to render the visual content on the display using the quality that is based on the distance comprises to:

generate derivative content based on the respective spatially weighted encoding quality parameters of at least some of the spatial portions of the visual content.

2. The apparatus of claim 1 , wherein respective spatially weighted encoding quality parameters are non-uniform.

3. The apparatus of claim 1 , wherein to render the visual content on the display using the quality that is based on the distance comprises to:

allocate an amount of resources for decoding one or more spatial portions of the visual content based on one or more of the respective spatially weighted encoding quality parameters associated with the one or more spatial portions.

4. The apparatus of claim 1 , wherein the respective spatially weighted encoding quality parameters are associated with a distribution curve that is descriptive of a quality level as a function of location within the visual content.

5. The apparatus of claim 4 , wherein the processor is further configured to:

generate the visual content via performance of at least a render operation using at least two or more images, the render operation comprising a stitching of the at least two or more images.

6. A method, comprising:

identifying, using facial recognition, a face of a user of an apparatus;

identifying a distance of the face of the user to a display of the apparatus; and

rendering visual content on the display using a quality that is based on the distance,

wherein the visual content comprises spatial portions,

wherein the spatial portions of the visual content are encoded using respective spatially weighted encoding quality parameters, the respective spatially weighted encoding quality parameters comprising information associated with resources useful for post-processing the visual content, and

wherein rendering the visual content on the display using the quality that is based on the distance comprises:

generating derivative content based on the respective spatially weighted encoding quality parameters of at least some of the spatial portions of the visual content.

7. The method of claim 6 , wherein respective spatially weighted encoding quality parameters are non-uniform.

8. The method of claim 6 , wherein rendering the visual content on the display using the quality that is based on the distance comprises:

allocating an amount of resources for decoding one or more spatial portions of the visual content based on one or more of the respective spatially weighted encoding quality parameters associated with the one or more spatial portions.

9. The method of claim 6 , wherein the respective spatially weighted encoding quality parameters are associated with a distribution curve that is descriptive of a quality level as a function of location within the visual content.

10. The method of claim 9 , further comprising:

generating the visual content via performance of at least a render operation using at least two or more images, the render operation comprising a stitching of the at least two or more images.

11. The method of claim 6 , further comprising:

encoding at least some of the spatial portions of the visual content using respective spatially weighted encoding quality parameters, wherein the respective spatially weighted encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the subset of the spatial portions.

12. A non-transitory computer-readable storage medium, comprising executable instructions that, when executed by a processor, facilitate performance of operations, the operations comprising operations to:

identify, using facial recognition, a face of a user of an apparatus;

identify a distance of the face of the user to a display of the apparatus; and

render visual content on the display using a quality that is based on the distance,

wherein the visual content comprises spatial portions,

wherein the spatial portions of the visual content are encoded using respective spatially weighted encoding quality parameters, the respective spatially weighted encoding quality parameters comprising information associated with resources useful for post-processing the visual content, and

wherein to render the visual content on the display using the quality that is based on the distance comprises to:

generate derivative content based on the respective spatially weighted encoding quality parameters of at least some of the spatial portions of the visual content.

13. The non-transitory computer-readable storage medium of claim 12 , wherein respective spatially weighted encoding quality parameters are non-uniform.

14. The non-transitory computer-readable storage medium of claim 12 , wherein to render the visual content on the display using the quality that is based on the distance comprises to:

allocate an amount of resources for decoding one or more spatial portions of the visual content based on one or more of the respective spatially weighted encoding quality parameters associated with the one or more spatial portions.

15. The non-transitory computer-readable storage medium of claim 12 , wherein the respective spatially weighted encoding quality parameters are associated with a distribution curve that is descriptive of a quality level as a function of location within the visual content.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the operations further comprise operations to:

generate the visual content via performance of at least a render operation using at least

two or more images, the render operation comprising a stitching of the at least two or more images.

17. The non-transitory computer-readable storage medium of claim 12 , wherein the operations further comprise operations to:

encode at least some of the spatial portions of the visual content using respective spatially weighted encoding quality parameters, wherein the respective spatially weighted encoding quality parameters are obtained by combining a first distortion model related to the obtaining the visual content with a second model that emphasizes the subset of the spatial portions.

Assignments (3)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 31, 2021
From: ADSUMILLI, BALINEEDU CHOWDARY; ABBAS, ADEEL; CHAWLA, SUMIT
To: GOPRO, INC.
Reel/Frame 055780/0991 →
Continuity (4)
Continuation 16363668 · Mar 25, 2019
Continuation 15432700 · Feb 14, 2017
Provisional Application 62351818 · Jun 17, 2016
Related Publication 20210218891A1 · Jul 15, 2021