IP Library Granted Patent US 10,326,904
Granted Patent B2
US 10,326,904 · App. 16/050,305 · Granted Jun 18, 2019

On-chip image sensor data compression

Inventors: Scott Patrick Campbell (Belmont, CA); David A. Newman (San Diego, CA); Brian G. Schunck (San Diego, CA)
Assignee: GoPro, Inc.
H04N1/2137H04N1/00209H04N5/23206H04N5/335H04N5/341H04N5/374H04N9/045H04N19/137H04N19/156H04N19/172H04N19/423H04N19/426H04N19/625H04N19/63H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,326,904
App. No.
16/050,305
Granted
Jun 18, 2019
Kind
B2
Abstract

Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

Claims (26)

1. An image capture system, comprising:

an image sensor chip configured to:

convert light into pixel data; and

generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories, wherein the variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

2. The system of claim 1 , wherein the image sensor chip comprises transform logic that transforms at least some of the pixel data on a row and column basis and outputs the transformed pixel data to a compression engine configured to generate the compressed pixel data, wherein the transform logic is configured to perform a first transformation and the compression engine is operable to perform a second transformation.

3. The system of claim 1 , wherein the image sensor chip is configured to convert light into pixel data by converting electrical signals representative of the light into pixel data.

4. The system of claim 1 , wherein each pixel category is associated with a group of pixel data and the transform is a wavelet transform.

5. The system of claim 4 , wherein the image sensor chip is configured to generate the compressed pixel data using at least one of quantization and entropy encoding.

6. The system of claim 5 , wherein the image sensor chip includes a Bayer color filter and the plurality of pixel categories include red, green1, blue, and green2 pixel categories.

7. The system of claim 5 , wherein the pixel data is chroma channel differenced before the transform data is generated.

8. The system of claim 5 , wherein the image sensor chip includes a plurality of pixel data feeds configured to communicate respective groups of pixel data associated with respective pixel categories of the plurality of pixel categories.

9. The system of claim 8 , wherein the compressed pixel data is generated according to the plurality of pixel categories using a parallel processing technique.

10. The system of claim 1 , wherein the compressed pixel data is generated using predictive encoding.

11. The system of claim 10 , wherein the image sensor chip includes a color filter and the pixel categories correspond to color planes.

12. The system of claim 1 , wherein the pixel data is a digital image.

13. The system of claim 1 , wherein the image sensor chip is configured to adjust the variable compression rate in response to at least one of a frame capture rate and an amount of the pixel data.

14. The system of claim 1 , wherein the image sensor chip is configured to receive settings for at least one of a frame capture rate and a frame resolution.

15. The system of claim 1 , wherein the image sensor chip is configured to adjust the variable compression rate based on a battery power consumption.

16. The system of claim 1 , wherein the image sensor chip is configured to generate compressed pixel data without using motion compensation.

17. The system of claim 1 , further comprising:

a digital signal processor chip comprising:

a bus coupled to an output bus of the image sensor chip and configured to receive the compressed pixel data from the image sensor chip;

hardware configured to decompress the compressed pixel data to obtain decompressed pixel data and to compress the decompressed pixel data using motion compensation.

18. The system of claim 17 , wherein the digital signal processor chip is configured to convert a color mapping scheme of the decompressed pixel data before compression of the decompressed pixel data.

19. The system of claim 17 , wherein the digital signal processor chip is configured to convert the decompressed pixel data from a Bayer scheme to a YUV scheme.

20. The system of claim 17 , wherein the digital signal processor chip is configured to downscale the decompressed pixel data.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
SECURITY INTEREST Recorded Dec 3, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047713/0309 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 1, 2018
From: CAMPBELL, SCOTT PATRICK; NEWMAN, DAVID A.; SCHUNCK, BRIAN G.
To: WOODMAN LABS, INC.
Reel/Frame 046520/0956 →
CHANGE OF NAME Recorded Aug 1, 2018
From: WOODMAN LABS, INC.
To: GOPRO, INC.
Reel/Frame 046694/0290 →
Continuity (6)
Continuation 15445166 · Feb 28, 2017
Continuation 15096479 · Apr 12, 2016
Continuation 14603563 · Jan 23, 2015
Continuation 14174812 · Feb 6, 2014
Continuation 13436540 · Mar 30, 2012
Related Publication 20180338060A1 · Nov 22, 2018