IP Library Granted Patent US 10,701,291
Granted Patent B2
US 10,701,291 · App. 16/401,529 · Granted Jun 30, 2020

On-chip image sensor data compression

Inventors: Scott Patrick Campbell (Belmont, CA); David A. Newman (San Diego, CA); Brian G. Schunck (San Diego, CA)
Assignee: GoPro, Inc.
H04N5/341H04N1/00209H04N1/2137H04N5/23206H04N5/335H04N9/045H04N19/0049H04N19/137H04N19/156H04N19/172H04N19/423H04N19/426H04N19/625H04N19/63H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,701,291
App. No.
16/401,529
Granted
Jun 30, 2020
Kind
B2
Abstract

Systems and methods are disclosed that capture and compress frames of pixel data. In an implementation, an image sensor chip is configured to convert light into pixel data and generate compressed pixel data at a variable compression rate including applying a transform to pixel data associated with a pixel category from a plurality of pixel categories. The variable compression rate is within an available bandwidth of an output bus configured to output the compressed pixel data.

Claims (39)

1. A method for compressing frames of pixel data, comprising:

organizing pixel data into groups of pixel data;

outputting compressed pixel data by an image sensor system using image compression on the groups of pixel data, the compressed pixel data outputted at a rate serviceable by an output bus of the image sensor system; and

transmitting, using the output bus, the compressed pixel data to a digital signal processor for processing into a video data format.

2. The method of claim 1 , wherein the image compression includes using a combination of lossless image compression and lossy image compression.

3. The method of claim 2 , wherein the image compression includes at least one of entropy encoding, predictive coding, and run-length encoding.

4. The method of claim 3 , wherein the outputting of compressed pixel data includes parallel processing the groups of pixel data according to one or more common pixel properties.

5. The method of claim 1 , wherein the rate is adjusted to accommodate a bandwidth limited output bus.

6. The method of claim 5 , further comprising:

buffering the pixel data to permit compression variability.

7. The method of claim 6 , wherein the rate of generating compressed pixel data is variable based on power availability.

8. An image sensor system on a chip comprising:

a compression engine configured to:

transform code commonly categorized groups of pixel data; and

output compressed pixel data based on the transform coded commonly categorized groups of pixel data within an available bandwidth of an output bus configured to output the compressed pixel data.

9. The image sensor system on a chip of claim 8 , further comprising:

a logic configured to perform a compression operation on rows or columns of pixels of the pixel data before the pixel data is transform coded.

10. The image sensor system on a chip of claim 9 , wherein the compression operation includes a first wavelet transform.

11. The image sensor system on a chip of claim 10 , wherein the compression engine is configured to:

receive output of the first wavelet transform; and

transform code the commonly categorized groups of pixel data using a second wavelet transform.

12. The image sensor system on a chip of claim 11 , wherein the compression engine is configured to:

receive the commonly categorized groups of pixel data using distinct pixel data feeds; and

compress the commonly categorized groups of pixel data using a parallel processing technique.

13. The image sensor system on a chip of claim 8 , wherein pins of the output bus of the image sensor system are coupled to pins of a digital signal processor, the digital signal processor configured to:

receive the compressed pixel data; and

process the compressed pixel data into a video format using motion compensation encoding.

14. The image sensor system on a chip of claim 8 , further comprising:

a buffer operable to buffer the pixel data to compensate for performance variances of the compression engine.

15. A method for compressing frames of pixel data, comprising:

categorizing pixel data into groups of pixel data;

providing compressed pixel data by the image sensor system using a transform coding of the groups of pixel data, the compressed pixel data generated at a rate accommodating an available bandwidth of an output bus of the image sensor system; and

transmitting, using the output bus, the compressed pixel data to a digital signal processor for video data format processing.

16. The method of claim 15 , wherein the transform coding includes a wavelet transform and the providing of compressed pixel data includes entropy encoding the transformed groups of pixel data.

17. The method of claim 15 , wherein the transform coding includes a plurality of wavelet transforms and the providing of compressed pixel data includes lossless image compression of the transformed groups of pixel data.

18. The method of claim 15 , wherein the transform coding of the groups of pixel data includes a wavelet transform performed by compression logic associated with respective rows and columns of a pixel array of the image sensor system.

19. The method of claim 18 , wherein the providing of compressed pixel data includes parallel processing the groups of pixel data according to pixel categories.

20. The method of claim 19 , further comprising:

storing the pixel data in a buffer to permit compression variability.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 15, 2019
From: CAMPBELL, SCOTT PATRICK; NEWMAN, DAVID A.; SCHUNCK, BRIAN G.
To: WOODMAN LABS, INC.
Reel/Frame 049183/0139 →
CHANGE OF NAME Recorded May 15, 2019
From: WOODMAN LABS, INC.
To: GOPRO, INC.
Reel/Frame 049183/0509 →
Continuity (7)
Continuation 16050305 · Jul 31, 2018
Continuation 15445166 · Feb 28, 2017
Continuation 15096479 · Apr 12, 2016
Continuation 14603563 · Jan 23, 2015
Continuation 14174812 · Feb 6, 2014
Continuation 13436540 · Mar 30, 2012
Related Publication 20190260901A1 · Aug 22, 2019