IP Library Granted Patent US 9,591,217
Granted Patent B2
US 9,591,217 · App. 15/282,326 · Granted Mar 7, 2017

Camera system encoder/decoder architecture

Inventors: Scott Patrick Campbell (Belmont, CA); Paul Mobbs (San Francisco, CA); Balineedu Chowdary Adsumilli (San Mateo, CA); Sumit Chawla (San Carlos, CA)
Assignee: GoPro, Inc.
H04N5/23241G06T3/4015H04N1/6027H04N5/23222H04N5/23229H04N5/23245H04N5/23254H04N5/23267H04N5/23296H04N5/247H04N9/09H04N9/735H04N19/102H04N19/172H04N19/1883H04N19/423H04N19/44H04N19/63H04N19/91
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,591,217
App. No.
15/282,326
Granted
Mar 7, 2017
Kind
B2
Abstract

An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Claims (42)

1. A camera system, comprising:

an image sensor chip configured to produce image data representative of light incident upon the image sensor chip; and

an image signal processor chip (“ISP”) comprising:

an encoder configured to:

when the camera system is configured to operate in an accelerated capture mode, perform a first encoding operation on image data to produce first encoded image data and store the encoded image data in memory; and

when the camera system is configured to operate in a normal mode or a standby mode, perform a second encoding operation on image data to produce second encoded image data and output the second encoded image data; and

a decoder configured to, when the camera system is configured to operate in the standby mode, access the first encoded image data from the memory and decode the first encoded image data to produce decoded image data, wherein the encoder, when the camera system is configured to operate in the standby mode, is configured to perform the second encoding operation on the decoded image data to produce the second encoded image data.

2. The camera system of claim 1 , wherein the encoder comprises a wavelet encoder, and wherein the decoder comprises a wavelet decoder.

3. The camera system of claim 1 , wherein a format of the first encoded image data is not a displayable image format.

4. The camera system of claim 1 , wherein the camera system is configured to operate in the accelerated captured mode in response to a rate of capturing image data by the image sensor chip exceeding a threshold.

5. The camera system of claim 1 , wherein the first encoding operation requires less processing power than the second encoding operation.

6. The camera system of claim 1 , wherein the first encoding operation requires less processing time than the second encoding operation.

7. The camera system of claim 1 , wherein the memory includes a combination read/write communication bus communicatively coupled to the encoder and the decoder, wherein the encoder is configured to write to the memory via the combination read/write communication bus, and wherein the decoder is configured to read from the memory via the combination read/write communication bus.

8. A method for capturing images by a camera system, comprising:

capturing, by an image sensor chip, image data representative of light incident upon the image sensor chip;

when the camera system is configured to operate in a normal capture mode:

encoding, by an encoder, the image data using a first encoding operation to produce first encoded image data;

outputting, by an output, the first encoded image data;

when the camera system is configured to operate in an accelerated capture mode:

encoding, by the encoder, the image data using a second encoding operation to produce second encoded image data;

storing, by the encoder, the second encoded image data in a memory; and

when the camera system is configured to operate in a standby mode:

accessing, by a decoder, the second encoded image data from the memory;

decoding, by the decoder, the second encoded image data to produce decoded image data;

encoding, by the encoder, the decoded image data using the first encoding operation to produce the first encoded image data; and

outputting, by the output, the first encoded image data.

9. The method of claim 8 , wherein the encoder comprises a wavelet encoder, and wherein the decoder comprises a wavelet decoder.

10. The method of claim 8 , wherein a format of the second encoded image data is not a displayable image format.

11. The method of claim 8 , wherein the camera system is configured to operate in the accelerated captured mode in response to a rate of capturing image data by the image sensor chip exceeding a threshold.

12. The method of claim 8 , wherein the first encoding operation requires less processing power than the second encoding operation.

13. The method of claim 8 , wherein the first encoding operation requires less processing time than the second encoding operation.

14. The method of claim 8 , wherein the memory includes a combination read/write communication bus communicatively coupled to the encoder and the decoder, wherein the encoder is configured to write to the memory via the combination read/write communication bus, and wherein the decoder is configured to read from the memory via the combination read/write communication bus.

15. A integrated circuit chip for capturing images in a camera system, comprising:

an encoder configured to:

when the camera system is configured to operate in an accelerated capture mode, perform a first encoding operation on image data captured by an image sensor chip to produce first encoded image data and store the encoded image data in memory; and

when the camera system is configured to operate in a normal mode or a standby mode, perform a second encoding operation on image data to produce second encoded image data and output the second encoded image data; and

a decoder configured to, when the camera system is configured to operate in the standby mode, access the first encoded image data from the memory and decode the first encoded image data to produce decoded image data, wherein the encoder, when the camera system is configured to operate in the standby mode, is configured to perform the second encoding operation on the decoded image data to produce the second encoded image data.

16. The integrated circuit chip of claim 15 , wherein the encoder comprises a wavelet encoder, and wherein the decoder comprises a wavelet decoder.

17. The integrated circuit chip of claim 15 , wherein a format of the first encoded image data is not a displayable image format.

18. The integrated circuit chip of claim 15 , wherein the camera system is configured to operate in the accelerated captured mode in response to a rate of capturing image data by the image sensor chip exceeding a threshold.

19. The integrated circuit chip of claim 15 , wherein the first encoding operation requires less processing power or less processing time than the second encoding operation.

20. The integrated circuit chip of claim 15 , wherein the memory includes a combination read/write communication bus communicatively coupled to the encoder and the decoder, wherein the encoder is configured to write to the memory via the combination read/write communication bus, and wherein the decoder is configured to read from the memory via the combination read/write communication bus.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Feb 22, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 041777/0440 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2016
From: CAMPBELL, SCOTT PATRICK; MOBBS, PAUL; ADSUMILLI, BALINEEDU CHOWDARY; CHAWLA, SUMIT
To: GOPRO, INC.
Reel/Frame 040064/0633 →
Continuity (4)
Continuation 15049015 · Feb 20, 2016
Continuation 14488283 · Sep 17, 2014
Provisional Application 61885412 · Oct 1, 2013
Related Publication 20170041541A1 · Feb 9, 2017