IP Library Granted Patent US 10,089,710
Granted Patent B2
US 10,089,710 · App. 15/606,737 · Granted Oct 2, 2018

Image capture accelerator

Inventor: Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
G06T1/20G06T3/4015H04N5/225H04N5/23245H04N5/374H04N5/378
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,089,710
App. No.
15/606,737
Granted
Oct 2, 2018
Kind
B2
Abstract

An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Claims (42)

1. A camera, comprising:

an image sensor chip configured to capture image data;

a camera memory; and

an image signal processor chip configured to:

receive the captured image data;

perform one or more color space conversion operations on the image data to produce converted image data;

perform one or more encoding operations on the converted image data to produce encoded image data; and

write the encoded image data to the camera memory;

wherein the image signal processor chip, when configured to operate in a standard processing mode, is configured to perform one or more pre-processing operations, including a demosaicing operation, on the received image data before performing the one or more color space conversion operations;

wherein the image signal processor, when configured to operate in an accelerated processing mode, is configured to swizzle the image data and bypass the one or more pre-processing operations.

2. The camera of claim 1 , wherein the image data is swizzled to facilitate color space conversion from a Bayer color space into a YUV color space.

3. The camera of claim 1 , wherein the one or more pre-processing operations includes noise reduction operations.

4. The camera of claim 1 , wherein the one or more pre-processing operations includes image sharpening operations.

5. The camera of claim 1 , wherein the image signal processor chip is further configured to perform one or more clean Bayer processing operations on the received image data before performing the one or more color space conversion operations.

6. The camera of claim 1 , wherein the image signal processor chip is further configured to perform one or more bit depth conversion operations on the image data before performing the one or more color space conversion operations.

7. The camera of claim 1 , wherein the image signal processor chip is further configured to display a preview image based on the encoded image data on a screen of the camera.

8. A method for processing an image, comprising:

receiving, by an image signal processor chip, image data captured by an image sensor chip;

producing, by the image signal processor chip, second image data by:

responsive to the image signal processor chip being configured to operate in an accelerated processing mode, swizzling the image data and bypassing one or more pre-processing operations, including a demosaicing operation;

performing, by the image signal processor chip, one or more color space conversion operations on the second image data to produce converted image data;

performing, by the image signal processor chip, one or more encoding operations on the converted image data to produce encoded image data; and

writing, by the image signal processor chip, the encoded image data to the camera memory.

9. The method of claim 8 , wherein the image data is swizzled to facilitate color space conversion from a Bayer color space into a YUV color space.

10. The method of claim 8 , wherein the one or more pre-processing operations includes noise reduction operations.

11. The method of claim 8 , wherein the one or more pre-processing operations includes image sharpening operations.

12. The method of claim 8 , further comprising performing, by the image signal processor chip, one or more clean Bayer processing operations on the received image data before performing the one or more color space conversion operations.

13. The method of claim 8 , further comprising performing, by the image signal processor chip, one or more bit depth conversion operations on the image data before performing the one or more color space conversion operations.

14. The method of claim 8 , further comprising displaying, by a monitor, a preview image based on the encoded image data.

15. An image signal processor chip configured to:

receive, image data captured by an image sensor chip;

produce second image data by:

responsive to the image signal processor chip being configured to operate in a standard processing mode, performing, by the image signal processor chip, one or more pre-processing operations, including a demosaicing operation, on the received image data; and

responsive to the image signal processor chip being configured to operate in an accelerated processing mode, swizzling the image data and bypassing the one or more pre-processing operations;

perform one or more color space conversion operations on the second image data to produce converted image data;

perform one or more encoding operations on the converted image data to produce encoded image data; and

write the encoded image data to the camera memory.

16. The image signal processor chip of claim 15 , wherein the image data is swizzled to facilitate color space conversion from a Bayer color space into a YUV color space.

17. The image signal processor chip of claim 15 , wherein the one or more pre-processing operations includes noise reduction operations.

18. The image signal processor chip of claim 15 , wherein the one or more pre-processing operations includes image sharpening operations.

19. The image signal processor chip of claim 15 , wherein the image signal processor chip is further configured to perform one or more clean Bayer processing operations on the received image data before performing the one or more color space conversion operations.

20. The image signal processor chip of claim 15 , wherein the image signal processor chip is further configured to perform one or more bit depth conversion operations on the image data before performing the one or more color space conversion operations.

Assignments (7)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
SECURITY INTEREST Recorded Jul 31, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 043380/0163 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2017
From: CAMPBELL, SCOTT PATRICK
To: WOODMAN LABS, INC.
Reel/Frame 042744/0952 →
MERGER Recorded Jun 9, 2017
From: WOODMAN LABS, INC.
To: GOPRO, INC.
Reel/Frame 042744/0962 →
Continuity (4)
Continuation 14603570 · Jan 23, 2015
Continuation 13940215 · Jul 11, 2013
Provisional Application 61671068 · Jul 12, 2012
Related Publication 20170262957A1 · Sep 14, 2017