IP Library Granted Patent US 10,096,082
Granted Patent B2
US 10,096,082 · App. 15/727,568 · Granted Oct 9, 2018

Upscaling and downscaling in a camera architecture

Inventors: Scott Patrick Campbell (Belmont, CA); Paul Mobbs (San Francisco, CA); Balineedu Chowdary Adsumilli (San Mateo, CA); Sumit Chawla (San Carlos, CA)
Assignee: GoPro, Inc.
G06T1/20G06T3/4015H04N5/23245H04N5/374H04N9/8042H04N19/42
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,096,082
App. No.
15/727,568
Granted
Oct 9, 2018
Kind
B2
Abstract

An image capture accelerator performs accelerated processing of image data. In one embodiment, the image capture accelerator includes accelerator circuitry including a pre-processing engine and a compression engine. The pre-processing engine is configured to perform accelerated processing on received image data, and the compression engine is configured to compress processed image data received from the pre-processing engine. In one embodiment, the image capture accelerator further includes a demultiplexer configured to receive image data captured by an image sensor array implemented within, for example, an image sensor chip. The demultiplexer may output the received image data to an image signal processor when the image data is captured by the image sensor array in a standard capture mode, and may output the received image data to the accelerator circuitry when the image data is captured by the image sensor array in an accelerated capture mode.

Claims (41)

1. A camera system, comprising:

an image sensor configured to provide image data representative of light incident upon the image sensor;

an accelerator comprising:

a decimator configured to decimate the image data into a plurality of image components,

a downscale engine configured to downscale the image data using one or more of the plurality of image components, and

an upscale engine configured to upscale the image data using one or more of the plurality of image components; and

an image signal processor configured to process image data outputted by any of the image sensor and the accelerator and to output the processed image data.

2. The camera system of claim 1 , wherein the accelerator further comprises an H.264 engine configured to decode image components encoded as H.264 video.

3. The camera system of claim 2 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the H.264 engine.

4. The camera system of claim 1 , wherein the accelerator further comprises a VC-5 engine configured to decode image components encoded as VC-5 video.

5. The camera system of claim 4 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the VC-5 engine.

6. The camera system of claim 1 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image component.

7. The camera system of claim 1 , wherein the upscale engine is configured to upscale the one or more of the plurality of image components by decoding a first image component using a first decoding algorithm, decoding a second image component using a second decoding algorithm, and combining the decoded first image component and the decoded second image component.

8. A camera system, comprising:

an image sensor configured to provide image data representative of light incident upon the image sensor; and

an image signal processor comprising:

a decimator configured to decimate the image data into a plurality of image components,

a downscale engine configured to downscale the image data using one or more of the plurality of image components,

an upscale engine configured to upscale the image data using one or more of the plurality of image components,

an encoder configured to encode any of the image data, the downscaled image data, and the upscaled image data to provide encoded image data, and

an output configured to output the encoded image data.

9. The camera system of claim 8 , wherein the image signal processor further comprises an H.264 engine configured to decode image components encoded as H.264 video.

10. The camera system of claim 9 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the H.264 engine.

11. The camera system of claim 8 , wherein the image signal processor further comprises a VC-5 engine configured to decode image components encoded as VC-5 video.

12. The camera system of claim 11 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the VC-5 engine.

13. The camera system of claim 8 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image component.

14. The camera system of claim 8 , wherein the upscale engine is configured to upscale the one or more of the plurality of image components by decoding a first image component using a first decoding algorithm, decoding a second image component using a second decoding algorithm, and combining the decoded first image component and the decoded second image component.

15. An image signal processor, comprising:

an input configured to receive image data;

a decimator configured to decimate the image data into a plurality of image components;

a downscale engine configured to downscale the image data using one or more of the plurality of image components;

an upscale engine configured to upscale the image data using one or more of the plurality of image components;

an encoder configured to encode any of the image data, the downscaled image data, and the upscaled image data to provide encoded image data; and

an output configured to output the encoded image data.

16. The image signal processor of claim 15 , further comprising:

an H.264 engine configured to decode image components encoded as H.264 video.

17. The image signal processor of claim 16 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the H.264 engine.

18. The image signal processor of claim 15 , further comprising:

a VC-5 engine configured to decode image components encoded as VC-5 video.

19. The image signal processor of claim 18 , wherein upscaling the image data comprises decoding the one or more of the plurality of image components using the VC-5 engine.

20. The image signal processor of claim 15 , wherein the downscale engine is configured to downscale the image data by outputting a low/low image component.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Mar 5, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048508/0728 →
SECURITY INTEREST Recorded Feb 9, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 044983/0718 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 30, 2017
From: CAMPBELL, SCOTT PATRICK; MOBBS, PAUL; ADSUMILLI, BALINEEDU CHOWDARY; CHAWLA, SUMIT
To: GOPRO, INC.
Reel/Frame 044254/0835 →
Continuity (7)
Continuation 15606721 · May 26, 2017
Continuation 15411201 · Jan 20, 2017
Continuation 15282326 · Sep 30, 2016
Continuation 15049015 · Feb 20, 2016
Continuation 14488283 · Sep 17, 2014
Provisional Application 61885412 · Oct 1, 2013
Related Publication 20180130172A1 · May 10, 2018