IP Library › Granted Patent US 12,022,184
Granted Patent B2
US 12,022,184 · App. 18/119,142 · Granted Jun 25, 2024

Systems and methods for DSP fast boot

Inventors: Peter Brook (Marina del Rey, CA); Russell Douglas Patton (Playa Vista, CA); Jonathan M Rodriguez, II (Los Angeles, CA)
Assignee: Snap Inc.
H04N23/617H04N23/65H04N23/71H04N23/73
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,022,184
App. No.
18/119,142
Granted
Jun 25, 2024
Kind
B2
Abstract

System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

Claims (48)

1. A method comprising:

receiving, at a device comprising an image sensor, a camera input to initiate capture of an image or video;

in response to the camera input, booting a digital signal processor (DSP) of the device using a first set of instructions, the first set of instructions executable by the DSP;

initiating, at the DSP, capture of first image sensor data using the first set of instructions;

receiving, at the DSP, a second set of instructions, the second set of instructions executable by the DSP; and

initiating, at the DSP, capture of second image sensor data using the second set of instructions.

2. The method of claim 1 further comprising:

causing the first image sensor data to be stored in a memory.

3. The method of claim 1 further comprising:

processing the first image sensor data using the DSP using the second set of instructions.

4. The method of claim 1 further comprising:

receiving the second set of instructions, over a higher-powered wireless connection, from a host device.

5. The method of claim 3 further comprising:

receiving the first set of instructions, over a lower-powered wireless connection, from a host device.

6. The method of claim 1 wherein booting the DSP of the device further comprises:

transferring the first set of instructions from a first memory to a second memory; and

executing the first set of instructions from the second memory to boot the DSP.

7. The method of claim 1 wherein initiating, at the DSP, capture of the second image sensor data using the second set of instructions further comprises:

adjusting an exposure time, using the second set of instructions, based on a determination of a brightness or a darkness of the first image sensor data.

8. The method of claim 1 wherein initiating, at the DSP, capture of the second image sensor data using the second set of instructions further comprises:

adjusting an exposure time, using the second set of instructions, based on sensor data.

9. The method of claim 1 wherein the second set of instructions comprises instructions for adjusting an exposure time based on analyzing the first image sensor data.

10. The method of claim 8 wherein the first set of instructions does not include instructions for adjusting the exposure time based on analyzing the first image sensor data.

11. The method of claim 1 wherein the first set of instructions consists only of instructions for setting sensor values of the image sensor of the device.

12. The method of claim 1 wherein the first set of instructions consists only of instructions for setting sensor values of an image sensor of the device and instructions for transferring the first image sensor data to a memory.

13. The method of claim 11 wherein the instructions for setting the sensor values of the image sensor comprise:

instructions for identifying a brightness value associated with preliminary sensor data; and

instructions for adjusting an exposure time for the image sensor based on the brightness value.

14. The method of claim 13 wherein the instructions for setting the sensor values of the image sensor further comprises:

instructions for capturing second preliminary sensor data following adjustment of the exposure time.

15. A device comprising:

a first memory comprising a first set of instructions;

a random access memory (RAM);

a camera device comprising an image sensor; and

a digital signal process (DSP) coupled to the first memory, the RAM, and the camera device, wherein the DSP is configured to:

boot in response to a camera input signal initiating capture of an image or video using the first set of instructions, the first set of instructions executable by the DSP;

initiate capture of first image sensor data using the first set of instructions;

receive a second set of instructions receiving, at the DSP, a second set of instructions, the second set of instructions executable by the DSP; and

initiate capture of second image sensor data using the second set of instructions.

16. The device of claim 15 wherein the DSP is further configured to:

process the first image sensor data using the second set of instructions.

17. The device of claim 15 wherein the receive the second set of instructions comprises:

receive the second set of instructions from the first memory.

18. The device of claim 15 wherein the receive the second set of instructions comprises:

receive the second set of instructions, over a higher-powered wireless connection, from a host device.

19. The device of claim 15 wherein the receive the second set of instructions comprises:

receiving the first set of instructions, over a lower-powered wireless connection, from a host device.

20. The device of claim 15 wherein the second set of instructions are received after the first image sensor data is stored in the RAM, and wherein the first memory is a read only memory (ROM).

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 8, 2023
From: BROOK, PETER; PATTON, RUSSELL DOUGLAS; RODRIGUEZ, JONATHAN M, II
To: SNAP INC.
Reel/Frame 062924/0001 →
Continuity (4)
Continuation 17451435 · Oct 19, 2021
Continuation 15206032 · Jul 8, 2016
Provisional Application 62191168 · Jul 10, 2015
Related Publication 20230224570A1 · Jul 13, 2023