IP Library › Granted Patent US 11,606,494
Granted Patent B2
US 11,606,494 · App. 17/451,435 · Granted Mar 14, 2023

Systems and methods for DSP fast boot

Inventors: Peter Brook (Marina del Rey, CA); Russell Douglas Patton (Marina Del Rey, CA); Jonathan M Rodriguez, II (Los Angeles, CA)
Assignee: Snap Inc.
H04N5/23225H04N5/2351H04N5/2353H04N5/23241
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,606,494
App. No.
17/451,435
Granted
Mar 14, 2023
Kind
B2
Abstract

System, methods, devices, and instructions are described for fast boot of a processor as part of camera operation. In some embodiments, in response to a camera input, a digital signal processor (DSP) of a device is booted using a first set of instructions. Capture of image sensor data is initiated using the first set of instructions at the DSP. The DSP then receives a second set of instructions and the DSP is programmed using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device. The first frame of the image sensor data is processed using the DSP as programmed by the second set of instructions. In some embodiments, the first set of instructions includes only instructions for setting camera sensor values, and the second set of instructions includes instructions for processing raw sensor data into formatted image files.

Claims (64)

1. A method comprising:

establishing, using lower-power wireless circuitry, a wireless connection with a client device;

processing, using a lower-power processor, a communication from the client device;

booting, using the lower-power processor, a higher-speed processor based on the communication indicating a request to display a content item;

accessing, using the higher-speed processor, the content item;

displaying, using the higher-speed processor, the content item on a display screen; and

powering off, using the lower-power processor, the display screen and the higher-speed processor.

2. The method of claim 1 further comprising:

determining a period of time to display the content item based on sensor data, wherein the displaying is for the period of time.

3. The method of claim 1 further comprising:

in response to the content item not being stored in a local memory,

activating higher-speed wireless circuitry,

retrieving using the higher-speed wireless circuitry the content item from the client device.

4. The method of claim 1 further comprising:

receiving a period of time to display the content from the client device, wherein the displaying is for the period of time.

5. The method of claim 1 further comprising:

in response to the higher-speed processor accessing the content item, powering on, the display screen.

6. The method of claim 1 further comprising:

receiving, at a camera device comprising an image sensor, an indication to capture an image or video;

in response to the indication to capture an image or video, booting a digital signal processor (DSP) of the device using a first set of instructions;

initiating capture of image sensor data using the first set of instructions at the DSP;

receiving, at the DSP, a second set of instructions;

programming the DSP using the second set of instructions after at least a first frame of the image sensor data is stored in a memory of the device; and

processing the first frame of the image sensor data using the DSP as programmed by the second set of instructions.

7. The method of claim 1 wherein the displaying is for a predetermined period of time.

8. The method of claim 7 wherein the powering off is after the predetermined period of time.

9. A device comprising:

a memory; a lower-power processor coupled to the memory; lower-power wireless circuitry coupled to the lower-power processor; a higher-speed processor coupled to the lower-power processor; and, a display screen coupled to the higher-speed processor, wherein the lower-power processor is configured to:

establish, using the lower-power wireless circuitry, a wireless connection with a client device,

process a communication from the client device,

power off the display screen and the higher-speed processor, and

boot a higher-speed processor based on the communication indicating a request to display a content item, and wherein the higher-power processor is configured to:

access the content item, and

display the content item on the display screen.

10. The device of claim 9 wherein the higher-power processor is further configured to:

determine a period of time to display the content item based on sensor data, and wherein the display is for the period of time.

11. The device of claim 9 wherein the higher-power processor is further configured to:

in response to the content item not being stored in the memory,

activate higher-speed wireless circuitry, and

retrieve using the higher-speed wireless circuitry the content item from the client device.

12. The device of claim 9 wherein the lower-power processor is further configured to:

receive a period of time to display the content from the client device and wherein the displaying is for the period of time.

13. The device of claim 9 wherein the higher-speed processor is further configured to:

in response to accessing the content item, powering on, the display screen.

14. The device of claim 9 , wherein the device further comprises an image sensor coupled to the lower-speed processor and a digital signal processor (DSP) couple to the lower-speed processor, and wherein the lower-speed processor is further configured to:

receive an indication to capture an image or video from the client device,

in response to the indication to capture an image or video, booting the DSP using a first set of instructions,

initiate capture of image sensor data using the first set of instructions at the DSP,

receiving, from the client device, a second set of instructions,

programming the DSP using the second set of instructions after at least a first frame of the image sensor data is stored in the memory, and wherein the DSP is configured to:

process the first frame of the image sensor data as programmed by the second set of instructions.

15. The device of claim 9 wherein the display is for a predetermined period of time.

16. The device of claim 15 wherein the power off is after the predetermined period of time.

17. A non-transitory computer readable medium comprising instructions that, when executed by a processor of a device, cause the device to:

establish, using lower-power wireless circuitry, a wireless connection with a client device;

process, using a lower-power processor, a communication from the client device;

boot, using the lower-power processor, a higher-speed processor based on the communication indicating a request to display a content item;

access, using the higher-speed processor, the content item;

display, using the higher-speed processor, the content item on a display screen; and

power off, using the lower-power processor, the display screen and the higher-speed processor.

18. The non-transitory computer readable medium of claim 17 wherein the instruction further cause the device to:

determine a period of time to display the content item based on sensor data, wherein the display is for the period of time.

19. The non-transitory computer readable medium of claim 17 wherein the display is for a predetermined period of time.

20. The non-transitory computer readable medium of claim 19 wherein the powering off is after the predetermined period of time.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 27, 2021
From: BROOK, PETER; PATTON, RUSSELL DOUGLAS; RODRIGUEZ, JONATHAN M, II
To: SNAP INC.
Reel/Frame 057933/0072 →
Continuity (3)
Continuation 15206032 · Jul 8, 2016
Provisional Application 62191168 · Jul 10, 2015
Related Publication 20220038622A1 · Feb 3, 2022
Cited By (1)
US 12,363,420