IP Library › Granted Patent US 9,813,638
Granted Patent B2
US 9,813,638 · App. 13/964,155 · Granted Nov 7, 2017

Lightpainting live view

Inventors: Ryan Harrison Warnberg (Brooklyn, NY); Michelle Kirstin McSwain (Brooklyn, NY)
Assignee: HI PABLO, INC.
H04N5/2621G06T11/001H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,813,638
App. No.
13/964,155
Granted
Nov 7, 2017
Kind
B2
Abstract

Methods and apparatus, including computer program products, for a light painting live view. A method includes, in a device comprising at least a processor, a memory, a display and a camera device having an on-screen viewfinder, accessing the camera, capturing individual frames of footage, each of the captured frames being displayed through the on-screen viewfinder in cumulative succession, rendering the captured frames on a graphical processing unit (GPU), sending the captured frames through a shader program, generating at least two images, a first image saved to the memory and a second image displayed on the display, and rendering the first image into the second image to generate a final image.

Claims (33)

1. A method comprising:

in a device comprising at least a processor, a memory, an integrated display and an integrated camera device having an on-screen viewfinder, accessing the integrated camera;

continuously capturing individual frames of footage and then displaying a progress of the individual frames that create a final image as they are captured, in real time, with each frame displaying as it is captured in cumulative succession on the on-screen viewfinder as the capture is being made, such that any light or object which passes in front of the camera will leave a trail on the on-screen viewfinder that illustrates a path that the light or object traveled during an exposure period until a user stops capturing or the device ceases to function;

rendering the captured frames on a graphical processing unit (GPU); sending the captured frames through a shader program;

generating at least two images, a first image saved to the memory and a second image displayed on the on-screen viewfinder; and

rendering the first image into the second image to generate a final image.

2. The method of claim 1 wherein the shader program receives input from the camera and outputs a progress frame.

3. The method of claim 2 wherein generating the at least two images comprises: an image/name stage; and

blending modes stage.

4. The method of claim 3 wherein the image/name stage comprises: storing image data coming from the camera in a buffer in the memory; using the stored image as an input to the shader program; and

outputting an intermediate image from the shader program to the display, the intermediate image blended with the input images.

5. The method of claim 4 wherein the blending modes stage comprises:

blending pixels of the intermediate output image with pixels of the input image; and

replacing previous values of pixels with pixels of the intermediate output image.

6. The method of claim 5 wherein the input is a OpenGL texture.

7. The method of claim 6 further comprising: compressing the final image; and

converting the compressed final image to a Joint Photographic Experts Group (JPEG) file.

8. The method of claim 7 further comprising projecting the JPEG file on the display.

9. The method of claim 8 wherein the device is selected from the group consisting of a DSLR camera, a smartphone, a tablet computer, a personal data assistants, a digital televisions, a computers, a laptops, a device with an integrated digital camera, a wearable device, and a device with a digital camera, a digital camera, and a personal data assistant.

10. The method of claim 9 wherein the device is a smartphone or tablet computer.

11. The method of claim 10 , wherein the blending modes stage further comprises:

selecting a maximum value between each of a plurality of pixel values of each pixel of the input image and each corresponding pixel value of each corresponding pixel of the intermediate output image; and

outputting each maximum pixel value as the pixel value for each corresponding pixel of the resultant blended image.

12. The method of claim 11 , wherein the shader program further comprises:

measuring an ambient light amount for the input image;

setting a brightness parameter between 0 and 1; and

throttling the effect of light input on a light painting.

13. An apparatus comprising:

a processor;

a memory;

a display; and

a camera device having an on-screen viewfinder;

the memory comprising a light painting live view process, the light painting live view process comprising the steps of the method of claim 1 .

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 27, 2017
From: MRI LIGHTPAINTING LLC
To: HI PABLO, INC.
Reel/Frame 041749/0940 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 29, 2016
From: WARNBERG, RYAN HARRISON; MCSWAIN, MICHELLE
To: HI PABLO, INC.
Reel/Frame 037850/0582 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 14, 2013
From: MCSWAIN, MICHELLE KIRSTEN; WARNBERG, RYAN HARRISON
To: MRI LIGHTPAINTING LLC
Reel/Frame 031003/0472 →
Continuity (2)
Provisional Application 61693795 · Aug 28, 2012
Related Publication 20150042832A1 · Feb 12, 2015