IP Library Granted Patent US 10,778,947
Granted Patent B2
US 10,778,947 · App. 15/914,673 · Granted Sep 15, 2020

Sympathetic assistive mutation of live camera preview/display image stream

Inventors: Christopher Cohen (Seattle, WA); Matthew Voss (Seattle, WA); Neill Winston Barham (Seattle, WA)
Assignee: FILMIC INC.
H04N9/646G06T5/002G06T7/90H04N5/23212H04N5/23216H04N5/23222H04N5/23293H04N9/77G06T2207/10016G06T2207/10024
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,778,947
App. No.
15/914,673
Granted
Sep 15, 2020
Kind
B2
Abstract

A method and system for generating a sympathetic assistive mutation of a live camera image stream. A cameral captures a digital video including a series of root images, at least one processor generates a series of mutated images, and a display device displays the series of mutated images as a preview of at least a portion of the series of root images. Each mutated image in the series of mutated images is generated by (a) obtaining the corresponding root image, which includes root pixels, (b) applying at least one of a function and a shader to the corresponding root image to obtain an assistive color for each of a portion of the root pixels, and (c) blending the assistive color with at least one color value of each root pixel in the portion of root pixels to thereby create the mutated image.

Claims (55)

1. A video capture system comprising:

a display;

a memory storing instructions implementing a mutation generating engine;

a camera configured to capture digital video and store the digital video in the memory, the digital video comprising a series of root images; and

at least one processor configured to execute the instructions implementing the mutation generating engine, the mutation generating engine being configured to generate a series of mutated images and display the series of mutated images in the display as a preview of at least a portion of the series of root images, a different mutated image in the series of mutated images corresponding to a different corresponding root image in the portion of the series of root images, each mutated image in the series of mutated images being generated by (a) obtaining the corresponding root image, the corresponding root image comprising root pixels, (b) applying at least one of a function and a shader to the corresponding root image to obtain an assistive color for each of a portion of the root pixels, and (c) blending the assistive color with at least one color value of each root pixel in the portion of root pixels to thereby create the mutated image.

2. The video capture system of claim 1 , wherein the assistive color represents at least one of a level of exposure and an amount of micro-contrast in the portion of the root pixels of the corresponding root image.

3. The video capture system of claim 1 , wherein the mutation generating engine is configured to display at least one manual control in the display,

the at least one manual control is operable by a user, and

the mutation generating engine is configured to generate the series of mutated images when the user operates the at least one manual control and for a predetermined amount of time after the user stops operating the at least one manual control.

4. The video capture system of claim 3 , wherein the mutation generating engine uses a blend ratio to blend the assistive color with the at least one color value of each root pixel in the portion of root pixels, and

the mutation generating engine is configured to adjust the blend ratio during the predetermined amount of time to reduce a contribution of the assistive color to the mutated image.

5. The video capture system of claim 4 , wherein the contribution of the assistive color to the mutated image is reduced linearly during the predetermined amount of time with the contribution being eliminated completely at an expiration of the predetermined amount of time.

6. The video capture system of claim 3 , wherein the at least one manual control comprises at least one of a focus control and an exposure control.

7. The video capture system of claim 1 , further comprising:

at least one manual control operable by a user, the mutation generating engine being configured to generate the series of mutated images when the user operates the at least one manual control and for a predetermined amount of time after the user stops operating the at least one manual control.

8. The video capture system of claim 7 , wherein the mutation generating engine uses a blend ratio to blend the assistive color with the at least one color value of each root pixel in the portion of root pixels, and

the mutation generating engine is configured to adjust the blend ratio during the predetermined amount of time to reduce a contribution of the assistive color to the mutated image.

9. The video capture system of claim 8 , wherein the contribution of the assistive color to the mutated image is reduced linearly during the predetermined amount of time with the contribution being eliminated completely at an expiration of the predetermined amount of time.

10. The video capture system of claim 7 , wherein the at least one manual control comprises at least one of a focus control and an exposure control.

11. The video capture system of claim 1 , wherein the assistive color is a first assistive color,

the portion of the root pixels is a first portion of the root pixels,

the first portion of the root pixels comprises any of the root pixels having a brightness that exceeds a maximum threshold value,

applying the at least one of the function and the shader to the corresponding root image obtains a second assistive color for each of a second portion of the root pixels,

the second portion of the root pixels comprises any of the root pixels having a brightness that is less than a minimum threshold value, and

generating each mutated image in the series of mutated images further comprises blending the second assistive color with at least one color value of each root pixel in the second portion of root pixels.

12. The video capture system of claim 11 , wherein applying the at least one of the function and the shader to the corresponding root image obtains a third assistive color for each of a third portion of the root pixels,

the third portion of the root pixels comprises any of the root pixels having a micro contrast score that exceeds a micro contrast threshold, and

generating each mutated image in the series of mutated images further comprises blending the third assistive color with at least one color value of each root pixel in the third portion of root pixels.

13. A method comprising:

capturing, with a camera, a digital video comprising a series of root images;

generating, with at least one processor, a series of mutated images, a different mutated image in the series of mutated images corresponding to a different corresponding root image in at least a portion of the series of root images, each mutated image in the series of mutated images being generated by (a) obtaining the corresponding root image, the corresponding root image comprising root pixels, (b) applying at least one of a function and a shader to the corresponding root image to obtain an assistive color for each of a portion of the root pixels, and (c) blending the assistive color with at least one color value of each root pixel in the portion of root pixels to thereby create the mutated image; and

displaying, on a display device, the series of mutated images as a preview of the portion of the series of root images.

14. The method of claim 13 , wherein the assistive color represents at least one of a level of exposure and an amount of micro-contrast in the portion of the root pixels of the corresponding root image.

15. The method of claim 13 , further comprising:

detecting, with the at least one processor, that a user has operated at least one manual control affecting one or more properties of a portion of the digital video captured after the operation of the at least one manual control, the series of mutated images not being generated until after the at least one processor detects the user has operated the at least one manual control.

16. The method of claim 15 , further comprising:

recording, with the at least one processor, an engagement timestamp when the user operated the at least one manual control.

17. The method of claim 15 , further comprising:

determining, with the at least one processor, that the user has stopped operating the at least one manual control.

18. The method of claim 17 , further comprising:

recording, with the at least one processor, a disengagement timestamp when the at least one processor determines the user has stopped operating the at least one manual control.

19. The method of claim 18 , wherein a blend ratio is used to blend the assistive color with the at least one color value of each root pixel in the portion of root pixels, and the method further comprises:

adjusting, with the at least one processor, the blend ratio to reduce a contribution of the assistive color to the mutated image after the at least one processor determines the user has stopped operating the at least one manual control.

20. The method of claim 19 , further comprising:

eliminating the contribution of the assistive color to the mutated image after a predetermined amount of time from the disengagement timestamp has elapsed.

21. The method of claim 15 , wherein the at least one manual control comprises at least one of a focus control and an exposure control.

22. The method of claim 13 , wherein the assistive color is a first assistive color,

the portion of the root pixels is a first portion of the root pixels,

the first portion of the root pixels comprises any of the root pixels having a brightness that exceeds a maximum threshold value,

applying the at least one of the function and the shader to the corresponding root image obtains a second assistive color for each of a second portion of the root pixels,

the second portion of the root pixels comprises any of the root pixels having a brightness that is less than a minimum threshold value, and

generating each mutated image in the series of mutated images further comprises blending the second assistive color with at least one color value of each root pixel in the second portion of root pixels.

23. The method of claim 22 , wherein applying the at least one of the function and the shader to the corresponding root image obtains a third assistive color for each of a third portion of the root pixels,

the third portion of the root pixels comprises any of the root pixels having a micro contrast score that exceeds a micro contrast threshold, and

generating each mutated image in the series of mutated images further comprises blending the third assistive color with at least one color value of each root pixel in the third portion of root pixels.

Assignments (4)
PATENT SECURITY AGREEMENT Recorded Dec 30, 2024
From: EVERNOTE CORPORATION
To: INTESA SANPAOLO S.P.A., AS SECURITY AGENT
Reel/Frame 069813/0645 →
MERGER Recorded Nov 19, 2023
From: FILMIC, INC.
To: EVERNOTE CORPORATION
Reel/Frame 065613/0721 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2020
From: COHEN, CHRISTOPHER; VOSS, MATTHEW
To: FILMIC INC.
Reel/Frame 052382/0900 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 13, 2020
From: BARHAM, NEILL WINSTON
To: FILMIC INC.
Reel/Frame 052383/0268 →
Continuity (3)
Provisional Application 62468874 · Mar 8, 2017
Provisional Application 62468063 · Mar 7, 2017
Related Publication 20180262688A1 · Sep 13, 2018