IP Library Granted Patent US 10,853,686
Granted Patent B2
US 10,853,686 · App. 16/403,246 · Granted Dec 1, 2020

Generation of salient contours using live video

Inventors: Atishay Jain (Noida, IN); Shamit Kumar Mehta (Delhi, IN); Stakshi Jindal Garg (Noida, IN); Geoffrey Charles Dowd (San Francisco, CA); Arian Behzadi (San Francisco, CA); Joseph Michael Andolina (San Francisco, CA); David Ericksen (Lehi, UT)
Assignee: ADOBE INC.
G06K9/4671G06K9/468G06K9/4609G06K9/6212G06K9/80G06T5/002G06T7/12G06T7/13G06T7/194H04N5/23229H04N5/272H04N21/44008G06T2200/24G06T2207/10016G06T2207/10024H04N5/23293
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,853,686
App. No.
16/403,246
Granted
Dec 1, 2020
Kind
B2
Abstract

In various implementations, a computing device is configured to provide a live preview of salient contours generated on a live digital video feed. In particular, a designer can use a computing device with a camera, such as a smart phone, to view a real-time preview of salient contours generated from edges detected in frames of a live digital video feed prior to capture, thereby eliminating the unpredictability of salient contours generated from a previously captured image. In some implementations, the salient contours are overlaid on a greyscale conversion of the live digital video feed for improved processing and visual contrast. Other implementations modify aspects of edge-detecting or post-processing filters for improved performance on mobile computing devices.

Claims (29)

1. A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for previewing salient contours, the operations comprising:

providing for display, a first preview, the first preview including a first frame of a live digital video with at least one detected edge from the first frame and corresponding adjacent gradients overlaid on the first frame of the live digital video;

adjusting at least one aspect of the live digital video in response to a received user input; and

providing for display, a second preview, the second preview including an updated first frame of the live digital video with at least one modified detected edge from the updated first frame and corresponding adjacent gradients overlaid on the updated frame of the live digital video, the at least one modified detected edge based on the adjustment to the live digital video.

2. The non-transitory computer storage medium of claim 1 , wherein adjusting the at least one aspect of the live digital video comprises inverting the live digital video.

3. The non-transitory computer storage medium of claim 1 , wherein the first frame and the updated first frame are each provided for display in greyscale.

4. The non-transitory computer storage medium of claim 3 , wherein the at least one detected edge and corresponding adjacent gradients, and the at least one modified detected edge and corresponding adjacent gradients are each provided for display utilizing a bright, solid color to clearly contrast with the respective frame.

5. The non-transitory computer storage medium of claim 1 , wherein the at least one detected edge and the at least one modified detected edge are each detected utilizing an edge-detecting filter.

6. The non-transitory computer storage medium of claim 5 , wherein the corresponding adjacent gradients are detected utilizing a plurality of filters configured to collectively preserve at least some color gradient information corresponding to at least some pixels adjacent to either one of the at least one detected edge and the at least one modified detected edge to detect the corresponding adjacent gradients.

7. The non-transitory computer storage medium of claim 1 , wherein the first preview and the second preview are each a preview of salient contours to be generated from a respective frame of the live digital video.

8. A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for previewing salient contours, the operations comprising:

providing for display, a first preview, the first preview including a first frame of a live digital video with at least one detected edge from the first frame and corresponding adjacent gradients overlaid on the first frame of the live digital video;

adjusting at least one aspect of the live digital video in response to a received user input; and

providing for display, a second preview, the second preview including an updated first frame of the live digital video feed with at least one modified detected edge from the updated first frame and corresponding adjacent gradients overlaid on the updated frame of the live digital video, the at least one modified detected edge based on the adjustment to the live digital video.

9. The non-transitory computer storage medium of claim 8 , wherein adjusting the at least one aspect of the live digital video comprises applying at least one filter to the live digital video.

10. The non-transitory computer storage medium of claim 9 , the at least one filter being configured to collectively preserve at least some gradient information corresponding to at least some pixels adjacent to the at least one detected edge to detect the corresponding adjacent gradients.

11. The non-transitory computer storage medium of claim 10 , the at least one filter including a first filter operable to generate at least some progressive gradients adjacent to the at least one detected edge.

12. The non-transitory computer storage medium of claim 11 , the first filter being a Gaussian blur filter.

13. The non-transitory computer storage medium of claim 11 , the at least one filter further including a second filter operable to intensify contrast in color values associated with the at least some progressive gradients generated by the first filter.

14. The non-transitory computer storage medium of claim 13 , the second filter being a modified threshold filter configured to intensify color values.

15. The non-transitory computer storage medium of claim 8 , wherein the at least one detected edge is detected utilizing an edge-detecting filter.

16. A non-transitory computer storage medium storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations for capturing salient contours, the operations comprising:

providing a first preview for display, the first preview including a first frame of a live digital video with at least one detected edge from the first frame and corresponding adjacent gradients overlaid on the first frame of the live digital video;

adjusting at least one aspect of the live digital video in response to a received user input; and

providing a second preview for display, the second preview including the first frame of the live digital video with at least one modified detected edge from the first frame and the corresponding adjacent gradients overlaid on the first frame of the live digital video, the at least one modified detected edge based on the adjustment to the live digital video.

17. The non-transitory computer storage medium of claim 16 , wherein the at least one detected edge is detected utilizing an edge-detecting filter.

18. The non-transitory computer storage medium of claim 16 , wherein adjusting the at least one aspect of the live digital video comprises inverting the live digital video.

19. The non-transitory computer storage medium of claim 17 , wherein the corresponding adjacent gradients are detected utilizing the adjusted at least one aspect of the live digital video, wherein the at least one aspect is adjusted based on a plurality of filters configured to collectively preserve at least some gradient information corresponding to at least some pixels adjacent to the at least one detected edge to detect the corresponding adjacent gradients.

20. The non-transitory computer storage medium of claim 19 , wherein the plurality of filters include a first filter operable to generate at least some progressive gradients adjacent to the at least one detected edge and a second filter operable to intensify contrast in color values associated with the at least some progressive gradients generated by the first filter.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 17, 2019
From: JAIN, ATISHAY; MEHTA, SHAMIT KUMAR; GARG, STAKSHI JINDAL; DOWD, GEOFFREY CHARLES; BEHZADI, ARIAN; ANDOLINA, JOSEPH MICHAEL; ERICKSEN, DAVID
To: ADOBE INC.
Reel/Frame 049209/0605 →
Continuity (3)
Continuation 15242080 · Aug 19, 2016
Continuation 14645581 · Mar 12, 2015
Related Publication 20190258893A1 · Aug 22, 2019
Cited By (1)
US 12,443,419