IP Library Granted Patent US 8,037,413
Granted Patent B2
US 8,037,413 · App. 12/022,668 · Granted Oct 11, 2011

Brush tool for audio editing

Assignee: Adobe Systems Incorporated
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,037,413
App. No.
12/022,668
Granted
Oct 11, 2011
Kind
B2
Abstract

This specification describes technologies relating to editing digital audio data. In some implementations, a computer-implemented method is provided. The method includes displaying a visual representation of audio data, receiving an input selecting a selected portion of audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data, and editing the selected portion of audio data including determining a degree of opacity for the selected audio data and applying an editing effect according to the degree of opacity.

Claims (112)

1. A computer-implemented method comprising:

displaying a visual representation of audio data;

receiving an input selecting a selected portion of audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data, the brush tool having a particular brush size identifying a coverage area for application of the brush relative to the visual representation of audio data; and

editing the selected portion of audio data including determining a degree of opacity for the selected audio data and variably applying an editing effect to audio data of the selection according to the degree of opacity.

2. The method of claim 1 , where selecting audio data within the visual representation includes applying the brush tool to a plurality of non-contiguous regions of the visual representation of the audio data.

3. The method of claim 1 , where applying the brush tool further comprises varying the application of the brush tool according to a rate at which the brush is moved relative to the visual representation of the audio data.

4. The method of claim 1 , where applying the brush tool further comprises varying the application of the brush tool according to a number of passes of the brush tool over a particular point of the visual representation of the audio data.

5. The method of claim 1 , where the visual representation is a frequency spectrogram and determining a degree of opacity for the selected audio data further comprises:

generating a mask image corresponding to the brush application within the selected audio data;

dividing the mask image into a grid including a plurality grid boxes with respect to specified time intervals and frequency bands; and

determining an opacity value for each grid box as a function of the brush tool application within that grid box.

6. The method of claim 1 , where applying an editing operation according to the degree of opacity includes:

determining a minimum and maximum amount of the editing effect to apply to the selected audio data; and

determining an amount of the editing effect to apply to a particular point of audio data in the selected audio data as a function of the minimum and maximum amounts and the opacity value associated with the particular point of audio data.

7. The method of claim 1 , further comprising:

isolating a portion of the audio data, the portion corresponding to the selected portion of audio data within the visual representation.

8. The method of claim 1 , further comprising:

updating the displayed visual representation according to the applied editing effect.

9. The method of claim 1 , further comprising:

storing edited audio data after applying the editing effect.

10. A computer-implemented method comprising:

displaying a visual representation of audio data;

receiving an input selecting audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data; and

automatically performing a correction operation on the selected audio data to form edited audio data, the correction operation including using a portion of the audio data from outside the selected audio data to correct the selected audio data.

11. The method of claim 10 , where performing the correction operation comprises identifying a bounding rectangle surrounding the selected audio data and applying the correction operation to all audio data within the bounding rectangle.

12. The method of claim 10 , where performing the correction operation further comprises:

identifying a plurality of frequency bands associated with the selected audio data; and

interpolating at least one feature of the audio data over time with respect to each identified frequency band of the plurality of frequency bands.

13. The method of claim 12 , where interpolating a feature for a particular frequency band further comprises:

identifying a first value for the feature of audio data occurring within a specified time prior to the selected audio data of the particular frequency band;

identifying a second value for the feature of audio data occurring within a specified time after the selected audio data of the particular frequency band; and

interpolating the feature of the audio data for the particular frequency band using the first value and the second value.

14. The method of claim 13 , where the feature is an intensity value.

15. The method of claim 13 , where the specified time corresponds to a specified number of samples.

16. The method of claim 10 , further comprising:

storing the edited audio data.

17. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

displaying a visual representation of audio data;

receiving an input selecting a selected portion of audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data, the brush tool having a particular brush size identifying a coverage area for application of the brush relative to the visual representation of audio data; and

editing the selected portion of audio data including determining a degree of opacity for the selected audio data and variably applying an editing effect to audio data of the selection according to the degree of opacity.

18. The computer program product of claim 17 , where selecting audio data within the visual representation includes applying the brush tool to a plurality of non-contiguous regions of the visual representation of the audio data.

19. The computer program product of claim 17 , where applying the brush tool further comprises varying the application of the brush tool according to a rate at which the brush is moved relative to the visual representation of the audio data.

20. The computer program product of claim 17 , where applying the brush tool further comprises varying the application of the brush tool according to a number of passes of the brush tool over a particular point of the visual representation of the audio data.

21. The computer program product of claim 17 , where the visual representation is a frequency spectrogram and determining a degree of opacity for the selected audio data further comprises:

generating a mask image corresponding to the brush application within the selected audio data;

dividing the mask image into a grid including a plurality grid boxes with respect to specified time intervals and frequency bands; and

determining an opacity value for each grid box as a function of the brush tool application within that grid box.

22. The computer program product of claim 17 , where applying an editing operation according to the degree of opacity includes:

determining a minimum and maximum amount of the editing effect to apply to the selected audio data; and

determining an amount of the editing effect to apply to a particular point of audio data in the selected audio data as a function of the minimum and maximum amounts and the opacity value associated with the particular point of audio data.

23. The computer program product of claim 17 , further operable to perform operations comprising:

isolating a portion of the audio data, the portion corresponding to the selected portion of audio data within the visual representation.

24. The computer program product of claim 17 , further operable to perform operations comprising:

updating the displayed visual representation according to the applied editing effect.

25. The computer program product of claim 17 , further operable to perform operations comprising:

storing edited audio data after applying the editing effect.

26. A computer program product, encoded on a non-transitory computer-readable medium, operable to cause data processing apparatus to perform operations comprising:

displaying a visual representation of audio data;

receiving an input selecting audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data; and

automatically performing a correction operation on the selected audio data to form edited audio data, the correction operation including using a portion of the audio data from outside the selected audio data to correct the selected audio data.

27. The computer program product of claim 26 , where performing the correction operation comprises identifying a bounding rectangle surrounding the selected audio data and applying the correction operation to all audio data within the bounding rectangle.

28. The computer program product of claim 26 , where performing the correction operation further comprises:

identifying a plurality of frequency bands associated with the selected audio data; and

interpolating at least one feature of the audio data over time with respect to each identified frequency band of the plurality of frequency bands.

29. The computer program product of claim 28 , where interpolating a feature for a particular frequency band further comprises:

identifying a first value for the feature of audio data occurring within a specified time prior to the selected audio data of the particular frequency band;

identifying a second value for the feature of audio data occurring within a specified time after the selected audio data of the particular frequency band; and

interpolating the feature of the audio data for the particular frequency band using the first value and the second value.

30. The computer program product of claim 29 , where the feature is an intensity value.

31. The computer program product of claim 29 , where the specified time corresponds to a specified number of samples.

32. The computer program product of claim 29 , further operable to perform operations comprising:

storing the edited audio data.

33. A system comprising:

a user interface; and

one or more computers operable to interact with the user interface and to perform operations including:

displaying a visual representation of audio data;

receiving an input selecting a selected portion of audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data, the brush tool having a particular brush size identifying a coverage area for application of the brush relative to the visual representation of audio data; and

editing the selected portion of audio data including determining a degree of opacity for the selected audio data and variably applying an editing effect to audio data of the selection according to the degree of opacity.

34. The system of claim 33 , where selecting audio data within the visual representation includes applying the brush tool to a plurality of non-contiguous regions of the visual representation of the audio data.

35. The system of claim 33 , where applying the brush tool further comprises varying the application of the brush tool according to a rate at which the brush is moved relative to the visual representation of the audio data.

36. The system of claim 33 , where applying the brush tool further comprises varying the application of the brush tool according to a number of passes of the brush tool over a particular point of the visual representation of the audio data.

37. The system of claim 33 , where the visual representation is a frequency spectrogram and determining a degree of opacity for the selected audio data further comprises:

generating a mask image corresponding to the brush application within the selected audio data;

dividing the mask image into a grid including a plurality grid boxes with respect to specified time intervals and frequency bands; and

determining an opacity value for each grid box as a function of the brush tool application within that grid box.

38. The system of claim 33 , where applying an editing operation according to the degree of opacity includes:

determining a minimum and maximum amount of the editing effect to apply to the selected audio data; and

determining an amount of the editing effect to apply to a particular point of audio data in the selected audio data as a function of the minimum and maximum amounts and the opacity value associated with the particular point of audio data.

39. The system of claim 33 , the one or more computers operable to perform operations further comprising:

isolating a portion of the audio data, the portion corresponding to the selected portion of audio data within the visual representation.

40. The system of claim 33 , the one or more computers operable to perform operations further comprising:

updating the displayed visual representation according to the applied editing effect.

41. The system of claim 33 , the one or more computers operable to perform operations further comprising:

storing edited audio data after applying the editing effect.

42. A system comprising:

a user interface; and

one or more computers operable to interact with the user interface and to perform operations including:

displaying a visual representation of audio data;

receiving an input selecting audio data within the visual representation, the selecting including applying a brush tool to the visual representation of the audio data; and

automatically performing a correction operation on the selected audio data to form edited audio data, the correction operation including using a portion of the audio data from outside the selected audio data to correct the selected audio data.

43. The system of claim 42 , where performing the correction operation comprises identifying a bounding rectangle surrounding the selected audio data and applying the correction operation to all audio data within the bounding rectangle.

44. The system of claim 42 , where performing the correction operation further comprises:

identifying a plurality of frequency bands associated with the selected audio data; and

interpolating at least one feature of the audio data over time with respect to each identified frequency band of the plurality of frequency bands.

45. The system of claim 43 , where interpolating a feature for a particular frequency band further comprises:

identifying a first value for the feature of audio data occurring within a specified time prior to the selected audio data of the particular frequency band;

identifying a second value for the feature of audio data occurring within a specified time after the selected audio data of the particular frequency band; and

interpolating the feature of the audio data for the particular frequency band using the first value and the second value.

46. The system of claim 45 , where the feature is an intensity value.

47. The system of claim 45 , where the specified time corresponds to a specified number of samples.

48. The system of claim 42 , the one or more computers operable to perform operations further comprising:

storing the edited audio data.

Assignments (2)
CHANGE OF NAME Recorded Apr 8, 2019
From: ADOBE SYSTEMS INCORPORATED
To: ADOBE INC.
Reel/Frame 048867/0882 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2008
From: JOHNSTON, DAVID E.
To: ADOBE SYSTEMS INCORPORATED
Reel/Frame 020452/0021 →
Continuity (2)
Provisional Application 60967829 · Sep 6, 2007
Related Publication 20090070674A1 · Mar 12, 2009