IP Library Granted Patent US 11,640,227
Granted Patent B2
US 11,640,227 · App. 16/949,208 · Granted May 2, 2023

Voice driven dynamic menus

Inventor: Jesse Chand (Los Angeles, CA)
Assignee: SNAP INC.
G06F3/0482G06F3/167G11B27/031G11B27/34G06F3/04817G06F3/165G06F2203/04803G10L21/003G10L21/02G10L21/0316G10L25/78
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,640,227
App. No.
16/949,208
Granted
May 2, 2023
Kind
B2
Abstract

Disclosed are systems, methods, and computer-readable storage media to provide voice driven dynamic menus. One aspect disclosed is a method including receiving, by an electronic device, video data and audio data, displaying, by the electronic device, a video window, determining, by the electronic device, whether the audio data includes a voice signal, displaying, by the electronic device, a first menu in the video window in response to the audio data including a voice signal, displaying, by the electronic device, a second menu in the video window in response to a voice signal being absent from the audio data, receiving, by the electronic device, input from the displayed menu, and writing, by the electronic device, to an output device based on the received input.

Claims (52)

1. A system comprising:

a hardware processor;

a user interface coupled to the hardware processor;

a communication module coupled to the hardware processor; and

hardware memory coupled to the hardware processor and storing instructions that, when executed configure the hardware processor to perform operations comprising:

retrieving, from a database, a video that includes an audio track;

determining that the audio track of the video includes a voice signal;

selecting, based on determining that the audio track includes the voice signal, an interactive menu that comprises a plurality of voice modification options including a first visual indicator that visually represents a voice modification characteristic associated with a first voice modification option;

receiving input selecting the first voice modification option from the plurality of voice modification options;

modifying a characteristic of the voice signal separately from one or more other audio components in the audio track based on the voice modification characteristic associated with the selected first voice modification option; and

in response to receiving input selecting the first voice modification option and modifying the characteristic, adding to a display an enlarged version of the first visual indicator together with modifying the characteristic of the voice signal, the enlarged version of the first visual indicator being displayed together with the first visual indicator.

2. The system of claim 1 , wherein the operations further comprise:

displaying a video window based on the retrieved video, wherein the interactive menu is selected from a plurality of menus and the selected interactive menu is displayed in the video window; and

applying an audio filter to audio data of the audio track in response to a first menu selection from the selected interactive menu.

3. The system of claim 2 , the operations further comprising:

applying a second audio filter to the audio data in response to a second menu selection from the selected interactive menu.

4. The system of claim 1 , wherein the enlarged version of the first visual indicator is automatically removed from being displayed in response to determining that modification of the characteristic of the voice signal is complete.

5. The system of claim 1 , wherein the first voice modification option is represented in the interactive menu by a first visual indicator that visually represents a voice modification characteristic associated with the first voice modification option, and wherein a second voice modification option is represented in the interactive menu by a second visual indicator, together with the first visual indicator, that visually represents another voice modification characteristic associated with the second voice modification option.

6. The system of claim 1 , wherein the plurality of voice modification options include at least one of an option to increase a frequency of the voice signal, an option to lower the frequency of the voice signal, an option to alter the voice signal to have robotic sound characteristics, or an option to vary a pitch of the voice signal.

7. The system of claim 5 , wherein the operations further comprise:

retrieving a second video that includes a second audio track;

determining that that a voice signal is absent from the second audio track of the second video by applying a threshold to a signal to noise ratio of one or more frequency bands in the second audio track; and

displaying a second menu of the plurality of menus in response to determining that the voice signal is absent from the second audio track of the second video.

8. The system of claim 1 , wherein the operations further comprise:

displaying a second visual indicator that visually represents a second voice modification characteristic associated with a second voice modification option.

9. A method, comprising:

retrieving, from a database, a video that includes an audio track;

determining that the audio track of the video includes a voice signal;

selecting, based on determining that the audio track includes the voice signal, an interactive menu that comprises a plurality of voice modification options including a first visual indicator that visually represents a voice modification characteristic associated with a first voice modification option;

receiving input selecting the first voice modification option from the plurality of voice modification options;

modifying a characteristic of the voice signal separately from one or more other audio components in the audio track based on the voice modification characteristic associated with the selected first voice modification option; and

in response to receiving input selecting the first voice modification option and modifying the characteristic, adding to a display an enlarged version of the first visual indicator together with modifying the characteristic of the voice signal, the enlarged version of the first visual indicator being displayed together with the first visual indicator.

10. The method of claim 9 , further comprising applying an audio filter to audio data in the audio track in response to a first menu selection from the selected interactive menu.

11. The method of claim 10 , further comprising applying a second audio filter to the audio data in response to a second menu selection from the selected interactive menu.

12. The method of claim 9 , wherein the enlarged version of the first visual indicator is removed from being displayed after modification of the characteristic of the voice signal is complete.

13. The method of claim 9 , wherein the plurality of voice modification options include at least one of an option to increase a frequency of the voice signal, an option to lower the frequency of the voice signal, an option to alter the voice signal to have robotic sound characteristics, or an option to vary a pitch of the voice signal.

14. The method of claim 9 , further comprising:

retrieving a second video that includes a second audio track;

determining that that a voice signal is absent from the second audio track of the second video; and

displaying a second menu of the plurality of menus in response to determining that the voice signal is absent from the second audio track of the second video.

15. A non-transitory computer readable storage medium comprising instructions that when executed cause a hardware processor to perform operations comprising:

retrieving, from a database, a video that includes an audio track;

determining that the audio track of the video includes a voice signal;

selecting, based on determining that the audio track includes the voice signal, an interactive menu that comprises a plurality of voice modification options including a first visual indicator that visually represents a voice modification characteristic associated with a first voice modification option;

receiving input selecting the first voice modification option from the plurality of voice modification options;

modifying a characteristic of the voice signal separately from one or more other audio components in the audio track based on the voice modification characteristic associated with the selected first voice modification option; and

in response to receiving input selecting the first voice modification option and modifying the characteristic, adding to a display an enlarged version of the first visual indicator together with modifying the characteristic of the voice signal, the enlarged version of the first visual indicator being displayed together with the first visual indicator.

16. The non-transitory computer readable medium of claim 15 , the operations further comprising applying an audio filter to audio data in the audio track in response to a first menu selection from the selected interactive menu.

17. The non-transitory computer readable medium of claim 16 , the operations further comprising applying a second audio filter to the audio data in response to a second menu selection from the selected interactive menu.

18. The non-transitory computer readable medium of claim 15 , wherein the enlarged version of the first visual indicator is automatically removed from being displayed in response to determining that modification of the characteristic of the voice signal is complete.

19. The non-transitory computer readable medium of claim 15 , wherein the plurality of voice modification options include at least one of an option to increase a frequency of the voice signal, an option to lower the frequency of the voice signal, an option to alter the voice signal to have robotic sound characteristics, or an option to vary a pitch of the voice signal.

20. The non-transitory computer readable medium of claim 15 , wherein the operations further comprise displaying a second visual indicator that visually represents a second voice modification characteristic associated with a second voice modification option.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2023
From: CHAND, JESSE
To: SNAP INC.
Reel/Frame 062281/0778 →
Continuity (3)
Continuation 15805984 · Nov 7, 2017
Provisional Application 62513269 · May 31, 2017
Related Publication 20210034202A1 · Feb 4, 2021