Speech-based selection of augmented reality content
Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for displaying augmented reality content. The program and method provide for receiving, by a device, speech input to select augmented reality content for display; determining at least one keyword included in the speech input; identifying, from plural augmented reality content items, an augmented reality content item corresponding to the at least one keyword; and displaying the augmented reality content item with an image captured by a camera of the device.
1. A method, comprising:
receiving, by a device, speech input to select augmented reality content for display;
determining at least one keyword included in the speech input;
identifying, from available augmented reality content items, a set of augmented reality content items corresponding to the at least one keyword;
determining a ranked order for the set of augmented reality content items;
displaying, based on the ranked order, a carousel interface with plural icons, each icon of the plural icons being user-selectable to activate a respective augmented reality content item with respect to an image captured by a camera of the device;
activating, based on the ranked order, a highest-ranked augmented reality content item within the set of augmented reality content items for modifying the image captured by the camera of the device.
2. The method of claim 1 , wherein a first part of the speech input includes a trigger word, and
wherein the at least one keyword is based on a second part of the speech input that does not include the trigger word.
3. The method of claim 1 , wherein identifying the set of augmented reality content items comprises:
sending, to a server, a request to search the available augmented reality content items based on the at least one keyword; and
receiving, from the server and based on sending the request, an indication of the set of augmented reality content items.
4. The method of claim 3 , wherein the server is configured to search the available augmented reality content items by comparing the at least one keyword with respective predefined words associated with the available augmented reality content items.
5. The method of claim 1 , further comprising:
activating the camera of the device prior to the displaying.
6. The method of claim 1 , wherein the icon for the highest-ranked augmented reality content item is displayed larger than remaining icons within the carousel interface.
7. The method of claim 1 , wherein the receiving, determining, identifying and displaying are performed by a messaging application running on the device.
8. A device, comprising:
at least one processor; and
a memory storing instructions that, when executed by the at least one processor, cause the at least one processor to perform operations comprising:
receiving speech input to select augmented reality content for display;
determining at least one keyword included in the speech input;
identifying, from available augmented reality content items, a set of augmented reality content items corresponding to the at least one keyword;
determining a ranked order for the set of augmented reality content items;
displaying, based on the ranked order, a carousel interface with plural icons, each icon of the plural icons being user-selectable to activate a respective augmented reality content item with respect to an image captured by a camera of the device;
activating, based on the ranked order, a highest-ranked augmented reality content item within the set of augmented reality content items for modifying the image captured by the camera of the device.
9. The device of claim 8 , wherein a first part of the speech input includes a trigger word, and
wherein the at least one keyword is based on a second part of the speech input that does not include the trigger word.
10. The device of claim 8 , wherein identifying the set of augmented reality content items comprises:
sending, to a server, a request to search the available augmented reality content items based on the at least one keyword; and
receiving, from the server and based on sending the request, an indication of the set of augmented reality content items.
11. The device of claim 10 , wherein the server is configured to search the available augmented reality content items by comparing the at least one keyword with respective predefined words associated with the available augmented reality content items.
12. The device of claim 8 , the operations further comprising:
activating the camera of the device prior to the displaying.
13. The device of claim 8 , wherein the icon for the highest-ranked augmented reality content item is displayed larger than remaining icons within the carousel interface.
14. The device of claim 8 , wherein the receiving, determining, identifying and displaying are performed by a messaging application running on the device.
15. A non-transitory computer-readable storage medium, the computer-readable storage medium including instructions that when executed by a computer, cause the computer to perform operations comprising:
receiving, by a device, speech input to select augmented reality content for display;
determining at least one keyword included in the speech input;
identifying, from available augmented reality content items, a set of augmented reality content items corresponding to the at least one keyword;
determining a ranked order for the set of augmented reality content items;
displaying, based on the ranked order, a carousel interface with plural icons, each icon of the plural icons being user-selectable to activate a respective augmented reality content item with respect to an image captured by a camera of the device;
activating, based on the ranked order, a highest-ranked augmented reality content item within the set of augmented reality content items for modifying the image captured by the camera of the device.
16. The non-transitory computer-readable storage medium of claim 15 , wherein a first part of the speech input includes a trigger word, and
wherein the at least one keyword is based on a second part of the speech input that does not include the trigger word.
17. The non-transitory computer-readable storage medium of claim 15 , wherein identifying the set of augmented reality content items comprises:
sending, to a server, a request to search the available augmented reality content items based on the at least one keyword; and
receiving, from the server and based on sending the request, an indication of the set of augmented reality content items.
18. The method of claim 3 , wherein the server is configured to search the available augmented reality content items by comparing the at least one keyword with respective predefined words associated with the available augmented reality content items.
19. The non-transitory computer-readable storage medium of claim 15 , further comprising:
activating the camera of the device prior to the displaying.
20. The non-transitory computer-readable storage medium of claim 15 , wherein the icon for the highest-ranked augmented reality content item is displayed larger than remaining icons within the carousel interface.