Event broadcast natural language interface
The application describes systems and methods for accepting a request in a natural language command to retrieve and presentation information regarding an event broadcast. The natural language command can be processed by a natural language processor to identify moment metadata, such as a moment type from the event broadcast. The system can utilize the moment type to retrieve data compiled by components of the system to create a media representation. The media representation can be created to satisfy a requested presentation type identified by the natural language command and interpreted by the natural language processor. The media representation can then be presented to the user.
1 . A method comprising:
receiving data of an event broadcast over a network, wherein the data is stored in data storage accessible by a natural language processor;
prior to receiving a natural language command, normalizing the data of the event broadcast, wherein normalizing the data adjusts audio characteristics and video characteristics of the data as compared to the data as received;
identifying event broadcast metadata associated with the event broadcast from the normalized data;
receiving a user request from a user, wherein the user request includes the natural language command related to the event broadcast, and wherein the natural language command comprises a first condition and a second condition;
providing the natural language command as an input to the natural language processor, wherein providing the natural language command as the input to the natural language processor causes the natural language processor to generate a response to the natural language command by:
identifying moment metadata of the event broadcast metadata requested by the natural language command that satisfies the first condition and the second condition, and
determining a presentation type defined by the natural language command;
retrieving, from the data storage, a subset of the data of the event broadcast, wherein the subset of the data of the event broadcast corresponds to the identified moment metadata;
creating a media representation of the subset of the data, wherein the media representation is created according to the presentation type defined by the natural language command; and
causing a user device to present the media representation of the subset of the data.
2 . The method of claim 1 , wherein the subset of the data of the event broadcast includes one or more moment clips from the event broadcast.
3 . The method of claim 2 , wherein creating the media representation includes combining the one or more moment clips into a moment reel to be presented to the user.
4 . The method of claim 1 , wherein causing a user device to present the media representation further comprises causing the user device to present a graphical overlay on the event broadcast as the event broadcast is being presented for the user.
5 . The method of claim 1 , wherein the user request is a text or a speech request.
6 . The method of claim 1 , wherein the subset of the data can include closed captioning data interpreted from the event broadcast by the natural language processor.
7 . A non-transitory computer-readable medium storing instructions that, when executed by a computing system within a cloud provider network, cause the computing system to perform operations comprising:
prior to receiving a natural language command, adjusting audio characteristics and video characteristics of data of an event broadcast as compared to the data as received;
identifying event broadcast metadata associated with the event broadcast from the normalized data;
receiving a request, wherein the request includes the natural language command related to the event broadcast of an event;
providing the natural language command as an input to a natural language processor, wherein providing the natural language command as the input to the natural language processor causes the natural language processor to generate a response to the natural language command by identifying a characteristic of the event broadcast metadata requested by the natural language command, and wherein the natural language command comprises a first condition and a second condition;
retrieving a subset of a set of data of the event broadcast, wherein the subset of the set of the data corresponds to the characteristic;
creating a media representation of the subset of the set of data of the event that satisfies the request; and
causing a user device to present the media representation of the subset of the set of data.
8 . The non-transitory computer-readable medium of claim 7 , wherein the characteristic is associated with moment metadata.
9 . The non-transitory computer-readable medium of claim 7 , wherein the natural language command further identifies a presentation type defined by the natural language command.
10 . The non-transitory computer-readable medium of claim 9 , wherein the media representation is created according to the presentation type.
11 . The non-transitory computer-readable medium of claim 7 , wherein the subset of the set of data of the event broadcast includes one or more moment clips from the event broadcast.
12 . The non-transitory computer-readable medium of claim 11 , wherein the instructions, when executed, further cause the computing system to perform operations comprising combining the one or more moment clips into a moment reel to be presented at a presentation device.
13 . The non-transitory computer-readable medium of claim 7 , wherein the instructions, when executed, further cause the computing system to perform operations comprising presenting a graphical overlay on the event broadcast as the event broadcast is being presented at a presentation device.
14 . The non-transitory computer-readable medium of claim 7 , wherein the request is a text or a speech request.
15 . The non-transitory computer-readable medium of claim 7 , wherein the subset of the set of data can include closed captioning data interpreted from the event broadcast by the natural language processor.
16 . An interactive broadcast system comprising:
a memory, wherein the memory is configured to store computer-executable instructions; and
one or more processors in communication with the memory, wherein the computer-executable instructions, when executed by the one or more processors, configure the one or more processors to perform operations including:
prior to receiving a natural language command, adjusting audio characteristics and video characteristics of data of an event broadcast as compared to the data as received;
identifying event broadcast metadata associated with the event broadcast from the normalized data;
receiving a user request, wherein the user request includes the natural language command related to the event broadcast;
providing the natural language command as an input to a natural language processor, wherein providing the natural language command as the input to the natural language processor causes the natural language processor to generate a response to the natural language command by identifying a characteristic of the event broadcast metadata requested by the natural language command, and wherein the natural language command comprises a first condition and a second condition;
creating a media representation that presents the response and satisfies the first condition and the second condition; and
causing a user device to present the media representation.
17 . The interactive broadcast system of claim 16 , wherein the natural language processor identifies a characteristic requested by the natural language command.
18 . The interactive broadcast system of claim 17 , wherein the characteristic is associated with moment metadata.
19 . The interactive broadcast system of claim 16 , wherein the natural language command further identifies a presentation type defined by the natural language command.
20 . The interactive broadcast system of claim 19 , wherein the media representation is created according to the presentation type.