Smart contract based user feedback for event contexts
Mechanisms are provided for collecting user feedback information from sensors associated with user devices in accordance with smart contract rules. For an event context for an event, a provider portion of a smart contract is generated. The event context indicates an occurrence within the event that is detected through processing patterns of event data collected for the event, and the provider portion specifies a type of user feedback that is of interest to a provider. For the event context, a user portion of the smart contract is generated, where the user portion specifies a type of user feedback that a user of a user device permits to be shared with the provider. A smart contract comprising the smart contract rules is generated by combining the provider portion with the user portion. Collection of user feedback information from the user device is controlled according to the smart contract data structure.
1 . A computer-implemented method, in a data processing system, the computer-implemented method comprising:
generating, for at least one event context for an event, a provider portion of a smart contract data structure, wherein:
the at least one event context indicates an occurrence within the event that is detected through processing patterns of data in event data collected for the event, and
the provider portion specifies a type of user feedback information that is of interest to a provider and is to be collected in response to detecting the at least one event context;
generating, for the at least one event context for the event, a user portion of the smart contract data structure, the user portion specifies a type of the user feedback information that a user of a user device permits to be shared with the provider;
generating the smart contract data structure comprising a set of smart contract rules by combining the provider portion with the user portion;
processing event data representing data collected by first sensors associated with the event to identify a pattern of data in the event data corresponding to the at least one event context;
executing the set of smart contract rules in the smart contract data structure in response to the detecting the at least one event context as a result of the processing of the event data;
collecting, in response to the detecting the at least one event context in the event data, theuser feedback information from second sensors of the user device in accordance with the set of smart contract rules, wherein:
the user feedback information is of interest to the provider as specified in the provider portion of the smart contract data structure for the detected at least one event context, and
the user feedback information is permitted, by the user portion of the smart contract data structure, to be shared with the provider;
analyzing the user feedback information to identify patterns in the user feedback information indicative of one or more predefined user reactions, time stamp information associated with the at least one event context, and a physical location of the user device relative to the at least one event context at a time of occurrence of the at least one event context; and
controlling, based on the analyzing of the user feedback information, at least one user experience system, by transmitting control signals from the data processing system to the user experience system, to cause the user experience system to modify an element of the event wherein;
the element of the event to modify is determined based on a retrieval of an experience control provider entry, corresponding to the provider, in a provider registry,
the experience control provider entry specifies a type of experience control to perform in response to the patterns of the user feedback information, and
the controlling of the at least one user experience system comprises controlling one or more of a lighting system to control a lighting characteristic of the event generated by the lighting system, an audio system to change an audio characteristic of the event generated by the audio system, a video system to change a video characteristic of one or more display devices of the event, or a special effects system to change special effects of the event generated by the special effects system.
2 . The computer-implemented method of claim 1 , wherein
the first sensors associated with the event are selected from the group consisting of;
cameras, separate from the user device and located at a physical location of the event, providing video data as part of the event data, and
audio sensors, separate from the user device and located at the physical location of the event, providing audio data as part of the event data, and
the processing of the event data comprises applying at least one of image pattern recognition analysis or audio pattern analysis to identify predefined patterns in at least one of the video data or the audio data indicative of an event context in the at least one event context for the event.
3 . The computer-implemented method of claim 1 , further comprising deploying the smart contract data structure to an agent application executing on the user device, wherein
the agent application enforces the smart contract data structure by performing the executing of the set of smart contract rules in response to a message being received, from the data processing system, and
the message indicates that the at least one event context has been identified as a result of the processing of the event data.
4 . The computer-implemented method of claim 1 , wherein the collecting of the user feedback information further comprises:
analyzing the user feedback information, by inputting the user feedback information into one or more machine learning trained computer models;
classifying, by the one or more machine learning trained computer models, the user feedback information into a predefined classification of a plurality of predefined classifications of the user feedback information, to identify the patterns in the user feedback information indicative of the one or more predefined user reactions, wherein
the predefined classification corresponds to a user reaction, of the one or more predefined user reactions, matching the type of the user feedback information that is of interest to the provider; and
transmitting, based on the classifying of the user feedback information by the one or more machine learning trained computer models into the predefined classification the user feedback information to a provider computing system.
5 . The computer-implemented method of claim 1 , further comprising:
transmitting the collected user feedback information to a provider computing system associated with the provider in accordance with the set of smart contract rules, wherein
a plurality of user devices, including the user device, transmit corresponding user feedback information to the provider computing system that aggregates the user feedback information, and
the controlling of the at least one user experience system comprises:
controlling, by the provider computing system, the at least one user
experience system based on the aggregated user feedback information from the plurality of user devices; and
modifying the element of the event based on an analysis of the aggregated user feedback information.
6 . A computer program product comprising a computer readable storage medium having a computer readable program stored therein, wherein the computer readable program, when executed in a data processing system, causes the data processing system to:
generate, for at least one event context for an event, a provider portion of a smart contract data structure, wherein:
the at least one event context indicates an occurrence within the event that is detected through processing patterns of data in event data collected for the event, and
the provider portion specifies a type of user feedback information that is of interest to a provider and is to be collected in response to detecting the at least one event context;
generate, for the at least one event context for the event, a user portion of the smart contract data structure, wherein the user portion specifies a type of the user feedback information that a user of a user device permits to be shared with the provider;
generate the smart contract data structure comprising a set of smart contract rules by combining the provider portion with the user portion;
process event data representing data collected by first sensors associated with the event to identify a pattern of data in the event data corresponding to the at least one event context;
execute the set of smart contract rules in the smart contract data structure in response to the detecting the at least one event context as a result of the processing of the event data;
collect, in response to the detecting the at least one event context in the event data, the user feedback information from second sensors of the user device in accordance with the set of smart contract rules, wherein:
the user feedback information is of interest to the provider as specified in the provider portion of the smart contract data structure for the detected at least one event context, and
the user feedback information is permitted, by the user portion of the smart contract data structure, to be shared with the provider;
analyze the user feedback information to identify patterns in the user feedback information indicative of one or more predefined user reactions, time stamp information associated with the at least one event context, and a physical location of the user device relative to the at least one event context at a time of occurrence of the at least one event context; and
control, based on the analysis of the user feedback information, at least one user experience system, by transmitting control signals from the data processing system to the user experience system, to cause the user experience system to modify an element of the event, wherein:
the element of the event to modify is determined based on a retrieval of an experience control provider entry, corresponding to the provider, in a provider registry,
the experience control provider entry specifies a type of experience control to perform in response to the patterns of the user feedback information, and
the control of the at least one user experience system comprises control of one or more of a lighting system to control a lighting characteristic of the event generated by the lighting system, an audio system to change an audio characteristic of the event generated by the audio system, a video system to change a video characteristic of one or more display devices of the event, or a special effects system to change special effects of the event generated by the special effects system.
7 . The computer program product of claim 6 , wherein
the first sensors associated with the event are selected from the group consisting of:
cameras, separate from the user device and located at a physical location of the event, providing video data as part of the event data, and
audio sensors, separate from the user device and located at the physical location of the event, providing audio data as part of the event data, and
the processing of the event data comprises applying at least one of image pattern recognition analysis or audio pattern analysis to identify predefined patterns in at least one of the video data or the audio data indicative of an event context in the at least one event context for the event.
8 . The computer program product of claim 6 , wherein
the computer readable program further causes the data processing system to deploy the smart contract data structure to an agent application executing on the user device,
the agent application enforces the smart contract data structure by performing the execution of the set of smart contract rules in response to a message being received, from the data processing system, and
the message indicates that the at least one event context has been identified as a result of the processing of the event data.
9 . The computer program product of claim 6 , wherein the computer readable program further causes the data processing system to:
analyze the user feedback information, by inputting the user feedback information into one or more machine learning trained computer models;
classify, by the one or more machine learning trained computer models, the user feedback information into a predefined classification of a plurality of predefined classifications of the user feedback information, to identify the patterns in the user feedback information indicative of the one or more predefined user reactions, wherein
the predefined classification corresponds to a user reaction, of the one or more predefined user reactions, matching the type of the user feedback information that is of interest to the provider; and
transmit, based on the user feedback information being classified by the one or more machine learning trained computer models into the predefined classification the user feedback information to a provider computing system.
10 . The computer program product of claim 6 , wherein the computer readable program further causes the data processing system to:
transmit the collected user feedback information to a provider computing system associated with the provider in accordance with the set of smart contract rules, wherein
a plurality of user devices, including the user device, transmit corresponding user feedback information to the provider computing system that aggregates the user feedback information, and
the control of the at least one user experience system comprises:
control, by the provider computing system, the at least one user experience system based on the aggregated user feedback information from the plurality of user devices, and
modify the element of the event based on an analysis of the aggregated user feedback information.
11 . An apparatus, comprising:
a processor; and
a memory coupled to the processor, wherein the memory comprises instructions which, when executed by the processor, cause the processor to:
generate, for at least one event context for an event, a provider portion of a smart contract data structure, wherein:
the at least one event context indicates an occurrence within the event that is detected through processing patterns of data in event data collected for the event, and
the provider portion specifies a type of user feedback information that is of interest to a provider and is to be collected in response to detecting the at least one event context;
generate, for the at least one event context for the event, a user portion of the smart contract data structure, wherein the user portion specifies a type of the user feedback information that a user of a user device permits to be shared with the provider;
generate the smart contract data structure comprising a set of smart contract rules by combining the provider portion with the user portion;
process event data representing data collected by first sensors associated with the event to identify a pattern of data in the event data corresponding to the at least one event context;
execute the set of smart contract rules in the smart contract data structure in response to the detecting the at least one event context as a result of the processing of the event data;
collect, in response to the detecting the at least one event context in the event data, the user feedback information from second sensors of the user device in accordance with the set of smart contract rules, wherein:
the user feedback information is of interest to the provider as specified in the provider portion of the smart contract data structure for the detected at least one event context, and
the user feedback information is permitted, by the user portion of the smart contract data structure, to be shared with the provider;
analyze the user feedback information to identify patterns in the user feedback information indicative of one or more predefined user reactions, time stamp information associated with the at least one event context, and a physical location of the user device relative to the at least one event context at a time of occurrence of the at least one event context; and
control, based on the analysis of the user feedback information, at least one user experience system, by transmitting control signals from a data processing system to the user experience system, to cause the user experience system to modify an element of the event, wherein:
the element of the event to modify is determined based on a retrieval of an experience control provider entry, corresponding to the provider, in a provider registry,
the experience control provider entry specifies a type of experience control to perform in response to the patterns of the user feedback information, and
the control of the at least one user experience system comprises control of one or more of a lighting system to control a lighting characteristic of the event generated by the lighting system, an audio system to change an audio characteristic of the event generated by the audio system, a video system to change a video characteristic of one or more display devices of the event, or a special effects system to change special effects of the event generated by the special effects system.
12 . The computer-implemented method of claim 1 , further comprising distributing the provider portion to a plurality of user devices for implementation as part of the smart contract data structure in each user device of the plurality of user devices, wherein:
each user device in the plurality of user devices comprises a corresponding user portion, and
each user device of the plurality of user devices generates a corresponding smart contract data structure at least by combining the corresponding user portion with the distributed provider portion, and
the corresponding smart contract data structure comprises the provider portion common to the plurality of user devices, and the corresponding user portion.
13 . The computer-implemented method of claim 1 , wherein the type of the user feedback information that is of interest to the provider and is to be collected in response to the detecting the at least one event context is selected from the group consisting of a specific movement pattern by the user and a specific biometric pattern of the user.
14 . The computer-implemented method of claim 1 , further comprising generating a registry of event contexts, wherein:
each entry in the registry of event contexts comprises a mapping data structure for a corresponding event context,
the mapping data structure maps the corresponding event context to at least one type of the user feedback information and a timing window that specifies a period of time relative to a time of the corresponding event context in which to collect the type of the user feedback information from the second sensors associated with the user device, and
the generating of the provider portion of the smart contract data structure comprises selecting the corresponding event context from a plurality of event contexts in the registry of event contexts for inclusion of a corresponding mapping data structure in the provider portion.
15 . The computer-implemented method of claim 14 , wherein the collecting of the user feedback information is controlled to be performed within the timing window specified in the corresponding mapping data structure.
16 . The computer-implemented method of claim 14 , wherein the mapping data structure is generated based on a historical analysis of event contexts, of the plurality of event contexts, of previously occurring events and timing information specifying when different types of the user feedback information were detected based on in the event contexts.
17 . The computer-implemented method of claim 1 , wherein the at least one user experience system comprises the lighting system, and wherein controlling of the lighting characteristic of the event comprises controlling lights lighting the event.
18 . The computer-implemented method of claim 1 , wherein the at least one user experience system comprises the audio system, and wherein controlling of the audio characteristic of the event comprises controlling audio output of a recording as part of the event.
19 . The computer-implemented method of claim 1 , wherein the at least one user experience system comprises the video system, and wherein controlling of the video characteristic comprises controlling presentation of video content that is output on the one or more display devices of the event.
20 . The computer-implemented method of claim 1 , wherein
the event is a virtual event,
the controlling of the at least one user experience system comprises controlling modification of a virtual environment of the event via the video system at least by digitally modifying an output of the virtual environment with an overlay presented over the virtual environment of the event, wherein the overlay provides at least one of additional video content, digital special effects, or digital lighting.