Systems and methods to automatically perform actions based on media content
Systems and methods are provided for automatically performing an action based on video content. One example method includes receiving, at a first computing device, a video and determining, with a content determination engine, content of the video. An action to perform at the first computing device and/or at a second computing device is generated, based on the content of the video. If the action is to be performed at the second computing device, the action is transmitted to the second computing device. The action is performed at the respective first and/or second computing device.
1. A method comprising:
receiving, at a first computing device, a first video portion, comprising a plurality of frames, at a capture rate below an intention detection threshold;
identifying content of the first video portion comprising one or more people appearing in the first video portion;
receiving, in response to the one or more people appearing in the video, a second video portion at an increased capture rate above the intention detection threshold;
determining, in the second video portion, an intention of at least one of the identified people based on at least one of received audio or text recognition of text present in the second video portion;
identifying, based on the determined intention, a video preset rule to save the second video portion, the video preset rule comprising automatically transmitting the second video portion from the first computing device to at least one other computing device;
saving the second video portion in accordance with the identified video preset rule; generating, based on the determined intention, a command to activate a connected device; and
transmitting the command to a second computing device in communication with the connected device; wherein: the command is to close a connected building security shutter.
2. The method of claim 1 , wherein:
determining content of the video further comprises:
identifying the building security shutter in the video; and
determining a state of the building security shutter; and
generating the command to close the building security shutter is based on the state of the identified building security shutter.
3. The method of claim 1 , wherein:
audio is also received at the first computing device and the method further comprises:
transmitting at least one of the received video portions and audio from the first computing device to at least one other computing device as part of a videoconference;
identifying the content of the video is based, at least in part, on the received audio; and wherein
the method further comprises stopping the broadcast of the received video and/or audio to the at least one other computing device.
4. A system comprising:
input circuitry configured to:
receive, at a first computing device, a first video portion, comprising a plurality of frames, at a capture rate below an intention detection threshold; and
processing circuitry configured to:
identify content of the first video portion comprising one or more people appearing in the first video portion;
receive, in response to the one or more people appearing in the video, a second video portion at an increased capture rate above the intention detection threshold;
determine, in the second video portion an intention of at least one of the identified people based on at least one of received audio or text recognition of text present in the second video portion;
identify, based on the determined intention, a video preset rule to save the second video portion, the video preset rule comprising automatically transmitting the second video portion from the first computing device to at least one other computing device;
save the second video portion in accordance with the identified video preset rule; generate, based on the determined intention, a command to activate a connected device; and
transmit the command to a second computing device in communication with the connected device; wherein: the processing circuitry configured to generate the command is to close a connected building security shutter.
5. The system of claim 4 , wherein:
the processing circuitry configured to determine the content of the video is further configured to:
identify the building security shutter in the video; and
determine a state of the building security shutter; and
the processing circuitry configured to generate the command to close the building security shutter is based on the state of the identified building security shutter.
6. The system of claim 4 , wherein:
the processing circuitry is further configured to:
receive audio at the first computing device; and
transmit at least one of the received video portions and audio from the first computing device to at least one other computing device as part of a videoconference;
the processing circuitry configured to identify the content of the video is further configured to identify the content of the video based, at least in part, on the received audio; and
the processing circuitry is further configured to stop the broadcast of the received video and/or audio to the at least one other computing device.
7. The method of claim 1 , wherein:
the command is to close a connected building security shutter;
determining the intention of at least one of the identified people in the video further comprises determining that an identified person in the video is an intruder; and
the command to shut the building security shutter is generated in response to determining that the identified person in the video is an intruder.
8. The method of claim 1 wherein:
the command is to close a connected building security shutter; and
the method further comprises:
generating an alert indicating a change in status of the building security shutter; and
transmitting the alert to a second computing device.
9. The method of claim 1 wherein:
the method further comprises determining, based on a light level of the video, a plurality of time stamps for at least a subset of the frames of the video; and
processing the video in accordance with the identified video preset rule further comprises saving the video and the determined plurality of time stamps to a storage device.
10. The system of claim 4 , wherein:
the processing circuitry configured to generate the command is further configured to generate a command to close a connected building security shutter;
the processing circuitry configured to determine the intention of at least one of the identified people in the video is further configured to determine that an identified person in the video is an intruder; and
the processing circuitry configured to generate the command to shut the building security shutter is further configured to generate the command in response to determining that the identified person in the video is an intruder.
11. The system of claim 4 , wherein:
the processing circuitry configured to generate the command is further configured to generate a command to close a connected building security shutter; and
the processing circuitry is further configured to:
generate an alert indicating a change in status of the building security shutter; and
transmit the alert to a second computing device.
12. The system of claim 4 , wherein:
the processing circuitry is further configured to determine, based on a light level of the video, a plurality of time stamps for at least a subset of the frames of the video; and
the processing circuitry configured to process the video in accordance with the identified video preset rule is further configured to save the video and the determined plurality of time stamps to a storage device.
13. The method of claim 1 , wherein saving the second video portion in accordance with the identified video preset rule further comprises compressing the second video portion and transmitting the second video portion a storage device remote from the first computing device.
14. The system of claim 4 , wherein the processing circuitry configured to save the second video portion in accordance with the identified video preset rule is further configured to compress the second video portion and transmit the second video portion a storage device remote from the first computing device.