Non-volatile memory system including a partial decoder and event detector for video streams
A partial decoder and event detection logic are deployed in a non-volatile memory system to offload processing from a host system while maintaining high video recording performance and backward compatibility with conventional host system logic.
1. A non-volatile memory system comprising:
a volatile memory;
a non-volatile memory; and
a controller configured to:
receive an encoded video stream from a host for storage in the non-volatile memory;
prior to storing the encoded video stream in the non-volatile memory:
partially-decode the encoded video stream;
determine whether there is enough space in the volatile memory to store the partially-decoded version of the encoded video stream in the volatile memory;
in response to determining that there is enough space in the volatile memory to store the partially-decoded version of the encoded video stream in the volatile memory, store the partially-decoded version of the encoded video stream in the volatile memory;
in response to determining that there is not enough space in the volatile memory to store the partially-decoded version of the encoded video stream in the volatile memory, store the partially-decoded version of the encoded video stream in a memory of the host;
detect an operational event in the stored partially-decoded video stream; and
inform the host of a location in a video frame of the detected operational event so the host can increase resolution in that location going forward; and
store the encoded video stream in the non-volatile memory.
2. The non-volatile memory system of claim 1 , wherein the operational event comprises object recognition.
3. The non-volatile memory system of claim 1 , wherein the operational event comprises motion above a configured threshold.
4. The non-volatile memory system of claim 1 , wherein the operational event comprises facial recognition.
5. The non-volatile memory system of claim 1 , wherein the controller is further configured to use a configurable frame-to-frame delta.
6. The non-volatile memory system of claim 1 , wherein the controller is further configured to perform a configurable amount of decoding.
7. A non-volatile memory system comprising:
a non-volatile memory;
means for receiving an encoded video stream from a host for storage in the non-volatile memory; and
means for, prior to storing the encoded video stream in the non-volatile memory:
partially-decoding the encoded video stream;
detecting an operational event from the partially-decoded video stream; and
informing the host of a location in a video frame of the detected operational event so the host can increase resolution in that location going forward, wherein the location comprises an identification of a quadrant and coordinates within the quadrant of the detected operational event.
8. The non-volatile memory system of claim 7 , wherein the operational event comprises one or more of pan, tilt, zoom, and increased resolution.
9. The non-volatile memory system of claim 7 , further comprising means for comparing frames of the partially-decoded video stream to a frame-to-frame delta threshold.
10. The non-volatile memory system of claim 7 , further comprising an interface to communicate with the host.
11. The non-volatile memory system of claim 7 , wherein the operational event comprises one or more of motion, object recognition, and facial recognition.
12. A method comprising:
performing the following in a non-volatile memory system comprising a volatile memory and a non-volatile memory:
receiving an encoded video stream from a host for storage in the non-volatile memory; and
prior to storing the encoded video stream in the non-volatile memory:
partially decoding the encoded video stream to generate partially-decoded video;
determining whether there is enough space in the volatile memory to store the partially-decoded video in the volatile memory;
in response to determining that there is enough space in the volatile memory, storing the partially-decoded video in the volatile memory;
in response to determining that there is not enough space in the volatile memory, storing the partially-decoded video in a memory of the host;
detecting an operational event in the stored partially-decoded video; and
notifying the host of a location in a video frame of the detected operational event.
13. The method of claim 12 , further comprising configuring the non-volatile memory system with an amount of partial decoding to perform.
14. The method of claim 12 , further comprising configuring the non-volatile memory system with a frame-to-frame delta level signifying the operational event.
15. The method of claim 12 , further comprising notifying the host of motion in the video stream.
16. The method of claim 12 , further comprising notifying the host with event coordinates.
17. The method of claim 16 , wherein the event coordinates comprise a subregion of the video frame and one or more of polar coordinates and Cartesian coordinates.
18. The method of claim 17 , wherein the subregion comprises a video quadrant.
19. The method of claim 12 , further comprising storing the video stream in the non-volatile memory.