IP Library Granted Patent US 11,736,796
Granted Patent B1
US 11,736,796 · App. 17/829,479 · Granted Aug 22, 2023

Workload triggered dynamic capture in surveillance systems

Inventor: Ramanathan Muthiah (Bangalore, IN)
Assignee: WESTERN DIGITAL TECHNOLOGIES, INC.
H04N23/665H04N5/77H04N5/907H04N23/51H04N23/661
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,736,796
App. No.
17/829,479
Granted
Aug 22, 2023
Kind
B1
Abstract

Systems and methods for managing write stream workload of video surveillance systems through playback workload triggered dynamic capture are described. A video camera may include a video image sensor for receiving video data. The video data may be written to a storage device. A request for access to the video data may then be received. An impact on a standard data write stream may be determined based on the time window determined for the access to the video data. At least one mitigation option may be initiated at the video image sensor as a result.

Claims (82)

1. A system, comprising:

a video image sensor; and

a surveillance controller configured to:

receive video data from the video image sensor, wherein the video data includes a video stream of video frames captured by the video image sensor;

write the video data to a storage device;

receive a request for access to the video data;

determine a time window for the access to the video data based on a data retrieval of the video data from the storage device;

determine an impact on a standard data write stream based on the time window; and

initiate, based on the impact on the standard data write stream, at least one mitigation option at the video image sensor.

2. The system of claim 1 , wherein the surveillance controller is further configured to:

retrieve a plurality of capture encode options based on past incidents having data write stream impacts; and

determine the at least one mitigation option from the plurality of capture encode options based on the impact on the standard data write stream.

3. The system of claim 1 , wherein:

the storage device is one storage device of a plurality of storage devices embedded in a network video recorder (NVR);

the NVR comprises the surveillance controller; and

the surveillance controller is further configured to determine the impact on the standard data write stream to the storage device based on the plurality of storage devices embedded in the NVR.

4. The system of claim 1 , wherein the surveillance controller is further configured to:

determine, based on the at least one mitigation option, capture configuration data to lower a bit rate of the video data captured by the video image sensor; and

reconfigure, during the time window and using the capture configuration data, video capture through the video image sensor.

5. The system of claim 1 , wherein the at least one mitigation option comprises a capture encode option that lowers a resolution of the video frames captured by the video image sensor.

6. The system of claim 1 , wherein the at least one mitigation option comprises a capture encode option that lowers a frame rate of the video frames captured by the video image sensor.

7. The system of claim 1 , wherein the at least one mitigation option comprises modifying at least one capture encode parameter such that a resultant bit rate of a write data stream to the storage device is lowered.

8. The system of claim 7 , wherein the at least one capture encode parameter is selected from:

frame size;

group of pictures;

encoding format;

codec; and

video profile.

9. The system of claim 1 , wherein the at least one mitigation option comprises modifying at least one capture encode parameter based on feedback on at least one state of other states of the storage device, the at least one state selected from:

health;

temperature;

garbage collection workload; and

capacity.

10. The system of claim 9 , wherein the feedback is based on a storage device resources model that tracks information on storage device state information including at least one of:

health;

temperature;

garbage collection workload; and

available capacity.

11. The system of claim 1 , wherein the at least one mitigation option comprises rearranging at least one activity on the system, the activity including background activity and enhanced post write read activity.

12. The system of claim 1 , wherein the request for access to the video data comprises one of:

playback of the video data, or

execution of analytics involving access to the storage device.

13. The system of claim 1 , further comprising

a video camera housing, wherein the video camera housing encloses:

the video image sensor;

the surveillance controller;

a network interface configured to communicate with a network; and

the storage device.

14. The system of claim 13 , wherein:

the storage device is one storage device of a plurality of storage devices embedded in the video camera housing; and

the surveillance controller is further configured to determine the impact on the standard data write stream to the storage device based on the plurality of storage devices embedded in the video camera housing.

15. A computer-implemented method, comprising:

receiving video data from a video image sensor, wherein the video data includes a video stream of video frames captured by the video image sensor;

writing the video data to a storage device;

receiving a request for access to the video data;

determining a time window for the access to the video data based on a data retrieval of the video data from the storage device;

determining an impact on a standard data write stream based on the time window; and

initiating, based on the impact on the standard data write stream, at least one mitigation option at the video image sensor.

16. The computer-implemented method of claim 15 , further comprising:

retrieving a plurality of capture encode options based on past incidents having data write stream impacts; and

determining the at least one mitigation option from the plurality of capture encode options based on the impact on the standard data write stream.

17. The computer-implemented method of claim 15 , further comprising:

determining, based on the at least one mitigation option, capture configuration data to lower bit rate of the video data captured by the video image sensor; and

reconfiguring, during the time window and using the capture configuration data, video capture through the video image sensor.

18. The computer-implemented method of claim 15 , wherein the at least one mitigation option is selected from:

lowering a resolution of the video frames captured by the video image sensor;

lowering a frame rate of the video frames captured by the video image sensor; and

modifying at least one capture encode parameter such that a resultant bit rate of a write data stream to the storage device is lowered.

19. The computer-implemented method of claim 15 , wherein the at least one mitigation option comprises modifying at least one capture encode parameter such that a resultant bit rate of a write data stream to the storage device is lowered, the at least one capture encode parameter is selected from:

frame size;

group of pictures;

encoding format;

codec; and

video profile.

20. A video camera, comprising:

a video image sensor;

means for receiving video data from the video image sensor, wherein the video data includes a video stream of video frames captured by the video image sensor;

means for writing the video data to a storage device;

means for receiving a request for access to the video data;

means for determining a time window for the access to the video data based on a data retrieval of the video data from the storage device;

means for determining an impact on a standard data write stream based on the time window; and

means for initiating, based on the impact on the standard data write stream, at least one mitigation option at the video image sensor.

Assignments (8)
PARTIAL RELEASE OF SECURITY INTERESTS Recorded Apr 25, 2025
From: JPMORGAN CHASE BANK, N.A., AS AGENT
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 071382/0001 →
SECURITY AGREEMENT Recorded Apr 25, 2025
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 071050/0001 →
PATENT COLLATERAL AGREEMENT Recorded Aug 23, 2024
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS THE AGENT
Reel/Frame 068762/0494 →
CHANGE OF NAME Recorded Jun 27, 2024
From: SANDISK TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067982/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067567/0682 →
PATENT COLLATERAL AGREEMENT - A&R LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 064715/0001 →
PATENT COLLATERAL AGREEMENT - DDTL LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067045/0156 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 1, 2022
From: MUTHIAH, RAMANATHAN
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 060066/0043 →