IP Library Granted Patent US 11,562,018
Granted Patent B2
US 11,562,018 · App. 16/781,717 · Granted Jan 24, 2023

Storage system and method for optimized surveillance search

Inventor: Ramanathan Muthiah (Bangalore, IN)
Assignee: Western Digital Technologies, Inc.
G06F16/735G06N5/04G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,562,018
App. No.
16/781,717
Granted
Jan 24, 2023
Kind
B2
Abstract

A storage system and method for optimized surveillance search are provided. In one embodiment, a storage system is provided comprising a memory and a controller. The controller is configured to: receive, from a host, an image of an object and a logical block address range of video data stored in the memory; search for the image of the object in video data in the logical block address range; and provide the host with possible hits from the search. Other embodiments are provided.

Claims (41)

1. A storage system comprising:

a memory; and

a controller configured to:

receive, from a host, a search request comprising an image of an object, a logical block address range of video data stored in the memory, and a quality-of-service parameter; and

in response to the receiving the search request:

retrieve the video data from the memory;

decode the video data to identify a set of Instantaneous Decoder Refresh (IDR) frames in the video data;

compare the set of IDR frames with the image of the object to identify a number of IDR frames in the set of IDR frames, wherein the number of IDR frames in the set of IDR frames is based on the quality-of-service parameter; and

provide the host with an indication of how closely each IDR frame in the set of IDR frames matches the object of interest.

2. The storage system of claim 1 , wherein a distance between adjacent frames in the set of IDR frames is provided for by the quality-of-service parameter.

3. The storage system of claim 1 , wherein the controller is further configured to compare the set of IDR frames with the image of the object using artificial intelligence.

4. The storage system of claim 1 , wherein the controller is further configured to compare the set of IDR frames with the image of the object using machine learning.

5. The storage system of claim 1 , wherein the controller is further configured to provide the indication via a table.

6. The storage system of claim 1 , wherein the image of the object is part of a video clip of images received from the host.

7. The storage system of claim 1 , wherein the memory comprises a three-dimensional memory.

8. The storage system of claim 1 , wherein the storage system is configured to be integrated in the host.

9. The storage system of claim 1 , wherein the storage system is configured to be removably connected with the host.

10. The storage system of claim 1 , wherein a distance between adjacent frames in the set of IDR frames is provided for by a bandwidth of the controller.

11. A method comprising:

performing operations in a storage system comprising a memory:

receiving, from a host, a search request comprising an image of an object, a logical block address range of video data stored in the memory, and a quality-of-service parameter; and

in response to the receiving the search request:

retrieving, by a processor, the video data from the memory;

decoding, by the processor, the video data to identify a set of Instantaneous Decoder Refresh (IDR) frames in the video data;

comparing, by the processor, the set of IDR frames with the image of the object to identify a number of IDR frames in the set of IDR frames, wherein the number of IDR frames in the set of IDR frames is based on the quality-of-service parameter; and

providing, by the processor, the host with an indication of how closely each IDR frame in the set of IDR frames matches the object of interest.

12. The method of claim 11 , wherein a distance between adjacent frames in the set of IDR frames is provided for by the quality-of-service parameter.

13. The method of claim 11 , wherein the set of IDR frames is compared with the image of the object using artificial intelligence.

14. The method of claim 11 , wherein the set of IDR frames is compared with the image of the object using machine learning.

15. The method of claim 11 , wherein a distance between adjacent frames in the set of IDR frames is provided for by the quality-of-service parameter.

16. The method of claim 11 , wherein a distance between adjacent frames in the set of IDR frames is provided for by a bandwidth of a controller of the storage system.

17. The method of claim 11 , wherein the indication is provided via a table.

18. The method of claim 11 , wherein the image of the object is part of a video clip of images received from the host.

19. The method of claim 11 , further comprising receiving a data retrieval request from the host.

20. A storage system comprising:

a memory;

means for receiving, from a host, a search request comprising an image of an object, a logical block address range of video data stored in the memory, and a quality-of-service parameter; and

means for, in response to the receiving the search request;

decoding the video data to identify a set of Instantaneous Decoder Refresh (IDR) frames in the video data;

comparing the set of IDR frames with the image of the object to identify a number of IDR frames in the set of IDR frames, wherein the number of IDR frames in the set of IDR frames is based on the quality-of-service parameter; and

providing the host with an indication of how closely each IDR frame in the set of IDR frames matches the object of interest.

Assignments (10)
SECURITY AGREEMENT Recorded Apr 25, 2025
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT
Reel/Frame 071050/0001 →
PARTIAL RELEASE OF SECURITY INTERESTS Recorded Apr 25, 2025
From: JPMORGAN CHASE BANK, N.A., AS AGENT
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 071382/0001 →
PATENT COLLATERAL AGREEMENT Recorded Aug 23, 2024
From: SANDISK TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS THE AGENT
Reel/Frame 068762/0494 →
CHANGE OF NAME Recorded Jun 27, 2024
From: SANDISK TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067982/0032 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 29, 2024
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: SANDISK TECHNOLOGIES, INC.
Reel/Frame 067567/0682 →
PATENT COLLATERAL AGREEMENT - A&R LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 064715/0001 →
PATENT COLLATERAL AGREEMENT - DDTL LOAN AGREEMENT Recorded Aug 21, 2023
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 067045/0156 →
RELEASE OF SECURITY INTEREST AT REEL 053482 FRAME 0453 Recorded Feb 8, 2022
From: JPMORGAN CHASE BANK, N.A.
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 058966/0279 →
SECURITY INTEREST Recorded May 14, 2020
From: WESTERN DIGITAL TECHNOLOGIES, INC.
To: JPMORGAN CHASE BANK, N.A., AS AGENT
Reel/Frame 053482/0453 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2020
From: MUTHIAH, RAMANATHAN
To: WESTERN DIGITAL TECHNOLOGIES, INC.
Reel/Frame 051716/0905 →
Continuity (1)
Related Publication 20210240764A1 · Aug 5, 2021