IP Library Granted Patent US 10,970,333
Granted Patent B2
US 10,970,333 · App. 16/324,217 · Granted Apr 6, 2021

Distributed video storage and search with edge computing

Inventors: Avneesh Agrawal (Bengaluru, IN); David Jonathan Julian (San Diego, CA); Venkata Sreekanta Reddy Annapureddy (San Diego, CA); Manoj Venkata Tutika (Bengaluru, IN); Vinay Kumar Rai (Bengaluru, IN); Sandeep Pandya (San Diego, CA); Adam David Kahn (San Diego, CA); Michael Campos (La Jolla, CA); Badugu Naveen Chakravarthy (Bengaluru, IN); Ankur Nigam (Bengaluru, IN); Praveen Kumar (Bengaluru, IN); Tejeswara Rao Gudena (Bengaluru, IN); Karan Kishore (Bengaluru, IN)
Assignee: NETRADYNE, INC.
G06F16/7837B60W40/09G06F16/00G06F16/71G06F16/73G06F16/7844G06K9/00758G06K9/00845G06N20/00
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,970,333
App. No.
16/324,217
Granted
Apr 6, 2021
Kind
B2
Abstract

Systems and methods are provided for distributed video storage and search with edge computing. The method may comprise caching a first portion of data on a first device. The method may further comprise determining, at a second device, whether the first device has the first portion of data. The determining may be based on whether the first piece of data satisfies a specified criterion. The method may further comprise sending the data, or a portion of the data, and/or a representation of the data from the first device to a third device.

Claims (69)

1. A method, comprising:

receiving first visual data from a camera at a first device, wherein the first device is proximate to the camera;

storing the first visual data at a memory of the first device;

receiving a search query at a second device;

transmitting the search query from the second device to the first device;

determining, at the first device, a first degree of relevance of the first visual data with respect to the search query based on the first visual data and the search query; and

transmitting the first visual data from the first device to the second device based on the determined first degree of relevance and on a plurality of search results received in response to the search query.

2. The method of claim 1 , further comprising:

processing the first visual data at the first device with an inference engine to produce an inference data;

wherein the determined first degree of relevance is based on the inference data and the search query.

3. The method of claim 2 , wherein the inference data is a textual representation of the first visual data.

4. The method of claim 1 , further comprising:

transmitting a first search result data from the first device to the second device, the first search result data including an indication of the determined first degree of relevance; and

receiving the first search result data at the second device.

5. The method of claim 4 , further comprising:

receiving a second visual data from a second camera at a third device, wherein the third device is proximate to the second camera;

transmitting the search query from the second device to the third device;

determining, at the third device, a second degree of relevance of the second visual data with respect to the search query based on the second visual data and the search query;

transmitting a second search result data from the third device to the second device, the second search result data including an indication of the determined second degree of relevance;

comparing, at the second device, the first search result data and the second search result data; and

selectively requesting, by the second device, the first visual data rather than the second visual data based on the comparison.

6. The method of claim 1 , further comprising:

requesting, by the second device, the first visual data from the first device based on the determined first degree of relevance and on the plurality of search results received in response to the search query.

7. The method of claim 1 , further comprising:

updating an inference engine based on the transmitted first visual data.

8. The method of claim 1 , wherein the first camera is affixed to a first vehicle.

9. The method of claim 1 , wherein the search query refers to a rarely observed driving scenario.

10. The method of claim 1 , further comprising:

determining, at the first device, whether a driving behavior of a driver of a first vehicle should be categorized as safe or unsafe based on the stored first visual data, wherein the first camera is affixed to the first vehicle.

11. An apparatus, the apparatus comprising:

a first memory unit;

a first at least one processor coupled to the first memory unit;

a second memory unit; and

a second at least one processor coupled to the second memory unit;

wherein the second at least one processor is configured to:

receive a search query; and

transmit the search query to a first memory unit; and

wherein the first at least one processor is configured to:

receive visual data from a proximate camera;

store the visual data at the first memory unit;

determine, by the first at least one processor, a degree of relevance of the visual data with respect to the search query based on the visual data and the search query; and

transmit the visual data from the first memory unit to the second memory unit based on the determined degree of relevance and on a plurality of search results received in response to the search query.

12. The apparatus of claim 11 , wherein the first at least one processor is further configured to:

process the visual data with an inference engine to produce an inference data; wherein the determined degree of relevance is based on the inference data and the search query.

13. The apparatus of claim 11 , wherein the first camera is affixed to a first vehicle.

14. The apparatus of claim 11 , wherein the search query refers to a rarely observed driving scenario.

15. The apparatus of claim 11 , wherein the first at least one processor is further configured to:

determine whether a driving behavior of a driver of a first vehicle should be categorized as safe or unsafe.

16. A computer program product, the computer program product comprising:

non-transitory computer-readable media having program code recorded thereon, the program code comprising program code to:

receive, at a first device, visual data from a camera, wherein the first device is proximate to the camera;

store the visual data to a memory at the first device;

transmit information associated with the visual data from the first device to a second device;

receive a search query at the second device;

determine, at the second device, a degree of relevance of the visual data with respect to the search query based at least in part on the information associated with the visual data and the search query; and

request, by the second device, that the first device transmit the visual data from the first device to the second device based on the determined degree of relevance and on a plurality of search results received in response to the search query.

17. The computer program product of claim 16 , wherein:

the information associated with the visual data and transmitted from the first device to the second device includes metadata corresponding to the visual data; and

the program code further comprises program code to:

determine the degree of relevance of the visual data with respect to the search query based in part on the metadata.

18. The computer program product of claim 16 , the program code further comprising program code to:

process the visual data with an inference engine at the first device to produce an inference data corresponding to the visual data, wherein the information associated with the visual data and transmitted from the first device to the second device includes the inference data; and

determine the degree of relevance of the visual data with respect to the search query based in part on the inference data.

19. The computer program product of claim 16 , the program code further comprising program code to:

query, at the second device, weather information in a proximity of the first device; and

determine the degree of relevance of the visual data with respect to the search query based in part on the query.

20. The computer program product of claim 16 , wherein the camera is a vehicle mounted camera, a vehicle dash camera, a drone mounted camera, an appliance mounted camera, a retail camera, a smart city camera or a surveillance camera.

21. The computer program product of claim 16 , wherein storing the visual data comprises assigning a descriptor of the visual data to a first queue of a plurality of queues.

22. The computer program product of claim 21 , wherein the first queue corresponds to at least one of: a specified compression level, specified criteria from a set of criteria, a specified period of data persistence, a location, a time, and a weather condition.

Assignments (3)
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075435/0670 →
SECURITY INTEREST Recorded Apr 6, 2026
From: NETRADYNE, INC.
To: FIRST-CITIZENS BANK & TRUST COMPANY
Reel/Frame 075359/0194 →
SECURITY INTEREST Recorded Mar 9, 2021
From: NETRADYNE, INC.
To: SILICON VALLEY BANK
Reel/Frame 055530/0593 →
Continuity (3)
Provisional Application 62468894 · Mar 8, 2017
Provisional Application 62372284 · Aug 8, 2016
Related Publication 20190171668A1 · Jun 6, 2019