IP Library Granted Patent US 12,585,939
Granted Patent B2
US 12,585,939 · App. 17/473,467 · Granted Mar 24, 2026

Systems and methods for distributed data analytics

Inventors: Lars Oleson (Bondi, AU); Shivanthan Yohanandan (Pakenham, AU); Ryan Mccrea (Etobicoke, CA); Deepa Lakshmi Chandrasekharan (Strathfiled, IN); Sabina Pokhrel (Kathmandu, NP); Yousef Rabi (Peakhurst, AU); Zhenhua Zhang (Chatswood, AU); Priyadharshini Devanand (Lidcombe, IN); Bernardo Rodeiro Croll (Kingsford, AU); James J. Meyer (Van Meter, IA)
Assignee: Xailient
G06N3/08G06F18/2148G06F18/217G06F18/28G06F18/40G06V10/774G06V10/82G06V10/945G06V40/16G06T2207/20084G06V10/462G06V40/161
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,585,939
App. No.
17/473,467
Granted
Mar 24, 2026
Kind
B2
Abstract

The invention provides systems and method for generating device-specific artificial neural network (ANN) models for distribution across user devices. Sample datasets are collected from devices in a particular environment or use case and include predictions by device-specific ANN models executing the user devices. The received datasets are used with existing datasets and stored ANN models to generate updated device-specific ANN models from each of the stored instances of the device ANN models based on the training data.

Claims (55)

1 . A method for generating device-specific artificial neural network (ANN) models for distribution across a plurality of user devices, the method comprising:

receiving, by a processor, sample datasets for object recognition from at least two of the plurality of user devices,

writing, by the processer, the sample datasets to a first data store;

identifying, by the processor and in a second data store, a use case dataset for object recognition within an environmental setting, the use case dataset comprising at least one or more training data parameters and an aspect of the environmental setting in which a user device of the plurality of user devices is placed;

identifying, by the processor and in the first data store, training data from the sample datasets that meet the one or more training data parameters;

identifying, by the processor and in the second data store, stored instances of the device-specific ANN models; and

generating, by the processor, updated device-specific ANN models from each of the stored instances of the device ANN models based on the training data, wherein each of the updated device-specific ANN models are specific to a hardware component and environment of a corresponding user device of the at least two of the plurality of user devices.

2 . The method of claim 1 , wherein the sample datasets comprise media data and predictions by device-specific ANN models executing on the user devices.

3 . The method of claim 2 , wherein the media data comprises image data and application of the ANN models to the image data facilitates the identification of objects of interest within the image data.

4 . The method of claim 2 , wherein the one or more training data parameters include media data parameters and device parameters.

5 . The method of claim 4 , wherein the media data parameters include one or more of a color index, a brightness index, a contrast index, an image temperature, a tint, one or more hue values, and a gamma value.

6 . The method of claim 4 , wherein the device parameters include one or more of available memory, processing speed, image resolution, and frame-rate capture.

7 . The method of claim 1 , wherein the user devices comprise a plurality of image capture devices.

8 . The method of claim 1 , wherein the use case dataset is specific to a particular use case.

9 . The method of claim 8 , wherein a use case comprises a functional aspect.

10 . The method of claim 9 , wherein the functional aspect of the use case comprises facial recognition.

11 . The method of claim 1 , wherein the environmental aspect of the use case comprises one of placement of the device in an outdoor environment, placement of the device in an indoor environment, placement of the device in a well-lit environment, or placement of the device in a poorly-lit environment.

12 . The method of claim 1 , wherein the predictions generated by the device-specific ANN models comprise a quantitative image salience metric for each image that indicates the likelihood that the media file contains an object of interest.

13 . The method of claim 12 , further comprising determining, based at least in part on the quantitative image salience metrics for each image, a minimum number of images necessary to achieve a threshold model accuracy.

14 . The method of claim 1 , further comprising maintaining a library of device-specific parameters and training data, and wherein generating the updated device-specific ANN models is further based on the device-specific parameters and training data.

15 . The method of claim 1 , further comprising distributing, by the processor, the device-specific updated ANN models to at least a subset of the user devices associated therewith.

16 . A system for generating device-specific artificial neural network (ANN) models for distribution across a plurality of user devices, the system comprising:

one or more processors; and

a memory coupled with the one or more processors wherein the one or more processors

executes a plurality of modules stored in the memory and wherein the plurality of modules

comprises:

a user interface that receives instructions from a user, the instructions identifying

one or more sample datasets from at least two of the plurality of user devices of a user environment;

a data store comprising the sample datasets;

a business logic module that, when executed, (i) identifies a use case dataset for object recognition within an environmental setting stored in the data store, the use case dataset comprising at least training data parameters and an aspect of the environmental setting in which a user device of the plurality of user devices is placed,

(ii) identifies training data from the sample datasets that meet the training data parameters provided in the use case dataset and (iii) identifies device-specific ANN models stored in the data store; and

an artificial intelligence machine learning module that when executed generates

updated device-specific ANN models from each of the stored instances of the device

ANN models based on the training data, wherein each of the updated device-specific ANN models are specific to a hardware component and environment of a corresponding user device of the at least two of the plurality of user devices.

17 . The system of claim 16 , wherein the sample datasets comprise media data and predictions by device specific ANN models executing on the user devices.

18 . The system of claim 17 , wherein the user devices comprise a plurality of image capture devices.

19 . The system of claim 17 , wherein the media data comprises image data and application of the ANN models to the image data facilitates the identification of objects of interest within the image data.

20 . The system of claim 17 , wherein the training data parameters include media data parameters and device parameters.

21 . The system of claim 20 , wherein the media data parameters include one or more of a color index, a brightness index, a contrast index, an image temperature, a tint, one or more hue values, and a gamma value.

22 . The system of claim 20 , wherein the device parameters include one or more of available memory, processing speed, image resolution, and frame-rate capture.

23 . The system of claim 16 , wherein the use case dataset is specific to a particular use case.

24 . The system of claim 23 , wherein a use case comprises a functional aspect.

25 . The system of claim 24 , wherein the functional aspect of the use case comprises facial recognition.

26 . The system of claim 16 , wherein the environmental aspect of the use case comprises one of placement of the device in an outdoor environment, placement of the device in an indoor environment, placement of the device in a well-lit environment, or placement of the device in a poorly-lit environment.

27 . The system of claim 17 , wherein the predictions generated by the device-specific ANN models comprise a quantitative image salience metric for each image that indicates the likelihood that the media file contains an object of interest.

28 . The system of claim 27 , wherein the artificial intelligence machine learning module further determines, based at least in part on the quantitative image salience metrics for each image, a minimum number of images necessary to achieve a threshold model accuracy.

29 . The system of claim 17 , further comprising a library of device-specific parameters and training data, and wherein the artificial intelligence machine learning module generates the updated device-specific ANN models based on the device-specific parameters and training data.

30 . The system of claim 17 , further comprising a deployment module for distributing the device-specific updated ANN models to at least a subset of the user devices associated therewith.

31 . A non-transitory computer-readable storage medium storing computer-readable instructions that, when executed by a computer, cause the computer to perform a method, the method comprising:

receiving, by a processor, sample datasets from at least two of a plurality of user devices,

writing, by the processer, the sample datasets to a first data store;

identifying, by the processor and in a second data store, a use case dataset for object recognition within an environmental setting, the use case dataset comprising at least one or more training data parameters and an aspect of the environmental setting in which a user device of the plurality of user devices is placed;

identifying, by the processor and in the first data store, training data from the sample datasets that meet the one or more training data parameters;

identifying, by the processor and in the second data store, stored instances of the device-specific ANN models; and

generating, by the processor, updated device-specific ANN models from each of the stored instances of the device ANN models based on the training data, wherein each of the updated device-specific ANN models are specific to a hardware component and environment of a corresponding user device of the at least two of the plurality of user devices.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2021
From: OLESON, LARS; YOHANANDAN, SHIVANTHAN; MCCREA, RYAN; CHANDRASEKHARAN, DEEPA LAKSHMI; POKHREL, SABINA; RABI, YOUSEF; ZHANG, ZHENHUA; DEVANAND, PRIYADHARSHINI; RODEIRO CROLL, BERNARDO
To: XAILIENT
Reel/Frame 057515/0757 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 17, 2021
From: MEYER, JAMES J.
To: XAILIENT
Reel/Frame 057538/0385 →
Continuity (3)
Continuation 17314465 · May 7, 2021
Provisional Application 63021735 · May 8, 2020
Related Publication 20210406605A1 · Dec 30, 2021
References Cited (72)
US 7599894B2 · Owechko et al. · 2009 [cited by applicant]
US 9354709B1 · Heller · 2016 [cited by examiner]
US 10007867B2 · Yu et al. · 2018 [cited by applicant]
US 10979625B2 · Lee et al. · 2021 [cited by applicant]
US 11423616B1 · Simon Kreuz et al. · 2022 [cited by applicant]
US 11562542B2 · Zhang et al. · 2023 [cited by applicant]
US 11669332B1 · Aiyer · 2023 [cited by examiner]
US 11701090B2 · Moctezuma de la Barrera et al. · 2023 [cited by applicant]
US 20050147297A1 · McLaughlin et al. · 2005 [cited by applicant]
US 20130176430A1 · Zhu · 2013 [cited by examiner]
US 20130294651A1 · Zhou · 2013 [cited by examiner]
US 20140355821A1 · Solem et al. · 2014 [cited by applicant]
US 20150089399A1 · Megill et al. · 2015 [cited by applicant]
US 20170286809A1 · Pankanti et al. · 2017 [cited by applicant]
US 20180060240A1 · Kadav et al. · 2018 [cited by applicant]
US 20180204088A1 · Chen et al. · 2018 [cited by applicant]
US 20180285682A1 · Najibi · 2018 [cited by examiner]
US 20180285699A1 · Kolouri et al. · 2018 [cited by applicant]
US 20180336430A1 · Sato · 2018 [cited by examiner]
US 20180373942A1 · Noda et al. · 2018 [cited by applicant]
US 20190042937A1 · Sheller · 2019 [cited by examiner]
US 20190065901A1 · Amato · 2019 [cited by examiner]
US 20190132520A1 · Gupta et al. · 2019 [cited by applicant]
US 20190147220A1 · Mccormac et al. · 2019 [cited by applicant]
US 20190205765A1 · Mondello · 2019 [cited by examiner]
US 20190279044A1 · Vasisht · 2019 [cited by examiner]
US 20190303725A1 · Gurvich · 2019 [cited by examiner]
US 20190332943A1 · Obradovic · 2019 [cited by examiner]
US 20190370613A1 · Arngren · 2019 [cited by examiner]
US 20200014761A1 · Kawaai et al. · 2020 [cited by applicant]
US 20200335208A1 · Talmor et al. · 2020 [cited by applicant]
US 20200372660A1 · Li et al. · 2020 [cited by applicant]
US 20200394458A1 · Yu et al. · 2020 [cited by applicant]
US 20200401891A1 · Xu · 2020 [cited by examiner]
US 20210035287A1 · Kim et al. · 2021 [cited by applicant]
US 20210056315A1 · Kale et al. · 2021 [cited by applicant]
US 20210150721A1 · Yohanandan et al. · 2021 [cited by applicant]
US 20210176239A1 · Rose · 2021 [cited by applicant]
US 20210262204A1 · Tafazoli Bilandi et al. · 2021 [cited by applicant]
US 20210406605A1 · Oleson et al. · 2021 [cited by applicant]
US 20210406606A1 · Oleson et al. · 2021 [cited by applicant]
US 20210406607A1 · Oleson et al. · 2021 [cited by applicant]
US 20220405574A1 · Bathen et al. · 2022 [cited by applicant]
US 20230079463A1 · Jonnada · 2023 [cited by examiner]
US 20230117712A1 · Jaber et al. · 2023 [cited by applicant]
US 20230176430A1 · Nakao et al. · 2023 [cited by applicant]
US 20230325627A1 · Ming Chang · 2023 [cited by examiner]
US 20230326183A1 · Kah et al. · 2023 [cited by applicant]
CN 110245659A · 2019 [cited by applicant]
JP 2010147696A · 2010 [cited by applicant]
JP 2013176101A · 2013 [cited by applicant]
JP 2019008460A · 2019 [cited by applicant]
JP 2019192082A · 2019 [cited by applicant]
WO 2007009876A1 · 2007 [cited by applicant]
WO 2018073121A1 · 2018 [cited by applicant]
WO WO2018173121A1 · 2018 [cited by applicant]
WO WO2018232378A1 · 2018 [cited by applicant]
WO WO2019176235A1 · 2019 [cited by applicant]
Jiao, L. et al. ‘A Survey of Deep Learning-based Object Detection’, IEEE Access, vol. 7, Sep. 5, 2019, pp. 128837-128868. [cited by applicant]
International Search Report and Written Opinion for International Application No. PCT/IB2021/053953, mailed Aug. 2, 2021. (14 pages). [cited by applicant]
Chao et al. 2018 “Fast object classification method based on saliency detection,” 2018 11th International Symposium on Computational Intelligence and Design, IEEE, 1:374-377. [cited by applicant]
Kavasidis et al. 2018 “A Saliency-based Convolutional Neural Network for Table and Chart Detection in Digitized Documents,” Arxiv.org, Cornell University Library, 13 pages. [cited by applicant]
Szegedy et al. 2015 “Going deeper with convolutions,” 2015 IEEE Conference on Computer Vision and Pattern Recognition, IEEE 9 pages. [cited by applicant]
Wang et al. 2018 “Video Salient Object Detection via Fully Convolutional Networks,” IEEE Transactions on Image Processing, 27(1):38-49. [cited by applicant]
Yohanandan et al. 2018 “Saliency Preservation in Low-Resolution Grayscale Images,” 237-254, XP047635328. [cited by applicant]
International Preliminary Report on Patentability for International Application No. PCT/IB2021/053953, mailed Nov. 17, 2022. (9 pages). [cited by applicant]
Supplemental European Search Report for European Application No. 21800158.4, mailed May 6, 2024. (12 pages). [cited by applicant]
Lu, B., et al., “Automating Deep Neural Network Model Selection for Edge Inference”, 2019 IEEE First International Conference on Cognitive Machine Intelligence (CogMI), 2019: pp. 184-193. https://api.semanticscholar.org… [cited by applicant]
De Lange, M., et al., “Unsupervised Model Personalization While Preserving Privacy and Scalability: An Open Problem,” 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 2020, p… [cited by applicant]
Luo, T., et al., “Distributed Anomaly Detection Using Autoencoder Neural Networks in WSN for IoT,” 2018 IEEE International Conference on Communications (ICC), Kansas City, MO, USA, 2018, pp. 1-6, doi: 10.1109/ICC.2018.8… [cited by applicant]
Reasons for Rejections for Japanese Application No. 2022-567287, mailed Aug. 15, 2024. (5 pages). [cited by applicant]
Shimura et al., “Efficient Object Detection for Railway Crossing Combining Image Classification and Object Detection,” IEICE Technical Report [online], The Institute of Electronics, Information and Communciation Enginee… [cited by applicant]