IP Library › Granted Patent US 12,513,389
Granted Patent B2
US 12,513,389 · App. 18/495,064 · Granted Dec 30, 2025

Camera parameter enhancement for multiple analytics

Inventors: Kunal Rao (Monroe, NJ); Sibendu Paul (West Lafayette, IN); Giuseppe Coviello (Robbinsville, NJ); Murugan Sankaradas (Dayton, NJ); Oliver Po (San Jose, CA); Srimat Chakradhar (Manalapan, NJ)
Assignee: NEC Corporation
H04N23/64H04N23/76
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,513,389
App. No.
18/495,064
Granted
Dec 30, 2025
Kind
B2
Abstract

Methods and systems for camera configuration include configuring an image capture configuration parameter of a camera according to a multi-objective reinforcement learning aggregated reward function. Respective quality estimates for analytics are determined after configuring the image capture parameters. The aggregated reward function is updated based on the quality estimates.

Claims (28)

1 . A computer-implemented method for camera configuration, comprising:

configuring an image capture configuration parameter of a camera according to a multi-objective reinforcement learning aggregated reward function;

determining respective quality estimates by a plurality of analytics unit quality estimators after configuring the image capture parameters; and

updating the aggregated reward function based on the quality estimates from the plurality of analytics unit quality estimators.

2 . The method of claim 1 , wherein determining the quality estimates includes applying respective trained estimator models that have been trained to accuracy for respective analytics tasks.

3 . The method of claim 1 , wherein updating the aggregated reward function combines the quality estimates according to an aggregation strategy.

4 . The method of claim 3 , wherein the multi-objective reinforcement learning uses a linear aggregation strategy.

5 . The method of claim 3 , wherein the multi-objective reinforcement learning uses a winner-takes-all aggregation strategy.

6 . The method of claim 3 , wherein the multi-objective reinforcement learning uses a weighted aggregation strategy.

7 . The method of claim 1 , wherein the image capture configuration parameter is selected from the group consisting of control brightness, contrast, color, sharpness, and focus.

8 . The method of claim 1 , further comprising training respective quality estimation models, for the plurality of analytics, to determine quality estimates based on an input image.

9 . The method of claim 1 , further comprising capturing a new image with the camera after changing the image capture configuration parameter, wherein determining the quality estimates is done using the new image.

10 . The method of claim 1 , wherein the multi-objective reinforcement learning treats a present set of image capture configuration parameters as a state of the camera and uses the aggregated reward function to determine an action that reflects a change in one or more of the image capture configuration parameters to balance performance of the plurality of analytics.

11 . A system for camera configuration, comprising:

a hardware processor; and

a memory that stores a computer program which, when executed by the hardware processor, causes the hardware processor to:

configure an image capture configuration parameter of a camera according to a multi-objective reinforcement learning aggregated reward function;

determine respective quality estimates by a plurality of analytics unit quality estimators after configuring the image capture parameters; and

update the aggregated reward function based on the quality estimates from the plurality of analytics unit quality estimators.

12 . The system of claim 11 , wherein the computer program further causes the hardware processor to apply respective trained estimator models that have been trained to accuracy for respective analytics tasks.

13 . The system of claim 11 , wherein the computer program further causes the hardware processor to combine the quality estimates according to an aggregation strategy.

14 . The system of claim 13 , wherein the multi-objective reinforcement learning uses a linear aggregation strategy.

15 . The system of claim 13 , wherein the multi-objective reinforcement learning uses a winner-takes-all aggregation strategy.

16 . The system of claim 13 , wherein the multi-objective reinforcement learning uses a weighted aggregation strategy.

17 . The system of claim 11 , wherein the image capture configuration parameter is selected from the group consisting of control brightness, contrast, color, sharpness, and focus.

18 . The system of claim 11 , further comprising training respective quality estimation models, for the plurality of analytics, to determine quality estimates based on an input image.

19 . The system of claim 11 , wherein the computer program further causes the hardware processor to capture a new image with the camera after changing the image capture configuration parameter, wherein determining the quality estimates is done using the new image.

20 . The system of claim 11 , wherein the multi-objective reinforcement learning treats a present set of image capture configuration parameters as a state of the camera and uses the aggregated reward function to determine an action that reflects a change in one or more of the image capture configuration parameters to balance performance of the plurality of analytics.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2025
From: NEC LABORATORIES AMERICA, INC.
To: NEC CORPORATION
Reel/Frame 072938/0913 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 26, 2023
From: RAO, KUNAL; PAUL, SIBENDU; COVIELLO, GIUSEPPE; SANKARADAS, MURUGAN; PO, OLIVER; CHAKRADHAR, SRIMAT
To: NEC LABORATORIES AMERICA, INC.
Reel/Frame 065355/0832 →
Continuity (2)
Provisional Application 63420235 · Oct 28, 2022
Related Publication 20240147054A1 · May 2, 2024
References Cited (17)
US 20200007781A1 · Aoba · 2020 [cited by examiner]
Dao et al., “Accurate and Timely Situation Awareness Retrieval from a Bandwidth Constrained Camera Network”, In 2017 IEEE 14th International Conference on Mobile Ad Hoc and Sensor Systems (MASS) Oct. 22, 2017, pp. 416-4… [cited by applicant]
Hsieh et al., “Focus: Querying Large Video Datasets with Low Latency and Low Cost”, In13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18) Oct. 2018, pp. 269-286. [cited by applicant]
Jain et al., “Panoptes: Servicing Multiple Applications Simultaneously using Steerable Cameras”, InProceedings of the 16th ACM/IEEE International Conference on Information Processing in Sensor Networks Apr. 18, 2017, pp… [cited by applicant]
Jang et al., “Application-aware IoT Camera Virtualization for Video Analytics Edge Computing”, In 2018 IEEE/ACM Symposium on Edge Computing (SEC) Oct. 25, 2018, pp. 132-144. [cited by applicant]
Jiang et al., “Chameleon: Scalable Adaptation of Video Analytics”, In Proceedings of the 2018 conference of the ACM special interest group on data communication Aug. 7, 2018, pp. 253-266. [cited by applicant]
Kang et al., “NoScope: Optimizing Neural Network Queries over Video at Scale”, arXiv:1703.02529v3 [cs.DB] Aug. 8, 2017, pp. 1-12. [cited by applicant]
Mittal et al., “No-Reference Image Quality Assessment in the Spatial Domain”, IEEE Transactions on image processing. Aug. 17, 2012, pp. 1-14. [cited by applicant]
Paul et al., “Enhancing Video Analytics Accuracy via Real-time Automated Camera Parameter Tuning”, In Proceedings of the 20th ACM Conference on Embedded Networked Sensor Systems Nov. 6, 2022, pp. 291-304. [cited by applicant]
Qureshi et al., “Planning Ahead for PTZ Camera Assignment and Handoff”, In2009 Third ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC) Aug. 30, 2009, pp. 1-8. [cited by applicant]
Sharma et al., “MultiSense: Fine-grained Multiplexing for Steerable Camera Sensor Networks”, In Proceedings of the second annual ACM conference on Multimedia systems Feb. 23, 2011, pp. 23-34. [cited by applicant]
Sprague et al., “Multiple-Goal Reinforcement Learning with Modular Sarsa(0)”, http://hdl.handle.net/1802/339, Apr. 2004, pp. 1-3. [cited by applicant]
Tong et al., “Large-Scale Vehicle Trajectory Reconstruction with Camera Sensing Network”, InProceedings of the 27th Annual International Conference on Mobile Computing and Networking Sep. 9, 2021, pp. 188-200. [cited by applicant]
Zhang et al., “AWStream: AdaptiveWide-Area Streaming Analytics”, InProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication Aug. 7, 2018, pp. 236-252. [cited by applicant]
Zhang et al., “Live Video Analytics at Scale with Approximation and Delay-Tolerance”, In14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17) Mar. 2017, pp. 377-392. [cited by applicant]
Liu et al., “Multiobjective Reinforcement Learning: a Comprehensive Overview”, IEEE Transactions on Systems, Man, and Cybernetics: Systems, vol. 45, No. 3, Mar. 2015, pp. 385-398. [cited by applicant]
Yao et al., “Adaptive online camera coordination for multi-camera multi-target surveillance”, in Computer Vision and Image Understanding, Apr. 2010, pp. 463-474. [cited by applicant]