IP Library › Granted Patent US 12,277,743
Granted Patent B2
US 12,277,743 · App. 18/428,084 · Granted Apr 15, 2025

Dynamically configured extraction, preprocessing, and publishing of a region of interest that is a subset of streaming video data

Inventor: Amol Ajgaonkar (Chandler, AZ)
Assignee: Insight Direct USA, Inc.
G06V10/25G06T5/90G06V10/36G06V20/46H04N23/661H04N23/80
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,277,743
App. No.
18/428,084
Granted
Apr 15, 2025
Kind
B2
Abstract

A method of preprocessing incoming video data of at least one region of interest from a camera collecting video data is disclosed herein that includes receiving the incoming video data from the camera; preprocessing the incoming video data, by a computer processor, according to preprocessing parameters defined within a runtime configuration file, with the preprocessing including formatting the incoming video data to create first video data of a first region of interest; and publishing the first video data of the first region of interest to an endpoint to allow access by a first subscriber.

Claims (36)

1. A method of preprocessing incoming video data of at least one region of interest from a camera collecting video data, the method comprising:

receiving the incoming video data from the camera;

preprocessing the incoming video data, by a computer processor, according to preprocessing parameters defined within a first runtime configuration file, wherein the preprocessing includes formatting the incoming video data to create first video data of a first region of interest;

making available the first video data of the first region of interest to allow access by a first entity; and

preprocessing the incoming video data, by the computer processor, according to preprocessing parameters defined within a second runtime configuration file to create second video data different from the first video data.

2. The method of claim 1 , wherein the step of preprocessing the incoming video data to create the first video data of the region of interest includes applying at least one of the following video edits to the incoming video data: crop, grayscale, contrast, brightness, color threshold, resize, blur, hue saturation value, sharpen, erosion, dilation, Laplacian image processing, Sobel image processing, pyramid up, and pyramid down.

3. The method of claim 1 , wherein the incoming video data is of a first field of view, and the first video data of the first region of interest is of a second field of view that is smaller than the first field of view.

4. The method of claim 1 , wherein the first video data is continuously published to an endpoint.

5. The method of claim 1 , wherein the preprocessing parameters of the first runtime configuration file define multiple video edits and the method further comprises:

performing the video edits defined by the preprocessing parameters of the first runtime configuration file in an order that reduces an amount of time taken by the computer processor to preprocess the incoming video data.

6. The method of claim 1 , wherein the preprocessing parameters defined within the first runtime configuration file are configured to be edited distant from the computer processor.

7. The method of claim 1 , further comprising:

publishing the first video data to a topic on an asynchronous messaging library.

8. The method of claim 7 , wherein the asynchronous messaging library is ZeroMQ.

9. The method of claim 7 , wherein the step of making available the first video data further comprises:

sending the first video data to the first entity.

10. A system for preprocessing incoming video data for use by a first entity, the system comprising:

a camera configurated to collect the incoming video data having a frame with a first field of view;

a first runtime configuration file that includes preprocessing parameters for formatting the incoming video data;

a gateway that includes a computer processor, the gateway being configured to receive incoming video data from the camera and preprocess the incoming video data according to the preprocessing parameters defined within the first runtime configuration file, wherein the preprocessing of the incoming video data by the gateway creates first video data of a first region of interest having a second field of view that is less than the first field of view of the frame of the incoming video data; and

a second runtime configuration file that includes preprocessing parameters for formatting the incoming video data differently than the first runtime configuration file,

wherein the first video data of the first region of interest is made available to allow access by the first entity, and

wherein the gateway is instructed to preprocess the incoming video data according to the preprocessing parameters defined within the second runtime configuration file to create second video data different from the first video data.

11. The system of claim 10 , wherein the preprocessing parameters defined within the first runtime configuration file include at least one of the following edits to be applied to the incoming video data: crop, grayscale, contrast, brightness, color threshold, resize, blur, hue saturation value, sharpen, erosion, dilation, Laplacian image processing, Sobel image processing, pyramid up, and pyramid down.

12. The system of claim 10 , wherein the first video data is made available to the first entity by publishing the first video data to an endpoint that is a topic on an asynchronous messaging library.

13. The system of claim 10 , wherein the preprocessing of the incoming video data according to the preprocessing parameters defined within the first runtime configuration file to create the first video data and the preprocessing of the incoming video data according to the preprocessing parameters defined within the second runtime configuration file to create the second video data is performed by the gateway concurrently.

14. The system of claim 10 , wherein the second video data is of a third field of view that is less than the first field of view of the incoming video data and different from the second field of view of the first video data.

15. The system of claim 10 , wherein the preprocessing parameters defined within the first runtime configuration file are configured to be edited distant from the gateway.

16. The system of claim 10 , wherein the first video data is made available to the first entity by publishing the first video data to an endpoint hosted by the gateway.

17. The system of claim 16 , wherein the endpoint includes a security protocol that allows for subscription by the first entity.

18. The method of claim 17 , further comprising:

storing an edited first runtime configuration file in computer-readable storage media distant from the computer processor.

19. The method of claim 18 , further comprising:

retrieving, by the computer processor, the edited first configuration file from the computer-readable storage media.

20. The method of claim 18 , further comprising:

comparing the preprocessing parameters defined within the first runtime configuration file to the edited preprocessing parameters defined within the edited first runtime configuration file to determine that the first runtime configuration file has been edited.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 1, 2024
From: AJGAONKAR, AMOL
To: INSIGHT DIRECT USA, INC.
Reel/Frame 066404/0439 →
Continuity (3)
Continuation 18204486 · Jun 1, 2023
Continuation 17564664 · Dec 29, 2021
Related Publication 20240177443A1 · May 30, 2024
References Cited (106)
US 5857109A · Taylor · 1999 [cited by applicant]
US 6757434B2 · Miled et al. · 2004 [cited by applicant]
US 7334249B1 · Byers · 2008 [cited by applicant]
US 8031956B2 · Ali · 2011 [cited by applicant]
US 8229587B2 · Shieh et al. · 2012 [cited by applicant]
US 8358319B2 · Côtéet al. · 2013 [cited by applicant]
US 8493482B2 · Côtéet al. · 2013 [cited by applicant]
US 8539355B2 · Compagnat et al. · 2013 [cited by applicant]
US 8577279B2 · Baker et al. · 2013 [cited by applicant]
US 8593483B2 · Côtéet al. · 2013 [cited by applicant]
US 8786625B2 · Côtéet al. · 2014 [cited by applicant]
US 9100588B1 · Seymour · 2015 [cited by applicant]
US 9741098B2 · Cox · 2017 [cited by applicant]
US 9871998B1 · Curlander et al. · 2018 [cited by applicant]
US 10057636B1 · Nijim et al. · 2018 [cited by applicant]
US 10114980B2 · Barinov et al. · 2018 [cited by applicant]
US 10122906B2 · Yang et al. · 2018 [cited by applicant]
US 10176309B2 · Tormasov et al. · 2019 [cited by applicant]
US 10380431B2 · Winter et al. · 2019 [cited by applicant]
US 10424087B2 · Risser · 2019 [cited by applicant]
US 10497136B2 · Tamaazousti et al. · 2019 [cited by applicant]
US 10529106B2 · Eckert · 2020 [cited by applicant]
US 10674185B2 · Thomas et al. · 2020 [cited by applicant]
US 10687022B2 · Rasheed et al. · 2020 [cited by applicant]
US 10701321B2 · Westmacott et al. · 2020 [cited by applicant]
US 10756912B2 · Balasaygun et al. · 2020 [cited by applicant]
US 10776941B2 · Hollander et al. · 2020 [cited by applicant]
US 10860860B1 · Huynh et al. · 2020 [cited by applicant]
US 10922105B1 · Verma et al. · 2021 [cited by applicant]
US 10958854B2 · Elboher · 2021 [cited by applicant]
US 10972519B2 · Bar-Mashiah et al. · 2021 [cited by applicant]
US 10979663B2 · Amengual Galdon et al. · 2021 [cited by applicant]
US 10979718B2 · Chou et al. · 2021 [cited by applicant]
US 11038884B2 · Li · 2021 [cited by applicant]
US 11044525B2 · Armaly · 2021 [cited by applicant]
US 11050551B2 · Maggu et al. · 2021 [cited by applicant]
US 11075744B2 · Tormasov et al. · 2021 [cited by applicant]
US 11120013B2 · Bates et al. · 2021 [cited by applicant]
US 11138345B2 · Zou et al. · 2021 [cited by applicant]
US 11153069B2 · Kurian · 2021 [cited by applicant]
US 11196978B2 · Presler · 2021 [cited by applicant]
US 11509836B1 · Ajgaonkar · 2022 [cited by applicant]
US 11594032B1 · Raman · 2023 [cited by applicant]
US 12118916B2 · Yang et al. · 2024 [cited by applicant]
US 20060277256A1 · Tiruthani et al. · 2006 [cited by applicant]
US 20060287081A1 · Osawa · 2006 [cited by applicant]
US 20070013801A1 · Sezan · 2007 [cited by examiner]
US 20070189708A1 · Lerman et al. · 2007 [cited by applicant]
US 20090033745A1 · Yeredor et al. · 2009 [cited by applicant]
US 20100104027A1 · Youn et al. · 2010 [cited by applicant]
US 20100131554A1 · Cooper · 2010 [cited by examiner]
US 20100198947A1 · Daughtery · 2010 [cited by examiner]
US 20110041080A1 · Fleischman et al. · 2011 [cited by applicant]
US 20120044945A1 · Bhayani · 2012 [cited by examiner]
US 20120075435A1 · Hovanky · 2012 [cited by examiner]
US 20130038737A1 · Yehezkel et al. · 2013 [cited by applicant]
US 20130216207A1 · Berry et al. · 2013 [cited by applicant]
US 20150026718A1 · Seyller · 2015 [cited by applicant]
US 20160127749A1 · Chowdhury et al. · 2016 [cited by applicant]
US 20160205341A1 · Hollander et al. · 2016 [cited by applicant]
US 20170085892A1 · Liu et al. · 2017 [cited by applicant]
US 20170134162A1 · Code et al. · 2017 [cited by applicant]
US 20170308403A1 · Turull et al. · 2017 [cited by applicant]
US 20180167698A1 · Mercer et al. · 2018 [cited by applicant]
US 20180268864A1 · Bovik · 2018 [cited by examiner]
US 20180330169A1 · Van Hoof et al. · 2018 [cited by applicant]
US 20180342045A1 · Lutz et al. · 2018 [cited by applicant]
US 20200007958A1 · Wondra · 2020 [cited by examiner]
US 20200195693A1 · Price · 2020 [cited by examiner]
US 20200336710A1 · Zhang · 2020 [cited by applicant]
US 20200380261A1 · Chandran et al. · 2020 [cited by applicant]
US 20210124760A1 · Klein et al. · 2021 [cited by applicant]
US 20210165966A1 · Swamypillai et al. · 2021 [cited by applicant]
US 20210195268A1 · Jiang et al. · 2021 [cited by applicant]
US 20210227126A1 · Se et al. · 2021 [cited by applicant]
US 20210233204A1 · Alattar et al. · 2021 [cited by applicant]
US 20210314396A1 · Basu et al. · 2021 [cited by applicant]
US 20210321064A1 · Broaddus · 2021 [cited by applicant]
US 20210337217A1 · Reddiar et al. · 2021 [cited by applicant]
US 20220044334A1 · Blaikie et al. · 2022 [cited by applicant]
US 20220276940A1 · Wald · 2022 [cited by applicant]
US 20220329539A1 · Kim et al. · 2022 [cited by applicant]
US 20220368972A1 · Cheraghi et al. · 2022 [cited by applicant]
US 20230056885A1 · Mamadapur et al. · 2023 [cited by applicant]
AU 499889B2 · 1979 [cited by applicant]
AU 2001296636A1 · 2002 [cited by applicant]
CA 2260932A1 · 1998 [cited by applicant]
CA 3057924A1 · 2021 [cited by applicant]
CN 105430429B · 2019 [cited by applicant]
DE 2945615A1 · 1981 [cited by applicant]
EP 0824824A1 · 1998 [cited by applicant]
EP 2200000B1 · 2011 [cited by applicant]
EP 3374926A1 · 2018 [cited by applicant]
EP 3275175A4 · 2018 [cited by applicant]
EP 3559868A1 · 2019 [cited by applicant]
EP 3719687A1 · 2020 [cited by applicant]
EP 3644277A4 · 2021 [cited by applicant]
GB 201406814 · 2014 [cited by applicant]
WO 2001011862A9 · 2001 [cited by applicant]
WO 2004061729A2 · 2004 [cited by applicant]
WO 2016078490A1 · 2016 [cited by applicant]
WO 2020022956A1 · 2020 [cited by applicant]
WO 2021053604A1 · 2021 [cited by applicant]
WO 2021135641A1 · 2021 [cited by applicant]
WO 2021208952A1 · 2021 [cited by applicant]
WO 2021226601A1 · 2021 [cited by applicant]