IP Library Granted Patent US 12,080,039
Granted Patent B2
US 12,080,039 · App. 17/341,602 · Granted Sep 3, 2024

Contextual policy-based computer vision control

Inventors: Sarbajit K. Rakshit (Kolkata, IN); Pritpal S. Arora (Bangalore, IN); Laxmikantha Sai Nanduru (R K Puram Post, IN)
Assignee: Kyndryl, Inc.
G06V10/255G06N20/00G06T1/0014G06V20/52H04N23/61H04N23/90
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,080,039
App. No.
17/341,602
Granted
Sep 3, 2024
Kind
B2
Abstract

A tool for providing contextual policy-based computer vision control. The tool identifies one or more camera devices in an environment. The tool determines a plurality of vision areas in a field of view within the environment. The tool determines one or more contextual policies for the plurality of vision areas in the field of view. The tool determines one or more vision augmentations for the plurality of vision areas based, at least in part, on an aggregate computer vision capability of the one or more camera devices in the environment and the one or more contextual policies for the plurality of vision areas in the field of view. The tool applies the one or more vision augmentations to at least one of the one or more camera devices in the environment.

Claims (78)

1. A method, comprising:

identifying, by one or more computer processors, a plurality of camera devices in an environment;

remotely moving, by the one or more computer processors, the plurality of camera devices through a range of motion to gather data from a field of view of the plurality of camera devices;

determining, by the one or more computer processors, a plurality of vision areas in the field of view within the environment, wherein the plurality of vision areas are virtual subsections of the field of view;

determining, by the one or more computer processors, one or more contextual policies for the plurality of vision areas in the field of view;

determining, by the one or more computer processors, one or more vision augmentations for the plurality of vision areas based on an aggregate computer vision capability of the plurality of camera devices in the environment and the one or more contextual policies for the plurality of vision areas in the field of view; and

applying, by the one or more computer processors, the one or more vision augmentations to at least one of the plurality of camera devices to control the one or more cameras to comply with the one or more contextual policies.

2. The method of claim 1 , wherein the applying the one or more vision augmentations further comprises:

determining, by the one or more computer processors, whether an object in at least one of the plurality of vision areas in the field of view violates at least one of the one or more contextual policies; and

responsive to a determination that the object violates at least one of the one or more contextual policies, applying, by the one or more computer processors, at least one of the one or more vision augmentations to at least one of the plurality of camera devices in the environment.

3. The method of claim 1 , further comprising:

determining, by the one or more computer processors, a plurality of specifications for each of the plurality of camera devices in the environment, wherein the plurality of specifications indicate a type of computer vision capability for each of the plurality of camera devices; and

aggregating, by the one or more computer processors, the type of computer vision capability for each of the plurality of camera devices in the environment to identify the aggregate computer vision capability of the plurality of camera devices, wherein the aggregate computer vision capability is a total range of computer vision capabilities for any combination of the plurality of camera devices in the environment.

4. The method of claim 1 , wherein the determining a plurality of vision areas in a field of view further comprises:

creating, by the one or more computer processors, one or more virtual sections to define the plurality of vision areas in the field of view;

configuring, by the one or more computer processors, the plurality of vision areas in the field of view based on a dimensional length of the one or more virtual sections; and

assigning, by the one or more computer processors, at least one of the plurality of camera devices to each of the plurality of vision areas in the field of view.

5. The method of claim 1 , wherein the determining one or more contextual policies for the plurality of vision areas in the field of view further comprises:

identifying, by the one or more computer processors, a plurality of contextual situations in real-time utilizing the plurality of camera devices in the environment;

selecting, by the one or more computer processors, one or more contextual policies based on the plurality of contextual situations, wherein the one or more contextual policies define a type of imaging that is prohibited in each of the plurality of vision areas within the field of view; and

assigning, by the one or more computer processors, at least one of the one or more contextual policies to at least one of the plurality of vision areas in the field of view.

6. The method of claim 1 , wherein the determining the one or more vision augmentations for the plurality of vision areas further comprises:

comparing, by the one or more computer processors, the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices in the environment to the one or more contextual policies assigned to each of the plurality of vision areas in the field of view; and

determining, by the one or more computer processors, at least one of the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices that satisfies the one or more contextual policies assigned to each of the plurality of vision areas in the field of view.

7. The method of claim 1 , further comprising:

evaluating, by the one or more computer processors, an augmented computer vision of the plurality of camera devices in the environment for conformance with the one or more contextual policies.

8. A computer program product comprising a computer-readable storage medium storing program instructions comprising:

program instructions to identify a plurality of camera devices in an environment;

program instructions to remotely move the plurality of camera devices through a range of motion to gather data from a field of view of the plurality of camera devices;

program instructions to determine a plurality of vision areas in the field of view within the environment, wherein the plurality of vision areas are virtual subsections of the field of view;

program instructions to determine one or more contextual policies for the plurality of vision areas in the field of view;

program instructions to determine one or more vision augmentations for the plurality of vision areas based on an aggregate computer vision capability of the plurality of camera devices in the environment and the one or more contextual policies for the plurality of vision areas in the field of view; and

program instructions to apply the one or more vision augmentations to at least one of the plurality of camera devices to control the one or more cameras to comply with the one or more contextual policies.

9. The computer program product of claim 8 , wherein the program instructions to apply the one or more vision augmentations further comprise:

program instructions to determine whether an object in at least one of the plurality of vision areas in the field of view violates at least one of the one or more contextual policies; and

program instructions to, responsive to a determination that the object violates at least one of the one or more contextual policies, apply at least one of the one or more vision augmentations to at least one of the plurality of camera devices in the environment.

10. The computer program product of claim 8 , further comprising:

program instructions to determine a plurality of specifications for each of the plurality of camera devices in the environment, wherein the plurality of specifications indicate a type of computer vision capability for each of the plurality of camera devices; and

program instructions to aggregate the type of computer vision capability for each of the plurality of camera devices in the environment to identify the aggregate computer vision capability of the plurality of camera devices, wherein the aggregate computer vision capability is a total range of computer vision capabilities for any combination of the plurality of camera devices in the environment.

11. The computer program product of claim 8 , wherein the program instructions to determine a plurality of vision areas in a field of view further comprise:

program instructions to create one or more virtual sections to define the plurality of vision areas in the field of view;

program instructions to configure the plurality of vision areas in the field of view based on a dimensional length of the one or more virtual sections; and

program instructions to assign at least one of the plurality of camera devices to each of the plurality of vision areas in the field of view.

12. The computer program product of claim 8 , wherein the program instructions to determine one or more contextual policies for the plurality of vision areas in the field of view further comprise:

program instructions to identify a plurality of contextual situations in real-time utilizing the plurality of camera devices in the environment;

program instructions to select one or more contextual policies based on the plurality of contextual situations, wherein the one or more contextual policies define a type of imaging that is prohibited in each of the plurality of vision areas within the field of view; and

program instructions to assign at least one of the one or more contextual policies to at least one of the plurality of vision areas in the field of view.

13. The computer program product of claim 8 , wherein the program instructions to determine the one or more vision augmentations for the plurality of vision areas further comprise:

program instructions to compare the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices in the environment to the one or more contextual policies assigned to each of the plurality of vision areas in the field of view; and

program instructions to determine at least one of the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices that satisfies the one or more contextual policies assigned to each of the plurality of vision areas in the field of view.

14. The computer program product of claim 8 , further comprising:

program instructions to evaluate augmented computer vision of the plurality of camera devices in the environment for conformance with the one or more contextual policies.

15. A computer system, comprising:

a memory storing instructions; and

a processor that, when executing the instructions, is configured to:

identify a plurality of camera devices in an environment;

remotely move the plurality of camera devices through a range of motion to gather data from a field of view of the plurality of camera devices;

determine a plurality of vision areas in the field of view within the environment, wherein the plurality of vision areas are virtual subsections of the field of view;

determine one or more contextual policies for the plurality of vision areas in the field of view;

determine one or more vision augmentations for the plurality of vision areas based, at least in part, on an aggregate computer vision capability of the plurality of camera devices in the environment and the one or more contextual policies for the plurality of vision areas in the field of view; and

apply the one or more vision augmentations to at least one of the plurality of camera devices to control the one or more cameras to comply with the one or more contextual policies.

16. The computer system of claim 15 , wherein the processor is further configured to:

determine whether an object in at least one of the plurality of vision areas in the field of view violates at least one of the one or more contextual policies; and

responsive to a determination that the object violates at least one of the one or more contextual policies, apply at least one of the one or more vision augmentations to at least one of the plurality of camera devices in the environment.

17. The computer system of claim 15 , wherein the processor is further configured to:

determine a plurality of specifications for each of the plurality of camera devices in the environment, wherein the plurality of specifications indicate a type of computer vision capability for each of the plurality of camera devices; and

aggregate the type of computer vision capability for each of the plurality of camera devices in the environment to identify the aggregate computer vision capability of the plurality of camera devices, wherein the aggregate computer vision capability is a total range of computer vision capabilities for any combination of the plurality of camera devices in the environment.

18. The computer system of claim 15 , wherein, when the processor is configured to determine a plurality of vision areas in a field of view, the processor is further configured to:

create one or more virtual sections to define the plurality of vision areas in the field of view;

configure the plurality of vision areas in the field of view based, at least in part, on a dimensional length of the one or more virtual sections; and

assign at least one of the plurality of camera devices to each of the plurality of vision areas in the field of view.

19. The computer system of claim 15 , wherein, when the processor is configured to determine one or more contextual policies for the plurality of vision areas in the field, the processor is further configured to:

identify a plurality of contextual situations in real-time utilizing the plurality of camera devices in the environment;

select one or more contextual policies based on the plurality of contextual situations, wherein the one or more contextual policies define a type of imaging that is prohibited in each of the plurality of vision areas within the field of view; and

assign at least one of the one or more contextual policies to at least one of the plurality of vision areas in the field of view.

20. The computer system of claim 15 , wherein, when the processor is configured to determine the one or more vision augmentations for the plurality of vision areas, the processor is further configured to:

compare the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices in the environment to the one or more contextual policies assigned to each of the plurality of vision areas in the field of view; and

determine at least one of the one or more vision augmentations supported by the aggregate computer vision capability of the plurality of camera devices that satisfies the one or more contextual policies assigned to each of the plurality of vision areas in the field of view.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 18, 2021
From: INTERNATIONAL BUSINESS MACHINES CORPORATION
To: KYNDRYL, INC.
Reel/Frame 058213/0912 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2021
From: RAKSHIT, SARBAJIT K.; ARORA, PRITPAL S.; NANDURU, LAXMIKANTHA SAI
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 056465/0672 →