IP Library Granted Patent US 10,671,847
Granted Patent B2
US 10,671,847 · App. 15/602,408 · Granted Jun 2, 2020

Service implementing a work flow based on image analysis

Inventors: David Chavez (Broomfield, CO); Laurent Philonenko (San Francisco, CO)
Assignee: Avaya Inc.
G06K9/00664G06K9/00771G06K9/00973G06K2209/27
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,671,847
App. No.
15/602,408
Granted
Jun 2, 2020
Kind
B2
Abstract

An image (e.g., a picture) is received from a communication device. The image has associated metadata that is captured while the image is taken. For example, the metadata may be a location, a date, and a time of the picture. One or more object(s) (e.g., a car) along with characteristics of the object(s) in the image are identified. For example, a characteristic may be an action associated with the object, such as a person is running. In response to analyzing the one or more objects for the one or more characteristics in conjunction with the metadata, one or more potential workflows are determined (e.g., a workflow to call the police). A list that identifies the one or more potential workflows is sent to the communication device. Input to select one of the one or more workflows is received, which initiates the selected workflow.

Claims (46)

1. A system comprising:

a microprocessor; and

a computer readable medium, coupled with the microprocessor and comprising microprocessor readable and executable instructions that cause the microprocessor to:

receive an image, wherein the image has associated metadata;

identify one or more objects in the image;

analyze the one or more objects for one or more characteristics in conjunction with the metadata;

in response to analyzing the one or more objects for the one or more characteristics in conjunction with the metadata, determine one or more potential workflows;

send a list that identifies the one or more potential workflows;

receive input to select one of the one or more potential workflows; and

send information to initiate the selected one of the one or more potential workflows.

2. The system of claim 1 , wherein analyzing the one or more objects for the one or more characteristics in conjunction with the metadata comprises: identifying a plurality of individual objects in the image, wherein determining the one or more potential workflows comprises: determining a plurality of separate workflows based on the plurality of individual objects in the image.

3. The system of claim 1 , wherein determining the one or more potential workflows comprises dynamically creating at least one of the one or more workflows based only on the received image, or based only on the received image and the metadata.

4. The system of claim 1 , wherein the one or more objects comprises a plurality of objects and wherein analyzing the one or more objects for the one or more characteristics in conjunction with the metadata comprises determining a relationship between at least two of the plurality of objects in the image.

5. The system of claim 1 , wherein the executable instructions further cause the microprocessor create a software object in a first computer format, send the software object to an Application Programming Interface (API) that formats the software object into a second computer format, and wherein the software object identifies a specific workflow service on a specific workflow server.

6. The system of claim 1 , wherein the input to select the one of the one or more workflows is a selection of a plurality of workflows and wherein the sent information initiates the plurality of separate workflows on a plurality of different workflow servers on a computer network.

7. The system of claim 1 , wherein the metadata comprises a location of the image and a name of a person taking the image and wherein the determined one or more potential workflows is based on the location of the image and the name of a person taking the image.

8. The system of claim 1 , wherein the metadata is sent as information to initiate the selected workflow.

9. The system of claim 1 , wherein analyzing the one or more objects for the one or more characteristics in conjunction with the metadata comprises analyzing the image based on an angle of the image or a distance from the image.

10. The system of claim 1 , wherein the metadata comprises a speed of the communication device taking the image and wherein the determined one or more potential workflows is based on the speed of the communication device taking the image.

11. The system of claim 1 , wherein the one or more characteristics comprises at least one of an event or an action.

12. A method comprising:

receiving, by a microprocessor, an image, wherein the image has associated metadata;

identifying, by the microprocessor, one or more objects in the image;

analyzing, by the microprocessor, the one or more objects for one or more characteristics in conjunction with the metadata;

in response to analyzing the one or more objects for the one or more characteristics in conjunction with the metadata, determining, by the microprocessor, one or more potential workflows;

sending, by the microprocessor, a list that identifies the one or more potential workflows;

receiving, by the microprocessor, input to select one of the one or more potential workflows; and

sending, by the microprocessor, information to initiate the selected one of the one or more potential workflows.

13. The method of claim 11 , wherein analyzing the one or more objects for the one or more characteristics in conjunction with the metadata comprises: identifying a plurality of individual objects in the image, wherein determining the one or more potential workflows comprises: determining a plurality of separate workflows based on the plurality of individual objects in the image.

14. The method of claim 11 , wherein determining the one or more potential workflows comprises dynamically creating at least one of the one or more workflows based only on the received image, or based only on the received image and the metadata.

15. The method of claim 11 , wherein the one or more objects comprises a plurality of objects and wherein analyzing the one or more objects for the one or more characteristics in conjunction with the metadata comprises determining a relationship between at least two of the plurality of objects in the image.

16. The method of claim 11 , further comprising:

creating a software object in a first computer format;

sending the software object to an Application Programming Interface (API) that formats the software object into a second computer format; and

wherein the software object identifies a specific workflow service on a specific workflow server.

17. The method of claim 11 , wherein the input to select the one of the one or more workflows is a selection of a plurality of workflows and wherein the sent information initiates the plurality of separate workflows on a plurality of different workflow servers on a computer network.

18. The method of claim 11 , wherein the metadata comprises a location of the image and a name of a person taking the image and wherein the determined one or more potential workflows is based on the location of the image and the name of a person taking the image.

19. The method of claim 11 , wherein the metadata comprises a speed of the communication device taking the image and wherein the determined one or more potential workflows is based on the speed of the communication device taking the image.

20. A communication device comprising:

a camera that takes an image;

a microprocessor; and

a computer readable medium, coupled with the microprocessor and comprising microprocessor readable and executable instructions that cause the microprocessor to:

capture metadata when the camera takes the image, wherein the metadata is associated with the image;

send the image and the metadata;

receive a list of potential workflows that have been determined based on one or more objects in the image, one or more characteristics of the one or more objects in the image, and/or the metadata; and

send a selected one of the potential workflows in the list potential workflows, wherein the sent selected one of the potential workflows initiates a selected workflow on a workflow server.

Assignments (15)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 4, 2024
From: AVAYA LLC
To: ARLINGTON TECHNOLOGIES, LLC
Reel/Frame 067022/0780 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: CITIBANK, N.A.
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0117 →
INTELLECTUAL PROPERTY RELEASE AND REASSIGNMENT Recorded Mar 25, 2024
From: WILMINGTON SAVINGS FUND SOCIETY, FSB
To: AVAYA LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 066894/0227 →
(SECURITY INTEREST) GRANTOR'S NAME CHANGE Recorded Sep 21, 2023
From: AVAYA INC.
To: AVAYA LLC
Reel/Frame 065019/0231 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 045034/0001) Recorded May 18, 2023
From: GOLDMAN SACHS BANK USA., AS COLLATERAL AGENT
To: AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC. (FORMER NAME OF AVAYA CLOUD INC.); HYPERQUALITY, INC.; HYPERQUALITY II, LLC; CAAS TECHNOLOGIES, LLC; AVAYA MANAGEMENT L.P.
Reel/Frame 063779/0622 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 53955/0436) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063705/0023 →
RELEASE OF SECURITY INTEREST IN PATENTS (REEL/FRAME 61087/0386) Recorded May 18, 2023
From: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS NOTES COLLATERAL AGENT
To: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063690/0359 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 4, 2023
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 063542/0662 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded May 3, 2023
From: AVAYA MANAGEMENT L.P.; AVAYA INC.; INTELLISIST, INC.; KNOAHSOFT INC.
To: WILMINGTON SAVINGS FUND SOCIETY, FSB [COLLATERAL AGENT]
Reel/Frame 063742/0001 →
RELEASE OF SECURITY INTEREST IN PATENTS AT REEL 45124/FRAME 0026 Recorded Apr 26, 2023
From: CITIBANK, N.A., AS COLLATERAL AGENT
To: AVAYA HOLDINGS CORP.; AVAYA INC.; AVAYA MANAGEMENT L.P.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
Reel/Frame 063457/0001 →
INTELLECTUAL PROPERTY SECURITY AGREEMENT Recorded Aug 5, 2022
From: AVAYA INC.; INTELLISIST, INC.; AVAYA MANAGEMENT L.P.; AVAYA CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS COLLATERAL AGENT
Reel/Frame 061087/0386 →
SECURITY INTEREST Recorded Sep 25, 2020
From: AVAYA INC.; AVAYA MANAGEMENT L.P.; INTELLISIST, INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC
To: WILMINGTON TRUST, NATIONAL ASSOCIATION
Reel/Frame 053955/0436 →
SECURITY INTEREST Recorded Jan 23, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: CITIBANK, N.A., AS COLLATERAL AGENT
Reel/Frame 045124/0026 →
SECURITY INTEREST Recorded Jan 10, 2018
From: AVAYA INC.; AVAYA INTEGRATED CABINET SOLUTIONS LLC; OCTEL COMMUNICATIONS LLC; VPNET TECHNOLOGIES, INC.; ZANG, INC.
To: GOLDMAN SACHS BANK USA, AS COLLATERAL AGENT
Reel/Frame 045034/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 23, 2017
From: CHAVEZ, DAVID; PHILONENKO, LAURENT
To: AVAYA INC.
Reel/Frame 042538/0652 →
Continuity (1)
Related Publication 20180341806A1 · Nov 29, 2018