IP Library Granted Patent US 11,461,559
Granted Patent B2
US 11,461,559 · App. 16/774,341 · Granted Oct 4, 2022

Mechanism to facilitate image translation

Inventor: Amit Gupta (Serilingampally Kv Rangareddy, IN)
Assignee: salesforce.com, inc.
G06F40/47G06F40/58G06N20/00G06T7/136G06V30/246G06V30/2445
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,461,559
App. No.
16/774,341
Granted
Oct 4, 2022
Kind
B2
Abstract

Techniques and structures to facilitate conversion of a workflow process is disclosed. The techniques include receiving an image, identifying one or more objects included in the image, identifying one or more properties associated with each of the one or more objects, generating a matrix including data including the identified objects and associated properties and processing the matrix at a machine learning model to determine whether the image is to be translated based on a determination that one or more objects and associated properties within the image are required to be translated.

Claims (68)

1. A method, comprising:

generating or updating, by a computing system including a processor, a set of weights of a machine learning model using a set of data, the set of weights corresponding to a set of properties;

obtaining, by the computing system, an image;

performing, by the computing system, object detection such that one or more objects in the image are detected;

identifying, by the computing system for at least one of the objects, a set of property values corresponding to the set of properties;

generating, by the computing system, a matrix having data including, for at least one of the objects, the corresponding set of property values; and

determining, by the computing system, by applying the machine learning model to the matrix, whether the image is to be translated, wherein determining whether the image is to be translated includes:

applying, for at least one of the objects, at least a first weight of the set of weights to at least a first value of the set of property values of the object such that an output value is generated, the first value and first weight corresponding to a first property of the set of properties; and

determining whether the image is to be translated based, at least in part, on the output value.

2. The method of claim 1 , further comprising:

determining, based on one or more weights of the set of weights, at least one object in the image that requires translation.

3. The method of claim 1 , further comprising:

determining whether the result is greater than a threshold value.

4. The method of claim 1 , at least one of the objects including image that does not include text.

5. The method of claim 1 , further comprising:

training the machine learning model using a set of data corresponding to one or more countries or geographic regions.

6. The method of claim 1 , further comprising training the machine learning model.

7. The method of claim 1 , further comprising:

obtaining training images;

identifying one or more objects included in the training images;

identifying one or more property values of one or more properties associated with each of the one or more objects in the training images;

generating a training data set including the identified property values; and

training the machine learning model using the training data set.

8. The method of claim 1 , further comprising:

obtaining training images;

identifying one or more objects included in the training images;

identifying one or more property values of one or more properties associated with each of the one or more objects in the training images;

generating a training data set including the identified property values;

wherein generating or updating the set of weights includes generating the set of weights corresponding to the set of properties using the training data set.

9. The method of claim 7 , wherein the training data set is associated with one or more languages.

10. The method of claim 2 , further comprising:

generating a list of properties associated with the at least one object that requires translation.

11. The method of claim 1 , wherein an object requires translation upon a determination that a value generated for the object using at least a portion of the set of weights is greater than a threshold value.

12. A non-transitory computer-readable medium having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

generate or update a set of weights of a machine learning model using a set of data, the set of weights corresponding to a set of properties;

obtain an image;

perform object detection such that one or more objects in the image are detected;

identify, for at least one of the objects, a set of property values corresponding to the set of properties;

generate a matrix having data including, for at least one of the objects, the corresponding set of property values; and

determine, by applying the machine learning model to the matrix, whether the image is to be translated, wherein determining whether the image is to be translated includes:

applying, for at least one of the objects, at least a first weight of the set of weights to at least a first value of the set of property values of the object such that an output value is generated, the first value and first weight corresponding to a first property of the set of properties; and

determining whether the image is to be translated based, at least in part, on the output value.

13. The non-transitory computer-readable medium of claim 12 , further comprising instructions that, when executed, cause the one or more processors to:

determine, based on one or more weights of the set of weights, at least one object in the image that requires translation.

14. The non-transitory computer-readable medium of claim 12 , having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to train the machine learning model.

15. The non-transitory computer-readable medium of claim 12 , having stored thereon instructions that, when executed by one or more processors, cause the one or more processors to:

identify one or more objects included in the training images;

identify one or more property values of one or more properties associated with each of the one or more objects in the training images;

generate a training data set including the identified property values; and

train the machine learning model using the training data set.

16. The non-transitory computer-readable medium of claim 13 , further comprising instructions configurable to cause the one or more processors to:

generate a list of properties associated with the at least one object that requires translation.

17. A system, comprising:

at least one physical memory device; and

one or more processors, the one or more processors cause:

generating or updating a set of weights of a machine learning model using a set of data, the set of weights corresponding to a set of properties;

obtaining an image;

performing object detection such that one or more objects in the image are detected;

identifying, for at least one of the objects, a set of property values corresponding to the set of properties;

generating a matrix having data including, for at least one of the objects, the corresponding set of property values; and

determining, by applying the machine learning model to the matrix, whether the image is to be translated, wherein determining whether the image is to be translated includes:

applying, for at least one of the objects, at least a first weight of the set of weights to at least a first value of the set of property values of the object such that an output value is generated, the first value and first weight corresponding to a first property of the set of properties; and

determining whether the image is to be translated based, at least in part, on the output value.

18. The system of claim 17 , wherein processing the image at the machine learning model further comprises:

determining, using the set of weights, at least one object in the image that requires translation.

19. The system of claim 17 , wherein an object requires translation upon a determination that a value generated for the object using at least a portion of the set of weights is greater than a threshold value.

20. The system of claim 17 , wherein processing the image at the machine learning model further comprises:

generating a list of properties associated with the at least one object that requires translation.

Assignments (2)
CHANGE OF NAME Recorded Jan 27, 2025
From: SALESFORCE.COM, INC.
To: SALESFORCE, INC.
Reel/Frame 070016/0566 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2020
From: GUPTA, AMIT
To: SALESFORCE.COM
Reel/Frame 052287/0102 →
Continuity (1)
Related Publication 20210232774A1 · Jul 29, 2021