IP Library Granted Patent US 12,488,186
Granted Patent B2
US 12,488,186 · App. 18/387,596 · Granted Dec 2, 2025

Inference based on different portions of a training set using a single inference model

Inventors: Yair Adato (Kfar Ben Nun, IL); Michael Feinstein (Tel Aviv, IL); Efrat Taig (Beer Sheva, IL); Dvir Yerushalmi (Kfar Saba, IL); Ori Liberman (Netanya, IL)
Assignee: BRIA ARTIFICIAL INTELLIGENCE LTD.
G06F40/30G06F40/279G06F40/40G06T7/194G06T7/70G06T11/001G06V10/764G06V10/774G10L15/063G10L15/18H04N5/272G06T2207/30196G10L2015/0631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,488,186
App. No.
18/387,596
Granted
Dec 2, 2025
Kind
B2
Abstract

Systems, methods and non-transitory computer readable media for inference based on different portions of a training set using a single inference model are provided. Textual inputs may be received, each of which may include a source-identifying-keyword. An inference model may be a result of training a machine learning model using a plurality of training examples. Each training example may include a respective textual content and a respective media content. The training examples may be grouped based on source-identifying-keywords included in the textual contents. Different parameters of the inference model may be based on different groups, and thereby be associated with different source-identifying-keywords. When generating new media content using the inference model and a textual input, parameters associated with the source-identifying-keyword included in the textual input may be used.

Claims (46)

1 . A non-transitory computer readable medium storing a software program comprising data and computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for inference based on different portions of a training set using a single inference model, the operations comprising:

receiving a first textual input in a natural language, the first textual input includes a first source-identifying-keyword;

receiving a second textual input in the natural language, the second textual input includes a second source-identifying-keyword, the second source-identifying-keyword differs from the first source-identifying-keyword;

accessing an inference model, the inference model is a result of training a machine learning model using a plurality of training examples, each training example of the plurality of training examples includes a respective textual content in the natural language and a respective media content, the plurality of training examples includes a first group of at least two training examples associated with a first source and a second group of at least two training examples associated with a second source, the first group differs from the second group, the first source differs from the second source, each textual content of the textual contents associated with the first group includes the first source-identifying-keyword, each textual content of the textual contents associated with the second group includes the second source-identifying-keyword, a first parameter of the inference model is based on the first group, a second parameter of the inference model is based on the second group, the first parameter differs from the second parameter;

using the inference model and the first textual input to generate a first new media content, the first new media content is based on the first parameter of the inference model; and

using the inference model and the second textual input to generate a second new media content, the second new media content is based on the second parameter of the inference model.

2 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

in response to the first textual input including the first source-identifying-keyword, updating a first data-record associated with the first source; and

in response to the first textual input including the second source-identifying-keyword, updating a second data-record associated with the second source.

3 . The non-transitory computer readable medium of claim 1 , wherein the first new media content includes a first new visual content, the second new media content includes a second new visual content, and wherein for each training example of the plurality of training examples, the respective media content includes a respective visual content.

4 . The non-transitory computer readable medium of claim 1 , wherein the first new media content includes a first new audio content, the second new media content includes a second new audio content, and wherein for each training example of the plurality of training examples, the respective media content includes a respective audio content.

5 . The non-transitory computer readable medium of claim 1 , wherein the first group and the second group have no training example in common.

6 . The non-transitory computer readable medium of claim 1 , wherein a particular training example is associated with both the first source and the second source, wherein the textual content included in the particular training example includes both the first source-identifying-keyword and the second source-identifying-keyword, and wherein both the first group and the second group includes the particular training example.

7 . The non-transitory computer readable medium of claim 1 , wherein the first parameter of the inference model includes a first artificial neuron, and the second parameter of the inference model includes a second artificial neuron.

8 . The non-transitory computer readable medium of claim 1 , wherein the first parameter of the inference model includes a first coefficient, and the second parameter of the inference model includes a second coefficient.

9 . The non-transitory computer readable medium of claim 1 , wherein the first parameter of the inference model includes a first threshold, and the second parameter of the inference model includes a second threshold.

10 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective visual content depicting a person, the first new media content includes a depiction of the person with a characteristic of people depicted in media contents associated with the first group, and the second new media content includes a depiction of the person with a characteristic of people depicted in media contents associated with the second group.

11 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective visual content depicting an event, the first new media content includes a depiction of the event with a characteristic of events depicted in media contents associated with the first group, and the second new media content includes a depiction of the event with a characteristic of events depicted in media contents associated with the second group.

12 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective visual content depicting two objects, the first new media content includes a depiction of the two objects positioned at a spatial relation characteristic to media contents associated with the first group, and the second new media content includes a depiction of the two objects positioned at a spatial relation characteristic to media contents associated with the second group.

13 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective visual content depicting two events, the first new media content includes a depiction of the two events in a temporal relation characteristic to media contents associated with the first group, and the second new media content includes a depiction of the two events in a temporal relation characteristic to media contents associated with the second group.

14 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective audio content including a vocalization of a speaker, the first new media content includes the vocalization of the speaker with a characteristic of vocalizations in media contents associated with the first group, and the second new media content includes the vocalization of the speaker with a characteristic of vocalizations in media contents associated with the second group.

15 . The non-transitory computer readable medium of claim 1 , wherein each one of the first textual input and the second textual input is indicative of a respective desire of an individual to generate a respective textual content including a description, the first new media content includes the description in a language register characteristic to media contents associated with the first group, and the second new media content includes the description in a language register characteristic to media contents associated with the second group.

16 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

receiving a third textual input, the third textual input does not include the first source-identifying-keyword or the second source-identifying-keyword;

using the inference model and the third textual input to generate a third new media content, the third new media content is based on both the first parameter and the second parameter of the inference model.

17 . The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

receiving a third textual input, the third textual input does not include the first source-identifying-keyword or the second source-identifying-keyword;

using the inference model and the third textual input to generate a third new media content, the third new media content is based on neither the first parameter nor the second parameter of the inference model.

18 . The non-transitory computer readable medium of claim 1 , wherein

the first group is associated with a first region of a mathematical space;

the second group is associated with a second region of the mathematical space;

the using the inference model and the first textual input to generate the first new media content includes using the inference model to identify a first mathematical object in the first region of the mathematical space corresponding to the first textual input, and using the identified first mathematical object to generate the first new media content; and

the using the inference model and the second textual input to generate the second new media content includes using the inference model to identify a second mathematical object in the second region of the mathematical space corresponding to the second textual input, and using the identified second mathematical object to generate the second new media content.

19 . A method for inference based on different portions of a training set using a single inference model, the method comprising:

receiving a first textual input in a natural language, the first textual input includes a first source-identifying-keyword;

receiving a second textual input in the natural language, the second textual input includes a second source-identifying-keyword, the second source-identifying-keyword differs from the first source-identifying-keyword;

accessing an inference model, the inference model is a result of training a machine learning model using a plurality of training examples, each training example of the plurality of training examples includes a respective textual content in the natural language and a respective media content, the plurality of training examples includes a first group of at least two training examples associated with a first source and a second group of at least two training examples associated with a second source, the first group differs from the second group, the first source differs from the second source, each textual content of the textual contents associated with the first group includes the first source-identifying-keyword, each textual content of the textual contents associated with the second group includes the second source-identifying-keyword, a first parameter of the inference model is based on the first group, a second parameter of the inference model is based on the second group, the first parameter differs from the second parameter;

using the inference model and the first textual input to generate a first new media content, the first new media content is based on the first parameter of the inference model; and

using the inference model and the second textual input to generate a second new media content, the second new media content is based on the second parameter of the inference model.

20 . A system for inference based on different portions of a training set using a single inference model, the system comprising:

at least one processor configured to perform the operations of:

receiving a first textual input in a natural language, the first textual input includes a first source-identifying-keyword;

receiving a second textual input in the natural language, the second textual input includes a second source-identifying-keyword, the second source-identifying-keyword differs from the first source-identifying-keyword;

accessing an inference model, the inference model is a result of training a machine learning model using a plurality of training examples, each training example of the plurality of training examples includes a respective textual content in the natural language and a respective media content, the plurality of training examples includes a first group of at least two training examples associated with a first source and a second group of at least two training examples associated with a second source, the first group differs from the second group, the first source differs from the second source, each textual content of the textual contents associated with the first group includes the first source-identifying-keyword, each textual content of the textual contents associated with the second group includes the second source-identifying-keyword, a first parameter of the inference model is based on the first group, a second parameter of the inference model is based on the second group, the first parameter differs from the second parameter;

using the inference model and the first textual input to generate a first new media content, the first new media content is based on the first parameter of the inference model; and

using the inference model and the second textual input to generate a second new media content, the second new media content is based on the second parameter of the inference model.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2024
From: ADATO, YAIR; FEINSTEIN, MICHAEL; TAIG, EFRAT; YERUSHALMI, DVIR; LIBERMAN, ORI
To: BRIA ARTIFICIAL INTELLIGENCE LTD.
Reel/Frame 067265/0060 →
Continuity (4)
Continuation PCTIL2023051132 · Nov 5, 2023
Provisional Application 63525754 · Jul 10, 2023
Provisional Application 63444805 · Feb 10, 2023
Related Publication 20240273307A1 · Aug 15, 2024
References Cited (54)
US 6094649A · Bowen · 2000 [cited by examiner]
US 9519461B2 · Gabel et al. · 2016 [cited by applicant]
US 9589013B2 · Pascal · 2017 [cited by examiner]
US 10083009B2 · Gabel et al. · 2018 [cited by applicant]
US 10091140B2 · Galley et al. · 2018 [cited by applicant]
US 10282672B1 · Mishra et al. · 2019 [cited by applicant]
US 10825227B2 · Amer et al. · 2020 [cited by applicant]
US 10885903B1 · Siddall · 2021 [cited by examiner]
US 10987596B2 · Evans · 2021 [cited by examiner]
US 11081104B1 · Su · 2021 [cited by examiner]
US 11082487B1 · Jain et al. · 2021 [cited by applicant]
US 11551440B1 · Namballa et al. · 2023 [cited by applicant]
US 11880917B2 · Adato et al. · 2024 [cited by applicant]
US 11881958B2 · Rey et al. · 2024 [cited by applicant]
US 11900052B2 · Li et al. · 2024 [cited by applicant]
US 11922317B2 · Takehara · 2024 [cited by applicant]
US 11934792B1 · Adato et al. · 2024 [cited by applicant]
US 11947922B1 · Adato et al. · 2024 [cited by applicant]
US 12073605B1 · Adato et al. · 2024 [cited by applicant]
US 12080277B1 · Adato et al. · 2024 [cited by applicant]
US 20130195361A1 · Deng et al. · 2013 [cited by applicant]
US 20170154273A1 · Guttmann · 2017 [cited by examiner]
US 20170161292A1 · Sever · 2017 [cited by examiner]
US 20180220108A1 · Siminoff · 2018 [cited by examiner]
US 20190080205A1 · Kaufhold et al. · 2019 [cited by applicant]
US 20190294999A1 · Guttmann · 2019 [cited by examiner]
US 20200066025A1 · Peebler et al. · 2020 [cited by applicant]
US 20200137535A1 · Hoffner · 2020 [cited by examiner]
US 20200265153A1 · Li et al. · 2020 [cited by applicant]
US 20200356591A1 · Yada et al. · 2020 [cited by applicant]
US 20210019541A1 · Wang et al. · 2021 [cited by applicant]
US 20210064825A1 · Sadamasa et al. · 2021 [cited by applicant]
US 20210224319A1 · Ingel · 2021 [cited by examiner]
US 20210350604A1 · Pejsa et al. · 2021 [cited by applicant]
US 20220130078A1 · Maheshwari · 2022 [cited by examiner]
US 20220269980A1 · Keren et al. · 2022 [cited by applicant]
US 20220335203A1 · Van Dyke et al. · 2022 [cited by applicant]
US 20220405314A1 · Du et al. · 2022 [cited by applicant]
US 20230052442A1 · Zass · 2023 [cited by examiner]
US 20230138780A1 · Manamohan et al. · 2023 [cited by applicant]
US 20230306504A1 · Liila et al. · 2023 [cited by applicant]
US 20230351807A1 · Ren et al. · 2023 [cited by applicant]
US 20230360364A1 · Wu et al. · 2023 [cited by applicant]
US 20230409298A1 · Ciminelli et al. · 2023 [cited by applicant]
US 20240104697A1 · Adato et al. · 2024 [cited by applicant]
CN 111414736A · 2020 [cited by applicant]
JP 2011511489A · 2011 [cited by examiner]
JP 7063348B2 · 2022 [cited by examiner]
PCT International Search Report for International Application No. PCT/IL2022/051189, mailed Feb. 9, 2023, 5pp. [cited by applicant]
PCT Written Opinion for International Application No. PCT/IL2022/051189, mailed Feb. 9, 2023, 7pp. [cited by applicant]
PCT International Search Report for International Application No. PCT/IL2023/051132, mailed Mar. 31, 2024, 5pp. [cited by applicant]
PCT Written Opinion for International Application No. PCT/IL2023/051132, mailed Mar. 31, 2024, 5pp. [cited by applicant]
Pang B. Lee L. Opinion mining and sentiment ana lysis. Foundations and Trends® in information retrieva l. Jul. 6, 2008;2(1-2): 1-35. <http://www.cs.cornell.edu/home/llee/omsa/omsa-published.pdf> (Jul. 6, 2008), 94pp. [cited by applicant]
Tzeng E. Hoffman J. Darrell T. Saenko K. Simultaneous deep transfer a cross domains and tasks. InProceedings of the IEEE international conference on computer vision 2015 (pp. 4068-4076). <https:/ /openaccess.thecvf.com/… [cited by applicant]