IP Library Granted Patent US 12,223,281
Granted Patent B2
US 12,223,281 · App. 18/387,701 · Granted Feb 11, 2025

Generating content using a generative model without relying on selected training examples

Inventors: Yair Adato (Kfar Ben Nun, IL); Efrat Taig (Beer Sheva, IL); Nimrod Sarid (Tel Aviv, IL); Ron Mokady (Ramat Hasaron, IL); Eyal Gutflaish (Beer Sheva, IL)
Assignee: BRIA ARTIFICIAL INTELLIGENCE LTD.
G06F40/30G06F40/279G06F40/40G06T7/194G06T7/70G06T11/001G06V10/764G06V10/774G10L15/063G10L15/18H04N5/272G06T2207/30196G10L2015/0631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,223,281
App. No.
18/387,701
Granted
Feb 11, 2025
Kind
B2
Abstract

Systems, methods and non-transitory computer readable media for generating content using a generative model without relying on selected training examples are provided. An input indicative of a desire to generate a new content using a generative model may be received. The generative model may be a result of training a machine learning model using a plurality of training examples. Each training example of the plurality of training examples may be associated with a respective content. Further, an indication of a particular subgroup of at least one but not all of the plurality of training examples may be obtained. Based on the indication, the input and the generative model may be used to generate the new content, abstaining from basing the generation of the new content on any training example included in the particular subgroup. The new content may be provided.

Claims (51)

1. A non-transitory computer readable medium storing a software program comprising data and computer implementable instructions that when executed by at least one processor cause the at least one processor to perform operations for generating content using a generative model, the operations comprising

receiving an input indicative of a desire to generate a new content using a generative model, the generative model is a result of training a machine learning model using all training examples of a plurality of training examples, each training example of the plurality of training examples is associated with a respective content, the generative model includes a plurality of artificial neurons;

obtaining an indication of a particular subgroup of at least one but not all of the plurality of training examples;

identifying a specific subgroup of the plurality of artificial neurons associated with the particular subgroup of at least one but not all of the plurality of training examples;

based on the indication, using the input and the generative model while disregarding the artificial neurons included in the specific subgroup to generate the new content, abstaining, after the training of the machine learning model is completed, from basing the generation of the new content on any training example included in the particular subgroup; and

providing the new content.

2. The non-transitory computer readable medium of claim 1 , wherein the new content is at least one of a visual content, an audio content or a textual content.

3. The non-transitory computer readable medium of claim 1 , wherein the particular subgroup is selected based on a geographical region.

4. The non-transitory computer readable medium of claim 1 , wherein the particular subgroup is selected based on a regulatory requirement.

5. The non-transitory computer readable medium of claim 1 , wherein the particular subgroup is selected based on a source associated with the contents associated with the particular subgroup.

6. The non-transitory computer readable medium of claim 1 , wherein the operations further comprise analyzing the input to select the particular subgroup.

7. The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

calculating a convolution of at least part of the content associated with a particular training example of the plurality of training examples to obtain a numerical result value; and

determining whether to include the particular training example in the particular subgroup based on the numerical result value.

8. The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

for each training example of the plurality of training examples, analyzing the respective content associated with the training example to identify a respective mathematical object corresponding to the respective training example in a mathematical space;

based on the identified mathematical objects, identifying a region in the mathematical space;

using the input to select a specific mathematical object in the mathematical space outside the identified region; and

using the specific mathematical object to generate the new content.

9. The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

using the input and the generative model to generate a plurality of alternative contents;

for each content of the plurality of alternative contents, determining a likelihood that the generation of the content is based on any training example included in the particular subgroup; and

selecting the new content of the plurality of alternative contents based on the determined likelihoods.

10. The non-transitory computer readable medium of claim 1 , wherein the operations further comprise:

using the input and the generative model to generate a preliminary content; and

based on the indication, analyzing the preliminary content to modify the preliminary content.

11. The non-transitory computer readable medium of claim 1 , wherein the generative model includes a plurality of weights, and the operations further comprise:

identifying a specific subgroup of the plurality of weights associated with the particular subgroup of at least one but not all of the plurality of training examples; and

abstaining from basing the generation of the new content on any one of the specific subgroup of the plurality of weights.

12. The non-transitory computer readable medium of claim 1 , wherein the generative model includes a memory unit that stores a plurality of patterns, and the operations further comprise:

identifying a specific subgroup of the plurality of patterns associated with the particular subgroup of at least one but not all of the plurality of training examples; and

abstaining from basing the generation of the new content on any one of the specific subgroup of the plurality of patterns.

13. The non-transitory computer readable medium of claim 1 , wherein the input includes a textual input indicative of the desire to generate the new content using the generative model.

14. The non-transitory computer readable medium of claim 13 , wherein the textual input includes a noun and an adjective adjacent to the noun, wherein for each training example of the particular subgroup, the respective content associated with the training example includes a respective object of a category of objects selected based on the noun wherein at least one aspect of the respective object matches the adjective.

15. The non-transitory computer readable medium of claim 13 , wherein the textual input includes a verb and an adverb adjacent to the verb, wherein for each training example of the particular subgroup, the respective content associated with the training example includes a respective event of a category of events selected based on the verb wherein at least one aspect of the respective event matches the adverb.

16. The non-transitory computer readable medium of claim 13 , wherein the textual input includes a preposition, wherein for each training example of the particular subgroup, the respective content associated with the training example includes a respective pair of objects wherein a spatial relation between the pair of objects in the respective content matches the preposition.

17. The non-transitory computer readable medium of claim 1 , wherein the input includes input image data.

18. The non-transitory computer readable medium of claim 1 , wherein each training example of the plurality of training examples includes a visual content, and the operations further comprise, and for each artificial neuron of the plurality of artificial neurons using the artificial neuron and properties of the visual contents associated with the plurality of training examples to attribute the artificial neuron to the particular subgroup, thereby determining whether to include the artificial neuron in the specific subgroup.

19. A system for generating content using a generative model without relying on selected training examples, the system comprising:

at least one processor configured to perform the operations of:

receiving an input indicative of a desire to generate a new content using a generative model, the generative model is a result of training a machine learning model using all training examples of a plurality of training examples, each training example of the plurality of training examples is associated with a respective content, the generative model includes a plurality of artificial neurons;

obtaining an indication of a particular subgroup of at least one but not all of the plurality of training examples;

identifying a specific subgroup of the plurality of artificial neurons associated with the particular subgroup of at least one but not all of the plurality of training examples;

based on the indication, using the input and the generative model while disregarding the artificial neurons included in the specific subgroup to generate the new content, abstaining, after the training of the machine learning model is completed, from basing the generation of the new content on any training example included in the particular subgroup; and

providing the new content.

20. A method for generating content using a generative model without relying on selected training examples, the method comprising:

receiving an input indicative of a desire to generate a new content using a generative model, the generative model is a result of training a machine learning model using all training examples of a plurality of training examples, each training example of the plurality of training examples is associated with a respective content, the generative model includes a plurality of artificial neurons;

obtaining an indication of a particular subgroup of at least one but not all of the plurality of training examples;

identifying a specific subgroup of the plurality of artificial neurons associated with the particular subgroup of at least one but not all of the plurality of training examples;

based on the indication, using the input and the generative model while disregarding the artificial neurons included in the specific subgroup to generate the new content, abstaining, after the training of the machine learning model is completed, from basing the generation of the new content on any training example included in the particular subgroup; and

providing the new content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2024
From: ADATO, YAIR; FEINSTEIN, MICHAEL; TAIG, EFRAT; YERUSHALMI, DVIR; LIBERMAN, ORI
To: BRIA ARTIFICIAL INTELLIGENCE LTD.
Reel/Frame 067265/0060 →
Continuity (4)
Continuation PCTIL2023051132 · Nov 5, 2023
Provisional Application 63525754 · Jul 10, 2023
Provisional Application 63444805 · Feb 10, 2023
Related Publication 20240273866A1 · Aug 15, 2024
References Cited (19)
US 9519461B2 · Gabel et al. · 2016 [cited by applicant]
US 10083009B2 · Gabel et al. · 2018 [cited by applicant]
US 10091140B2 · Galley et al. · 2018 [cited by applicant]
US 10282672B1 · Mishra et al. · 2019 [cited by applicant]
US 10825227B2 · Amer et al. · 2020 [cited by applicant]
US 11082487B1 · Jain et al. · 2021 [cited by applicant]
US 11551440B1 · Namballa et al. · 2023 [cited by applicant]
US 11947922B1 · Adato et al. · 2024 [cited by applicant]
US 20200265153A1 · Li et al. · 2020 [cited by applicant]
US 20210019541A1 · Wang et al. · 2021 [cited by applicant]
US 20210064825A1 · Sadamasa et al. · 2021 [cited by applicant]
US 20220269980A1 · Keren · 2022 [cited by examiner]
US 20220335203A1 · Van Dyke et al. · 2022 [cited by applicant]
US 20220405314A1 · Du et al. · 2022 [cited by applicant]
US 20230306504A1 · Liila et al. · 2023 [cited by applicant]
US 20230351807A1 · Ren et al. · 2023 [cited by applicant]
US 20230360364A1 · Wu et al. · 2023 [cited by applicant]
US 20230409298A1 · Ciminelli · 2023 [cited by examiner]
PCT Form PCT/ISA/206, “Invitation to Pay Additional Fees and, Where Applicable, Protest Fee” and Annex to Form PCT/ISA/206, “Communication Relating to the Results of the Partial International Search” for International A… [cited by applicant]