IP Library › Granted Patent US 12,190,417
Granted Patent B2
US 12,190,417 · App. 17/519,525 · Granted Jan 7, 2025

Generating and orchestrating motion of visual contents in an interactive interface to guide user attention

Inventors: Yair Adato (Kfar Ben Nun, IL); Gal Jacobi (Hudson, NY); Ori Feldstein (Tel Aviv, IL); Eyal Gutflaish (Tel Aviv, IL)
Assignee: BRIA ARTIFICIAL INTELLIGENCE LTD.
G06T11/40G06F3/013G06F3/0482G06F16/739G06F16/743G06F16/7837G06F16/784G06F40/166G06N3/045G06Q30/0203G06T11/00G06T11/60G06V20/00G06V20/41G06V20/49G06V40/20G11B27/031G11B27/034G11B27/34G06V20/44
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,190,417
App. No.
17/519,525
Granted
Jan 7, 2025
Kind
B2
Abstract

Systems, methods and non-transitory computer readable media for generating and orchestrating motion of visual contents are provided. A plurality of visual contents may be accessed. Data indicative of a layout of the plurality of visual contents in a user interface may be accessed. A sequence for the plurality of visual contents may be determined based on the layout. For each visual content of the plurality of visual contents, the visual content may be analyzed to generate a video clip including a motion of at least one object depicted in the visual content. A presentation of the plurality of visual contents in the user interface may be caused. The determined sequence for the plurality of visual contents may be used to orchestrate a series of playbacks of the generated video clips.

Claims (43)

1. A non-transitory computer readable medium storing a software program comprising data and computer implementable instructions that when executed by at least one processor causes the at least one processor to carry out a method for generating and orchestrating motion of visual contents, the method comprising

accessing a plurality of visual contents;

accessing data indicative of a layout of the plurality of visual contents in a user interface, including positions of the plurality of visual contents in the user interface;

analyzing the plurality of visual contents to detect objects;

determining a sequence for the plurality of visual contents based on distances between visual contents in the layout and on numbers of objects shared between visual contents,

for each visual content of the plurality of visual contents, analyzing the visual content to generate a video clip including a motion of at least one object depicted in the visual content;

causing a presentation of the plurality of visual contents in the user interface; and

using the sequence for the plurality of visual contents determined based on the distances between visual contents in the layout and on the numbers of objects shared between visual contents to orchestrate a series of playbacks of the generated video clips, wherein the playback of each video clip is placed in the user interface based on the position of the visual content corresponding to the video clip in the user interface.

2. The non-transitory computer readable medium of claim 1 , wherein the playback of each video clip is placed in the user interface based on a position of the visual content corresponding to the video clip in the user interface.

3. The non-transitory computer readable medium of claim 1 , wherein the determined sequence for the plurality of visual contents is configured to guide a user attention through the user interface.

4. The non-transitory computer readable medium of claim 1 , wherein the playback of a first video clip of the generated video clips is configured to start after a completion of the playback of a second video clip of the generated video clips.

5. The non-transitory computer readable medium of claim 1 , wherein the playback of a first video clip of the generated video clips is configured to start while the playback of a second video clip of the generated video clips occurs.

6. The non-transitory computer readable medium of claim 1 , wherein each visual content of the plurality of visual contents includes at least a depiction of a product.

7. The non-transitory computer readable medium of claim 6 , wherein each generated video clip includes a motion of the product depicted in the corresponding visual content.

8. The non-transitory computer readable medium of claim 6 , wherein the determination of the sequence for the plurality of visual contents is further based on prices corresponding to the products depicted in the visual contents.

9. The non-transitory computer readable medium of claim 6 , wherein the determination of the sequence for the plurality of visual contents is further based on historic sales data corresponding to the products depicted in the visual contents.

10. The non-transitory computer readable medium of claim 6 , wherein the method further comprises using information related to a product depicted in a visual content to determine a length for the generated video clip corresponding to the visual content.

11. The non-transitory computer readable medium of claim 1 , wherein the determination of the sequence for the plurality of visual contents is further based on an analysis of the plurality of visual contents.

12. The non-transitory computer readable medium of claim 1 , wherein the determination of the sequence for the plurality of visual contents is further based on a prospective viewer.

13. The non-transitory computer readable medium of claim 1 , wherein the determination of the sequence for the plurality of visual contents is further based on dimensions associated with the visual contents.

14. The non-transitory computer readable medium of claim 1 , wherein the method further comprises:

analyzing each visual content of the plurality of visual contents to determine a mathematical object corresponding to the visual content in a mathematical space; and

further basing the determination of the sequence for the plurality of visual contents on the mathematical objects corresponding to the plurality of visual contents.

15. The non-transitory computer readable medium of claim 14 , wherein the mathematical space is a non-orientable space.

16. The non-transitory computer readable medium of claim 1 , wherein the method further comprises using the layout to determine a duration for each generated video clip.

17. The non-transitory computer readable medium of claim 1 , wherein the method further comprises using the layout to determine a direction of motion corresponding to each generated video clip.

18. The non-transitory computer readable medium of claim 1 , wherein a first generated video clip includes a person looking to a direction of a particular visual content based on the layout while refereeing to the particular visual content.

19. A system for generating and orchestrating motion of visual contents, the system includes at least one processor configured to perform the steps of:

accessing a plurality of visual contents;

accessing data indicative of a layout of the plurality of visual contents in a user interface, including positions of the plurality of visual contents in the user interface;

analyzing the plurality of visual contents to detect objects;

determining a sequence for the plurality of visual contents based on distances between visual contents in the layout and on numbers of objects shared between visual contents;

for each visual content of the plurality of visual contents, analyzing the visual content to generate a video clip including a motion of at least one object depicted in the visual content;

causing a presentation of the plurality of visual contents in the user interface; and

using the sequence for the plurality of visual contents determined based on the distances between visual contents in the layout and on the numbers of objects shared between visual contents to orchestrate a series of playbacks of the generated video clips, wherein the playback of each video clip is placed in the user interface based on the position of the visual content corresponding to the video clip in the user interface.

20. A method for generating and orchestrating motion of visual contents, the method comprising:

accessing a plurality of visual contents;

accessing data indicative of a layout of the plurality of visual contents in a user interface, including positions of the plurality of visual contents in the user interface;

analyzing the plurality of visual contents to detect objects;

determining a sequence for the plurality of visual contents based on distances between visual contents in the layout and on numbers of objects shared between visual contents;

for each visual content of the plurality of visual contents, analyzing the visual content to generate a video clip including a motion of at least one object depicted in the visual content;

causing a presentation of the plurality of visual contents in the user interface; and

using the sequence for the plurality of visual contents determined based on the distances between visual contents in the layout and on the numbers of objects shared between visual contents to orchestrate a series of playbacks of the generated video clips, wherein the playback of each video clip is placed in the user interface based on the position of the visual content corresponding to the video clip in the user interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 30, 2022
From: ADATO, YAIR; JACOBI, GAL; FELDSTEIN, ORI; GUTFLAISH, EYAL
To: BRIA ARTIFICIAL INTELLIGENCE LTD.
Reel/Frame 060361/0302 →
Continuity (4)
Continuation PCTUS2021057987 · Nov 4, 2021
Provisional Application 63189830 · May 18, 2021
Provisional Application 63114540 · Nov 17, 2020
Related Publication 20220157341A1 · May 19, 2022
References Cited (17)
US 7200266B2 · Ozer · 2007 [cited by examiner]
US 8769559B2 · Moon · 2014 [cited by examiner]
US 20080163071A1 · Abbott · 2008 [cited by examiner]
US 20110078623A1 · Liu · 2011 [cited by examiner]
US 20140195345A1 · Lyren · 2014 [cited by examiner]
US 20180137632A1 · Takada · 2018 [cited by examiner]
US 20180295408A1 · Wu · 2018 [cited by examiner]
US 20190205938A1 · Van Winkle · 2019 [cited by examiner]
US 20190325626A1 · Tao · 2019 [cited by applicant]
US 20200005046A1 · Attorre · 2020 [cited by examiner]
US 20200043145A1 · Cao · 2020 [cited by examiner]
US 20200228880A1 · Iyer · 2020 [cited by examiner]
US 20210073264A1 · Vaughn · 2021 [cited by examiner]
US 20220108727A1 · van Welzen · 2022 [cited by examiner]
Love et al, “Topological Convolutional Neural Networks”, published: Oct. 2020, publisher: TDA and Beyond, pp. 1-9 (Year: 2020). [cited by examiner]
PCT International Search Report for International Application No. PCT/US2021/057987, mailed Mar. 2, 2022, 5pp. [cited by applicant]
PCT Written Opinion for International Application No. PCT/US2021/057987, mailed Mar. 2, 2022, 8pp. [cited by applicant]