IP Library Granted Patent US 10,564,991
Granted Patent B2
US 10,564,991 · App. 15/569,410 · Granted Feb 18, 2020

Content adapted multimedia guidance

Inventors: Dan Kotlicki (Tel-Aviv, IL); Ohad Rozen (Tel-Aviv, IL); Edi Buslovich (Natania, IL)
Assignee: Toonimo Inc.
G06F9/453G06F3/167G06F16/64G06F16/957G06F16/986G06F3/0485
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,564,991
App. No.
15/569,410
Granted
Feb 18, 2020
Kind
B2
Abstract

A method of creating content adapted multimedia guidance for a web document, comprising: analyzing location and type of dynamic components in a web document for the creation of a flow dataset, that maps at least one trigger node representing a user initiated trigger event and at least one action node linked to the trigger node and representing instruction to present guidance related to one of the dynamic components in response to the user initiated trigger event; identifying a loading event during which the web document is loaded on a client terminal of a user; extracting at least one generated value from the dynamic components; building an audio sequence associated with the action node by selecting audio segments according to the generated value and arranging the audio segments according to the flow dataset; and when the trigger is activated, playing the audio sequence on the client terminal.

Claims (40)

1. A method of creating content adapted multimedia guidance for a web document, comprising:

automatically creating a flow dataset of a web document by analyzing at least location and type of a plurality of dynamic components in said web document, said flow dataset maps at least one trigger node representing at least one user initiated trigger event and at least one action node which is linked to said at least one trigger node and representing instruction to present audio guidance related to at least one of said plurality of dynamic components in response to said at least one user initiated trigger event;

identifying a loading event during which said web document is loaded to be rendered by a browser running on a client terminal of a user;

extracting at least one value generated in said at least one dynamic components during said rendering of said web document;

automatically building an audio sequence comprising audio segments selected from a plurality of audio segments stored in a database according to said at least one generated value and arranging said audio segments of said audio sequence according to said location and type of said plurality of dynamic components, said audio sequence is associated with said at least one action node; and

playing said audio sequence on said client terminal by said browser to present said audio guidance to assist said user when said at least one user initiated trigger event linked to said at least one action node is activated.

2. The method of claim 1 , wherein said identifying of said loading is done by receiving an indication of said loading activated by a code line read by a browser rendering said web document.

3. The method of claim 1 , wherein said playing includes buffering said audio segments on a memory of said client terminal and playing said audio segments sequentially.

4. The method of claim 1 , wherein said flow dataset includes at least one root trigger node that initiates execution of at least one nodes linked to said at least one root trigger node.

5. The method of claim 4 , wherein when one of said at least one root trigger node is activated, actions linked from another of said at least one root trigger node are stopped.

6. The method of claim 1 , wherein said at least one trigger node is defined to be activated only once for each loading of said web-document.

7. The method of claim 1 , wherein said at least one trigger node includes at least one condition and said trigger is activated only when said condition is fulfilled.

8. The method of claim 7 , wherein said at least one condition includes one of variables extracted from data available on said web document and variables received from said client terminal, wherein said least one condition is fulfilled only for some values of said variables.

9. The method of claim 1 , wherein said at least one trigger node is activated when a specific one of said plurality of audio segments is played.

10. The method of claim 1 , wherein said at least one trigger node is activated by an action made by said user on said web document.

11. The method of claim 1 , wherein said plurality of audio segments includes recorded voices of different languages and said audio sequence is built from audio segments of one of said languages.

12. The method of claim 11 , wherein said one of said languages is determined according to geographic location of said user.

13. The method of claim 1 , wherein at least one of action node of said instruction to present guidance include one of: instruction to present a visual animation element on said web document relating to at least one of said plurality of dynamic components; automatically scroll said web document; instruction to simulate a user's click on said web document; instruction to load a different web document; instruction to present a user-interaction element on said web document; instruction to present a visual effect to indicate a location on said web document; instruction to and activate a document object model (DOM) effect on at least one of said plurality of dynamic components.

14. The method of claim 13 , wherein said presented visual animation element is synced to said played audio sequence such that movements in said presented visual animation occur simultaneously to specific audio segments of said played audio sequence.

15. The method of claim 13 , wherein said automatic scroll of said web document is initiated when one of said plurality of dynamic components is not currently visible to the user.

16. The method of claim 1 , wherein said playing includes presenting subtitles of a text corresponding to said audio sequence, said subtitles overlaid on said web document.

17. The method of claim 1 , wherein said playing includes presenting a sound player, said sound player allows said user to control progress of said audio sequence.

18. The method of claim 1 , wherein said audio sequence includes instructions for said user to perform an action on said web document.

19. A computer program product for creating content adapted multimedia guidance for a web document, comprising:

a non-transitory computer readable storage medium;

first program instructions to automatically create a flow dataset of a web document by analyzing at least location and type of a plurality of dynamic components in said web document, said flow dataset maps at least one trigger node representing at least one user initiated trigger event and at least one action node which is linked to said at least one trigger node and representing instruction to present audio guidance related to at least one of said plurality of dynamic components in response to said at least one user initiated trigger event;

second program instructions to identify a loading event during which said web document is loaded to be rendered by a browser running on a client terminal of a user;

third program instructions to extract at least one value generated in said at least one dynamic component during said rendering of said web document;

fourth program instructions to automatically build an audio sequence comprising audio segments selected from a plurality of audio segments stored in a database according to said at least one generated value and arranging said audio segments of said audio sequence according to said location and type of said plurality of dynamic components, said audio sequence is associated with said at least one action node; and

fifth program instructions to play said audio sequence on said client terminal by said browser to present said audio guidance to assist said user when said at least one user initiated trigger event linked to said at least one action node is activated;

wherein said first, second, third, fourth and fifth program instructions are executed by at least one processor from said non-transitory computer readable storage medium.

20. A system creating content adapted multimedia guidance for a web document, comprising:

a database for storing a plurality of audio segments;

a code store for storing a code;

a processor, connected to said database and said code store, adapted to implement said code;

wherein said code comprises:

code to automatically create a flow dataset of a web document by analyzing at least location and type of a plurality of dynamic components in said web document, said flow dataset maps at least one trigger node representing at least one user initiated trigger event and at least one action node which is linked to said at least one trigger node and representing instruction to present audio guidance related to at least one of said plurality of dynamic components in response to said at least one user initiated trigger event;

code to identify a loading event during which said web document is loaded to be rendered by a browser running on a client terminal of a user;

code to extract at least one value generated in said at least one dynamic components during said rendering of said web document;

code to automatically build an audio sequence comprising audio segments selected from said plurality of audio segments according to said at least one generated value and arranging said audio segments of said audio sequence according to said location and type of said plurality of dynamic components, said audio sequence is associated with said at least one action node; and code to play said audio sequence on said client terminal by said browser to present said audio guidance to assist said user when said at least one user initiated trigger event linked to said at least one action node is activated.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded Mar 22, 2020
From: COMERICA BANK
To: TOONIMO, INC.
Reel/Frame 052186/0322 →
RELEASE OF SECURITY INTEREST Recorded Mar 22, 2020
From: COMERICA BANK
To: TOONIMO, INC.
Reel/Frame 052186/0331 →
SECURITY INTEREST Recorded Jun 13, 2019
From: TOONIMO, INC.
To: COMERICA BANK
Reel/Frame 049463/0053 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 31, 2017
From: KOTLICKI, DAN; ROZEN, OHAD; BUSLOVICH, EDI
To: TOONIMO INC.
Reel/Frame 043989/0178 →
Continuity (2)
Provisional Application 62152984 · Apr 27, 2015
Related Publication 20180300162A1 · Oct 18, 2018
Cited By (2)
US 12,315,063 US 12,361,626