IP Library Granted Patent US 11,172,006
Granted Patent B1
US 11,172,006 · App. 17/337,604 · Granted Nov 9, 2021

Customizable remote interactive platform

Inventors: Amir Ashkenazi (Los Altos, CA); Chris Jones (San Bruno, CA); George Babu (Toronto, CA)
Assignee: Monarch Visual Technologies, Inc.
H04L65/601H04L65/4015H04L65/4046
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,172,006
App. No.
17/337,604
Granted
Nov 9, 2021
Kind
B1
Abstract

Systems and methods for providing a remote interactive experience via a digital platform are provided. Methods may include receiving instructions from a host device to configure a canvas. A canvas may include a graphical representation with customizable content and layout. The instructions may include content instructions and layout instructions. Content instructions may include a selection of one or more interaction apps, from a set of interaction apps, for inclusion in the canvas. Methods may include displaying the canvas on a display screen of one or more participant devices.

Claims (97)

1. A method for providing a remote interactive experience via a digital platform, said method executed by computer executable code stored in a non-transitory medium and run on a processor, said method comprising:

receiving, at a central server via a network interface, instructions from a host device to configure a canvas, wherein:

the canvas comprises a graphical representation with customizable content and layout;

the instructions comprise content instructions and layout instructions;

the content instructions comprise a selection of one or more interaction apps, from a set of interaction apps, for inclusion in the canvas; and

the layout instructions comprise a selection of a sizing and positioning of the one or more interaction apps;

causing, via the network interface, a display screen of one or more participant devices to display the canvas as part of an interactive session;

receiving, at the central server via the network interface, a request from one of the participant devices to modify an aspect of the canvas; and

causing, via the network interface, the canvas displayed on the one of the participant devices to update based on the request.

2. The method of claim 1 further comprising, when one of the interaction apps included in the canvas comprises playback of a web-based media:

computing, for each of the one or more participant devices, an optimized path to directly access the media over the web; and

playing the media on each of the one or more participant devices via the optimized path.

3. The method of claim 1 further comprising:

gathering session data, said session data comprising data relating to:

displaying the canvas; and

activity performed via the host device and the one or more participant devices in interaction with the canvas; and

compartmentalizing the session data into separate identifiable categories.

4. The method of claim 3 further comprising, based on the compartmentalization of the session into separate identifiable categories:

automatically generating, for each of the one or more participant devices and the host device, a separate indexed session summary, wherein said indexed session summary provides a navigable recording of the session that is personalized based on a unique session experience of each device.

5. The method of claim 3 wherein:

the identifiable categories comprise audio streams, video streams, and canvas changes, said canvas changes comprising displaying new canvases and canvas modifications; and

the identifiable categories are further compartmentalized based on source, said source being the host device or one of the participant devices.

6. The method of claim 1 further comprising:

recording a portion of the interactive session;

receiving annotation instructions from a device, said device being the host device or one of the participant devices, to annotate the recorded portion of the interactive session; and

saving the annotated portion for playback in real-time during the interactive session and/or after the session.

7. The method of claim 6 wherein the recorded portion is a time-based or content-based portion of the session.

8. The method of claim 1 wherein the canvas is a first canvas, and the method further comprises:

receiving further instructions from the host device to configure a second canvas; and

displaying the second canvas on the display screen of the one or more participant devices in a sequence as part of the interactive session;

wherein the sequence is based, at least in part, on the further instructions.

9. The method of claim 1 further comprising receiving utilization information from at least one of the one or more participant devices, said utilization information comprising information derived from a participant interacting with at least one of the one or more interaction apps.

10. The method of claim 9 wherein the participant interaction comprises a video feed generated via a camera of the at least one of the one or more participant devices.

11. The method of claim 1 further comprising:

receiving a request from the host device to increase a focus on a first participant device from the one or more participant devices; and

in response to the request, initiating a separate data stream between the host device and the first participant device, said data stream comprising audio-based communication, video-based communication, and/or text-based communication.

12. The method of claim 11 wherein:

the audio-based communication, video-based communication, and/or text-based communication is displayed on a window in the canvas displayed on the host device and also on a window displayed in the canvas of the first participant device; and

the windows are partitioned to a side of the canvases displayed on the host device and displayed on the first participant device, said partitioning enabling display of a general session on the canvases in parallel with the audio-based communication, video-based communication, and/or text-based communication.

13. The method of claim 1 further comprising:

analyzing, via an artificial-intelligence (AI) element of the platform, a response of one or more of the participant devices to the canvas; and

generating, based on the analyzing, performance metrics for the one or more of the participant devices.

14. The method of claim 13 wherein:

the response comprises an audio and/or video clip of a participant practicing a skill;

the AI element is trained to score a performance of the skill, and the performance metrics generated are scores of the audio and/or video clip; and

the skill is playing music, speaking a language, or solving mathematical problems.

15. The method of claim 1 further comprising:

generating performance metrics for each participant device based on a response of the participant device to the canvas; and

presenting the performance metrics on a dashboard displayed on the host device; wherein the dashboard is customizable by the host device, said customization including a selection of performance metrics to display on the dashboard, and/or a selection of participant devices for which to include for presentation in the dashboard.

16. A digital platform for providing a remote interactive experience, said platform comprising:

a central server, said central server comprising:

a processor;

a non-transitory memory storing computer executable code; and

a network interface;

wherein:

the central server is connected, via the network interface, to a host device and to a group of one or more participant devices; and

the platform is configured to:

receive instructions from the host device to configure a canvas, wherein:

the canvas comprises a graphical representation with customizable content and layout;

the instructions comprise content instructions and layout instructions;

the content instructions comprise a selection of one or more interaction apps, from a set of interaction apps, for inclusion in the canvas; and

the layout instructions comprise a selection of a sizing and positioning of the one or more interaction apps;

cause a display screen of one or more devices from the group of participant devices to display the canvas as part of an interactive session;

receive a request from one of the participant devices to modify an aspect of the canvas; and

cause the canvas displayed on the one of the participant devices to update based on the request.

17. The platform of claim 16 wherein, when one of the interaction apps included in the canvas comprises playback of a web-based media, the platform is further configured to:

compute, for each of the one or more participant devices, an optimized path to directly access the media over the web; and

play the media on each of the one or more participant devices via the optimized path.

18. The platform of claim 16 wherein the platform is further configured to:

gather session data, said session data comprising data relating to:

displaying the canvas; and

activity performed via the host device and the one or more participant devices in interaction with the canvas; and

compartmentalize the session data into separate identifiable categories.

19. The platform of claim 18 wherein, based on the compartmentalization of the session into separate identifiable categories, the platform is further configured to:

automatically generate, for each of the one or more participant devices and the host device, a separate indexed session summary, wherein said indexed session summary provides a navigable recording of the session that is personalized based on a unique session experience of each device.

20. The platform of claim 18 wherein:

the identifiable categories comprise audio streams, video streams, and canvas changes, said canvas changes comprising displaying new canvases and canvas modifications; and

the identifiable categories are further compartmentalized based on source, said source being the host device or one of the participant devices.

21. The platform of claim 16 wherein the platform is further configured to:

record a portion of the interactive session;

receive annotation instructions from a device, said device being the host device or one of the participant devices, to annotate the recorded portion of the interactive session; and

save the annotated portion for playback in real-time during the interactive session and/or after the session.

22. The platform of claim 16 wherein the platform is further configured to receive utilization information from at least one of the one or more participant devices, said utilization information comprising information derived from a participant interacting with at least one of the one or more interaction apps.

23. A method for providing a remote interactive experience via a digital platform, said method executed by computer executable code stored in a non-transitory memory and run on a processor, said method comprising:

receiving instructions from a host device to configure a virtual room, said virtual room that is configured to be accessible to one or more participant devices;

receiving, from a first participant device, a request to access the virtual room; and

in response to the request, rendering a canvas on a screen of the first participant device, said canvas comprising a graphical representation with a content and a layout;

wherein:

the content and/or layout of the canvas is customizable, and is configured at least in part based on the instructions of the host device;

the instructions comprise a selection of one or more interaction apps, from a set of interaction apps, for inclusion in the canvas;

the one or more participant devices are associated with a level of access, said level of access which comprises a set of rules that define, for each of the one or more participant devices:

which interaction apps are included in the canvas;

which interaction apps the participant device is permissioned to activate; and/or

a level of permission of the participant device to modify an interaction app; and

the level of access is based at least in part on the instructions.

24. The method of claim 23 further comprising receiving instructions from the host device to configure a plurality of virtual rooms.

25. The method of claim 23 wherein the configuration of the virtual room persists for a future session after a current session terminates.

Assignments (5)
CHANGE OF NAME Recorded Mar 3, 2022
From: MONARCH VISUAL TECHNOLOGIES, INC.
To: SWITCHBOARD VISUAL TECHNOLOGIES, INC.
Reel/Frame 059311/0901 →
CORRECTIVE ASSIGNMENT TO CORRECT THE THE TERM PROVISIONAL IN THE BODY OF THE ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 056515 FRAME: 0615. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Feb 16, 2022
From: SWEAT EQUITY PARTNERS, LLC
To: MONARCH VISUAL TECHNOLOGIES, INC.
Reel/Frame 059125/0935 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 8, 2021
From: SWEAT EQUITY PARTNERS, LLC
To: MONARCH VISUAL TECHNOLOGIES, INC.
Reel/Frame 056515/0615 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: ASHKENAZI, AMIR
To: MONARCH VISUAL TECHNOLOGIES, INC.
Reel/Frame 056426/0641 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 3, 2021
From: JONES, CHRIS; BABU, GEORGE
To: SWEAT EQUITY PARTNERS, LLC
Reel/Frame 056426/0704 →
Continuity (2)
Provisional Application 63128321 · Dec 21, 2020
Provisional Application 63043081 · Jun 23, 2020
Cited By (3)
US 12,341,829 US 12,739,291 US 12,739,292