IP Library Granted Patent US 11,310,462
Granted Patent B2
US 11,310,462 · App. 16/948,552 · Granted Apr 19, 2022

User engagement computer system and method of using same

Inventors: William Rocklin (Brooklyn, NY); Rembert Reynolds (Brooklyn, NY); Rei Inamoto (Brooklyn, NY); Tucker Charles Schoos (Brooklyn, NY); Nathalie Gina Torres (Brooklyn, NY); Robert Cecil Dickerson (Columbia, MO); William Turnage (Brooklyn, NY); Fumiaki Yoshimatsu (New York, NY); Chelsea Garber (Brooklyn, NY)
Assignee: Mado Labs, Inc.
H04N7/147G06F3/017G10L15/22H04L65/1089H04L65/4015G06F3/0488
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,310,462
App. No.
16/948,552
Granted
Apr 19, 2022
Kind
B2
Abstract

A user engagement computer system for enhancing user engagement via video chats and methods of using same are disclosed. The system includes one or more modules that provide enhanced video chat features such as one of the following: detecting user presence at the user devices, automating the establishment and/or scheduling of video chat sessions based on user presence, controlling the available functionality of the video chat application during a video chat session based on user presence, providing a kids mode with safeguards for children who video chat, providing visualization of storytelling, providing shared digital interactions via a shared interactive digital screen overlaid onto the video chat display, providing user controls via unspoken words, motions and gestures, actively measuring user engagement during a video chat session, and utilizing state machines to dynamically change between system states.

Claims (8)

1. A computer-implemented method for interactive engagement by two or more user devices, each associated with a different user, with a user engagement computer system that is in communication with the two or more user devices, wherein the two or more user devices each has a respective audio sensor, a respective video sensor, and a respective motion sensor, the method comprising:

(a) detecting, by the user engagement computer system during a video chat session comprising substantially simultaneous presentation of audio and video between the two or more user devices using outputs from at least one of the respective audio sensors, the respective video sensors, and the respective motion sensors, a gestural input by one or more of the respective users of the two or more user devices;

(b) in response to detecting the gestural input, determining, during the video chat session by the user engagement system, that the detected gestural input matches gestural content stored in a content database, wherein the match is based on a confidence score that reflects how closely the detected gestural input matches the stored gestural content; and

(c) transmitting, by the user engagement system to the one or more of the respective users of the two or more user devices, a command corresponding to the matched stored gestural content, wherein the command initiates

an automated action to further engage at least one of the respective users.

2. The method of claim 1 , wherein the gestural input comprises a facial gestural input and the at least one of the respective audio sensors, the respective video sensors, and the respective motion sensors comprises the respective motion sensors.

3. The method of claim 1 , wherein the gestural input comprises blowing of air by a respective user of one of the two or more user devices into a microphone at the respective user device and the at least one of the respective audio sensors, the respective video sensors and the respective motion sensors comprises the respective audio sensors.

4. The method of claim 1 , wherein the automated action that is performed during the video chat session comprises activating a shared interactive digital screen that is displayable as overlaid onto the video of the video chat session between the two or more user devices.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 24, 2020
From: ROCKLIN, WILLIAM; REYNOLDS, REMBERT; INAMOTO, REI; SCHOOS, TUCKER CHARLES; TORRES, NATHALIE GINA; DICKERSON, ROBERT CECIL, III; TURNAGE, WILLIAM; YOSHIMATSU, FUMIAKI; GARBER, CHELSEA
To: MADO LABS, INC.
Reel/Frame 053875/0789 →
Continuity (3)
Division 16237882 · Jan 2, 2019
Provisional Application 62625617 · Feb 2, 2018
Related Publication 20210014452A1 · Jan 14, 2021