IP Library Granted Patent US 12,236,798
Granted Patent B2
US 12,236,798 · App. 16/151,226 · Granted Feb 25, 2025

Presentation assessment and valuation system

Inventors: Brian A. Scholz (Fort Collins, CO); Bruce E. Fischer (Windsor, CO)
Assignee: Bongo Learn, Inc.
G09B19/04G06F3/013G06F40/253G06V40/174G10L15/22G10L15/26G10L25/63G10L25/48
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,236,798
App. No.
16/151,226
Granted
Feb 25, 2025
Kind
B2
Abstract

A computer implemented interactive presentation assessment and valuation system which provides a server computer that allows one or more computing devices to access a presentation assessment and valuation system which provides a presentation analyzer which applies standardized scoring algorithms to the video data or audio data associated with a presentation and correspondingly generates standardized word rate, word clarity, filler words, tone, or eye contact scores, and calculates a presentation score based upon an average or weighted average of the scores.

Claims (69)

1. A system, comprising:

a server which serves a program through a network to coordinate processing of a presentation, said program including:

a user interface executable to:

depict a graphical user interface on a display surface of a computing device;

record by user command in said graphical user interface a presentation; retrieve by user indications in said graphical user interface said presentation;

depict in said graphical user interface on said display surface of said first computing device said presentation; and

an eye contact analyzer executable to:

analyze occurrence of eye contact in speaker data within said presentation;

retrieve pixel data within said presentation corresponding to head, eye, or iris position;

compare relative pixel intensity level of said pixel data to an eye contact threshold;

calculate an eye contact rate based upon an amount of time units said pixel level intensity exceeds said eye contact threshold divided by total time units encompassed by said speaker data.

2. The system of claim 1 , further comprising a presentation scoring module executable to calculate an eye contact score, wherein if said eye contact rate exceeds a pre-selected eye contact rate threshold, then said eye contact score equals 100, and wherein if said eye contact rate is less than the eye contact rate threshold, then the eye contact score equals the eye contact rate.

3. The system of claim 1 , further comprising:

a transcription module executable to analyze speech data included in said presentation, including:

count words in said speech data;

count filler words in said speech data; and

depict in said graphical user interface on said display surface of said computing device said presentation;

a formatter executable to:

format text of said speech data including all of said words in said speech data and said filler words in said speech data in a formatted text display area,

depict a filler word indicator visually identifying each filler word in said formatted text;

associate a filler word trigger area with each filler word visually identified in said formatted text;

activate said filler word trigger area by user command; and

depict a filler word score image in said formatted text discrete from said filler word trigger area, said filler word score image including a filler word count of said filler words in said formatted text.

4. The system of claim 3 , wherein said formatted text comprises spatially fixed paragraphs.

5. The system of claim 1 , further comprising:

a transcription module executable to analyze speech data included in said presentation, including:

count words in said speech data;

count filler words in said speech data; and

depict in said graphical user interface on said display surface of said computing device said recorded presentation; and

a formatter executable to concurrently depict on a display surface of said computing device:

formatted text of said speech data including all of said words in said speech data and said filler words in said speech data in a formatted text display area.

6. The system of claim 1 , further comprising:

a transcription module executable to analyze speech data included in said presentation, including:

count words in said speech data;

count filler words in said speech data;

assign a word recognition confidence metric to each of said words and said filler words in said speech data, wherein said recognition confidence metric determined by extracting word confidence features and processing said word confidence features against one or more word confidence feature recognition thresholds for the word;

depict in said graphical user interface on said display surface of said computing device said presentation;

a formatter executable to:

format text of said speech data including all of said words in said speech data and said filler words in said speech data in a formatted text display area,

depict a clarity indicator visually identifying each word in said formatted text having a word recognition confidence metric of less than said word recognition confidence metric threshold;

associate a clarity trigger area with each word in said formatted text having said word recognition confidence metric of less than said word recognition confidence metric threshold;

activate said clarity trigger area by user command; and

depict a clarity score image in said formatted text discrete from said clarity trigger area, said clarity score image including said word recognition confidence metric of said word associated with said trigger area.

7. The system of claim 1 further comprising:

a transcription module executable to analyze speech data included in said presentation including:

count words in said speech data;

count filler words in said speech data; and

assign a word recognition confidence metric to each of said words and said filler words in said speech data, wherein said recognition confidence metric determined by extracting word confidence features and processing said word confidence features against one or more word confidence feature recognition thresholds for said words in said speech data;

a presentation scoring module executable to:

calculate a word rate score;

calculate a clarity score;

calculate a filler word score;

calculate a presentation score as an average of the sum of two or more of said word rate score, said clarity score and said filler word score;

associate said word rate score, said clarity score, said filler word score, and said presentation score with said presentation;

retrievably save said presentation associated with said word rate score, said clarity score, said filler word score, and said presentation score in a presentation database; and

depict in said graphical user interface on said display surface of said computing device said presentation and one or more of said word rate score said clarity score, said filler word score, and said presentation score in a presentation score display-area on said display surface associated with said computing device.

8. The system of claim 7 , wherein said word rate score equals a pre-selected word rate which corresponds to a word rate score of 100, wherein each integer deviation either above and below said pre-selected word rate results in a corresponding integer reduction in said word rate score of 100.

9. The system of claim 7 , wherein said clarity score equals a sum of said words having said word recognition confidence metric greater than a pre-selected word recognition confidence metric divided by the total word count.

10. The system of claim 7 , wherein said filler word score equals said filler word count times 100 divided by the total word count.

11. The system of claim 7 , wherein said program is executable to:

serve said presentation associated with said word rate score, said clarity score, said filler word score, and said presentation score from said presentation database to either said computing device;

playback said recorded presentation on said computing device, wherein playback includes:

depiction of a video in a video display area on a display surface associated with said computing device;

generation of audio from a speaker associated with said computing device; and depiction of one or more of said word rate score, said clarity score, said filler word score, and said presentation score in a presentation score display area on said display surface associated with said computing device.

12. The system of claim 7 , wherein said program is further executable to:

associate a grade with said presentation, said grade variably based on one or more of associated said word rate score, said clarity score, said filler word score, and said presentation score; and

retrievably save said recorded presentation associated with said grade in said presentation database accessible by said computing device.

13. The system of claim 7 , further comprising a line chart including a word rate baseline and a word rate line which compares a word rate of said speech to said word rate baseline in a word rate line chart display area.

14. The system of claim 13 , wherein said word rate baseline corresponds to a pre-selected word rate which matches a word rate score of 100, and wherein and each integer deviation above and below said pre-selected word rate results in a corresponding integer reduction in said word rate score.

Assignments (3)
SECURITY INTEREST Recorded May 18, 2022
From: BONGO LEARN, INC.
To: WEBSTER BANK, NATIONAL ASSOCIATION
Reel/Frame 059945/0152 →
ENTITY CONVERSION Recorded Sep 7, 2021
From: EDUPRESENT LLC
To: BONGO LEARN, INC.
Reel/Frame 057426/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 3, 2018
From: SCHOLZ, BRIAN A.; FISCHER, BRUCE E.
To: EDUPRESENT LLC
Reel/Frame 047060/0435 →
Continuity (1)
Related Publication 20200111386A1 · Apr 9, 2020
References Cited (186)
US 5764901A · Skarbo et al. · 1998 [cited by applicant]
US 6154631A · Remschel · 2000 [cited by applicant]
US 6471521B1 · Dornbush et al. · 2002 [cited by applicant]
US 6484316B1 · Lindberg · 2002 [cited by applicant]
US 6577333B2 · Tai et al. · 2003 [cited by applicant]
US 6871043B2 · Sand · 2005 [cited by applicant]
US 7185054B1 · Ludwig et al. · 2007 [cited by applicant]
US 7478129B1 · Chemtob · 2009 [cited by applicant]
US 7496845B2 · Deutscher et al. · 2009 [cited by applicant]
US 7506262B2 · Gupta et al. · 2009 [cited by applicant]
US 7623755B2 · Kuspa · 2009 [cited by applicant]
US 7809802B2 · Lerman et al. · 2010 [cited by applicant]
US 7908602B2 · Alcorn · 2011 [cited by applicant]
US 8108255B1 · Robinson et al. · 2012 [cited by applicant]
US 8140973B2 · Sandquist et al. · 2012 [cited by applicant]
US 8272874B2 · Julia et al. · 2012 [cited by applicant]
US 8457967B2 · Audhkhasi · 2013 [cited by examiner]
US 8473835B2 · Hariton · 2013 [cited by applicant]
US 8494857B2 · Pakhomov · 2013 [cited by examiner]
US 8640030B2 · Kulas · 2014 [cited by applicant]
US 8696364B2 · Cohen · 2014 [cited by applicant]
US 8756057B2 · Miller · 2014 [cited by examiner]
US 8799757B2 · Jewsbury et al. · 2014 [cited by applicant]
US 8806320B1 · Abdo · 2014 [cited by examiner]
US 8887050B1 · Siracusano, Jr. · 2014 [cited by applicant]
US 9459754B2 · Lewis et al. · 2016 [cited by applicant]
US 9591072B2 · Scherbel et al. · 2017 [cited by applicant]
US 9792908B1 · Bassemir · 2017 [cited by examiner]
US 10204264B1 · Gallagher · 2019 [cited by examiner]
US 10311743B2 · Chen · 2019 [cited by examiner]
US 10423727B1 · Juneja · 2019 [cited by examiner]
US 10446055B2 · Gupta · 2019 [cited by examiner]
US 10460178B1 · Fieldman · 2019 [cited by examiner]
US 11120405B2 · Steinhoff · 2021 [cited by examiner]
US 11132913B1 · Ramanarayanan · 2021 [cited by examiner]
US 20020059342A1 · Gupta et al. · 2002 [cited by applicant]
US 20020105598A1 · Tai et al. · 2002 [cited by applicant]
US 20020115051A1 · Sanda · 2002 [cited by applicant]
US 20030036947A1 · Smith, III et al. · 2003 [cited by applicant]
US 20030073064A1 · Riggs · 2003 [cited by applicant]
US 20030152904A1 · Doty, Jr. · 2003 [cited by applicant]
US 20030174160A1 · Deutscher et al. · 2003 [cited by applicant]
US 20030202007A1 · Silverstein · 2003 [cited by examiner]
US 20040014021A1 · Suleiman · 2004 [cited by applicant]
US 20040044950A1 · Mills et al. · 2004 [cited by applicant]
US 20040125133A1 · Pea et al. · 2004 [cited by applicant]
US 20040143630A1 · Kaufmann et al. · 2004 [cited by applicant]
US 20040153504A1 · Hutchinson · 2004 [cited by applicant]
US 20040153508A1 · Alcorn et al. · 2004 [cited by applicant]
US 20050084152A1 · McPeake et al. · 2005 [cited by applicant]
US 20060111902A1 · Julia et al. · 2006 [cited by applicant]
US 20060293889A1 · Kiss et al. · 2006 [cited by applicant]
US 20070033632A1 · Baynger et al. · 2007 [cited by applicant]
US 20070074116A1 · Thomas · 2007 [cited by applicant]
US 20070174774A1 · Lerman et al. · 2007 [cited by applicant]
US 20070179777A1 · Gupta et al. · 2007 [cited by applicant]
US 20070233492A1 · Matsumoto · 2007 [cited by examiner]
US 20070234214A1 · Lovejoy et al. · 2007 [cited by applicant]
US 20070245243A1 · Lanza et al. · 2007 [cited by applicant]
US 20080021708A1 · Bennett et al. · 2008 [cited by applicant]
US 20080092047A1 · Fealkoff et al. · 2008 [cited by applicant]
US 20080126387A1 · Blinnikka · 2008 [cited by applicant]
US 20080133736A1 · Wensley et al. · 2008 [cited by applicant]
US 20080140401A1 · Abrash et al. · 2008 [cited by applicant]
US 20080254425A1 · Cohen · 2008 [cited by applicant]
US 20080286739A1 · Umrigar et al. · 2008 [cited by applicant]
US 20090055175A1 · Terrell, II · 2009 [cited by examiner]
US 20090089062A1 · Lu · 2009 [cited by examiner]
US 20090112859A1 · Dehlinger · 2009 [cited by examiner]
US 20090119258A1 · Petty · 2009 [cited by applicant]
US 20090152349A1 · Bonev et al. · 2009 [cited by applicant]
US 20090164904A1 · Horowitz · 2009 [cited by applicant]
US 20090225164A1 · Renkis · 2009 [cited by applicant]
US 20090249223A1 · Barsook et al. · 2009 [cited by applicant]
US 20090288011A1 · Piran et al. · 2009 [cited by applicant]
US 20090327856A1 · Mouilleseaux et al. · 2009 [cited by applicant]
US 20100011292A1 · Marinkovich et al. · 2010 [cited by applicant]
US 20100056128A1 · Hwang et al. · 2010 [cited by applicant]
US 20100223056A1 · Kadirkamanathan · 2010 [cited by examiner]
US 20100251177A1 · Geppert et al. · 2010 [cited by applicant]
US 20100274584A1 · Kim · 2010 [cited by applicant]
US 20100274847A1 · Anderson et al. · 2010 [cited by applicant]
US 20100281384A1 · Lyons et al. · 2010 [cited by applicant]
US 20100293478A1 · Dahlgren · 2010 [cited by applicant]
US 20110010624A1 · Vanslette et al. · 2011 [cited by applicant]
US 20110026898A1 · Lussier et al. · 2011 [cited by applicant]
US 20110123965A1 · Yu · 2011 [cited by examiner]
US 20110214045A1 · Sumler et al. · 2011 [cited by applicant]
US 20110223572A1 · Bobbitt, Jr. · 2011 [cited by examiner]
US 20110231194A1 · Lewis · 2011 [cited by applicant]
US 20110270922A1 · Jones et al. · 2011 [cited by applicant]
US 20110296312A1 · Boyer et al. · 2011 [cited by applicant]
US 20120036423A1 · Haynes et al. · 2012 [cited by applicant]
US 20120210217A1 · Abbas et al. · 2012 [cited by applicant]
US 20120288845A1 · Kumar · 2012 [cited by applicant]
US 20130073964A1 · Meaney et al. · 2013 [cited by applicant]
US 20130125000A1 · Fleischhauer et al. · 2013 [cited by applicant]
US 20130191763A1 · Jones et al. · 2013 [cited by applicant]
US 20130298025A1 · Lewis · 2013 [cited by examiner]
US 20130298026A1 · Fitzpatrick · 2013 [cited by applicant]
US 20130332879A1 · Lewis · 2013 [cited by applicant]
US 20130334300A1 · Evans · 2013 [cited by examiner]
US 20130346332A1 · Schalk et al. · 2013 [cited by applicant]
US 20140025379A1 · Ganapathiraju et al. · 2014 [cited by applicant]
US 20140035920A1 · Duwenhorst · 2014 [cited by examiner]
US 20140108562A1 · Panzer · 2014 [cited by applicant]
US 20140279852A1 · Chen · 2014 [cited by applicant]
US 20140356822A1 · Hoque · 2014 [cited by examiner]
US 20150006759A1 · Scherbel et al. · 2015 [cited by applicant]
US 20150121225A1 · Somasundaram et al. · 2015 [cited by applicant]
US 20150269857A1 · Feng · 2015 [cited by applicant]
US 20150310852A1 · Spizzo · 2015 [cited by examiner]
US 20160019202A1 · Adams · 2016 [cited by examiner]
US 20160049094A1 · Gupta · 2016 [cited by examiner]
US 20160269345A1 · Weizman · 2016 [cited by applicant]
US 20160316059A1 · Nuta · 2016 [cited by examiner]
US 20170287355A1 · Pogorelik · 2017 [cited by applicant]
US 20180068662A1 · Schlippe et al. · 2018 [cited by applicant]
US 20180075845A1 · Kochura · 2018 [cited by examiner]
US 20180122374A1 · Bassemir · 2018 [cited by examiner]
US 20180349335A1 · Hodge · 2018 [cited by examiner]
US 20190108219A1 · Barrett · 2019 [cited by examiner]
US 20190214039A1 · Nakayama · 2019 [cited by examiner]
US 20190311331A1 · Steinhoff · 2019 [cited by examiner]
US 20200065612A1 · Xu · 2020 [cited by examiner]
US 20210004768A1 · Steinhoff · 2021 [cited by examiner]
US 20210090137A1 · Lewis · 2021 [cited by examiner]
US 20210358476A1 · Leone · 2021 [cited by examiner]
US 20220237892A1 · Anderton-Yang · 2022 [cited by examiner]
CA 3106719A · 2020 [cited by applicant]
EP 2667340A1 · 2013 [cited by applicant]
WO 2012057835 · 2012 [cited by applicant]
WO WO2013188290 · 2013 [cited by applicant]
WO WO2016014032A1 · 2016 [cited by examiner]
WO WO2016146978A1 · 2016 [cited by applicant]
Chris Deziel, “How to Calculate an Average Score”, shttps://sciencing.com/calculate-average-score-6395171.html, Mar. 13, 2018 (Year: 2018). [cited by examiner]
Chaiwongsai et al. “Improved Tone Model for Low Complexity Tone Recognition” SICE Annual Conference 2014 (Year: 2014). [cited by examiner]
Kurihara et al. “Presentation Sensei: A Presentation Training System using Speech and Image Processing” ICMI'07, Nov. 12-15, 2007, Nagoya, Aichi, Japan. (Year: 2007). [cited by examiner]
Shangavi et al. “Self-Speech Evaluation with Speech Recognition and Gesture Analysis” 2018 National Information Technology Conference (NITC), Oct. 2-4, Colombo, Sri Lanka (Year: 2018). [cited by examiner]
Naim et al. “Automated Analysis and Prediction of Job Interview Performance” Automated Analysis and Prediction of Job Interview Performance vol. 9, No. 2, Apr.-Jun. 2018 (Year: 2018). [cited by examiner]
Jeon et al. “Acoustic Feature-based Non-scorable Response Detection for an Automated Speaking Proficiency Assessment” INTERSPEECH 2012 ISCA's 13th Annual Conference Portland, OR, USA (Year: 2021). [cited by examiner]
Close, “Giving Meaning to Test Scores” published at www.renaissance.com/2016/05/12/giving-meaning-to-test-scores/ May 12, 2016 (Year: 2016). [cited by examiner]
PCT International Patent Application No. PCT/US13/44968, International Search Report and Written Opinion of the International Search Authority, dated Dec. 20, 2013, 21 pages. [cited by applicant]
PCT International Patent Application No. PCT/US18/28179; International Search Report and Written Opinion of the International Searching Authority dated Jun. 27, 2018, 12 pages. [cited by applicant]
PCT International Patent Application No. PCT/US15/14493; International Search Report and Written Opinion of the International Searching Authority dated May 14, 2015, 14 pages. [cited by applicant]
Apsolon. Video Tips & Tricks ep. 09: How to add YouTube Annotations, Mar. 6, 2009, YouTube, https://www.youtube,com.watch?v=XAG3z4scWTw. [cited by applicant]
Blakowski, et al. Tools for Specifying and Executing Synchronized Multimedia Presentations. Conference Proceedings of 2nd ACM International Workshop on Network and Operating System Support for Digital Audio and Video, H… [cited by applicant]
Goreact Blog. Introducing GoReact Slide Sync. Website, https://blog.goreact.com, originally downloaded Apr. 21, 2017, 4 pages total. [cited by applicant]
Goreact. Affordable Online Video Assessment. Website, https://goreact.com, originally downloaded Mar. 28, 2017, 5 pages total. [cited by applicant]
Kira Talent. Video Admissions Platform. Website, https://www.kiratalent.com, originally downloaded Apr. 3, 2017, 7 pages total. [cited by applicant]
Jfrumar. Omnisio Presentation Screencast. YouTube, YouTube, May 17, 2008, www.youtube.com/watch?v=7_SrHIAqlak. [cited by applicant]
U.S. Appl. No. 15/409,935, filed Jan. 19, 2017. [cited by applicant]
U.S. Appl. No. 15/954,210, filed Apr. 16, 2018. [cited by applicant]
U.S. Appl. No. 14/960,234, filed Dec. 4, 2015. [cited by applicant]
U.S. Appl. No. 15/729,149, filed Oct. 10, 2017. [cited by applicant]
U.S. Appl. No. 14/174,127, filed Feb. 6, 2014. [cited by applicant]
U.S. Appl. No. 14/480,509, filed Sep. 8, 2014. [cited by applicant]
U.S. Appl. No. 16/232,994, filed Dec. 26, 2018. [cited by applicant]
Australian Patent Application No. 2015214261; Office Action dated Jan. 31, 2019, 5 pages. [cited by applicant]
Australian Patent Application No. 2017201408; Office.Action dated Jan. 15, 2018, 4 pages. [cited by applicant]
Australian Patent Application No. 2017201408; Office.Action dated Jan. 14, 2019, 6 pages. [cited by applicant]
Australian Patent Application No. 2017201408; Office Action dated Jun. 28, 2018, 4 pages. [cited by applicant]
Canadian Patent Application No. 2,853,480; Office Action dated Sep. 7, 2017, 4 pages total. [cited by applicant]
Canadian Patent Application No. 2,914,902; Office Action dated Oct. 9, 2018, 11 pages total. [cited by applicant]
Canadian Patent Application No. 2,949,204; Office Action dated Nov. 20, 2018, 3 pages total. [cited by applicant]
European Patent Application No. 11836763.0; Office Action dated Sep. 15, 2017, 5 pages total. [cited by applicant]
European Patent Application No. 13804359.1; Office Action dated Mar. 7, 2017, 7 pages total. [cited by applicant]
U.S. Appl. No. 15/284,408, filed Oct. 3, 2016. [cited by applicant]
U.S. Appl. No. 61/658,298, filed Jun. 11, 2012. [cited by applicant]
International Patent Cooperation Treaty Patent Application No. PCT/US2011/001820, filed Oct. 27, 2011. [cited by applicant]
U.S. Appl. No. 61/441,670, filed Feb. 11, 2011. [cited by applicant]
U.S. Appl. No. 61/407,548, filed Oct. 28, 2010. [cited by applicant]
PCT International Patent Application No. PCT/US15/14493; International Search Report and Written Opinion mailed May 14, 2015, 14 pages total. [cited by applicant]
U.S. Appl. No. 13/842,846; Office Action mailed Dec. 31, 2014. [cited by applicant]
Apple. iPhone User Guide For iOS 4.2 Software; Copyright 2010, 5 total pages (excerpt). [cited by applicant]
ZeeBigBang. FORscene Tutorial (full). Vimeo. N.p., Oct. 14, 2010. Website, https://vimeo.com/15836683, originally downloaded Sep. 1, 2015, 1 page. [cited by applicant]
European Patent Application No. 15746331.6; Office Action dated Sep. 29, 2020, 8 pages. [cited by applicant]
European Patent Application No. 19868267.6; partial supplementary European Search Report dated May 17, 2022, 14 pages. [cited by applicant]
U.S. Appl. No. 16/655,354; Office Action mailed Sep. 17, 2020. [cited by applicant]
HP WebCam User Guide. Feb. 2012 (retrieved on Sep. 10, 2020); retrieved from internet: <URL: http://h10032.wwl.hp.com/ctg/Manual/c03367177.pdf> (Year: 2012). [cited by applicant]
Izbassarova et al. Automated Rating of Recorded Classroom Presentations using Speech Analysis in Kazakh. arXiv:1801.00453, Cornell University Library, Jan. 2018, 6 pages. [cited by applicant]
PCT International Patent Application No. PCT/US19/52460; International Search Report and Written Opinion of the International Searching Authority dated Dec. 6, 2019, 14 pages. [cited by applicant]
Tausczik et al. The Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods. Journal of Language and Social Psychology, Dec. 2009, 29(1)24-54. [cited by applicant]
European Patent Application No. 19868267.6; Extended European Search Report dated Aug. 4, 2022, 16 pages. [cited by applicant]
Canadian Patent Application No. 3,106,719, Office Action dated Apr. 12, 2023, 4 pages. [cited by applicant]
PCT International Patent Application No. PCT/US23/23481, International Search Report and Written Opinion of the International Searching Authority dated Nov. 14, 2023, 16 pages. [cited by applicant]