IP Library › Granted Patent US 12,342,042
Granted Patent B2
US 12,342,042 · App. 16/403,235 · Granted Jun 24, 2025

System and methods for providing and consuming online media content

Inventors: Chaitanya Korupolu (Visakhapatnam, IN); Girish Padmanabhan (Pune, IN); Venkata Vara Prasad Karri (Visakhapatnam, IN)
Assignee: International Business Machines Corporation
H04N21/44218H04N21/44222H04N21/4667H04N21/6587
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,342,042
App. No.
16/403,235
Granted
Jun 24, 2025
Kind
B2
Abstract

Methods and apparatus, including computer program products, implementing and using techniques for providing online media content. Online audiovisual media to be displayed to a user is provided to a client device. In response to detecting that the user is inattentive relative to the displayed audiovisual media, the provisioning of the audiovisual media and/or the display of the audiovisual media on the client device are automatically paused. In response to detecting that the user's attention has returned to the audiovisual media, a modified version of the audiovisual media is provided to the client device, to be displayed to the user.

Claims (27)

1. A method for providing online media content in an online learning setting, comprising:

providing online audiovisual media, to a client device, to be displayed to a user in an online learning setting;

detecting multiple times by a computing device an attention level of the user in the online learning setting, the attention level in the online learning setting detected by comparing previously recorded images of the user tagged as attentive or inattentive to previous online learning settings with a current image of the user in the online learning setting;

in response to detecting by the computing device that the user keeps losing his or her attention in the online learning setting repeatedly by comparing previously recorded images of the user in previous online learning settings with the current image of the user in the online learning setting, making a determination regarding an alternative means of learning material to present to the user in the online learning setting, the alternative means a preferred means of learning based on a type of media the user prefers in learning; and

providing a modified version of the audiovisual media via the client device to the user by substituting audiovisual media with audio content, video content, or text content based on the preferred means of learning of the type of media the user prefers.

2. The method of claim 1 , wherein detecting that the user is inattentive and attentive relative to the displayed audiovisual media in the online learning setting further includes:

recording, by the client device, images or video of the user while the user watches the audiovisual media in the online learning setting; and

examining the recorded images or video to identify body language of the user that indicates attention or loss of attention in the online learning setting.

3. The method of claim 1 , wherein the user consents to have his or her image used by the computing device.

4. A computer program product for displaying online media content while keeping a user's attention, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions being executable by a processor to cause the processor to perform a method comprising:

providing online learning audiovisual media to a client device, to be displayed to a user;

in response to detecting multiple times that the user is inattentive relative to the client device displaying the online learning audiovisual media in the online learning setting, an attention level detected by comparing previously recorded images of the user tagged as attentive or inattentive to previous online learning settings with a current image of the user in the online learning setting, automatically pausing the provisioning of the online learning audiovisual media and pausing the display of the audiovisual media on the client device;

identifying a topic of interest for the user, the topic of interest not related to the online learning setting;

presenting to the user via the client device audiovisual media related to the topic of interest for the user to encourage the user to return attention to the client device; and

in response to detecting that the user's attention has returned to the client device, providing a modified version of the audiovisual media in the online learning setting to the client device, to be displayed to the user, the modified version providing a section of the audiovisual media in the online learning setting that was displayed during a time the user was inattentive or providing a summary of the section of the audiovisual media in the online learning setting that was displayed during the time the user was inattentive.

5. The computer program product of claim 4 , wherein the instructions being executable by the processor further causes the processor to:

make a decision about identifying the topic of interest for the user based on one or more of: prior social networking data, the user's area of expertise, and the user's prior content viewing.

6. The computer program product of claim 4 , wherein providing a modified version of the audiovisual media includes one or more of:

providing a modified type of audiovisual media including substituting the audiovisual media with audio content or video content, and

providing audiovisual media having a modified level of difficulty making it easier to absorb information.

7. The computer program product of claim 6 , wherein the substitution is made in response to a determination relating to the user's preferred learning style.

8. The computer program product of claim 6 , wherein providing audiovisual media having a modified level of difficulty includes substituting the audiovisual media with one of: audiovisual media covering more advanced content, and audiovisual media covering less advanced content.

9. The computer program product of claim 8 , wherein the substitution is made in response to a determination relating to the user's learning capabilities and skill level.

10. The computer program product of claim 4 , wherein detecting that the user is inattentive and attentive relative to the displayed audiovisual media further includes:

recording, by the client device, images or video of the user while the user watches the audiovisual media; and

examining the recorded images or video to identify body language of the user that indicates attention or loss of attention.

11. The computer program product of claim 4 , wherein the user consents to have his or her image used.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 3, 2019
From: KORUPOLU, CHAITANYA; PADMANABHAN, GIRISH; KARRI, VENKATA VARA PRASAD
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 049077/0347 →
Continuity (1)
Related Publication 20200351550A1 · Nov 5, 2020
References Cited (39)
US 5724987A · Gevins · 1998 [cited by examiner]
US 20040152060A1 · Ando · 2004 [cited by examiner]
US 20050181348A1 · Carey · 2005 [cited by examiner]
US 20080271080A1 · Gossweiler · 2008 [cited by examiner]
US 20080276270A1 · Kotaru · 2008 [cited by examiner]
US 20090073314A1 · Uemukai · 2009 [cited by examiner]
US 20100064010A1 · Alkov · 2010 [cited by examiner]
US 20130047175A1 · Ramirez Flores · 2013 [cited by examiner]
US 20130117248A1 · Bhogal · 2013 [cited by examiner]
US 20140006326A1 · Bazanov · 2014 [cited by examiner]
US 20140071342A1 · Winograd · 2014 [cited by examiner]
US 20140078039A1 · Woods · 2014 [cited by examiner]
US 20140223462A1 · Aimone · 2014 [cited by examiner]
US 20140340531A1 · Jain · 2014 [cited by examiner]
US 20150036999A1 · Batur et al. · 2015 [cited by applicant]
US 20150070516A1 · Shoemake · 2015 [cited by examiner]
US 20150099255A1 · Aslan · 2015 [cited by examiner]
US 20160078369A1 · Frank · 2016 [cited by examiner]
US 20160191959A1 · Chittella · 2016 [cited by examiner]
US 20160203726A1 · Hibbs · 2016 [cited by examiner]
US 20160366203A1 · Blong · 2016 [cited by examiner]
US 20170039876A1 · Alyuz Civitci · 2017 [cited by examiner]
US 20170180799A1 · Dey · 2017 [cited by examiner]
US 20170243599A1 · Hu · 2017 [cited by examiner]
US 20170257669A1 · Liu · 2017 [cited by examiner]
US 20170332036A1 · Panchaksharaiah · 2017 [cited by examiner]
US 20180012238A1 · Giannuzzi · 2018 [cited by examiner]
US 20180018507A1 · Chetlur · 2018 [cited by examiner]
US 20180024631A1 · Lo · 2018 [cited by applicant]
US 20180077455A1 · Mahmoud et al. · 2018 [cited by applicant]
US 20180205990A1 · Matthews · 2018 [cited by examiner]
US 20180270517A1 · Maillot · 2018 [cited by examiner]
US 20180314328A1 · Ghajar · 2018 [cited by applicant]
US 20200273485A1 · Jagmag · 2020 [cited by examiner]
Ali, Syed Imran et al. “An efficient system to identify user attentiveness based on fatigue detection”; International Conference on Information Systems and Computer Networks (ISCON), 2014. pp. 1-5. [cited by applicant]
Fessenden, Therese, Scrolling and Attention:; Nielsen Norman Group; Fremont, CA; https://www.nngroup.com/articles/scrolling-and-attention; Apr. 15, 2018; 11 pp. [cited by applicant]
Lagun, Dmitry et al. “Understanding and Measuring User Engagement and Attention in Online News Reading”; WSDM '16 Proceedings of the Ninth ACM International Conference on Web Search and Data Mining, pp. 113-122, 2016. [cited by applicant]
Shaikh, Faisan, Essentials of Deep Learning—Sequence to Sequence modelling with Attention (using python); https://www.analyticsvidhya.com/blog/2018/03/essentials-of-deep-learning-sequence-to-sequence-modelling-with-atte… [cited by applicant]
Yang, Zhongliang et al., “Image Captioning with Object Detection and Localization”; Image and Graphics. ICIG 2017. Lecture Notes in Computer Science, vol. 10667. Springer, Cham, 2017. 10 pp. [cited by applicant]