IP Library Granted Patent US 12,462,261
Granted Patent B2
US 12,462,261 · App. 17/406,722 · Granted Nov 4, 2025

Optimizing carbon emissions from streaming platforms with artificial intelligence based model

Inventors: Divgian Sidhu (Mohali, IN); Ayush Jain (Lucknow, IN); Smitkumar Narotambhai Marvaniya (Bangalore, IN); Sujoy Kumar Roy Chowdhury (Kolkata, IN)
Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
G06Q30/018G06F11/3428G06Q30/0282H04N21/2343
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,462,261
App. No.
17/406,722
Granted
Nov 4, 2025
Kind
B2
Abstract

Media is streamed in accordance with carbon footprint considerations. A streaming history of a streaming plan is analyzed to determine a historical carbon footprint. At least one streaming plan is presented that includes target carbon footprint relative to the historical carbon footprint. A selection is received for one of the at least one streaming plan, wherein the streaming performance on the streaming plan is tracked for post streaming plan carbon emissions. The user streaming performance is modified for the post streaming plan carbon emissions to substantially match the target carbon footprint of the at least one streaming plan.

Claims (50)

1 . A computer-implemented method for optimizing streaming media comprising:

analyzing a streaming history of a streaming subscription to determine a historical carbon footprint;

training a neural network to forecast an upcoming carbon footprint based on the historical carbon footprint by matching search items extracted from user requirements and source code stored in repositories to obtain a trained neural network;

producing, using the trained neural network, at least one streaming plan that includes a target carbon footprint relative to the upcoming carbon footprint;

receiving a selected streaming plan for one of the at least one streaming plan having a target carbon emissions, wherein a streaming performance on the selected streaming plan is tracked for post streaming plan carbon emissions in carbon unit of measure;

maximizing the streaming performance and minimizing the carbon emissions using multi-objective optimization during streaming by dynamically modifying the streaming performance including:

dividing content being broadcast into frames by performing video segmentation of the content being broadcast responsive to a temporal change meeting a threshold value;

analyzing an aesthetic quality of the frames based on frame content parameters to determine a carbon output for the frames;

training a multi-modal model with historical trends of carbon emissions per calendar time periods for the streaming media being broadcast based on the carbon output for the frames to obtain a trained multi-modal model;

predicting, with the trained multi-modal model, an upcoming carbon footprint as a streaming performance of content per frame for carbon units being produced from the streaming media; and

adjusting, with the trained multi-modal model, the frames into carbon-aware frames by optimizing the carbon units produced by the frames based on user streaming characteristics and the aesthetic quality of the frames to match the target carbon footprint of the selected streaming plan and the upcoming carbon footprint in real time including reducing resolution for images including only black and white text, and increasing resolution for images of motion and color images.

2 . The computer-implemented method of claim 1 , wherein the at least one streaming plan includes a type of devices on which streaming media can be viewed.

3 . The computer-implemented method of claim 1 , wherein the at least one streaming plan includes a number of devices on which streaming media can be viewed.

4 . The computer-implemented method of claim 1 , wherein the at least one streaming plan includes a resolution for the streaming media to be viewed.

5 . The computer-implemented method of claim 1 , wherein maximizing the streaming performance further comprises selecting a quality for image resolution selected from a group consisting of standard definition, high definition, full high definition, and 4K.

6 . A system for optimizing streaming media comprising:

a hardware processor; and

a memory that stores a computer program product, which, when executed by the hardware processor, causes the hardware processor to:

analyze a streaming history of a streaming subscription to determine a historical carbon footprint;

train a neural network to forecast an upcoming carbon footprint based on the historical carbon footprint by matching search items extracted from user requirements and source code stored in repositories to obtain a trained neural network;

present, using the trained neural network, at least one streaming plan includes a target carbon footprint relative to the upcoming carbon footprint;

receive a selected streaming plan for one of the at least one streaming plan having a target carbon emissions, wherein a streaming performance on the selected streaming plan is tracked for post streaming plan carbon emissions in carbon unit of measure;

maximize the streaming performance and minimize the carbon emissions using multi-objective optimization during streaming by dynamically modifying the streaming performance including:

divide content being broadcast into frames by performing video segmentation of the content being broadcast responsive to a temporal change meeting a threshold value;

analyze an aesthetic quality of the frames based on frame content parameters to determine a carbon output for the frames;

train a multi-modal model with historical trends of carbon emissions per calendar time periods for the streaming media being broadcast based on the carbon output for the frames to obtain a trained multi-modal model;

predict, with the trained multi-modal model, an upcoming carbon footprint as a streaming performance of content per frame for carbon units being produced from the streaming media; and

adjust, with the trained multi-modal model, the frames into carbon-aware frames by optimizing the carbon units produced by the frames based on user streaming characteristics and the aesthetic quality of the frames to match the target carbon footprint of the selected streaming plan and the upcoming carbon footprint in real time including reducing resolution for images including only black and white text, and increasing resolution for images of motion and color images.

7 . The system of claim 6 , wherein the at least one streaming plan includes a type of devices on which streaming media can be viewed.

8 . The system of claim 6 , wherein the at least one streaming plan includes a number of devices on which streaming media can be viewed.

9 . The system of claim 6 , wherein the at least one streaming plan includes a resolution for the streaming media to be viewed.

10 . The system of claim 6 , wherein maximizing the streaming performance further comprises selecting a quality for image resolution selected from a group consisting of standard definition, high definition, full high definition, and 4K.

11 . A computer program product for optimizing streaming media comprising a computer readable storage medium having computer readable program instructions embodied therewith, the program instructions executable by a processor to cause the processor to:

analyze, using the processor, a streaming history of a streaming subscription to determine a historical carbon footprint of a user's streaming history;

train a neural network to forecast an upcoming carbon footprint based on the historical carbon footprint by matching search items extracted from user requirements and source code stored in repositories to obtain a trained neural network;

produce, using the trained neural network, at least one streaming plan includes a target carbon footprint relative to the upcoming carbon footprint;

receive, using the processor, a selected streaming plan for one of the at least one streaming plan having a target carbon emissions, wherein a streaming performance on the selected streaming plan is tracked for post streaming plan in carbon unit of measure;

maximize the streaming performance and minimize the carbon emissions using multi-objective optimization during streaming by dynamically modifying the streaming performance including:

divide content being broadcast into frames by performing video segmentation of the content being broadcast responsive to a temporal change meeting a threshold value;

analyze an aesthetic quality of the frames based on frame content parameters to determine a carbon output for the frames;

train a multi-modal model with historical trends of carbon emissions per calendar time periods for the streaming media being broadcast based on the carbon output for the frames to obtain a trained multi-modal model;

predict, with the trained multi-modal model, an upcoming carbon footprint as a streaming performance of content per frame for carbon units being produced from the streaming media; and

adjust, with the trained multi-modal model, the frames into carbon-aware frames by optimizing the carbon units produced by the frames based on the user streaming characteristics and the aesthetic quality of the frames to match the target carbon footprint of the selected streaming plan and the upcoming carbon footprint in real time including reducing resolution for images including only black and white text, and increasing resolution for images of motion and color images.

12 . The computer program product of claim 11 , wherein the at least one streaming plan includes a type of devices on which streaming media can be viewed.

13 . The computer program product of claim 11 , wherein the at least one streaming plan includes a number of devices on which streaming media can be viewed.

14 . The computer program product of claim 11 , wherein the at least one streaming plan includes a resolution for the streaming media to be viewed.

15 . The computer program product of claim 11 , wherein maximizing the streaming performance further comprises selecting a quality for image resolution selected from a group consisting of standard definition, high definition, full high definition, and 4K.

16 . The computer-implemented method of claim 1 , wherein the frame content parameters include content information, object dynamics, and personalization.

17 . The system of claim 6 , wherein the user streaming characteristics includes streaming quality, device type for viewing streaming media being broadcast as a function of low carbon producing standard definition content or high carbon producing high definition content for the post streaming plan carbon emissions, network type, streaming duration.

18 . The computer program product of claim 11 , wherein analyzing the aesthetic quality further comprises detecting pixel-wise objects that depict movement in the frames.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 19, 2021
From: SIDHU, DIVGIAN; JAIN, AYUSH; MARVANIYA, SMITKUMAR NAROTAMBHAI; ROY CHOWDHURY, SUJOY KUMAR
To: INTERNATIONAL BUSINESS MACHINES CORPORATION
Reel/Frame 057232/0715 →
Continuity (1)
Related Publication 20230059038A1 · Feb 23, 2023
References Cited (26)
US 9324375B1 · Casalena et al. · 2016 [cited by applicant]
US 10432970B1 · Phillips et al. · 2019 [cited by applicant]
US 20110314095A1 · Gupta · 2011 [cited by examiner]
US 20120117149A1 · Nagpal et al. · 2012 [cited by applicant]
US 20120203886A1 · Mavromatis · 2012 [cited by applicant]
US 20130184879A1 · Xia et al. · 2013 [cited by applicant]
US 20180191868A1 · Wang et al. · 2018 [cited by applicant]
US 20190090001A1 · Smith · 2019 [cited by examiner]
US 20190213097A1 · Jin · 2019 [cited by examiner]
EP 2763421A1 · 2014 [cited by applicant]
Apple Support, “Download and stream shows, movies, and events from Apple TV+, MLS Season Pass, and Apple TV channels” Apple, published on Aug. 13, 2021, https://web.archive.org/web/20210813011808/https://support.apple.c… [cited by examiner]
Carbon Trust, “Carbon impact of video streaming”, published on Jun. 11, 2021, https://www.carbontrust.com/our-work-and-impact/guides-reports-and-tools/carbon-impact-of-video-streaming, (Year: 2021). [cited by examiner]
O. Ejembi and S. N. Bhatti, “Client-Side Energy Costs of Video Streaming,” 2015 IEEE International Conference on Data Science and Data Intensive Systems, Sydney, NSW, Australia, 2015, pp. 252-259, doi: 10.1109/DSDIS.201… [cited by examiner]
Benjaafar, Saif, et al., “Carbon footprint and the management of supply chains: Insights from simple models,” IEEE transactions on automation science and engineering, Jul. 2012, 37 pages, 10.1. [cited by applicant]
Mell, Peter, et al., “The NIST Definition of Cloud Computing,” Sep. 2011, 7 pages. [cited by applicant]
Anonyomous, “Does Binge Watching Leave a Carbon Footprint?—Reduce Emissions,” https://www.terrapass.com/blog/does-binge-watching-leave-a-carbon-footprint, Jun. 2021, 5 pages. [cited by applicant]
Anonyomous, “Does online video streaming harm the environment?—saveonenergy.com,” https://www.saveonenergy.com/uk/does-online-video-streaming-harm-the-environment/, Jun. 2021, 4 pages. [cited by applicant]
Anonyomous, “German study highlights carbon footprint of video streaming,” https://www.deccanherald.com/International/german-study-highlights-carbon-footprint-of-video-streaming-885479.html, Sep. 2020, 4 pages. [cited by applicant]
St. John, Jeff, “Google Tests Load-Shifting at Data Centers to Capture the Grid's Peak Clean Energy Hours,” https://www.greentechmedia.com/articles/read/google-tests-shifting-data-center-loads-to-capture-grids-clean-ene… [cited by applicant]
Anonyomous, “National Grid Carbon Intensity Forecast,” https://electricityinfo.org/forecast-carbon-intensity/, Jun. 2021, 2 pages. [cited by applicant]
Carleton, Audrey, “How to lower your digital carbon footprint,” https://blog.arcadia.com/internet-carbon-footprint/, Mar. 2020, 6 pages. [cited by applicant]
Anonyomous, “Predictive Carbon Footprint Management of Devices,” https://ip.com/IPCOM/000258746, Jun. 2019, 6 pages. [cited by applicant]
Kamiya, George, “The carbon footprint of streaming video: fact-checking the headlines,” https://www.iea.org/commentaries/the-carbon-footprint-of-streaming-video-fact-checking-the-headlines, Dec. 2020, 11 pages. [cited by applicant]
Chandaria, Jigna, et al., “The carbon footprint of watching television, comparing digital terrestrial television with video-on-demand,” Proceedings of the 2011 IEEE International Symposium on Sustainable Systems and Tec… [cited by applicant]
Hamill, Jasper, “Your Netflix binge-watching is pollution the planet, documentary claims,” https://metro.co.uk/2020/03/09/binge-watching-netflix-12370377/, Mar. 2020, 3 pages. [cited by applicant]
Ng, Yan Bin, et al., “Forecasting future action sequences with attention: a new approach to weakly supervised action forecasting,” IEEE Transactions on Image Processing, Sep. 2020, 13 pages, 29. [cited by applicant]