In the context of rising environmental concerns, this paper introduces VEEP, an architecture designed to predict energy consumption and CO2 emissions in cloud-based video encoding. VEEP combines video analysis with machine learning (ML)-based energy prediction and real-time carbon intensity, enablin...
In the context of rising environmental concerns, this paper introduces VEEP, an architecture designed to predict energy consumption and CO2 emissions in cloud-based video encoding. VEEP combines video analysis with machine learning (ML)-based energy prediction and real-time carbon intensity, enabling precise estimations of CPU energy usage and CO2 emissions during the encoding process. It is trained on the Video Complexity Dataset (VCD) and encoding results from various AWS EC2 instances. VEEP achieves high accuracy, indicated by an 𝑅2-score of 0.96, a mean absolute error (MAE) of 2.41 × 10−5, and a mean squared error (MSE) of 1.67 × 10−9. An important finding is the potential to reduce emissions by up to 375 times when comparing cloud instances and their locations. These results highlight the importance of considering environmental factors in cloud computing.
Size: 14.01 MB
Language: en
Added: Apr 25, 2024
Slides: 30 pages
Slide Content
Armin Lachini, Manuel Hoi, Samira Afzal, Sandro Linder, Farzad Tashtarian, Radu Prodan, Christian Timmerer
Institute of Information Technology (ITEC), Alpen-Adria-Universität Austria [email protected] | https://athena.itec.aau.at/
VEEP: Video Encoding Energy
and CO₂ Emission Prediction
1
Motivation & Objective
66% of internet traffic are video content
Encoding is an energy intense task
Predict cloud-instance energy-consumption for encoding
Calculate CO₂ emissions for specific cloud-region
2
Architecture – Overview
3
Architecture – Video Analyzer
Video Analyzer
[1] VCA GitHub Repository: https://github.com/cd-athena/VCA
Video Complexity Analyzer (VCA)[1]
Open source tool
YUV or Y4M
Outputs complexity features
4
5
Complexity Features
E = 137
L = 156
6
Complexity Features
E = 137
L = 156
avgU = 149
avgV = 144
Video Analyzer
[1] VCA GitHub Repository: https://github.com/cd-athena/VCA
Video Complexity Analyzer (VCA)[1]
Open source tool
YUV or Y4M
Outputs complexity features
8
9
Architecture – Video Analyzer
Architecture – Energy Predictor
10
Energy Predictor
Trained on VE-Match[2] dataset
Encoding data of 500 videos on AWS EC2 instances
Data on encoding CPU energy usage
11
[2] https://dl.acm.org/doi/abs/10.1145/3593908.3593943
Energy Predictor
Trained on VE-Match[2] dataset
Encoding data of 500 videos on AWS EC2 instances
Data on encoding CPU energy usage
12
[2] https://dl.acm.org/doi/abs/10.1145/3593908.3593943
Architecture – CO₂ Data Source
13
Architecture – CO₂ Data Source
14
CO₂ Data Source
Electricity Maps[3]
Live data for carbon intensity
Accounts for imports/exports
15
[3] https://www.electricitymaps.com/
Annual Overview
CO₂ emissions over the year 2023 in Austria.
16
Daily Overview
17
Architecture – CO₂ Calculator
18
Architecture – CO₂ Calculator
19
Architecture
20
Analysis
21
Methodology
Instance Types
Types optimized for different usecases
Different hardware configurations
22
Methodology
Instance Types
Types optimized for different usecases
Different hardware configurations
Codec
AVC/H.264
Regions
Global selection of countries
Diverse mix of energy mixes
23
Emissions per Instance Type
CO₂ emissions for encoding Wood_s001 on different
instances in India
24
Emissions per Instance Type
CO₂ emissions for encoding Wood_s001 on different
instances in India
25
11x
Emissions per Country
CO₂ emissions for encoding Wood_s001 on c5.large
in different countries
26
Emissions per Country
CO₂ emissions for encoding Wood_s001 on c5.large
in different countries
27
37x
Conclusion
Core goal
Predict CPU energy
Calculate CO₂ emissions
Achievements
Energy-prediction with R²-score of 0.96
CO₂ emission reduction up to 405 times
Future work
Consider findings during scheduling of CPU intense
jobs
28
Thank you
Have a
great day
ahead!
Paper Link
https://doi.org/10.1145/3652104.3652528
Alpen-Adria-Universität Austria
Institute of Information Technology (ITEC)
Armin Lachini [email protected]