{"id":7305,"date":"2014-12-31T12:30:46","date_gmt":"2014-12-31T10:30:46","guid":{"rendered":"http:\/\/blog.zhaw.ch\/icclab\/?p=7305"},"modified":"2015-01-21T10:44:33","modified_gmt":"2015-01-21T08:44:33","slug":"energy-aware-cloud-load-management","status":"publish","type":"post","link":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/","title":{"rendered":"Energy Aware Cloud Load Management"},"content":{"rendered":"<p>Resource Management in Cloud Computing is a topic that has received much interest both within the research community and within the operations of the large cloud providers; naturally, as it has a significant impact on the cloud provider&#8217;s bottom line. Much of the work to date on resource management focuses on Service Level Agreements (for different definitions of an SLA); some of the work also considers energy as a factor.<\/p>\n<h2>Objectives<\/h2>\n<p>The primary objective of this work is to develop an energy aware load management solution for Openstack: variants of this have been proposed before and indeed implemented in other stacks (e.g. Eucalyptus) but no such capability exists for Openstack as yet. As well as realizing the solution, the work will involve deploying a variant of the solution on the cloud platform without impacting the operation of the platform and determining what energy savings can be made. It is worth noting that the classical load balancing approach which is very typical for resource managers in cloud contexts is somewhat contradictory to minimizing energy consumption; consequently, the very standard load management tools are not suitable for minimizing cloud energy consumption.<\/p>\n<h2>Research Challenges<\/h2>\n<p>The research challenges are the following:<\/p>\n<ul>\n<li>How to characterize the load in the system, particularly relating to spikes in demand<\/li>\n<li>How much buffer space to maintain to accommodate load spikes<\/li>\n<li>How to perform load consolidation &#8211; what load should be moved to what machines?<\/li>\n<li>When to perform load consolidation &#8211; how frequently should it take place?<\/li>\n<li>What are the energy gains that can be achieved from such a dynamic system?<\/li>\n<\/ul>\n<h2>Relevance to current and future markets<\/h2>\n<p>Advanced resource management mechanisms are a necessity for cloud computing generally. In the case of large deployments, Facebook&#8217;s autoscale is an example of how they can be used to achieve energy savings of the order of 15%. In the case of smaller deployments, it is still the case that there are many [[ https:\/\/gigaom.com\/2013\/11\/30\/the-sorry-state-of-server-utilization-and-the-impending-post-hypervisor-era\/ | highly underutilized servers ]] in typical Data Centres and ultimately there will be a need to reduce costs and realize energy efficiencies. The problem is a large, general problem and energy is one specific aspect of it &#8211; one of the challenges for this work is how to integrate with other active parts of the ecosystem.<\/p>\n<p>There are some commercial offering which explicitly address energy efficiency in the cloud context. These include:<\/p>\n<ul>\n<li><a href=\"http:\/\/ieeexplore.ieee.org\/xpls\/abs_all.jsp?arnumber=6008716&amp;tag=1\">Eucalyptus has support for Energy Efficient Management of VMs<\/a>\u00a0which uses essentially the same techniques as in this work, albeit in the context of a different cloud stack;<\/li>\n<li>Hauwei offers <a href=\"https:\/\/wiki.openstack.org\/wiki\/FusionCompute\">Fusion Compute<\/a>\u00a0which includes energy management as one of its capabilities;<\/li>\n<li><a href=\"http:\/\/www.sardinasystems.com\/\">Sardina Systems<\/a> has an offering which focuses on energy management for Openstack specifically.<\/li>\n<\/ul>\n<h2>Impact<\/h2>\n<ul>\n<li>Link to Code\n<ul>\n<li>So far this work has focused on understanding performance of live migration &#8211;\u00a0the code to perform advanced load management has not been pushed out to our public repo as it is currently in its very initial stages.<\/li>\n<\/ul>\n<\/li>\n<li>Blog\n<ul>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/performance-analysis-of-post-copy-live-migration-in-openstack\/\">Performance analysis of \u201cpost-copy\u201d live migration in Openstack<\/a>, Dec 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/setting-up-post-copy-live-migration-in-openstack\/\">Setting up post-copy live migration in OpenStack<\/a>, Dec 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/the-impact-of-ephemeral-vm-disk-usage-on-the-performance-of-live-migration-in-openstack\/\">The impact of ephemeral VM disk usage on the performance of Live Migration in Openstack<\/a>, Oct 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/performance-of-live-migration-in-openstack-under-cpu-and-network-load\/\">Performance of Live Migration in Openstack under CPU and network load<\/a>, Sept 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/an-analysis-of-the-performance-of-live-migration-in-openstack\/\">An analysis of the performance of live migration in Openstack<\/a>, Sept 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/an-analysis-of-the-performance-of-block-live-migration-in-openstack\/\">An analysis of the performance of block live migration in Openstack<\/a>, Sept 2014<\/li>\n<li><a href=\"http:\/\/blog.zhaw.ch\/icclab\/setting-up-live-migration-in-openstack-icehouse\/\">Setting up Live Migration in Openstack Icehouse<\/a>, Sept 2014<\/li>\n<\/ul>\n<\/li>\n<li>Talks<\/li>\n<li><a href=\"https:\/\/www.youtube.com\/watch?v=vvbCio_0FGQ\">Vojtech&#8217;s vbrownbag talk at\u00a0Openstack Summit Paris,<\/a>\u00a0Nov 2014<\/li>\n<li>Link to related projects and initiatives\n<ul>\n<li><a href=\"https:\/\/wiki.openstack.org\/wiki\/FusionCompute\">Huawei Fusion Compute<\/a><\/li>\n<li><a href=\"http:\/\/ieeexplore.ieee.org\/xpls\/abs_all.jsp?arnumber=6008716&amp;tag=1\">Energy-Efficient Management of Virtual Machines in Eucalyptus<\/a><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<h2>Architecture<\/h2>\n<p>See the <a title=\"Energy Efficiency and Cloud Computing \u2013 The Theme\" href=\"http:\/\/blog.zhaw.ch\/icclab\/energy-efficiency-and-cloud-computing-the-theme\/\">Energy Theme<\/a> for the larger system architecture.<\/p>\n<h2>Implementation Roadmap<\/h2>\n<p>The next steps on the implementation roadmap are as follows:<\/p>\n<ul>\n<li>Get tunnelled post-copy live migration working with modifications to libvirt (Jan 2015)<\/li>\n<li>See if this can be pushed upstream to libvirt<\/li>\n<li>Consolidate live migration work into clearer message relating to the potential of live migration (Jan 2015)<\/li>\n<li>Devise control mechanism which can be used to provide energy based control (Feb 2015)<\/li>\n<li>Deploy and test on Arcus servers (Mar 2015)<\/li>\n<li>Determine if it is ready for deployment on Bart\/Lisa (April 2015)<\/li>\n<\/ul>\n<h2>Contact<\/h2>\n<ul>\n<li>Se\u00e1n Murphy &lt;<a href=\"mailto:murp@zhaw.ch\">murp@zhaw.ch<\/a>&gt;<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<div class=\"pt-sm\">Schlagw\u00f6rter: <a href=\"https:\/\/blog.zhaw.ch\/icclab\/tag\/cloud-energy-consumption\/\">cloud energy consumption<\/a>, <a href=\"https:\/\/blog.zhaw.ch\/icclab\/tag\/cloud-optimization\/\">cloud optimization<\/a>, <a href=\"https:\/\/blog.zhaw.ch\/icclab\/tag\/energy-aware-resource-management\/\">energy aware resource management<\/a>, <a href=\"https:\/\/blog.zhaw.ch\/icclab\/tag\/resource-management\/\">resource management<\/a><br><\/div>","protected":false},"excerpt":{"rendered":"<p>Resource Management in Cloud Computing is a topic that has received much interest both within the research community and within the operations of the large cloud providers; naturally, as it has a significant impact on the cloud provider&#8217;s bottom line. Much of the work to date on resource management focuses on Service Level Agreements (for [&hellip;]<\/p>\n","protected":false},"author":92,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"ngg_post_thumbnail":0,"footnotes":""},"categories":[1,544],"tags":[543,547,546,545],"features":[],"class_list":["post-7305","post","type-post","status-publish","format-standard","hentry","category-allgemein","category-energy-aware-cloud-load-management","tag-cloud-energy-consumption","tag-cloud-optimization","tag-energy-aware-resource-management","tag-resource-management"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v27.2 (Yoast SEO v27.2) - https:\/\/yoast.com\/product\/yoast-seo-premium-wordpress\/ -->\n<title>Energy Aware Cloud Load Management - Service Engineering (ICCLab &amp; SPLab)<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Energy Aware Cloud Load Management\" \/>\n<meta property=\"og:description\" content=\"Resource Management in Cloud Computing is a topic that has received much interest both within the research community and within the operations of the large cloud providers; naturally, as it has a significant impact on the cloud provider&#8217;s bottom line. Much of the work to date on resource management focuses on Service Level Agreements (for [&hellip;]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\" \/>\n<meta property=\"og:site_name\" content=\"Service Engineering (ICCLab &amp; SPLab)\" \/>\n<meta property=\"article:published_time\" content=\"2014-12-31T10:30:46+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2015-01-21T08:44:33+00:00\" \/>\n<meta name=\"author\" content=\"Sean Murphy\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Sean Murphy\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\"},\"author\":{\"name\":\"Sean Murphy\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d\"},\"headline\":\"Energy Aware Cloud Load Management\",\"datePublished\":\"2014-12-31T10:30:46+00:00\",\"dateModified\":\"2015-01-21T08:44:33+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\"},\"wordCount\":698,\"commentCount\":0,\"keywords\":[\"cloud energy consumption\",\"cloud optimization\",\"energy aware resource management\",\"resource management\"],\"articleSection\":[\"*.*\",\"Energy Aware Cloud Load Management\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\",\"url\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\",\"name\":\"Energy Aware Cloud Load Management - Service Engineering (ICCLab &amp; SPLab)\",\"isPartOf\":{\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/#website\"},\"datePublished\":\"2014-12-31T10:30:46+00:00\",\"dateModified\":\"2015-01-21T08:44:33+00:00\",\"author\":{\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d\"},\"breadcrumb\":{\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Startseite\",\"item\":\"https:\/\/blog.zhaw.ch\/icclab\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Energy Aware Cloud Load Management\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/#website\",\"url\":\"https:\/\/blog.zhaw.ch\/icclab\/\",\"name\":\"Service Engineering (ICCLab &amp; SPLab)\",\"description\":\"A Blog of the ZHAW Zurich University of Applied Sciences\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/blog.zhaw.ch\/icclab\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d\",\"name\":\"Sean Murphy\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g\",\"caption\":\"Sean Murphy\"},\"url\":\"https:\/\/blog.zhaw.ch\/icclab\/author\/murp\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Energy Aware Cloud Load Management - Service Engineering (ICCLab &amp; SPLab)","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/","og_locale":"en_US","og_type":"article","og_title":"Energy Aware Cloud Load Management","og_description":"Resource Management in Cloud Computing is a topic that has received much interest both within the research community and within the operations of the large cloud providers; naturally, as it has a significant impact on the cloud provider&#8217;s bottom line. Much of the work to date on resource management focuses on Service Level Agreements (for [&hellip;]","og_url":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/","og_site_name":"Service Engineering (ICCLab &amp; SPLab)","article_published_time":"2014-12-31T10:30:46+00:00","article_modified_time":"2015-01-21T08:44:33+00:00","author":"Sean Murphy","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Sean Murphy","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#article","isPartOf":{"@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/"},"author":{"name":"Sean Murphy","@id":"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d"},"headline":"Energy Aware Cloud Load Management","datePublished":"2014-12-31T10:30:46+00:00","dateModified":"2015-01-21T08:44:33+00:00","mainEntityOfPage":{"@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/"},"wordCount":698,"commentCount":0,"keywords":["cloud energy consumption","cloud optimization","energy aware resource management","resource management"],"articleSection":["*.*","Energy Aware Cloud Load Management"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/","url":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/","name":"Energy Aware Cloud Load Management - Service Engineering (ICCLab &amp; SPLab)","isPartOf":{"@id":"https:\/\/blog.zhaw.ch\/icclab\/#website"},"datePublished":"2014-12-31T10:30:46+00:00","dateModified":"2015-01-21T08:44:33+00:00","author":{"@id":"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d"},"breadcrumb":{"@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/blog.zhaw.ch\/icclab\/energy-aware-cloud-load-management\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Startseite","item":"https:\/\/blog.zhaw.ch\/icclab\/"},{"@type":"ListItem","position":2,"name":"Energy Aware Cloud Load Management"}]},{"@type":"WebSite","@id":"https:\/\/blog.zhaw.ch\/icclab\/#website","url":"https:\/\/blog.zhaw.ch\/icclab\/","name":"Service Engineering (ICCLab &amp; SPLab)","description":"A Blog of the ZHAW Zurich University of Applied Sciences","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/blog.zhaw.ch\/icclab\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/blog.zhaw.ch\/icclab\/#\/schema\/person\/c87a6eef7e1f4a152aeec5f8b9527b8d","name":"Sean Murphy","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/4514cb0ddfe236fd05d5ddb715bc19e1e1e35dafa16bb1b911e6094d278211d6?s=96&d=mm&r=g","caption":"Sean Murphy"},"url":"https:\/\/blog.zhaw.ch\/icclab\/author\/murp\/"}]}},"_links":{"self":[{"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/posts\/7305","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/users\/92"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/comments?post=7305"}],"version-history":[{"count":4,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/posts\/7305\/revisions"}],"predecessor-version":[{"id":7353,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/posts\/7305\/revisions\/7353"}],"wp:attachment":[{"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/media?parent=7305"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/categories?post=7305"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/tags?post=7305"},{"taxonomy":"features","embeddable":true,"href":"https:\/\/blog.zhaw.ch\/icclab\/wp-json\/wp\/v2\/features?post=7305"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}