{"id":7795,"date":"2019-01-18T07:11:43","date_gmt":"2019-01-17T21:11:43","guid":{"rendered":"https:\/\/nsrd.info\/blog\/?p=7795"},"modified":"2019-01-18T07:11:52","modified_gmt":"2019-01-17T21:11:52","slug":"basics-estimating-cloud-tier-movement","status":"publish","type":"post","link":"https:\/\/nsrd.info\/blog\/2019\/01\/18\/basics-estimating-cloud-tier-movement\/","title":{"rendered":"Basics \u2013 Estimating Cloud Tier Movement"},"content":{"rendered":"\n<p>When it comes to extending to object storage for long term retention, you really can&#8217;t beat Data Domain. Cloud Tiering is built into the operating system, but smart backup applications such as NetWorker and Avamar can seamlessly work with Cloud Tier for movement and recall operations.<\/p>\n\n\n\n<figure class=\"wp-block-image is-resized\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload.jpg\" alt=\"Cloud Uploads\" class=\"wp-image-7796\" width=\"675\" height=\"675\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload.jpg 900w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload-150x150.jpg 150w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload-300x300.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload-768x768.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload-144x144.jpg 144w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload-200x200.jpg 200w\" sizes=\"auto, (max-width: 675px) 100vw, 675px\" \/><figcaption><br><\/figcaption><\/figure>\n\n\n\n<p>I&#8217;ve talked about Cloud Tiering in the past \u2013\u00a0below is a diagram that effectively shows the high level conceptual approach. You write to the Data Domain active tier, then when data is beyond a particular age, you can have it moved out to object storage. That object storage can be public cloud (e.g., AWS, Azure), or it can be to something suitable on-premises, such as Dell EMC Elastic Cloud Storage (ECS).<\/p>\n\n\n\n<figure class=\"wp-block-image\"><img loading=\"lazy\" decoding=\"async\" width=\"800\" height=\"576\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2016\/10\/cloud-tier.png\" alt=\"Cloud Tier\" class=\"wp-image-6010\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2016\/10\/cloud-tier.png 800w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2016\/10\/cloud-tier-300x216.png 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2016\/10\/cloud-tier-768x553.png 768w\" sizes=\"auto, (max-width: 800px) 100vw, 800px\" \/><figcaption>Cloud Tiering<\/figcaption><\/figure>\n\n\n\n<p>Fully integrated backup applications will handle that data movement for you, but even if you don&#8217;t have a fully integrated backup application, Data Domain can have the tiering configured at the Mtree level.<\/p>\n\n\n\n<p>But how much space will you free up? That&#8217;s always the golden question.<\/p>\n\n\n\n<p>Well, with DDOS 6.2, you&#8217;ve now got the option of testing it out yourself \u2013\u00a0and you don&#8217;t need Cloud Tier enabled, or licensed, on your Data Domain, in order to run that test. In fact, it&#8217;s so simple that it barely needs a blog article, except it&#8217;s important to know that this is available to you.<\/p>\n\n\n\n<p>When working from the CLI, Data Domain Cloud Tiering is controlled via the <em>data-movement<\/em> command. As of DDOS 6.2, a new option has been added called an <em>eligibility\u00a0check<\/em>. It works like this:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\"># <strong>data-movement start eligibility-check age-threshold <em>nDays<\/em> mtrees <em>mtreeList<\/em><\/strong><\/pre>\n\n\n\n<p>Here&#8217;s an example of it running on a 0.5TB DDVE running in my lab \u2013\u00a0as you can imagine, there&#8217;s not a lot of data to review here:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">sysadmin@adamantium# <strong>data-movement start eligibility-check age-threshold 30 mtrees \/data\/col1\/orilla<\/strong><br>Data-movement eligibility-check started<br>Run data-movement status for the status <\/pre>\n\n\n\n<p>Now in this case, I&#8217;m checking for a single Mtree, that owned by my NetWorker server, and looking at what would happen if I turned on Cloud Tiering for all data older than 30 days. <\/p>\n\n\n\n<p>Depending on how much data you have, your eligibility check may take a little while to run of course \u2013\u00a0the system is basically building up a profile of how much data could be freed from your active tier by enabling the movement time you&#8217;ve specified. Here&#8217;s the output of me checking the status, and the final output:<\/p>\n\n\n\n<pre class=\"wp-block-preformatted\">sysadmin@adamantium# <strong>data-movement status<\/strong><br>Data-movement to cloud tier:<br>----------------------------<br>Data-movement eligibility-check:<br>    28% complete; Elapsed time:  0:01:03<br> sysadmin@adamantium# <strong>data-movement status<\/strong><br>Data-movement to cloud tier:<br>----------------------------<br>Data-movement eligibility-check was started on Jan 15 2019 20:27 and completed on Jan 15 2019 20:31<br> Cleanable active-tier space (post-comp): 14.50 GiB,<br> Files inspected: 3286, Files eligible: 893 <\/pre>\n\n\n\n<p>So based on the age profile I&#8217;d given, the Data Domain expected that I&#8217;d be able to free up around 14.5GiB from my lab DDVE if I enacted that data movement policy. That doesn&#8217;t sound like a lot, and of course being a lab server that&#8217;s primarily because most data is kept on it for less time than a month, and longer running backups tend to be of very similar data &#8211; e.g., VMs that don&#8217;t change their content very much at all. (For instance, I&#8217;m getting 314.8x, or 99.7% deduplication on that DDVE based on repetitive backups.)<\/p>\n\n\n\n<p>If you haven&#8217;t upgraded to DDOS 6.2 yet, this is a really good reason to get the upgrade done. Of course, whenever you go to upgrade something as fundamental as your Data Domain operating system, <strong><a rel=\"noreferrer noopener\" aria-label=\"make sure you check out the compatibility guide (opens in a new tab)\" href=\"http:\/\/compatibilityguide.emc.com:8080\/CompGuideApp\/\" target=\"_blank\">make sure you check out the compatibility guide<\/a><\/strong> before you do so and confirm your backup software is supported on the new version, or plan the bigger change accordingly.<\/p>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<p>Hey, while you&#8217;re here, don&#8217;t forget to check out <strong><a href=\"https:\/\/www.amazon.com\/Data-Protection-Ensuring-Availability\/dp\/1482244152\/ref=mt_paperback?_encoding=UTF8&amp;me=\" target=\"_blank\" rel=\"noreferrer noopener\" aria-label=\"Data Protection: Ensuring Data Availability (opens in a new tab)\">Data Protection: Ensuring Data Availability<\/a><\/strong>. <\/p>\n","protected":false},"excerpt":{"rendered":"<p>When it comes to extending to object storage for long term retention, you really can&#8217;t beat Data Domain. Cloud Tiering&hellip;<\/p>\n","protected":false},"author":1,"featured_media":7796,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[1229,1181,1438],"tags":[1325,275,1348],"class_list":["post-7795","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cloud","category-data-domain-2","category-long-term-retention","tag-cloud-tier","tag-data-domain","tag-long-term-retention"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2019\/01\/bigStock-Cloud-Upload.jpg","jetpack_shortlink":"https:\/\/wp.me\/pKpIN-21J","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/7795","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/comments?post=7795"}],"version-history":[{"count":2,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/7795\/revisions"}],"predecessor-version":[{"id":7798,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/7795\/revisions\/7798"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/media\/7796"}],"wp:attachment":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/media?parent=7795"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/categories?post=7795"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/tags?post=7795"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}