{"id":67,"date":"2009-02-05T20:13:03","date_gmt":"2009-02-05T09:13:03","guid":{"rendered":"http:\/\/nsrd.wordpress.com\/?p=67"},"modified":"2009-02-05T20:13:03","modified_gmt":"2009-02-05T09:13:03","slug":"monthly-rather-than-weekly-fulls-using-backup-to-disk","status":"publish","type":"post","link":"https:\/\/nsrd.info\/blog\/2009\/02\/05\/monthly-rather-than-weekly-fulls-using-backup-to-disk\/","title":{"rendered":"Monthly rather than weekly fulls using backup to disk"},"content":{"rendered":"<p>When backup to disk is deployed, most sites usually just transition from their standard tape backups to disk without any change to the schedules. That is, daily incrementals (or differentials), with weekly fulls. This isn&#8217;t necessarily the best way to make use of backup to disk, and I&#8217;ll explain in this post way.<\/p>\n<p>One of the traditional reasons why long incremental cycles aren&#8217;t used in backup is the load and seek impact during recovery. That is, you&#8217;ll certainly reduce the amount of data you backup if you do incrementals for a month, but if they&#8217;re all going to tape, then the chances are that if you do a recovery towards the end of that month you may have a <em>lot<\/em> of tapes to load. Unless you&#8217;re using high speed loading tapes (e.g., the StorageTek\/Sun 98\/99 series drives), this is going to make a significant impact to the recovery. Indeed, even with such drives, you&#8217;re still going to have an impact that may be undesirable.<\/p>\n<p>If you&#8217;re backing up to disk however, your options change. Disk seek times are orders of magnitude faster than tape seek times, and there&#8217;s no &#8216;load&#8217; time associated with disk as opposed to tape media either.<\/p>\n<p>In an average site where &#8216;odd&#8217; things aren&#8217;t happening (e.g., filesystem backups of databases, etc.), my experience is that nightly incrementals take up somewhere between 5-8% of a full backup. That is, if the full backups are 10TB, the incrementals sit somewhere around 512 GB &#8211; 819 GB.<\/p>\n<p>We&#8217;ll use these numbers for an example &#8211; 10TB full, 820GB incremental. Over the course of an average, 4-week month then, the total data backed up using the weekly-full strategy will be:<\/p>\n<ul>\n<li>4 x 10TB fulls<\/li>\n<li>(6 x 820GB) x 4 incrementals<\/li>\n<\/ul>\n<p>For a total of 59TB of backup.<\/p>\n<p>Looking at a monthly full scenario for a 31-day month however, the sizing will instead be:<\/p>\n<ul>\n<li>1 x 10TB full<\/li>\n<li>30 x 820GB incrementals<\/li>\n<\/ul>\n<p>This amounts to a total of 34TB of backup.<\/p>\n<p>If you have to pay for a new array for disk backup units that have enough space to hold a months&#8217; worth of backups, which would <em>you<\/em> rather pay for? 59TB of storage, or 34TB of storage?<\/p>\n<p>(Of course, I know there&#8217;s some fudge space required in any such sizing &#8211; realistically you&#8217;d want to ensure that after you&#8217;ve fitted on everything you <em>want<\/em> to fit, there&#8217;s still enough room for another full backup. That way you&#8217;ve got sufficient space on disk to continue to backup to it while you&#8217;re staging data off.)<\/p>\n<p>Obviously the needs of each individual site must be evaluated, so I&#8217;m not advocating a blind switch to this method; instead, it&#8217;s a design option you should be aware of.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>When backup to disk is deployed, most sites usually just transition from their standard tape backups to disk without any&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[16],"tags":[403,600,1250,867],"class_list":["post-67","post","type-post","status-publish","format-standard","hentry","category-networker","tag-fulls","tag-monthly","tag-policies","tag-schedules"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pKpIN-15","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/67","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/comments?post=67"}],"version-history":[{"count":0,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/67\/revisions"}],"wp:attachment":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/media?parent=67"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/categories?post=67"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/tags?post=67"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}