{"id":6085,"date":"2017-01-05T18:25:59","date_gmt":"2017-01-05T08:25:59","guid":{"rendered":"http:\/\/nsrd.info\/blog\/?p=6085"},"modified":"2018-12-11T10:05:09","modified_gmt":"2018-12-11T00:05:09","slug":"why-do-i-need-ecdm","status":"publish","type":"post","link":"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/","title":{"rendered":"Why do I need eCDM?"},"content":{"rendered":"<p>Why do I need eCDM? Your first&nbsp;question to me might be&nbsp;<em>what is eCDM<\/em>? Well, that&#8217;s a fair point \u2013 it&#8217;s a relatively new term, and it&#8217;s also an&nbsp;<em>eTLA<\/em> \u2013 an extended&nbsp;Three Letter Acronym. eCDM refers to&nbsp;<em>enterprise copy data management<\/em>. Now this isn&#8217;t necessarily a backup topic, but backup is one of&nbsp;the components that fit into copy data, so it&#8217;s a sideline topic and one which will get increasing attention in&nbsp;the coming years.<\/p>\n<p>You see,&nbsp;data growth&nbsp;continues to increase, but the&nbsp;<em>primary<\/em> data set, the&nbsp;<em>original dataset<\/em> is&nbsp;typically growing at a fairly straight-forward rate. It&#8217;s definitely growing, but not&nbsp;to the same degree as the occupancy by&nbsp;<em>copies<\/em> of the data. The&nbsp;numbers as such (timescale or size) don&#8217;t really matter, but for a lot of businesses, the disparity between original dataset and copies of the dataset if mapped will look something&nbsp;along the lines of the following:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-size-vs-copies\/\" rel=\"attachment wp-att-6086\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6086\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-size-vs-copies.png\" alt=\"original size vs copies\" width=\"767\" height=\"531\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-size-vs-copies.png 767w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-size-vs-copies-300x208.png 300w\" sizes=\"auto, (max-width: 767px) 100vw, 767px\" \/><\/a><\/p>\n<p>Your mileage depending on what your original data is, its RPOs and RTOs, and what you use it for&nbsp;will&nbsp;vary of course, and that&#8217;ll have an impact on the number of copies you keep. But&nbsp;that sort of comparison will look similar to a lot of people when&nbsp;they sit down to think about it. In fact, when the topic of eCDM first started coming up in (at the time) EMC, a colleague and I got to talking about our experiences with it. I related a few of my experiences&nbsp;from my prior life as a Unix system administrator, and my colleague mentioned in a previous job they&#8217;d actually done a thought experiment to calculate the&nbsp;<em>average<\/em> number of copies being retained for databases in their environment. The number? 26. And his first thought when he said that number was &#8220;&#8230;it was probably too low&#8221;.<\/p>\n<p>If you&#8217;re not sure about this, let&#8217;s run our own experiment, and&nbsp;start with a 1TB database.<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/ecdm-orig\/\" rel=\"attachment wp-att-6087\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6087\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/eCDM-Orig.jpg\" alt=\"Original Copy\" width=\"329\" height=\"379\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/eCDM-Orig.jpg 329w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/eCDM-Orig-260x300.jpg 260w\" sizes=\"auto, (max-width: 329px) 100vw, 329px\" \/><\/a><\/p>\n<p>We all know though, right, that 1TB isn&#8217;t 1TB isn&#8217;t 1TB when it comes to enterprise storage? For a start,&nbsp;that&#8217;s not going to occupy 1TB of disk storage \u2013 there&#8217;s going to be RAID involved. (I&#8217;m not going to bother with RAID here, that&#8217;s an overhead no matter what.)<\/p>\n<p>For important systems within our&nbsp;environments requiring fast recovery&nbsp;times with minimised&nbsp;data loss, we&#8217;ll be looking at&nbsp;maintaining snapshots. Now,&nbsp;these days snapshots are usually&nbsp;<em>logical copies<\/em> rather&nbsp;than complete 1:1 copies, but there&#8217;s still a data overhead as changes occur, and there&#8217;s still a management cost (even if only at a human level) for the snapshots. So our 1TB database becomes something along the following lines:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-copy-plus-snapshots\/\" rel=\"attachment wp-att-6089\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6089\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-plus-snapshots.jpg\" alt=\"Original Copy + Snapshots\" width=\"1216\" height=\"379\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-plus-snapshots.jpg 1216w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-plus-snapshots-300x94.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-plus-snapshots-768x239.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-plus-snapshots-1024x319.jpg 1024w\" sizes=\"auto, (max-width: 1216px) 100vw, 1216px\" \/><\/a><\/p>\n<p>But we don&#8217;t just keep a local instance of important data \u2013 it gets replicated:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-copy-snapshots-replica\/\" rel=\"attachment wp-att-6090\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6090\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-snapshots-replica.jpg\" alt=\"Original + Snapshots + Replica\" width=\"1749\" height=\"379\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-snapshots-replica.jpg 1749w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-snapshots-replica-300x65.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-snapshots-replica-768x166.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-copy-snapshots-replica-1024x222.jpg 1024w\" sizes=\"auto, (max-width: 1749px) 100vw, 1749px\" \/><\/a><\/p>\n<p>And of course,&nbsp;when we&#8217;re replicating, we&nbsp;typically need to keep snapshots in the replica storage as well to ensure a replication of corruption doesn&#8217;t destroy our recoverability in a disaster:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-snapshots-replica-replsnaps\/\" rel=\"attachment wp-att-6091\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6091\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snapshots-replica-replsnaps.jpg\" alt=\"original + snapshots + replica + replsnaps\" width=\"2670\" height=\"379\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snapshots-replica-replsnaps.jpg 2670w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snapshots-replica-replsnaps-300x43.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snapshots-replica-replsnaps-768x109.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snapshots-replica-replsnaps-1024x145.jpg 1024w\" sizes=\"auto, (max-width: 2670px) 100vw, 2670px\" \/><\/a><\/p>\n<p>Of course,&nbsp;so far we&#8217;ve just been looking at primary copies, so we also need to think about&nbsp;having a backup copy:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-snap-repl-replsnap-backup\/\" rel=\"attachment wp-att-6092\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6092\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup.jpg\" alt=\"primary snap repl replsnap backup\" width=\"2670\" height=\"804\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup.jpg 2670w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-300x90.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-768x231.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-1024x308.jpg 1024w\" sizes=\"auto, (max-width: 2670px) 100vw, 2670px\" \/><\/a><\/p>\n<p>But we know a single backup isn&#8217;t&nbsp;much of a backup, so we&#8217;re going to be keeping multiple backups:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-snap-repl-replsnap-backup-buretent\/\" rel=\"attachment wp-att-6093\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6093\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-buretent.jpg\" alt=\"primary snap repl replsnap backup buretent\" width=\"2729\" height=\"804\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-buretent.jpg 2729w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-buretent-300x88.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-buretent-768x226.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-buretent-1024x302.jpg 1024w\" sizes=\"auto, (max-width: 2729px) 100vw, 2729px\" \/><\/a><\/p>\n<p>And of course, a backup should never be a single point of&nbsp;failure within an environment, so that&#8217;s more likely going to look like the following:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-snap-repl-replsnap-backup-clone\/\" rel=\"attachment wp-att-6094\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6094\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-clone.jpg\" alt=\"primary snap repl replsnap backup clone\" width=\"2754\" height=\"899\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-clone.jpg 2754w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-clone-300x98.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-clone-768x251.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-snap-repl-replsnap-backup-clone-1024x334.jpg 1024w\" sizes=\"auto, (max-width: 2754px) 100vw, 2754px\" \/><\/a><\/p>\n<p>They&#8217;re just our regular retention&nbsp;backups though. Most companies, whether we&#8217;d encourage them otherwise or not, will use the backup environment to maintain long term retention (LTR) copies for compliance purposes, so we need to consider those copies as well:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-through-to-ltr\/\" rel=\"attachment wp-att-6095\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6095\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR.jpg\" alt=\"primary through to LTR\" width=\"2766\" height=\"1312\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR.jpg 2766w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-300x142.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-768x364.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-1024x486.jpg 1024w\" sizes=\"auto, (max-width: 2766px) 100vw, 2766px\" \/><\/a><\/p>\n<p>And again, LTR backups shouldn&#8217;t be a single&nbsp;source of failure either, so:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-through-to-ltr-clone\/\" rel=\"attachment wp-att-6096\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6096\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-clone.jpg\" alt=\"primary through to LTR clone\" width=\"2766\" height=\"1408\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-clone.jpg 2766w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-clone-300x153.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-clone-768x391.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-LTR-clone-1024x521.jpg 1024w\" sizes=\"auto, (max-width: 2766px) 100vw, 2766px\" \/><\/a><\/p>\n<p>Phew! Regardless of&nbsp;whether you&#8217;re deduplicating, regardless of whether your&nbsp;snapshots are&nbsp;copy-on-first-write or some other space saving technique, that&#8217;s a&nbsp;<em>lot<\/em> of copies being built up, and as changes occur, that&#8217;s still a growing increase in the amount of primary and protection storage required&nbsp;<em>for just 1 TB of original data<\/em>.<\/p>\n<p>Yet we&#8217;re not done. For&nbsp;businesses facing new threats, there&#8217;ll potentially be copies of the database sitting in an isolated&nbsp;recovery site, too:<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-through-to-irs\/\" rel=\"attachment wp-att-6097\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6097\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS.jpg\" alt=\"primary through to IRS\" width=\"2766\" height=\"1774\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS.jpg 2766w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-300x192.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-768x493.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-1024x657.jpg 1024w\" sizes=\"auto, (max-width: 2766px) 100vw, 2766px\" \/><\/a><\/p>\n<p>Even more copies. Admittedly your IRS&nbsp;copies shouldn&#8217;t be manageable via&nbsp;conventional means, but they&#8217;re there, and if you&#8217;ve got to&nbsp;manage them&nbsp;<em>on top of<\/em> all the other copies, you&#8217;re compounding your work again.<\/p>\n<p>Yet&nbsp;<em>we&#8217;re still not done<\/em>. So far I&#8217;ve covered&nbsp;an&nbsp;indicative set of&nbsp;copies for the&nbsp;<em>original use case<\/em> of the&nbsp;<em>original data<\/em>. That&#8217;s not the end of it!<\/p>\n<p><a href=\"https:\/\/nsrd.info\/blog\/2017\/01\/05\/why-do-i-need-ecdm\/primary-through-to-irs-and-other-uses\/\" rel=\"attachment wp-att-6098\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-6098\" src=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-and-other-uses.jpg\" alt=\"primary through to IRS and other uses\" width=\"2766\" height=\"2233\" srcset=\"https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-and-other-uses.jpg 2766w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-and-other-uses-300x242.jpg 300w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-and-other-uses-768x620.jpg 768w, https:\/\/nsrd.info\/blog\/wp-content\/uploads\/2017\/01\/primary-through-to-IRS-and-other-uses-1024x827.jpg 1024w\" sizes=\"auto, (max-width: 2766px) 100vw, 2766px\" \/><\/a><\/p>\n<p>So let&#8217;s return to the original question:&nbsp;<em>why do I need eCDM?&nbsp;<\/em>By now that should be answered: <em>why <strong>don&#8217;t<\/strong> you need eCDM!?<\/em> You&#8217;ve got copies &#8230; and copies and copies and copies &#8230; sitting in your environment,&nbsp;occupying primary storage, replication storage, protection storage, and in time even possibly&nbsp;in cloud storage too.<\/p>\n<p>This is where eCDM comes in \u2013 having a system that can give you focus on the copies of&nbsp;data being generated in your environment. In version 1 of eCDM, we&#8217;ve focused on giving power over <a href=\"https:\/\/australia.emc.com\/collateral\/demos\/microsites\/mediaplayer-video\/emc-protectpoint-lightboard-overview.htm\" target=\"_blank\">ProtectPoint<\/a>&nbsp;related copies, but&nbsp;that&#8217;s a starting point. There&#8217;s more to follow over time, of course.<\/p>\n<p>To quote the <a href=\"https:\/\/www.emc.com\/en-us\/data-protection\/enterprise-copy-data-management\/index.htm\" target=\"_blank\">eCDM product page<\/a>, eCDM:<\/p>\n<blockquote>\n<ul>\n<li><strong>Discovers<\/strong> copies non-disruptively across the enterprise for global oversight<\/li>\n<li><strong>Automates<\/strong> SLO compliance and efficient copy creation<\/li>\n<li><strong>Optimizes<\/strong> IT operations based on actionable insight<\/li>\n<\/ul>\n<\/blockquote>\n<p>eCDM is&nbsp;a new tier of data management&nbsp;to help organisations deal with copy data, and if you sit down and think about the number of copies you might have (particularly of critical data sets in your organisation), you&#8217;ll probably find yourself wondering why you don&#8217;t have it installed already.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Why do I need eCDM? Your first&nbsp;question to me might be&nbsp;what is eCDM? Well, that&#8217;s a fair point \u2013 it&#8217;s&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":true,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[3],"tags":[1332,1333],"class_list":["post-6085","post","type-post","status-publish","format-standard","hentry","category-architecture","tag-ecdm","tag-enterprise-data-copy-management"],"aioseo_notices":[],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/pKpIN-1A9","jetpack_sharing_enabled":true,"jetpack_likes_enabled":true,"_links":{"self":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/6085","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/comments?post=6085"}],"version-history":[{"count":4,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/6085\/revisions"}],"predecessor-version":[{"id":7402,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/posts\/6085\/revisions\/7402"}],"wp:attachment":[{"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/media?parent=6085"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/categories?post=6085"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nsrd.info\/blog\/wp-json\/wp\/v2\/tags?post=6085"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}