Re: Backing Up 100 Terabytes of Data

[Adam Nave <nave () MACALESTER EDU>]

If the data has been repeated across multiple systems over several years,
it's very likely that there is a large amount of duplication. With the right
backup system (something that supports data deduplication), you might be
able to shrink that down quite a bit.

With a situation like this, it might be useful to tell the faculty what is
feasible given their budget (maybe 10-20 TB) and then make them responsible
for choosing what data to back up. It's easy for them to say that all of it
is important, but we all know that some of it is *more* important.

--Adam

On Mon, Jun 29, 2009 at 9:12 AM, Sarazen, Daniel <dsarazen () umassp edu>wrote:

> Thanks Joel,
>
> This is the exact scenario. 30 Years of research, stored on multiple
> servers/desktops.
>
> Most of the data can be backed up once and stored (not including
> updating the storage media as technology evolves), with more frequent
> back-ups for the new, accumulating data.
>
> My REAL problem? The researchers don't want to pay a lot for back-up
> systems and storing. They want every dollar possible devoted to
> developing new data, so I'm trying to find the most cost effective
> solution.
>
> And yes, the backups would be solely for DR purposes.
>
> Thanks,
>
> PLEASE NOTE: Effective June 17 my office phone number has changed to
> 774-455-7558. My fax number is now 774-455-7550
>
>
> :: Daniel Sarazen, Senior Information Technology Auditor
> :: University Internal Audit
> :: University of Massachusetts President's Office
> :: 774-455-7558
> :: 781-724-3377 Cell
> :: 774-455-7550 Fax
> :: Dsarazen () umassp edu
>
> University of Massachusetts : 333 South St. : Suite 450 : Shrewsbury, MA
> 01545 : www.massachusetts.edu
>
> -----Original Message-----
> From: The EDUCAUSE Security Constituent Group Listserv
> [mailto:SECURITY () LISTSERV EDUCAUSE EDU] On Behalf Of Joel Rosenblatt
> Sent: Monday, June 29, 2009 8:52 AM
> To: SECURITY () LISTSERV EDUCAUSE EDU
> Subject: Re: [SECURITY] Backing Up 100 Terabytes of Data
>
> Hi,
>
> You did not say anything about the nature of the data.  Many researchers
> have large amounts of data that is relatively static - they collect it
> over time and
> the older data never changes - they just keep on adding data to the end
> of the collection.
>
> If that is the case, then backup speed is not all that important - you
> will need to do one massive backup at first, and then small incremental
> backups of the
> additional or changing data from then on.
>
> The assumption in this case is that the backup is purely for DR and not
> for online access.
>
> Another thing to look at is the type of data - many times, the data is
> sparse and can be highly compressed.
>
> My 2 cents.
>
> Joel Rosenblatt
>
> Joel Rosenblatt, Manager Network & Computer Security
> Columbia Information Security Office (CISO)
> Columbia University, 612 W 115th Street, NY, NY 10025 / 212 854 3033
> http://www.columbia.edu/~joel <http://www.columbia.edu/%7Ejoel>
>
>
> --On Monday, June 29, 2009 7:33 AM -0400 "Sarazen, Daniel"
> <dsarazen () UMASSP EDU> wrote:
>
> > Hi All,
> >
> >
> >
> > I have researchers with over 100 terabytes of data. Any back-up
> > suggestions that would include being able to store the back-up data a
> > reasonable distance away from the data center?
> >
> >
> >
> > Thanks
> >
> >
> >
> > PLEASE NOTE: Effective June 17 my office phone number has changed to
> > 774-455-7558. My fax number is now 774-455-7550
> >
> >
> >
> >
> >
> > :: Daniel Sarazen, Senior Information Technology Auditor
> > :: University Internal Audit
> > :: University of Massachusetts President's Office
> >
> > :: 774-455-7558
> >
> > :: 781-724-3377 Cell
> > :: 774-455-7550 Fax
> > :: Dsarazen () umassp edu
> >
> >
> > University of Massachusetts : 333 South St. : Suite 450 : Shrewsbury,
> MA
> > 01545 : www.massachusetts.edu <http://www.massachusetts.edu/>
>
>
>
> Joel Rosenblatt, Manager Network & Computer Security
> Columbia Information Security Office (CISO)
> Columbia University, 612 W 115th Street, NY, NY 10025 / 212 854 3033
> http://www.columbia.edu/~joel <http://www.columbia.edu/%7Ejoel>



--
Adam Nave, CISSP
Linux/Unix Systems Administrator
Macalester College