Re: Backing Up 100 Terabytes of Data

[Vik Solem <vik.solem () TUFTS EDU>]

Hi Daniel,

With the preamble that I'm not in your shoes, and I don't have all of
your context, I would break it down as follows.

(1) periodically (daily or weekly) backup all of the machines to a
local backup server (The first backup will contain all of the current
data.)

(2) copy the first backup to a remote backup server

(3) periodically move changes from the local backup server to the
remote backup server

I think that (1) will involve the most amount of human intervention,
and is likely to be very time consuming.

I think that (2) is most effectively accomplished with the massive
bandwidth afforded by tapes/disks transported in a large vehicle, such
as the aforementioned minivan.

I think that the most affordable way to accomplish (3) is transmitting
updates to the local server via IP.

Hope that helps.

-Vik


On Jun 29, 2009, at 10:12 , Sarazen, Daniel wrote:

> Thanks Joel,
>
> This is the exact scenario. 30 Years of research, stored on multiple
> servers/desktops.
>
> Most of the data can be backed up once and stored (not including
> updating the storage media as technology evolves), with more frequent
> back-ups for the new, accumulating data.
>
> My REAL problem? The researchers don't want to pay a lot for back-up
> systems and storing. They want every dollar possible devoted to
> developing new data, so I'm trying to find the most cost effective
> solution.
>
> And yes, the backups would be solely for DR purposes.
>
> Thanks,
>
> PLEASE NOTE: Effective June 17 my office phone number has changed to
> 774-455-7558. My fax number is now 774-455-7550
>
>
> :: Daniel Sarazen, Senior Information Technology Auditor
> :: University Internal Audit
> :: University of Massachusetts President's Office
> :: 774-455-7558
> :: 781-724-3377 Cell
> :: 774-455-7550 Fax
> :: Dsarazen () umassp edu
>
> University of Massachusetts : 333 South St. : Suite 450 :
> Shrewsbury, MA
> 01545 : www.massachusetts.edu
>
> -----Original Message-----
> From: The EDUCAUSE Security Constituent Group Listserv
> [mailto:SECURITY () LISTSERV EDUCAUSE EDU] On Behalf Of Joel Rosenblatt
> Sent: Monday, June 29, 2009 8:52 AM
> To: SECURITY () LISTSERV EDUCAUSE EDU
> Subject: Re: [SECURITY] Backing Up 100 Terabytes of Data
>
> Hi,
>
> You did not say anything about the nature of the data.  Many
> researchers
> have large amounts of data that is relatively static - they collect it
> over time and
> the older data never changes - they just keep on adding data to the
> end
> of the collection.
>
> If that is the case, then backup speed is not all that important - you
> will need to do one massive backup at first, and then small
> incremental
> backups of the
> additional or changing data from then on.
>
> The assumption in this case is that the backup is purely for DR and
> not
> for online access.
>
> Another thing to look at is the type of data - many times, the data is
> sparse and can be highly compressed.
>
> My 2 cents.
>
> Joel Rosenblatt
>
> Joel Rosenblatt, Manager Network & Computer Security
> Columbia Information Security Office (CISO)
> Columbia University, 612 W 115th Street, NY, NY 10025 / 212 854 3033
> http://www.columbia.edu/~joel
>
>
> --On Monday, June 29, 2009 7:33 AM -0400 "Sarazen, Daniel"
> <dsarazen () UMASSP EDU> wrote:
>
> > Hi All,
> >
> >
> >
> > I have researchers with over 100 terabytes of data. Any back-up
> > suggestions that would include being able to store the back-up data a
> > reasonable distance away from the data center?
> >
> >
> >
> > Thanks
> >
> >
> >
> > PLEASE NOTE: Effective June 17 my office phone number has changed to
> > 774-455-7558. My fax number is now 774-455-7550
> >
> >
> >
> >
> >
> > :: Daniel Sarazen, Senior Information Technology Auditor
> > :: University Internal Audit
> > :: University of Massachusetts President's Office
> >
> > :: 774-455-7558
> >
> > :: 781-724-3377 Cell
> > :: 774-455-7550 Fax
> > :: Dsarazen () umassp edu
> >
> >
> > University of Massachusetts : 333 South St. : Suite 450 : Shrewsbury,
> MA
> > 01545 : www.massachusetts.edu <http://www.massachusetts.edu/>
>
>
>
> Joel Rosenblatt, Manager Network & Computer Security
> Columbia Information Security Office (CISO)
> Columbia University, 612 W 115th Street, NY, NY 10025 / 212 854 3033
> http://www.columbia.edu/~joel


Vik Solem, GCSC
Sr. Applications Risk Consultant
Tufts University UIT / 617-627-4326