nanog mailing list archives
RE: Network Storage
From: Ian McDonald <iam () st-andrews ac uk>
Date: Thu, 12 Apr 2012 21:18:05 +0000
Hi, You'll need to build an array that'll random read/write upwards of 200MB/s if you want to get a semi-reliable capture to disk. That means SSD if you're very rich, or many spindles (preferably 15k's) in a stripe/ raid10 if you're building from your scrap pile. Bear in mind that write cache won't help you, as the io isn't going to be bursty, rather a continuous stream. Another great help is scoping what you're looking for and pre-processing before writing out only the 'interesting' bits, thus reducing the io requirement. It does depend what you're trying to do, as headers can be adequate for many applications. Aligning your partitions with the physical disk geometry can produce surprising speedups, as can stripe block size changes, but that's generally empirical, and depends on your workload. -- ian -----Original Message----- From: Maverick Sent: 12/04/2012, 21:27 To: nanog () nanog org Subject: Network Storage Hello Everyone, Can you please comment on what is best solution for storing network traffic. We have been graciously granted access by our network administrator to capture traffic but the one Tera byte disk space is no match with the data that we are seeing, so it fills up quickly. We can't get additional space on the server itself so I am looking for some external solutions. Can you please suggest something that would be best for Gbps speeds . Best, Ali
Current thread:
- Re: Network Storage, (continued)
- Re: Network Storage John T. Yocum (Apr 12)
- Re: Network Storage Dan Olson (Apr 12)
- Re: Network Storage Matthew Luckie (Apr 12)
- Re: Network Storage Jared Mauch (Apr 12)
- Re: Network Storage George Herbert (Apr 15)
- Re: Network Storage Andrew Thrift (Apr 15)
- Re: Network Storage Simon Leinen (Apr 16)
- RE: Network Storage Drew Weaver (Apr 16)
- Re: Network Storage Michael J McCafferty (Apr 12)
- Re: Network Storage Leo Bicknell (Apr 15)
- Re: Network Storage Jimmy Hess (Apr 12)
- Re: Network Storage Kyle Creyts (Apr 14)