Search Docs by Keyword

Storage Types – Tier 3

 

Technology Description

The NESE Tape System is comprised of a tape library and a disk-based frontend. The tape library itself has 7858 tape slots and 28 LTO 8 tape drives (each tape will hold ~20TB).  The IBM Spectrum Scale disk-based frontend buffer storage employs three storage enclosures (with a total of 1.2PB of usable space) and three systems (to manage the storage itself).

Location

The NESE Tape System is located in the Massachusetts Green High Performance Center in Holyoke, MA., adjacent to the Cannon compute cluster.

Snapshot or backup schedule

Since the NESE Tape System is not an active datastore used in day to day research, these schedules are not applicable. Tape system users move data in and out by moving data to the frontend disk-based system to have it added to tape and retrieve information by request to the system itself.

DR explanation

Each tape has a copy to greatly reduce the possibility of data loss.

Since the tape library itself is located completely in the MGHPCC, there is currently no formal DR strategy. Arrangements can be made to send tapes offsite to a commercial data storage vendor if desired (enter a ticket at portal.rc.fas.harvard.edu for details).

Usage/recommendations

  • Keep the number files in a single directory to less than 10K if at all possible.
  • Smaller files (less than 1GB) can be problematic for any storage system. If your data has many of these, please tar or zip them up into a larger file before transferring them.

This is a work-in-progress; more usage and tips will be added soon.

 

© The President and Fellows of Harvard College
Except where otherwise noted, this content is licensed under Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license.