Search Docs by Keyword

Table of Contents

Storage Types – Tier 3


Technology Description

The NESE Tape System is comprised of a tape library and a disk-based frontend. The tape library itself has 6658 tape slots and 28 IBM TS1160 tape drives (each tape will hold ~20TB).  The IBM Spectrum Scale disk-based frontend buffer storage employs three storage enclosures (with a total of 1.2PB of usable space) and three systems (to manage the storage itself).

To request a new allocation or update exiting allocations
please refer to the Storage Service Center Document.

Location

The NESE Tape System is located in the Massachusetts Green High Performance Center in Holyoke, MA., adjacent to the Cannon compute cluster.

Snapshot or backup schedule

Since the NESE Tape System is not an active datastore used in day to day research, these schedules are not applicable. Tape system users move data in and out by moving data to the frontend disk-based system to have it added to tape and retrieve information by request to the system itself.

DR explanation

Each tape has a copy to greatly reduce the possibility of data loss.

Since the tape library itself is located completely in the MGHPCC, there is currently no formal DR strategy. Arrangements can be made to send tapes offsite to a commercial data storage vendor if desired (enter a ticket at portal.rc.fas.harvard.edu for details).

Usage/recommendations

  • Keep the number files in a single directory to less than 10K if at all possible.
  • Smaller files (less than 1GB) can be problematic for any storage system. If your data has many of these, please tar or zip them up into a larger file before transferring them.

Access

Globus

NESE Tape Globus Access and Globus Docs

MinIO/S3

https://docs.min.io/minio/baremetal/reference/minio-mc.html
https://docs.min.io/minio/baremetal/console/minio-console.html


This document is a work-in-progress

 

© The President and Fellows of Harvard College
Except where otherwise noted, this content is licensed under Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license.