Service Bands: In Depth

Description: This service band provides temporary storage for data analysis requiring very fast access to data

Target users: Researchers requiring fast access to data, including very large files

Characteristics:

• high speed/high bandwidth (e.g. Indiana has 40 gigabit per second transfer rate)
• geared for parallel-IO computing
• NO backups
• inactive files purged after X days (i.e. not accessed)
• accessible only from HPC systems

Options:

• ability to move files between this and Service Band 2

Note: Most of these characteristics and options exist in the HPC /scratch service today (e.g. ability to move files between this and other systems does not)

Description: This service band provides access to a storage environment designed for ongoing activities.

Target users: Researchers and library curators who need to store, organize, process, and analyze data and digital assets, sometimes in collaborations with colleagues

Characteristics:

• individual or group-owned directory (data retained as long as owner is at NYU)
• group work spaces (files remain in group spaces even after individuals leave NYU)
• self-service group creation, access management, permissions control, and file sharing
• sharable both on campus and off campus
• sharable with designated non-NYU individuals
• mountable file system making files available on department servers and staff/individual workstations/laptops (over VPN?)
• sftp access
• accessible to HPC resources
• file recovery (snapshots)
• fast access for high-volume, high-intensity work
• no file purging

Options:

• file backups (long-term)
• Globus endpoint  (Globus is a file transfer tool)
• ability to move files between individual and group workspaces

• ability to move files between this and other systems (e.g. desktop, departmental servers, national labs)
• metadata (basic?)

Note: Nothing similar currently exists at NYU. This new service would also accommodate users of the current HPC /archive service for backup of large files.

Description: This service band provides a feature-rich publication environment with preservation and curation options available.

Target users: Researchers and library curators looking to store data and digital assets in a stable environment where they are easily discoverable; researchers looking to comply with open access standards and/or open access/open data policies mandated by funding agencies.

Characteristics:

• permanent citation
• discovery
• metadata
• access
• long-term preservation

Options:

• format migration
• formal archival information package (AIP, e.g. as in R*)
• dark content or unpublished/private data
• embargo
• option to share with limited group, e.g. individuals, all of NYU
• contextual rendering
• geodiscovery
• usage data about collection/file access and downloads
• ability to expose content through multiple paths, e.g. API’s
• option to add to metadata (by someone other than original depositor)
• self-service deposit option
• facilitation of internal and external discovery (BobCat, Worldcat, Google, DPLA)
• versioning

Note: This service band is similar to Stanford’s Digital Repository and aspects of NYU’s FDA, R*, and SDR.

Description: This service band provides an environment for working with high security restricted data (a/k/a Secure Data Enclave)

Target Users: Researchers working with data whose unauthorized access or loss could seriously or adversely affect NYU, a partner, or the public.

Characteristics:

• storage in high-security network zone
• customized virtual environment where information inflow and outflow are strictly controlled and  monitored
• access to authorized users only
• analytical software within the enclave
• compliance with guidelines for restricted data at NYU

Note: work is currently being done on a proof-of-concept project with CUSP and other schools that will advise the use cases and design the roadmap of Service Band 4.