Access rights
All volumes (special case of AFS is described in separate article) are covered by standard set of unix permissions. Default set up of directories (including the home directory) and files is 755, ie. rwxr-xr-x. In case you want to change this behavior you can do it by invoking command
chmod 700 <directory>
To change the rights for your home directory and for computing/temporal directory (scratch) use
chmod 700 /home/$USER chmod 700 $SCRATCHDIR
Changing the rights can be performed also from user scripts if you compute some sensitive data. On the other hand you can use current properties allowing read and execute to share your scripts in groups of users.
Backup policy of the /home volume
The /storage volume is proof against an accidental failure of any of its hard drives. For long-term data protection or a protection of crucial data, please, store your data in the MetaCentrum's backed-up NFSv4 volume (/storage) - for further information about its backup policy, let us refer you to MetaCentrum site.
All the CERIT-SC computing nodes provide the following types of storage volumes, which are available for users:
- /scratch - fast filesystem (having the storage capacity of about 8 TB), dedicated for applications' temporal/working data. This volume is local on every computing node, provides a basic protection against HW failures (RAID 10) and is not backed up.
- /scratch/<username>/job_$PBS_JOBID
- automatically created directories dedicated for temporal/working data of the jobs; These volumes should be used only by currently running jobs, so any data must be removed immediately after a job finishes.
- to access the volume, use the $SCRATCHDIR environment variable
If your job operates with large files, store them in the relevant subdirectory of the /scratch volume (on the machine your job really runs!). This volume is provided by high-performance local discs, and thus the delay of IO operations will be minimized.
-
- /home directories on local cluster - This space is visible by all the nodes in the cluster. Your home directory is best for compiling and building programs and for storing output that consists of large numbers of small files. Use this volume for storing your data (storage-brno3-cerit.metacentrum.cz serves as home directory for all CERIT-SC resources.).
- /storage/home ... use this volume for data, which you want to make available from the MetaCentrum nodes, archieval storage can be used for data, which you want to make permanent and backed-up.
Frontend name | System | Home directory |
---|---|---|
skirit.ics.muni.cz | Debian 8 | /storage/brno2/home/ |
alfrid.meta.zcu.cz | Debian 8 | /storage/plzen1/home/ |
tarkil.grid.cesnet.cz | Debian 8 | /storage/praha1/home/ |
nympha.zcu.cz | Debian 8 | /storage/plzen1/home/ |
minos.zcu.cz | Debian 8 | /storage/plzen1/home/ |
perian.ncbr.muni.cz | Debian 8 | /storage/brno2/home/ |
onyx.ncbr.muni.cz | Debian 8 | /storage/brno2/home/ |
zuphux.cerit-sc.cz | Centos 7.3 | /storage/brno3-cerit/home/ |
- /storage - MetaCentrum's shared and backed-up NFSv4 volumes (available from the frontend as well as all the computing nodes)
The structure of user home directories is as follows:
NFS4 server |
directory |
space |
alternative server names |
---|---|---|---|
storage-brno2.metacentrum.cz | /storage/brno2/ | 110 TB | (nienna1|nienna2|nienna-home).ics.muni.cz |
storage-brno3-cerit.metacentrum.cz | /storage/brno3-cerit/ | 932 TB | kefeus-home.cerit-sc.cznfs-kat.ics.muni.cz (DO NOT USE old kefeus-home.cerit-sc.cz!!!) |
storage-brno4-cerit-hsm.metacentrum.cz | /storage/brno4-cerit-hsm/ | 512 TiB | nfs1-hsm.cerit-sc.cz |
storage-brno5-archive.metacentrum.cz | /storage/brno5-archive/ | 4PB | nfs.du3.cesnet.cz |
storage-brno6.metacentrum.cz | /storage/brno6/ | 262 TB | |
storage-brno7-cerit.metacentrum.cz | /storage/brno7/ | 374 TB | fineus-home.cerit-sc.cz |
storage-brno8.metacentrum.cz | /storage/brno8/ | 88 TB | old /storage/ostrava1/ |
storage-brno9-ceitec.metacentrum.cz | /storage/brno9-ceitec/ | 262 TB | storage-ceitec1.ncbr.muni.cz |
storage-budejovice1.metacentrum.cz | /storage/budejovice1/ | 44 TB | (storage-cb1|storage-cb2).metacentrum.cz |
storage-jihlava1-cerit.metacentrum.cz | /storage/jihlava1-cerit/ | cancelled | data archived to /storage/brno4-cerit-hsm/fineus |
storage-jihlava2-archive.metacentrum.cz | /storage/jihlava2-archive/ | 4266 TiB | nfs.du2.cesnet.cz |
storage-plzen1.metacentrum.cz | /storage/plzen1/ | 350 TB | (storage-eiger1|storage-eiger2|storage-eiger3).zcu.cz |
storage-plzen2-archive.metacentrum.cz | /storage/plzen2-archive/ | 8034 TiB | nfs.du1.cesnet.cz |
storage-praha1.metacentrum.cz | /storage/praha1/ | 51 TB | storage-praha1(a|b).metacentrum.cz |
Note: The often user problem is the inability to access the folders in /storage while they are logged in to frontend by the ssh key. In this case they don't have generated the Kerberos tickets. This can be repaired by invocation of kinit command.